Jul 06 22:18:04.556012 ip-10-0-141-52 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 06 22:18:04.556022 ip-10-0-141-52 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 06 22:18:04.556029 ip-10-0-141-52 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 06 22:18:04.556267 ip-10-0-141-52 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 06 22:18:14.029173 ip-10-0-141-52 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 06 22:18:14.029186 ip-10-0-141-52 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot cd1ad699e7ed4d819d085710cc513d0c --
Jul 06 22:19:59.108362 ip-10-0-141-52 systemd[1]: Starting Kubernetes Kubelet...
Jul 06 22:19:59.474336 ip-10-0-141-52 kubenswrapper[2556]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 22:19:59.474336 ip-10-0-141-52 kubenswrapper[2556]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 06 22:19:59.474336 ip-10-0-141-52 kubenswrapper[2556]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 22:19:59.474336 ip-10-0-141-52 kubenswrapper[2556]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 06 22:19:59.474336 ip-10-0-141-52 kubenswrapper[2556]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 22:19:59.474336 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.442493    2556 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 06 22:19:59.474336 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446718    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 22:19:59.474336 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446728    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 22:19:59.474336 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446732    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 22:19:59.474336 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446735    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 22:19:59.474336 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446738    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 22:19:59.474336 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446741    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 22:19:59.474336 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446745    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 22:19:59.474336 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446748    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 22:19:59.477619 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446751    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 22:19:59.477619 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446753    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 22:19:59.477619 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446756    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 22:19:59.477619 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446759    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 22:19:59.477619 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446762    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 22:19:59.477619 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446764    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 22:19:59.477619 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446767    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 22:19:59.477619 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446770    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 22:19:59.477619 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446772    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 22:19:59.477619 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446775    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 22:19:59.477619 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446778    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 22:19:59.477619 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446780    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 22:19:59.477619 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446783    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 22:19:59.477619 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446786    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 22:19:59.477619 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446788    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 22:19:59.477619 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446791    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 22:19:59.477619 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446794    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 22:19:59.477619 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446797    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 22:19:59.477619 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446801    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 22:19:59.477619 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446806    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 22:19:59.478566 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446809    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 22:19:59.478566 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446812    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 22:19:59.478566 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446814    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 22:19:59.478566 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446817    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 22:19:59.478566 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446819    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 22:19:59.478566 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446822    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 22:19:59.478566 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446824    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 22:19:59.478566 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446826    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 22:19:59.478566 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446830    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 22:19:59.478566 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446835    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 22:19:59.478566 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446837    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 22:19:59.478566 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446840    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 22:19:59.478566 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446842    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 22:19:59.478566 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446846    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 22:19:59.478566 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446848    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 22:19:59.478566 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446851    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 22:19:59.478566 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446853    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 22:19:59.478566 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446856    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 22:19:59.478566 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446858    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 22:19:59.481455 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446861    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 22:19:59.481455 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446863    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 22:19:59.481455 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446866    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 22:19:59.481455 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446869    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 22:19:59.481455 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446872    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 22:19:59.481455 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446874    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 22:19:59.481455 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446877    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 22:19:59.481455 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446879    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 22:19:59.481455 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446882    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 22:19:59.481455 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446884    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 22:19:59.481455 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446887    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 22:19:59.481455 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446890    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 22:19:59.481455 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446893    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 22:19:59.481455 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446896    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 22:19:59.481455 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446898    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 22:19:59.481455 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446901    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 22:19:59.481455 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446903    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 22:19:59.481455 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446906    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 22:19:59.481455 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446908    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 22:19:59.481455 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446911    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 22:19:59.482489 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446913    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 22:19:59.482489 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446916    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 22:19:59.482489 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446918    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 22:19:59.482489 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446920    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 22:19:59.482489 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446923    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 22:19:59.482489 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446925    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 22:19:59.482489 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446927    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 22:19:59.482489 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446930    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 22:19:59.482489 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446932    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 22:19:59.482489 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446935    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 22:19:59.482489 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446937    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 22:19:59.482489 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446940    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 22:19:59.482489 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446942    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 22:19:59.482489 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446945    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 22:19:59.482489 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446948    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 22:19:59.482489 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446951    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 22:19:59.482489 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446954    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 22:19:59.482489 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446959    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 22:19:59.482489 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446962    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 22:19:59.484055 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446965    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 22:19:59.484055 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446968    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 22:19:59.484055 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446970    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 22:19:59.484055 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446974    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 22:19:59.484055 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446977    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 22:19:59.484055 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446980    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 22:19:59.484055 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446982    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 22:19:59.484055 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446989    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 22:19:59.484055 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446991    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 22:19:59.484055 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446994    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 22:19:59.484055 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446996    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 22:19:59.484055 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.446999    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 22:19:59.484055 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.447002    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 22:19:59.484055 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448705    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 22:19:59.484055 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448713    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 22:19:59.484055 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448716    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 22:19:59.484055 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448720    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 22:19:59.484055 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448723    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 22:19:59.484055 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448725    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 22:19:59.484055 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448728    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 22:19:59.484622 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448731    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 22:19:59.484622 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448733    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 22:19:59.484622 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448736    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 22:19:59.484622 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448739    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 22:19:59.484622 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448742    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 22:19:59.484622 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448744    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 22:19:59.484622 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448747    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 22:19:59.484622 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448750    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 22:19:59.484622 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448752    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 22:19:59.484622 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448755    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 22:19:59.484622 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448759    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 22:19:59.484622 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448763    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 22:19:59.484622 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448766    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 22:19:59.484622 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448769    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 22:19:59.484622 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448771    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 22:19:59.484622 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448774    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 22:19:59.484622 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448776    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 22:19:59.484622 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448779    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 22:19:59.484622 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448781    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 22:19:59.485346 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448784    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 22:19:59.485346 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448792    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 22:19:59.485346 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448795    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 22:19:59.485346 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448797    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 22:19:59.485346 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448800    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 22:19:59.485346 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448802    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 22:19:59.485346 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448805    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 22:19:59.485346 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448807    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 22:19:59.485346 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448810    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 22:19:59.485346 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448812    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 22:19:59.485346 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448815    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 22:19:59.485346 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448817    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 22:19:59.485346 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448820    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 22:19:59.485346 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448822    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 22:19:59.485346 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448825    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 22:19:59.485346 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448827    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 22:19:59.485346 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448830    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 22:19:59.485346 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448832    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 22:19:59.485346 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448834    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 22:19:59.485346 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448837    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 22:19:59.485891 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448839    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 22:19:59.485891 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448843    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 22:19:59.485891 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448845    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 22:19:59.485891 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448848    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 22:19:59.485891 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448850    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 22:19:59.485891 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448854    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 22:19:59.485891 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448856    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 22:19:59.485891 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448859    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 22:19:59.485891 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448861    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 22:19:59.485891 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448864    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 22:19:59.485891 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448866    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 22:19:59.485891 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448868    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 22:19:59.485891 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448871    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 22:19:59.485891 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448873    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 22:19:59.485891 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448881    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 22:19:59.485891 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448884    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 22:19:59.485891 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448886    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 22:19:59.485891 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448889    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 22:19:59.485891 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448891    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 22:19:59.485891 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448894    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 22:19:59.486692 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448896    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 22:19:59.486692 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448900    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 22:19:59.486692 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448903    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 22:19:59.486692 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448906    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 22:19:59.486692 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448909    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 22:19:59.486692 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448912    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 22:19:59.486692 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448914    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 22:19:59.486692 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448917    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 22:19:59.486692 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448919    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 22:19:59.486692 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448923    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 22:19:59.486692 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448926    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 22:19:59.486692 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448931    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 22:19:59.486692 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448935    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 22:19:59.486692 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448938    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 22:19:59.486692 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448941    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 22:19:59.486692 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448944    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 22:19:59.486692 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448946    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 22:19:59.486692 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448948    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 22:19:59.486692 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448951    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 22:19:59.487592 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448953    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 22:19:59.487592 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448956    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 22:19:59.487592 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448958    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 22:19:59.487592 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448962    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 22:19:59.487592 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448965    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 22:19:59.487592 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448967    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 22:19:59.487592 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448970    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 22:19:59.487592 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448972    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 22:19:59.487592 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448982    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 22:19:59.487592 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448984    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 22:19:59.487592 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448987    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 22:19:59.487592 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448989    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 22:19:59.487592 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448992    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 22:19:59.487592 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.448994    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 22:19:59.487592 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449462    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 22:19:59.487592 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449468    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 22:19:59.487592 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449471    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 22:19:59.487592 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449475    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 22:19:59.487592 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449479    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 22:19:59.488602 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449482    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 22:19:59.488602 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449485    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 22:19:59.488602 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449488    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 22:19:59.488602 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449490    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 22:19:59.488602 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449494    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 22:19:59.488602 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449498    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 22:19:59.488602 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449502    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 22:19:59.488602 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449505    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 22:19:59.488602 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449508    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 22:19:59.488602 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449511    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 22:19:59.488602 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449514    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 22:19:59.488602 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449517    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 22:19:59.488602 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449519    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 22:19:59.488602 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449522    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 22:19:59.488602 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449524    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 22:19:59.488602 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449527    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 22:19:59.488602 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449530    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 22:19:59.488602 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449532    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 22:19:59.488602 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449534    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 22:19:59.488602 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449537    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 22:19:59.489272 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449539    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 22:19:59.489272 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449548    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 22:19:59.489272 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449551    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 22:19:59.489272 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449553    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 22:19:59.489272 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449556    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 22:19:59.489272 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449559    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 22:19:59.489272 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449563    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 22:19:59.489272 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449566    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 22:19:59.489272 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449568    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 22:19:59.489272 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449571    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 22:19:59.489272 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449573    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 22:19:59.489272 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449575    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 22:19:59.489272 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449578    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 22:19:59.489272 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449580    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 22:19:59.489272 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449583    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 22:19:59.489272 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449585    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 22:19:59.489272 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449587    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 22:19:59.489272 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449591    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 22:19:59.489272 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449595    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 22:19:59.571331 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449597    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 22:19:59.571331 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449601    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 22:19:59.571331 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449603    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 22:19:59.571331 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449606    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 22:19:59.571331 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449608    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 22:19:59.571331 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449611    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 22:19:59.571331 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449614    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 22:19:59.571331 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449616    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 22:19:59.571331 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449619    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 22:19:59.571331 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449621    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 22:19:59.571331 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449623    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 22:19:59.571331 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449629    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 22:19:59.571331 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449631    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 22:19:59.571331 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449634    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 22:19:59.571331 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449636    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 22:19:59.571331 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449645    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 22:19:59.571331 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449647    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 22:19:59.571331 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449650    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 22:19:59.571331 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449652    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 22:19:59.571331 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449656    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 22:19:59.529742 ip-10-0-141-52 systemd[1]: Started Kubernetes Kubelet.
Jul 06 22:19:59.572523 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449658    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 22:19:59.572523 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449660    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 22:19:59.572523 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449663    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 22:19:59.572523 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449665    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 22:19:59.572523 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449667    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 22:19:59.572523 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449670    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 22:19:59.572523 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449673    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 22:19:59.572523 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449675    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 22:19:59.572523 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449677    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 22:19:59.572523 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449680    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 22:19:59.572523 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449684    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 22:19:59.572523 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449689    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 22:19:59.572523 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449692    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 22:19:59.572523 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449694    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 22:19:59.572523 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449697    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 22:19:59.572523 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449699    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 22:19:59.572523 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449702    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 22:19:59.572523 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449704    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 22:19:59.572523 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449707    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 22:19:59.573710 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449709    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 22:19:59.573710 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449712    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 22:19:59.573710 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449714    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 22:19:59.573710 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449717    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 22:19:59.573710 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449719    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 22:19:59.573710 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449721    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 22:19:59.573710 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449724    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 22:19:59.573710 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449726    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 22:19:59.573710 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449729    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 22:19:59.573710 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449737    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 22:19:59.573710 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449740    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 22:19:59.573710 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449742    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 22:19:59.573710 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449745    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 22:19:59.573710 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449747    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 22:19:59.573710 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449749    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 22:19:59.573710 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.449752    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 22:19:59.573710 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.449824    2556 flags.go:64] FLAG: --address="0.0.0.0"
Jul 06 22:19:59.573710 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.449835    2556 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 06 22:19:59.573710 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.449846    2556 flags.go:64] FLAG: --anonymous-auth="true"
Jul 06 22:19:59.573710 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.449851    2556 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 06 22:19:59.573710 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.449855    2556 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 06 22:19:59.576826 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.449858    2556 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 06 22:19:59.576826 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.449863    2556 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 06 22:19:59.576826 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.449869    2556 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 06 22:19:59.576826 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.449874    2556 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 06 22:19:59.576826 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.449878    2556 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 06 22:19:59.576826 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.449881    2556 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 06 22:19:59.576826 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.449884    2556 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 06 22:19:59.576826 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.449888    2556 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 06 22:19:59.576826 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.449890    2556 flags.go:64] FLAG: --cgroup-root=""
Jul 06 22:19:59.576826 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.449894    2556 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 06 22:19:59.576826 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.449897    2556 flags.go:64] FLAG: --client-ca-file=""
Jul 06 22:19:59.576826 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.449899    2556 flags.go:64] FLAG: --cloud-provider="external"
Jul 06 22:19:59.576826 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.449902    2556 flags.go:64] FLAG: --cluster-dns="[]"
Jul 06 22:19:59.576826 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.449909    2556 flags.go:64] FLAG: --cluster-domain=""
Jul 06 22:19:59.576826 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.449912    2556 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 06 22:19:59.576826 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.449915    2556 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 06 22:19:59.576826 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.449917    2556 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 06 22:19:59.576826 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.449921    2556 flags.go:64] FLAG: --container-log-max-files="5"
Jul 06 22:19:59.576826 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.449924    2556 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 06 22:19:59.576826 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.449927    2556 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 06 22:19:59.576826 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.449930    2556 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 06 22:19:59.576826 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.449939    2556 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 06 22:19:59.576826 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.449942    2556 flags.go:64] FLAG: --contention-profiling="false"
Jul 06 22:19:59.576826 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.449945    2556 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 06 22:19:59.577994 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.449948    2556 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 06 22:19:59.577994 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.449951    2556 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 06 22:19:59.577994 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.449953    2556 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 06 22:19:59.577994 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.449960    2556 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 06 22:19:59.577994 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.449963    2556 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 06 22:19:59.577994 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.449966    2556 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 06 22:19:59.577994 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.449968    2556 flags.go:64] FLAG: --enable-load-reader="false"
Jul 06 22:19:59.577994 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.449971    2556 flags.go:64] FLAG: --enable-server="true"
Jul 06 22:19:59.577994 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.449974    2556 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 06 22:19:59.577994 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.449983    2556 flags.go:64] FLAG: --event-burst="100"
Jul 06 22:19:59.577994 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.449987    2556 flags.go:64] FLAG: --event-qps="50"
Jul 06 22:19:59.577994 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.449991    2556 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 06 22:19:59.577994 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.449994    2556 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 06 22:19:59.577994 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.449997    2556 flags.go:64] FLAG: --eviction-hard=""
Jul 06 22:19:59.577994 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450001    2556 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 06 22:19:59.577994 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450004    2556 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 06 22:19:59.577994 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450007    2556 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 06 22:19:59.577994 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450010    2556 flags.go:64] FLAG: --eviction-soft=""
Jul 06 22:19:59.577994 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450013    2556 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 06 22:19:59.577994 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450016    2556 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 06 22:19:59.577994 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450018    2556 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 06 22:19:59.577994 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450021    2556 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 06 22:19:59.577994 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450024    2556 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 06 22:19:59.577994 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450027    2556 flags.go:64] FLAG: --fail-swap-on="true"
Jul 06 22:19:59.577994 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450030    2556 flags.go:64] FLAG: --feature-gates=""
Jul 06 22:19:59.578930 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450034    2556 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 06 22:19:59.578930 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450037    2556 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 06 22:19:59.578930 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450040    2556 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 06 22:19:59.578930 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450043    2556 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 06 22:19:59.578930 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450046    2556 flags.go:64] FLAG: --healthz-port="10248"
Jul 06 22:19:59.578930 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450054    2556 flags.go:64] FLAG: --help="false"
Jul 06 22:19:59.578930 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450057    2556 flags.go:64] FLAG: --hostname-override="ip-10-0-141-52.ec2.internal"
Jul 06 22:19:59.578930 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450060    2556 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 06 22:19:59.578930 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450063    2556 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 06 22:19:59.578930 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450066    2556 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 06 22:19:59.578930 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450069    2556 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 06 22:19:59.578930 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450073    2556 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 06 22:19:59.578930 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450075    2556 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 06 22:19:59.578930 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450078    2556 flags.go:64] FLAG: --image-service-endpoint=""
Jul 06 22:19:59.578930 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450081    2556 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 06 22:19:59.578930 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450083    2556 flags.go:64] FLAG: --kube-api-burst="100"
Jul 06 22:19:59.578930 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450086    2556 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 06 22:19:59.578930 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450110    2556 flags.go:64] FLAG: --kube-api-qps="50"
Jul 06 22:19:59.578930 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450115    2556 flags.go:64] FLAG: --kube-reserved=""
Jul 06 22:19:59.578930 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450118    2556 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 06 22:19:59.578930 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450120    2556 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 06 22:19:59.578930 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450124    2556 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 06 22:19:59.578930 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450126    2556 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 06 22:19:59.578930 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450129    2556 flags.go:64] FLAG: --lock-file=""
Jul 06 22:19:59.579797 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450132    2556 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 06 22:19:59.579797 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450135    2556 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 06 22:19:59.579797 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450138    2556 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 06 22:19:59.579797 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450143    2556 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 06 22:19:59.579797 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450146    2556 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 06 22:19:59.579797 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450149    2556 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 06 22:19:59.579797 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450151    2556 flags.go:64] FLAG: --logging-format="text"
Jul 06 22:19:59.579797 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450154    2556 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 06 22:19:59.579797 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450157    2556 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 06 22:19:59.579797 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450160    2556 flags.go:64] FLAG: --manifest-url=""
Jul 06 22:19:59.579797 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450163    2556 flags.go:64] FLAG: --manifest-url-header=""
Jul 06 22:19:59.579797 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450167    2556 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 06 22:19:59.579797 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450171    2556 flags.go:64] FLAG: --max-open-files="1000000"
Jul 06 22:19:59.579797 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450174    2556 flags.go:64] FLAG: --max-pods="110"
Jul 06 22:19:59.579797 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450183    2556 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 06 22:19:59.579797 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450186    2556 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 06 22:19:59.579797 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450189    2556 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 06 22:19:59.579797 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450192    2556 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 06 22:19:59.579797 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450195    2556 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 06 22:19:59.579797 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450198    2556 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 06 22:19:59.579797 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450201    2556 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 06 22:19:59.579797 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450208    2556 flags.go:64] FLAG: --node-status-max-images="50"
Jul 06 22:19:59.579797 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450211    2556 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 06 22:19:59.579797 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450214    2556 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 06 22:19:59.579797 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450217    2556 flags.go:64] FLAG: --pod-cidr=""
Jul 06 22:19:59.580631 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450221    2556 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 06 22:19:59.580631 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450229    2556 flags.go:64] FLAG: --pod-manifest-path=""
Jul 06 22:19:59.580631 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450233    2556 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 06 22:19:59.580631 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450236    2556 flags.go:64] FLAG: --pods-per-core="0"
Jul 06 22:19:59.580631 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450239    2556 flags.go:64] FLAG: --port="10250"
Jul 06 22:19:59.580631 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450242    2556 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 06 22:19:59.580631 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450245    2556 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0fc7f313b17ff5014"
Jul 06 22:19:59.580631 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450248    2556 flags.go:64] FLAG: --qos-reserved=""
Jul 06 22:19:59.580631 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450251    2556 flags.go:64] FLAG: --read-only-port="10255"
Jul 06 22:19:59.580631 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450254    2556 flags.go:64] FLAG: --register-node="true"
Jul 06 22:19:59.580631 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450257    2556 flags.go:64] FLAG: --register-with-taints=""
Jul 06 22:19:59.580631 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450260    2556 flags.go:64] FLAG: --registry-burst="10"
Jul 06 22:19:59.580631 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450263    2556 flags.go:64] FLAG: --registry-qps="5"
Jul 06 22:19:59.580631 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450266    2556 flags.go:64] FLAG: --reserved-cpus=""
Jul 06 22:19:59.580631 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450269    2556 flags.go:64] FLAG: --reserved-memory=""
Jul 06 22:19:59.580631 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450272    2556 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 06 22:19:59.580631 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450275    2556 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 06 22:19:59.580631 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450278    2556 flags.go:64] FLAG: --rotate-certificates="false"
Jul 06 22:19:59.580631 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450281    2556 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 06 22:19:59.580631 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450284    2556 flags.go:64] FLAG: --runonce="false"
Jul 06 22:19:59.580631 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450286    2556 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 06 22:19:59.580631 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450289    2556 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 06 22:19:59.580631 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450299    2556 flags.go:64] FLAG: --seccomp-default="false"
Jul 06 22:19:59.580631 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450302    2556 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 06 22:19:59.580631 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450305    2556 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 06 22:19:59.581566 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450308    2556 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 06 22:19:59.581566 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450311    2556 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 06 22:19:59.581566 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450314    2556 flags.go:64] FLAG: --storage-driver-password="root"
Jul 06 22:19:59.581566 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450317    2556 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 06 22:19:59.581566 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450319    2556 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 06 22:19:59.581566 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450322    2556 flags.go:64] FLAG: --storage-driver-user="root"
Jul 06 22:19:59.581566 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450325    2556 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 06 22:19:59.581566 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450334    2556 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 06 22:19:59.581566 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450337    2556 flags.go:64] FLAG: --system-cgroups=""
Jul 06 22:19:59.581566 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450341    2556 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 06 22:19:59.581566 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450346    2556 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 06 22:19:59.581566 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450349    2556 flags.go:64] FLAG: --tls-cert-file=""
Jul 06 22:19:59.581566 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450352    2556 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 06 22:19:59.581566 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450358    2556 flags.go:64] FLAG: --tls-min-version=""
Jul 06 22:19:59.581566 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450361    2556 flags.go:64] FLAG: --tls-private-key-file=""
Jul 06 22:19:59.581566 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450369    2556 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 06 22:19:59.581566 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450372    2556 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 06 22:19:59.581566 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450374    2556 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 06 22:19:59.581566 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450377    2556 flags.go:64] FLAG: --v="2"
Jul 06 22:19:59.581566 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450381    2556 flags.go:64] FLAG: --version="false"
Jul 06 22:19:59.581566 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450385    2556 flags.go:64] FLAG: --vmodule=""
Jul 06 22:19:59.581566 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450388    2556 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 06 22:19:59.581566 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.450391    2556 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 06 22:19:59.581566 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450553    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 22:19:59.581566 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450557    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 22:19:59.582409 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450560    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 22:19:59.582409 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450562    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 22:19:59.582409 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450565    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 22:19:59.582409 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450568    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 22:19:59.582409 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450570    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 22:19:59.582409 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450578    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 22:19:59.582409 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450581    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 22:19:59.582409 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450584    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 22:19:59.582409 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450586    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 22:19:59.582409 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450588    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 22:19:59.582409 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450591    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 22:19:59.582409 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450593    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 22:19:59.582409 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450597    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 22:19:59.582409 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450601    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 22:19:59.582409 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450606    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 22:19:59.582409 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450609    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 22:19:59.582409 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450615    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 22:19:59.582409 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450618    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 22:19:59.582409 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450621    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 22:19:59.582409 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450625    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 22:19:59.718422 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450629    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 22:19:59.718422 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450633    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 22:19:59.718422 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450636    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 22:19:59.718422 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450640    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 22:19:59.718422 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450644    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 22:19:59.718422 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450648    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 22:19:59.718422 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450652    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 22:19:59.718422 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450656    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 22:19:59.718422 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450660    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 22:19:59.718422 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450664    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 22:19:59.718422 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450668    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 22:19:59.718422 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450672    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 22:19:59.718422 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450675    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 22:19:59.718422 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450679    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 22:19:59.718422 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450684    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 22:19:59.718422 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450688    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 22:19:59.718422 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450692    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 22:19:59.718422 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450695    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 22:19:59.718422 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450705    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 22:19:59.718422 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450708    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 22:19:59.719263 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450710    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 22:19:59.719263 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450713    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 22:19:59.719263 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450716    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 22:19:59.719263 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450719    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 22:19:59.719263 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450721    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 22:19:59.719263 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450724    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 22:19:59.719263 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450728    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 22:19:59.719263 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450730    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 22:19:59.719263 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450734    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 22:19:59.719263 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450737    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 22:19:59.719263 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450739    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 22:19:59.719263 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450742    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 22:19:59.719263 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450744    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 22:19:59.719263 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450747    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 22:19:59.719263 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450749    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 22:19:59.719263 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450752    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 22:19:59.719263 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450756    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 22:19:59.719263 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450759    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 22:19:59.719263 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450762    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 22:19:59.720439 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450765    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 22:19:59.720439 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450767    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 22:19:59.720439 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450770    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 22:19:59.720439 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450773    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 22:19:59.720439 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450775    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 22:19:59.720439 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450778    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 22:19:59.720439 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450780    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 22:19:59.720439 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450783    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 22:19:59.720439 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450785    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 22:19:59.720439 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450788    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 22:19:59.720439 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450790    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 22:19:59.720439 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450793    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 22:19:59.720439 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450800    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 22:19:59.720439 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450803    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 22:19:59.720439 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450806    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 22:19:59.720439 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450809    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 22:19:59.720439 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450812    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 22:19:59.720439 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450817    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 22:19:59.720439 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450820    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 22:19:59.720439 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450826    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 22:19:59.721011 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450829    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 22:19:59.721011 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450835    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 22:19:59.721011 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450839    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 22:19:59.721011 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450843    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 22:19:59.721011 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450848    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 22:19:59.721011 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450852    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 22:19:59.721011 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450856    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 22:19:59.721011 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450860    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 22:19:59.721011 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450864    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 22:19:59.721011 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450868    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 22:19:59.721011 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450872    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 22:19:59.721011 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450876    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 22:19:59.721011 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450879    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 22:19:59.721011 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450883    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 22:19:59.721011 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450887    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 22:19:59.721011 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450891    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 22:19:59.721011 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450895    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 22:19:59.721011 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.450898    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 22:19:59.721545 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.451705    2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 22:19:59.721545 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.460811    2556 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 06 22:19:59.721545 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.460827    2556 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 06 22:19:59.721545 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.461460    2556 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 06 22:19:59.721545 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.461475    2556 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 06 22:19:59.721545 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461564    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 22:19:59.721545 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461572    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 22:19:59.721545 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461577    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 22:19:59.721545 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461581    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 22:19:59.721545 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461585    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 22:19:59.721545 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461589    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 22:19:59.721545 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461593    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 22:19:59.721545 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461597    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 22:19:59.721545 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461601    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 22:19:59.721545 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461605    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 22:19:59.722124 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461609    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 22:19:59.722124 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461613    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 22:19:59.722124 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461617    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 22:19:59.722124 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461621    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 22:19:59.722124 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461625    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 22:19:59.722124 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461628    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 22:19:59.722124 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461632    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 22:19:59.722124 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461636    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 22:19:59.722124 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461641    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 22:19:59.722124 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461645    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 22:19:59.722124 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461649    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 22:19:59.722124 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461652    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 22:19:59.722124 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461656    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 22:19:59.722124 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461660    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 22:19:59.722124 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461664    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 22:19:59.722124 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461668    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 22:19:59.722124 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461672    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 22:19:59.722124 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461676    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 22:19:59.722124 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461681    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 22:19:59.722124 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461686    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 22:19:59.723059 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461690    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 22:19:59.723059 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461694    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 22:19:59.723059 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461698    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 22:19:59.723059 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461702    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 22:19:59.723059 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461705    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 22:19:59.723059 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461709    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 22:19:59.723059 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461713    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 22:19:59.723059 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461718    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 22:19:59.723059 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461722    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 22:19:59.723059 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461725    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 22:19:59.723059 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461729    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 22:19:59.723059 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461735    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 22:19:59.723059 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461740    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 22:19:59.723059 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461744    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 22:19:59.723059 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461752    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 22:19:59.723059 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461758    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 22:19:59.723059 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461763    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 22:19:59.723059 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461767    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 22:19:59.723059 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461771    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 22:19:59.874714 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461775    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 22:19:59.874714 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461780    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 22:19:59.874714 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461784    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 22:19:59.874714 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461788    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 22:19:59.874714 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461793    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 22:19:59.874714 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461797    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 22:19:59.874714 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461801    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 22:19:59.874714 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461805    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 22:19:59.874714 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461810    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 22:19:59.874714 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461813    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 22:19:59.874714 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461818    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 22:19:59.874714 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461822    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 22:19:59.874714 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461826    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 22:19:59.874714 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461830    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 22:19:59.874714 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461834    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 22:19:59.874714 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461840    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 22:19:59.874714 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461844    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 22:19:59.874714 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461849    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 22:19:59.874714 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461853    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 22:19:59.874714 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461858    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 22:19:59.876310 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461862    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 22:19:59.876310 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461866    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 22:19:59.876310 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461869    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 22:19:59.876310 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461873    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 22:19:59.876310 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461877    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 22:19:59.876310 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461881    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 22:19:59.876310 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461885    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 22:19:59.876310 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461890    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 22:19:59.876310 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461894    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 22:19:59.876310 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461908    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 22:19:59.876310 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461912    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 22:19:59.876310 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461917    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 22:19:59.876310 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461921    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 22:19:59.876310 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461925    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 22:19:59.876310 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461929    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 22:19:59.876310 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461933    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 22:19:59.876310 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461937    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 22:19:59.876310 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461941    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 22:19:59.876310 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461945    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 22:19:59.876310 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461949    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 22:19:59.877532 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461953    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 22:19:59.877532 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461957    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 22:19:59.877532 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461962    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 22:19:59.877532 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461965    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 22:19:59.877532 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461969    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 22:19:59.877532 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461973    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 22:19:59.877532 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461977    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 22:19:59.877532 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461981    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 22:19:59.877532 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461985    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 22:19:59.877532 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.461989    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 22:19:59.877532 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.461996    2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 22:19:59.877532 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462182    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 22:19:59.877532 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462191    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 22:19:59.877532 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462195    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 22:19:59.877532 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462199    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 22:19:59.879071 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462203    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 22:19:59.879071 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462206    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 22:19:59.879071 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462210    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 22:19:59.879071 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462214    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 22:19:59.879071 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462219    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 22:19:59.879071 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462223    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 22:19:59.879071 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462227    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 22:19:59.879071 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462234    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 22:19:59.879071 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462240    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 22:19:59.879071 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462245    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 22:19:59.879071 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462249    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 22:19:59.879071 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462253    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 22:19:59.879071 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462260    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 22:19:59.879071 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462264    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 22:19:59.879071 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462268    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 22:19:59.879071 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462272    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 22:19:59.879071 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462275    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 22:19:59.879071 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462279    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 22:19:59.879071 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462283    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 22:19:59.879856 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462286    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 22:19:59.879856 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462290    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 22:19:59.879856 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462293    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 22:19:59.879856 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462297    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 22:19:59.879856 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462301    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 22:19:59.879856 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462304    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 22:19:59.879856 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462308    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 22:19:59.879856 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462312    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 22:19:59.879856 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462315    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 22:19:59.879856 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462320    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 22:19:59.879856 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462324    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 22:19:59.879856 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462329    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 22:19:59.879856 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462333    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 22:19:59.879856 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462336    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 22:19:59.879856 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462340    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 22:19:59.879856 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462344    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 22:19:59.879856 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462348    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 22:19:59.879856 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462353    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 22:19:59.879856 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462358    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 22:19:59.880577 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462362    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 22:19:59.880577 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462365    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 22:19:59.880577 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462369    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 22:19:59.880577 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462373    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 22:19:59.880577 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462376    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 22:19:59.880577 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462380    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 22:19:59.880577 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462385    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 22:19:59.880577 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462389    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 22:19:59.880577 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462393    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 22:19:59.880577 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462396    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 22:19:59.880577 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462400    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 22:19:59.880577 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462403    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 22:19:59.880577 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462407    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 22:19:59.880577 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462411    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 22:19:59.880577 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462414    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 22:19:59.880577 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462418    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 22:19:59.880577 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462422    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 22:19:59.880577 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462425    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 22:19:59.880577 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462429    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 22:19:59.880577 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462433    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 22:19:59.881323 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462437    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 22:19:59.881323 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462441    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 22:19:59.881323 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462444    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 22:19:59.881323 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462447    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 22:19:59.881323 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462451    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 22:19:59.881323 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462454    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 22:19:59.881323 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462458    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 22:19:59.881323 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462462    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 22:19:59.881323 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462466    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 22:19:59.881323 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462469    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 22:19:59.881323 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462474    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 22:19:59.881323 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462477    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 22:19:59.881323 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462481    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 22:19:59.881323 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462486    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 22:19:59.881323 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462489    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 22:19:59.881323 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462493    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 22:19:59.881323 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462497    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 22:19:59.881323 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462500    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 22:19:59.881323 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462505    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 22:19:59.881323 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462509    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 22:19:59.882067 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462515    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 22:19:59.882067 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462520    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 22:19:59.882067 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462523    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 22:19:59.882067 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462528    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 22:19:59.882067 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462532    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 22:19:59.882067 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462536    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 22:19:59.882067 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462539    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 22:19:59.882067 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462543    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 22:19:59.882067 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462546    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 22:19:59.882067 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462549    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 22:19:59.882067 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462553    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 22:19:59.882067 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462557    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 22:19:59.882067 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462561    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 22:19:59.882067 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462564    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 22:19:59.882067 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462568    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 22:19:59.882067 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462572    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 22:19:59.882067 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:19:59.462575    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 22:19:59.882723 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.462582    2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 22:19:59.882723 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.462727    2556 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 06 22:19:59.882723 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.465200    2556 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 06 22:19:59.882723 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.466526    2556 server.go:1019] "Starting client certificate rotation"
Jul 06 22:19:59.882723 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.466622    2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 22:19:59.882723 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.466650    2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 22:19:59.882723 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.469062    2556 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 22:19:59.882723 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.470698    2556 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 22:19:59.882723 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.483183    2556 log.go:25] "Validated CRI v1 runtime API"
Jul 06 22:19:59.882723 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.487475    2556 log.go:25] "Validated CRI v1 image API"
Jul 06 22:19:59.882723 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.488893    2556 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 06 22:19:59.882723 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.503390    2556 fs.go:135] Filesystem UUIDs: map[16724402-2f17-440b-8395-7dbf5e804201:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 a21c716d-b8f6-43ab-9d30-23552eb2b7fc:/dev/nvme0n1p3]
Jul 06 22:19:59.883197 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.503406    2556 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 06 22:19:59.883241 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.508294    2556 manager.go:216] Machine: {Timestamp:2026-07-06 22:19:59.507091902 +0000 UTC m=+0.295114825 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3082983 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec249059c24766af60d175ab9ac770b8 SystemUUID:ec249059-c247-66af-60d1-75ab9ac770b8 BootID:cd1ad699-e7ed-4d81-9d08-5710cc513d0c Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:45:77:e1:f3:61 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:45:77:e1:f3:61 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:6a:c0:81:5d:97:ed Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 06 22:19:59.883241 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.508397    2556 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 06 22:19:59.883241 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.508475    2556 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 06 22:19:59.883241 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.511066    2556 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 06 22:19:59.883241 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.511087    2556 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-52.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 06 22:19:59.883241 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.511796    2556 topology_manager.go:138] "Creating topology manager with none policy"
Jul 06 22:19:59.883241 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.511805    2556 container_manager_linux.go:309] "Creating device plugin manager"
Jul 06 22:19:59.883241 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.511812    2556 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 22:19:59.883586 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.512389    2556 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 22:19:59.883586 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.513667    2556 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 06 22:19:59.883586 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.516651    2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 22:19:59.883586 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.517523    2556 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 22:19:59.883586 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.517649    2556 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 06 22:19:59.883586 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.517677    2556 kubelet.go:486] "Attempting to sync node with API server"
Jul 06 22:19:59.883586 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.517691    2556 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 06 22:19:59.883586 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.517707    2556 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 06 22:19:59.883586 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.517716    2556 kubelet.go:398] "Adding apiserver pod source"
Jul 06 22:19:59.883586 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.517725    2556 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 06 22:19:59.883586 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.518084    2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 22:19:59.883586 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.518121    2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 22:19:59.883586 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.521641    2556 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 06 22:19:59.883586 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.523687    2556 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 06 22:19:59.883586 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.523729    2556 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 06 22:19:59.883586 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.524793    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 06 22:19:59.883586 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.524806    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 06 22:19:59.883586 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.524811    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 06 22:19:59.883586 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.524818    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 06 22:19:59.883586 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.524827    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 06 22:19:59.883586 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.524834    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 06 22:19:59.883586 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.524843    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 06 22:19:59.883586 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.524849    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 06 22:19:59.883586 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.524855    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 06 22:19:59.883586 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.524862    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 06 22:19:59.883586 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.524876    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 06 22:19:59.883586 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.524882    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 06 22:19:59.883586 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.525616    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 06 22:19:59.883586 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.525631    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 06 22:19:59.883586 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:19:59.527746    2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 06 22:19:59.883586 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:19:59.527804    2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-52.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 06 22:19:59.883586 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.527932    2556 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-52.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 06 22:19:59.883586 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.529027    2556 server.go:1268] "Started kubelet"
Jul 06 22:19:59.883586 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.531730    2556 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 06 22:19:59.883586 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.531763    2556 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 06 22:19:59.883586 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.532865    2556 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 06 22:19:59.883586 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.532938    2556 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 06 22:19:59.883586 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.534706    2556 server.go:310] "Adding debug handlers to kubelet server"
Jul 06 22:19:59.883586 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:19:59.536704    2556 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 06 22:19:59.885008 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.539864    2556 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 06 22:19:59.885008 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.540172    2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 06 22:19:59.885008 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:19:59.542135    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-52.ec2.internal\" not found"
Jul 06 22:19:59.885008 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.542702    2556 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 06 22:19:59.885008 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.542708    2556 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 06 22:19:59.885008 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.542850    2556 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 06 22:19:59.885008 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.542902    2556 reconstruct.go:97] "Volume reconstruction finished"
Jul 06 22:19:59.885008 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.542906    2556 reconciler.go:29] "Reconciler: start to sync state"
Jul 06 22:19:59.885008 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.544349    2556 factory.go:55] Registering systemd factory
Jul 06 22:19:59.885008 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.544364    2556 factory.go:223] Registration of the systemd container factory successfully
Jul 06 22:19:59.885008 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.544534    2556 factory.go:153] Registering CRI-O factory
Jul 06 22:19:59.885008 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.544542    2556 factory.go:223] Registration of the crio container factory successfully
Jul 06 22:19:59.885008 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.544582    2556 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 06 22:19:59.885008 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.544600    2556 factory.go:103] Registering Raw factory
Jul 06 22:19:59.885008 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.544610    2556 manager.go:1196] Started watching for new ooms in manager
Jul 06 22:19:59.885008 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.544916    2556 manager.go:349] Starting recovery of all containers
Jul 06 22:19:59.885008 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.546990    2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xwvgp"
Jul 06 22:19:59.885008 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.547007    2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xwvgp"
Jul 06 22:19:59.885008 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:19:59.552512    2556 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 06 22:19:59.885008 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:19:59.552703    2556 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-52.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 06 22:19:59.885008 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:19:59.553008    2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-52.ec2.internal.18bfd362fabdc82d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-52.ec2.internal,UID:ip-10-0-141-52.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-52.ec2.internal,},FirstTimestamp:2026-07-06 22:19:59.529003053 +0000 UTC m=+0.317025978,LastTimestamp:2026-07-06 22:19:59.529003053 +0000 UTC m=+0.317025978,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-52.ec2.internal,}"
Jul 06 22:19:59.885008 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.556057    2556 manager.go:354] Recovery completed
Jul 06 22:19:59.885008 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.559906    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 22:19:59.885008 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.561868    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-52.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 22:19:59.885008 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.561904    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-52.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 22:19:59.885008 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.561921    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-52.ec2.internal" event="NodeHasSufficientPID"
Jul 06 22:19:59.885008 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.562488    2556 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 06 22:19:59.885008 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.562497    2556 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 06 22:19:59.885008 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.562500    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 22:19:59.885008 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.562510    2556 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 22:19:59.885008 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.563209    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-52.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 22:19:59.885008 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.563237    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-52.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 22:19:59.885817 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.563251    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-52.ec2.internal" event="NodeHasSufficientPID"
Jul 06 22:19:59.885817 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.564504    2556 policy_none.go:49] "None policy: Start"
Jul 06 22:19:59.885817 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.564518    2556 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 06 22:19:59.885817 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.564528    2556 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 06 22:19:59.885817 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.566483    2556 policy_none.go:47] "Start"
Jul 06 22:19:59.885817 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.604656    2556 manager.go:337] "Starting Device Plugin manager"
Jul 06 22:19:59.885817 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:19:59.604848    2556 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 06 22:19:59.885817 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.604864    2556 server.go:87] "Starting device plugin registration server"
Jul 06 22:19:59.885817 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.605077    2556 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 06 22:19:59.885817 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.605087    2556 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 06 22:19:59.885817 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.605159    2556 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 06 22:19:59.885817 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.605238    2556 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 06 22:19:59.885817 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.605246    2556 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 06 22:19:59.885817 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:19:59.605743    2556 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 06 22:19:59.885817 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:19:59.605782    2556 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-52.ec2.internal\" not found"
Jul 06 22:19:59.885817 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.645090    2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 06 22:19:59.885817 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.646259    2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 06 22:19:59.885817 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.646301    2556 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 06 22:19:59.885817 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.646325    2556 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 06 22:19:59.885817 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:19:59.646369    2556 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 06 22:19:59.885817 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.648905    2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 22:19:59.885817 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.706078    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 22:19:59.885817 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.708493    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-52.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 22:19:59.885817 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.708517    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-52.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 22:19:59.885817 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.708527    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-52.ec2.internal" event="NodeHasSufficientPID"
Jul 06 22:19:59.885817 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.708550    2556 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-52.ec2.internal"
Jul 06 22:19:59.885817 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.715695    2556 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-52.ec2.internal"
Jul 06 22:19:59.885817 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:19:59.715714    2556 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-52.ec2.internal\": node \"ip-10-0-141-52.ec2.internal\" not found"
Jul 06 22:19:59.885817 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:19:59.737310    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-52.ec2.internal\" not found"
Jul 06 22:19:59.885817 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.747455    2556 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-52.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-52.ec2.internal"]
Jul 06 22:19:59.885817 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.747514    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 22:19:59.885817 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.749010    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-52.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 22:19:59.885817 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.749033    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-52.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 22:19:59.885817 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.749042    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-52.ec2.internal" event="NodeHasSufficientPID"
Jul 06 22:19:59.885817 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.751414    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 22:19:59.885817 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.751525    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-52.ec2.internal"
Jul 06 22:19:59.885817 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.751550    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 22:19:59.885817 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.752067    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-52.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 22:19:59.886767 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.752067    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-52.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 22:19:59.886767 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.752110    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-52.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 22:19:59.886767 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.752136    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-52.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 22:19:59.886767 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.752150    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-52.ec2.internal" event="NodeHasSufficientPID"
Jul 06 22:19:59.886767 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.752152    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-52.ec2.internal" event="NodeHasSufficientPID"
Jul 06 22:19:59.886767 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.754531    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-52.ec2.internal"
Jul 06 22:19:59.886767 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.754604    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 22:19:59.886767 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.755446    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-52.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 22:19:59.886767 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.755476    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-52.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 22:19:59.886767 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.755491    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-52.ec2.internal" event="NodeHasSufficientPID"
Jul 06 22:19:59.886767 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:19:59.777691    2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-52.ec2.internal\" not found" node="ip-10-0-141-52.ec2.internal"
Jul 06 22:19:59.886767 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:19:59.781800    2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-52.ec2.internal\" not found" node="ip-10-0-141-52.ec2.internal"
Jul 06 22:19:59.886767 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:19:59.838335    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-52.ec2.internal\" not found"
Jul 06 22:19:59.938584 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:19:59.938555    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-52.ec2.internal\" not found"
Jul 06 22:19:59.943778 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.943759    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/329630a55090cd720672a34e51ec6742-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-52.ec2.internal\" (UID: \"329630a55090cd720672a34e51ec6742\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-52.ec2.internal"
Jul 06 22:19:59.943828 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.943787    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4e0af277c0cb33613563e1e2b5c15bcc-config\") pod \"kube-apiserver-proxy-ip-10-0-141-52.ec2.internal\" (UID: \"4e0af277c0cb33613563e1e2b5c15bcc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-52.ec2.internal"
Jul 06 22:19:59.943828 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:19:59.943804    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/329630a55090cd720672a34e51ec6742-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-52.ec2.internal\" (UID: \"329630a55090cd720672a34e51ec6742\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-52.ec2.internal"
Jul 06 22:20:00.039480 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:00.039457    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-52.ec2.internal\" not found"
Jul 06 22:20:00.043979 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.043960    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/329630a55090cd720672a34e51ec6742-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-52.ec2.internal\" (UID: \"329630a55090cd720672a34e51ec6742\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-52.ec2.internal"
Jul 06 22:20:00.044026 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.043987    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4e0af277c0cb33613563e1e2b5c15bcc-config\") pod \"kube-apiserver-proxy-ip-10-0-141-52.ec2.internal\" (UID: \"4e0af277c0cb33613563e1e2b5c15bcc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-52.ec2.internal"
Jul 06 22:20:00.044026 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.044005    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/329630a55090cd720672a34e51ec6742-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-52.ec2.internal\" (UID: \"329630a55090cd720672a34e51ec6742\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-52.ec2.internal"
Jul 06 22:20:00.044103 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.044052    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/329630a55090cd720672a34e51ec6742-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-52.ec2.internal\" (UID: \"329630a55090cd720672a34e51ec6742\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-52.ec2.internal"
Jul 06 22:20:00.044103 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.044068    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/329630a55090cd720672a34e51ec6742-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-52.ec2.internal\" (UID: \"329630a55090cd720672a34e51ec6742\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-52.ec2.internal"
Jul 06 22:20:00.044103 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.044071    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4e0af277c0cb33613563e1e2b5c15bcc-config\") pod \"kube-apiserver-proxy-ip-10-0-141-52.ec2.internal\" (UID: \"4e0af277c0cb33613563e1e2b5c15bcc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-52.ec2.internal"
Jul 06 22:20:00.085243 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.085203    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-52.ec2.internal"
Jul 06 22:20:00.085243 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.085242    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-52.ec2.internal"
Jul 06 22:20:00.140131 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:00.140091    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-52.ec2.internal\" not found"
Jul 06 22:20:00.241750 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:00.241725    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-52.ec2.internal\" not found"
Jul 06 22:20:00.344898 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:00.344832    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-52.ec2.internal\" not found"
Jul 06 22:20:00.445423 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:00.445395    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-52.ec2.internal\" not found"
Jul 06 22:20:00.467029 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.467008    2556 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 06 22:20:00.467204 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.467173    2556 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 06 22:20:00.485996 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.485979    2556 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 22:20:00.517940 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.517924    2556 apiserver.go:52] "Watching apiserver"
Jul 06 22:20:00.527109 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.527081    2556 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 06 22:20:00.528223 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.528201    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-9gpdr","openshift-image-registry/node-ca-t4r7v","openshift-multus/multus-additional-cni-plugins-2gn7f","openshift-multus/network-metrics-daemon-fxpqz","openshift-network-diagnostics/network-check-target-s9ptr","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57fr6","openshift-multus/multus-q9jfs","openshift-network-operator/iptables-alerter-hn4dg","openshift-ovn-kubernetes/ovnkube-node-mxl25","kube-system/global-pull-secret-syncer-626fl","kube-system/konnectivity-agent-prtqv","openshift-cluster-node-tuning-operator/tuned-crtmj"]
Jul 06 22:20:00.531270 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.531254    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9gpdr"
Jul 06 22:20:00.533259 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.533242    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xk5qq\""
Jul 06 22:20:00.533466 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.533451    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 06 22:20:00.533507 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.533488    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 06 22:20:00.533799 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.533784    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-t4r7v"
Jul 06 22:20:00.535675 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.535654    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 06 22:20:00.535781 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.535743    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 06 22:20:00.535878 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.535864    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-56btr\""
Jul 06 22:20:00.535946 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.535928    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 06 22:20:00.536763 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.536747    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2gn7f"
Jul 06 22:20:00.538867 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.538850    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 06 22:20:00.538955 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.538912    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 06 22:20:00.539002 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.538955    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-t7m6v\""
Jul 06 22:20:00.539002 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.538963    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 06 22:20:00.539002 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.538989    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 06 22:20:00.539002 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.538960    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 06 22:20:00.539581 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.539567    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxpqz"
Jul 06 22:20:00.539854 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:00.539817    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxpqz" podUID="40861954-16ff-4b9b-8e92-d00574ea8a9f"
Jul 06 22:20:00.541888 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.541866    2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 06 22:20:00.542556 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.542534    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s9ptr"
Jul 06 22:20:00.542654 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:00.542603    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s9ptr" podUID="5fa5d933-5f4e-4ac8-b844-ac59aea241cb"
Jul 06 22:20:00.543372 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.543357    2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-52.ec2.internal"
Jul 06 22:20:00.545107 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.545092    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57fr6"
Jul 06 22:20:00.546706 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.546689    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/53db0d7a-f95e-4101-9677-2e12ea5f8b26-host\") pod \"node-ca-t4r7v\" (UID: \"53db0d7a-f95e-4101-9677-2e12ea5f8b26\") " pod="openshift-image-registry/node-ca-t4r7v"
Jul 06 22:20:00.546790 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.546713    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r47dj\" (UniqueName: \"kubernetes.io/projected/53db0d7a-f95e-4101-9677-2e12ea5f8b26-kube-api-access-r47dj\") pod \"node-ca-t4r7v\" (UID: \"53db0d7a-f95e-4101-9677-2e12ea5f8b26\") " pod="openshift-image-registry/node-ca-t4r7v"
Jul 06 22:20:00.546790 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.546730    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ae29cca7-c528-42da-bc42-0c0961f7638f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2gn7f\" (UID: \"ae29cca7-c528-42da-bc42-0c0961f7638f\") " pod="openshift-multus/multus-additional-cni-plugins-2gn7f"
Jul 06 22:20:00.546790 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.546775    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ae29cca7-c528-42da-bc42-0c0961f7638f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2gn7f\" (UID: \"ae29cca7-c528-42da-bc42-0c0961f7638f\") " pod="openshift-multus/multus-additional-cni-plugins-2gn7f"
Jul 06 22:20:00.546970 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.546808    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40861954-16ff-4b9b-8e92-d00574ea8a9f-metrics-certs\") pod \"network-metrics-daemon-fxpqz\" (UID: \"40861954-16ff-4b9b-8e92-d00574ea8a9f\") " pod="openshift-multus/network-metrics-daemon-fxpqz"
Jul 06 22:20:00.546970 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.546828    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-775d7\" (UniqueName: \"kubernetes.io/projected/40861954-16ff-4b9b-8e92-d00574ea8a9f-kube-api-access-775d7\") pod \"network-metrics-daemon-fxpqz\" (UID: \"40861954-16ff-4b9b-8e92-d00574ea8a9f\") " pod="openshift-multus/network-metrics-daemon-fxpqz"
Jul 06 22:20:00.546970 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.546847    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtgz7\" (UniqueName: \"kubernetes.io/projected/38ae4b4b-d53d-4dbc-bba1-0b252c243af3-kube-api-access-qtgz7\") pod \"aws-ebs-csi-driver-node-57fr6\" (UID: \"38ae4b4b-d53d-4dbc-bba1-0b252c243af3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57fr6"
Jul 06 22:20:00.546970 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.546871    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8f22a5f0-92b2-4853-9cce-38758ed34f72-hosts-file\") pod \"node-resolver-9gpdr\" (UID: \"8f22a5f0-92b2-4853-9cce-38758ed34f72\") " pod="openshift-dns/node-resolver-9gpdr"
Jul 06 22:20:00.546970 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.546895    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jnzw\" (UniqueName: \"kubernetes.io/projected/8f22a5f0-92b2-4853-9cce-38758ed34f72-kube-api-access-4jnzw\") pod \"node-resolver-9gpdr\" (UID: \"8f22a5f0-92b2-4853-9cce-38758ed34f72\") " pod="openshift-dns/node-resolver-9gpdr"
Jul 06 22:20:00.546970 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.546915    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 06 22:20:00.546970 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.546920    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ae29cca7-c528-42da-bc42-0c0961f7638f-cni-binary-copy\") pod \"multus-additional-cni-plugins-2gn7f\" (UID: \"ae29cca7-c528-42da-bc42-0c0961f7638f\") " pod="openshift-multus/multus-additional-cni-plugins-2gn7f"
Jul 06 22:20:00.546970 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.546927    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 06 22:20:00.546970 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.546946    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6qcl\" (UniqueName: \"kubernetes.io/projected/5fa5d933-5f4e-4ac8-b844-ac59aea241cb-kube-api-access-f6qcl\") pod \"network-check-target-s9ptr\" (UID: \"5fa5d933-5f4e-4ac8-b844-ac59aea241cb\") " pod="openshift-network-diagnostics/network-check-target-s9ptr"
Jul 06 22:20:00.546970 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.546946    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-rgv2c\""
Jul 06 22:20:00.547450 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.546985    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/38ae4b4b-d53d-4dbc-bba1-0b252c243af3-registration-dir\") pod \"aws-ebs-csi-driver-node-57fr6\" (UID: \"38ae4b4b-d53d-4dbc-bba1-0b252c243af3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57fr6"
Jul 06 22:20:00.547450 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.547020    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/38ae4b4b-d53d-4dbc-bba1-0b252c243af3-device-dir\") pod \"aws-ebs-csi-driver-node-57fr6\" (UID: \"38ae4b4b-d53d-4dbc-bba1-0b252c243af3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57fr6"
Jul 06 22:20:00.547450 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.547046    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/38ae4b4b-d53d-4dbc-bba1-0b252c243af3-etc-selinux\") pod \"aws-ebs-csi-driver-node-57fr6\" (UID: \"38ae4b4b-d53d-4dbc-bba1-0b252c243af3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57fr6"
Jul 06 22:20:00.547450 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.547074    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f22a5f0-92b2-4853-9cce-38758ed34f72-tmp-dir\") pod \"node-resolver-9gpdr\" (UID: \"8f22a5f0-92b2-4853-9cce-38758ed34f72\") " pod="openshift-dns/node-resolver-9gpdr"
Jul 06 22:20:00.547450 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.547099    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ae29cca7-c528-42da-bc42-0c0961f7638f-system-cni-dir\") pod \"multus-additional-cni-plugins-2gn7f\" (UID: \"ae29cca7-c528-42da-bc42-0c0961f7638f\") " pod="openshift-multus/multus-additional-cni-plugins-2gn7f"
Jul 06 22:20:00.547450 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.547143    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ae29cca7-c528-42da-bc42-0c0961f7638f-cnibin\") pod \"multus-additional-cni-plugins-2gn7f\" (UID: \"ae29cca7-c528-42da-bc42-0c0961f7638f\") " pod="openshift-multus/multus-additional-cni-plugins-2gn7f"
Jul 06 22:20:00.547450 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.547173    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ae29cca7-c528-42da-bc42-0c0961f7638f-os-release\") pod \"multus-additional-cni-plugins-2gn7f\" (UID: \"ae29cca7-c528-42da-bc42-0c0961f7638f\") " pod="openshift-multus/multus-additional-cni-plugins-2gn7f"
Jul 06 22:20:00.547450 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.547220    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ae29cca7-c528-42da-bc42-0c0961f7638f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2gn7f\" (UID: \"ae29cca7-c528-42da-bc42-0c0961f7638f\") " pod="openshift-multus/multus-additional-cni-plugins-2gn7f"
Jul 06 22:20:00.547450 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.547254    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/38ae4b4b-d53d-4dbc-bba1-0b252c243af3-socket-dir\") pod \"aws-ebs-csi-driver-node-57fr6\" (UID: \"38ae4b4b-d53d-4dbc-bba1-0b252c243af3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57fr6"
Jul 06 22:20:00.547450 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.547227    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 06 22:20:00.547450 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.547282    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/53db0d7a-f95e-4101-9677-2e12ea5f8b26-serviceca\") pod \"node-ca-t4r7v\" (UID: \"53db0d7a-f95e-4101-9677-2e12ea5f8b26\") " pod="openshift-image-registry/node-ca-t4r7v"
Jul 06 22:20:00.547450 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.547307    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlt5k\" (UniqueName: \"kubernetes.io/projected/ae29cca7-c528-42da-bc42-0c0961f7638f-kube-api-access-dlt5k\") pod \"multus-additional-cni-plugins-2gn7f\" (UID: \"ae29cca7-c528-42da-bc42-0c0961f7638f\") " pod="openshift-multus/multus-additional-cni-plugins-2gn7f"
Jul 06 22:20:00.547450 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.547334    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/38ae4b4b-d53d-4dbc-bba1-0b252c243af3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-57fr6\" (UID: \"38ae4b4b-d53d-4dbc-bba1-0b252c243af3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57fr6"
Jul 06 22:20:00.547450 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.547359    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/38ae4b4b-d53d-4dbc-bba1-0b252c243af3-sys-fs\") pod \"aws-ebs-csi-driver-node-57fr6\" (UID: \"38ae4b4b-d53d-4dbc-bba1-0b252c243af3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57fr6"
Jul 06 22:20:00.548056 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.547493    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-q9jfs"
Jul 06 22:20:00.549561 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.549541    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 06 22:20:00.549619 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.549577    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-fhq8g\""
Jul 06 22:20:00.549839 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.549824    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hn4dg"
Jul 06 22:20:00.550569 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.550528    2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 22:15:00 +0000 UTC" deadline="2027-12-22 00:56:33.776396571 +0000 UTC"
Jul 06 22:20:00.550649 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.550570    2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12794h36m33.225830291s"
Jul 06 22:20:00.552172 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.552151    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 06 22:20:00.552284 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.552214    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 06 22:20:00.552401 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.552303    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 06 22:20:00.552401 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.552363    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-qtp99\""
Jul 06 22:20:00.552549 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.552535    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mxl25"
Jul 06 22:20:00.554612 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.554594    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 06 22:20:00.554809 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.554789    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-jhwq7\""
Jul 06 22:20:00.554925 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.554882    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 06 22:20:00.554925 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.554888    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 06 22:20:00.554925 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.554888    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 06 22:20:00.555192 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.555179    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 06 22:20:00.555272 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.555213    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 06 22:20:00.555723 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.555701    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-626fl"
Jul 06 22:20:00.555826 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:00.555769    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-626fl" podUID="7ae74a76-a46c-483e-8f38-a4bc4b9f0b03"
Jul 06 22:20:00.558308 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.558291    2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 22:20:00.558409 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.558359    2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-52.ec2.internal"
Jul 06 22:20:00.558409 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.558371    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-prtqv"
Jul 06 22:20:00.560664 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.560642    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 06 22:20:00.560752 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.560644    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-dkxxp\""
Jul 06 22:20:00.560752 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.560721    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-52.ec2.internal"]
Jul 06 22:20:00.560883 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.560766    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 06 22:20:00.560883 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.560829    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-crtmj"
Jul 06 22:20:00.563337 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.563319    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-mpxbz\""
Jul 06 22:20:00.563440 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.563390    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 06 22:20:00.563440 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.563410    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 06 22:20:00.563440 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.563411    2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 22:20:00.569631 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.569598    2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 22:20:00.569745 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.569730    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-141-52.ec2.internal"]
Jul 06 22:20:00.594304 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.594288    2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-4cfnd"
Jul 06 22:20:00.603707 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.602964    2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-4cfnd"
Jul 06 22:20:00.643931 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.643910    2556 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 06 22:20:00.647498 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.647462    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ae29cca7-c528-42da-bc42-0c0961f7638f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2gn7f\" (UID: \"ae29cca7-c528-42da-bc42-0c0961f7638f\") " pod="openshift-multus/multus-additional-cni-plugins-2gn7f"
Jul 06 22:20:00.647498 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.647492    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-775d7\" (UniqueName: \"kubernetes.io/projected/40861954-16ff-4b9b-8e92-d00574ea8a9f-kube-api-access-775d7\") pod \"network-metrics-daemon-fxpqz\" (UID: \"40861954-16ff-4b9b-8e92-d00574ea8a9f\") " pod="openshift-multus/network-metrics-daemon-fxpqz"
Jul 06 22:20:00.647662 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.647522    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/086f78e8-b3fd-4fc8-9778-850b2750d55f-lib-modules\") pod \"tuned-crtmj\" (UID: \"086f78e8-b3fd-4fc8-9778-850b2750d55f\") " pod="openshift-cluster-node-tuning-operator/tuned-crtmj"
Jul 06 22:20:00.647662 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.647549    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bb153ded-966e-45d9-a254-2c3b68f5196d-konnectivity-ca\") pod \"konnectivity-agent-prtqv\" (UID: \"bb153ded-966e-45d9-a254-2c3b68f5196d\") " pod="kube-system/konnectivity-agent-prtqv"
Jul 06 22:20:00.647662 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.647573    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8f22a5f0-92b2-4853-9cce-38758ed34f72-hosts-file\") pod \"node-resolver-9gpdr\" (UID: \"8f22a5f0-92b2-4853-9cce-38758ed34f72\") " pod="openshift-dns/node-resolver-9gpdr"
Jul 06 22:20:00.647662 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.647589    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tb26w\" (UniqueName: \"kubernetes.io/projected/1b5d7713-5335-4f89-a52b-26c16df76095-kube-api-access-tb26w\") pod \"iptables-alerter-hn4dg\" (UID: \"1b5d7713-5335-4f89-a52b-26c16df76095\") " pod="openshift-network-operator/iptables-alerter-hn4dg"
Jul 06 22:20:00.647662 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.647605    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/49cd65b9-2343-4e21-8907-73358ec673ee-host-kubelet\") pod \"ovnkube-node-mxl25\" (UID: \"49cd65b9-2343-4e21-8907-73358ec673ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxl25"
Jul 06 22:20:00.647662 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.647620    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/49cd65b9-2343-4e21-8907-73358ec673ee-env-overrides\") pod \"ovnkube-node-mxl25\" (UID: \"49cd65b9-2343-4e21-8907-73358ec673ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxl25"
Jul 06 22:20:00.647662 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.647635    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/086f78e8-b3fd-4fc8-9778-850b2750d55f-etc-sysctl-d\") pod \"tuned-crtmj\" (UID: \"086f78e8-b3fd-4fc8-9778-850b2750d55f\") " pod="openshift-cluster-node-tuning-operator/tuned-crtmj"
Jul 06 22:20:00.647662 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.647651    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/086f78e8-b3fd-4fc8-9778-850b2750d55f-tmp\") pod \"tuned-crtmj\" (UID: \"086f78e8-b3fd-4fc8-9778-850b2750d55f\") " pod="openshift-cluster-node-tuning-operator/tuned-crtmj"
Jul 06 22:20:00.648053 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.647670    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f22a5f0-92b2-4853-9cce-38758ed34f72-tmp-dir\") pod \"node-resolver-9gpdr\" (UID: \"8f22a5f0-92b2-4853-9cce-38758ed34f72\") " pod="openshift-dns/node-resolver-9gpdr"
Jul 06 22:20:00.648053 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.647696    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ae29cca7-c528-42da-bc42-0c0961f7638f-cnibin\") pod \"multus-additional-cni-plugins-2gn7f\" (UID: \"ae29cca7-c528-42da-bc42-0c0961f7638f\") " pod="openshift-multus/multus-additional-cni-plugins-2gn7f"
Jul 06 22:20:00.648053 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.647711    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/49cd65b9-2343-4e21-8907-73358ec673ee-log-socket\") pod \"ovnkube-node-mxl25\" (UID: \"49cd65b9-2343-4e21-8907-73358ec673ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxl25"
Jul 06 22:20:00.648053 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.647726    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/49cd65b9-2343-4e21-8907-73358ec673ee-ovnkube-script-lib\") pod \"ovnkube-node-mxl25\" (UID: \"49cd65b9-2343-4e21-8907-73358ec673ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxl25"
Jul 06 22:20:00.648053 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.647762    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7ae74a76-a46c-483e-8f38-a4bc4b9f0b03-kubelet-config\") pod \"global-pull-secret-syncer-626fl\" (UID: \"7ae74a76-a46c-483e-8f38-a4bc4b9f0b03\") " pod="kube-system/global-pull-secret-syncer-626fl"
Jul 06 22:20:00.648053 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.647782    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eeb26f6e-20ef-4054-9dd6-c362f392c2e1-host-run-netns\") pod \"multus-q9jfs\" (UID: \"eeb26f6e-20ef-4054-9dd6-c362f392c2e1\") " pod="openshift-multus/multus-q9jfs"
Jul 06 22:20:00.648053 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.647827    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/38ae4b4b-d53d-4dbc-bba1-0b252c243af3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-57fr6\" (UID: \"38ae4b4b-d53d-4dbc-bba1-0b252c243af3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57fr6"
Jul 06 22:20:00.648053 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.647839    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ae29cca7-c528-42da-bc42-0c0961f7638f-cnibin\") pod \"multus-additional-cni-plugins-2gn7f\" (UID: \"ae29cca7-c528-42da-bc42-0c0961f7638f\") " pod="openshift-multus/multus-additional-cni-plugins-2gn7f"
Jul 06 22:20:00.648053 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.647900    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/49cd65b9-2343-4e21-8907-73358ec673ee-host-run-netns\") pod \"ovnkube-node-mxl25\" (UID: \"49cd65b9-2343-4e21-8907-73358ec673ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxl25"
Jul 06 22:20:00.648053 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.647924    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/086f78e8-b3fd-4fc8-9778-850b2750d55f-etc-sysctl-conf\") pod \"tuned-crtmj\" (UID: \"086f78e8-b3fd-4fc8-9778-850b2750d55f\") " pod="openshift-cluster-node-tuning-operator/tuned-crtmj"
Jul 06 22:20:00.648053 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.647953    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/38ae4b4b-d53d-4dbc-bba1-0b252c243af3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-57fr6\" (UID: \"38ae4b4b-d53d-4dbc-bba1-0b252c243af3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57fr6"
Jul 06 22:20:00.648053 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.647964    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/eeb26f6e-20ef-4054-9dd6-c362f392c2e1-os-release\") pod \"multus-q9jfs\" (UID: \"eeb26f6e-20ef-4054-9dd6-c362f392c2e1\") " pod="openshift-multus/multus-q9jfs"
Jul 06 22:20:00.648053 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.648002    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40861954-16ff-4b9b-8e92-d00574ea8a9f-metrics-certs\") pod \"network-metrics-daemon-fxpqz\" (UID: \"40861954-16ff-4b9b-8e92-d00574ea8a9f\") " pod="openshift-multus/network-metrics-daemon-fxpqz"
Jul 06 22:20:00.648053 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.648012    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8f22a5f0-92b2-4853-9cce-38758ed34f72-hosts-file\") pod \"node-resolver-9gpdr\" (UID: \"8f22a5f0-92b2-4853-9cce-38758ed34f72\") " pod="openshift-dns/node-resolver-9gpdr"
Jul 06 22:20:00.648692 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.648061    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/eeb26f6e-20ef-4054-9dd6-c362f392c2e1-host-var-lib-cni-multus\") pod \"multus-q9jfs\" (UID: \"eeb26f6e-20ef-4054-9dd6-c362f392c2e1\") " pod="openshift-multus/multus-q9jfs"
Jul 06 22:20:00.648692 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.648124    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ae29cca7-c528-42da-bc42-0c0961f7638f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2gn7f\" (UID: \"ae29cca7-c528-42da-bc42-0c0961f7638f\") " pod="openshift-multus/multus-additional-cni-plugins-2gn7f"
Jul 06 22:20:00.648692 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.648130    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbj72\" (UniqueName: \"kubernetes.io/projected/eeb26f6e-20ef-4054-9dd6-c362f392c2e1-kube-api-access-nbj72\") pod \"multus-q9jfs\" (UID: \"eeb26f6e-20ef-4054-9dd6-c362f392c2e1\") " pod="openshift-multus/multus-q9jfs"
Jul 06 22:20:00.648692 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:00.648161    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 22:20:00.648692 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.648191    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jnzw\" (UniqueName: \"kubernetes.io/projected/8f22a5f0-92b2-4853-9cce-38758ed34f72-kube-api-access-4jnzw\") pod \"node-resolver-9gpdr\" (UID: \"8f22a5f0-92b2-4853-9cce-38758ed34f72\") " pod="openshift-dns/node-resolver-9gpdr"
Jul 06 22:20:00.648692 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:00.648231    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40861954-16ff-4b9b-8e92-d00574ea8a9f-metrics-certs podName:40861954-16ff-4b9b-8e92-d00574ea8a9f nodeName:}" failed. No retries permitted until 2026-07-06 22:20:01.148209923 +0000 UTC m=+1.936232860 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/40861954-16ff-4b9b-8e92-d00574ea8a9f-metrics-certs") pod "network-metrics-daemon-fxpqz" (UID: "40861954-16ff-4b9b-8e92-d00574ea8a9f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 22:20:00.648692 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.648232    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f22a5f0-92b2-4853-9cce-38758ed34f72-tmp-dir\") pod \"node-resolver-9gpdr\" (UID: \"8f22a5f0-92b2-4853-9cce-38758ed34f72\") " pod="openshift-dns/node-resolver-9gpdr"
Jul 06 22:20:00.648692 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.648250    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6qcl\" (UniqueName: \"kubernetes.io/projected/5fa5d933-5f4e-4ac8-b844-ac59aea241cb-kube-api-access-f6qcl\") pod \"network-check-target-s9ptr\" (UID: \"5fa5d933-5f4e-4ac8-b844-ac59aea241cb\") " pod="openshift-network-diagnostics/network-check-target-s9ptr"
Jul 06 22:20:00.648692 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.648294    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/38ae4b4b-d53d-4dbc-bba1-0b252c243af3-device-dir\") pod \"aws-ebs-csi-driver-node-57fr6\" (UID: \"38ae4b4b-d53d-4dbc-bba1-0b252c243af3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57fr6"
Jul 06 22:20:00.648692 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.648324    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/38ae4b4b-d53d-4dbc-bba1-0b252c243af3-etc-selinux\") pod \"aws-ebs-csi-driver-node-57fr6\" (UID: \"38ae4b4b-d53d-4dbc-bba1-0b252c243af3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57fr6"
Jul 06 22:20:00.648692 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.648350    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/49cd65b9-2343-4e21-8907-73358ec673ee-host-run-ovn-kubernetes\") pod \"ovnkube-node-mxl25\" (UID: \"49cd65b9-2343-4e21-8907-73358ec673ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxl25"
Jul 06 22:20:00.648692 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.648376    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/49cd65b9-2343-4e21-8907-73358ec673ee-host-cni-netd\") pod \"ovnkube-node-mxl25\" (UID: \"49cd65b9-2343-4e21-8907-73358ec673ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxl25"
Jul 06 22:20:00.648692 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.648381    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/38ae4b4b-d53d-4dbc-bba1-0b252c243af3-device-dir\") pod \"aws-ebs-csi-driver-node-57fr6\" (UID: \"38ae4b4b-d53d-4dbc-bba1-0b252c243af3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57fr6"
Jul 06 22:20:00.648692 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.648398    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bb153ded-966e-45d9-a254-2c3b68f5196d-agent-certs\") pod \"konnectivity-agent-prtqv\" (UID: \"bb153ded-966e-45d9-a254-2c3b68f5196d\") " pod="kube-system/konnectivity-agent-prtqv"
Jul 06 22:20:00.649430 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.648423    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/086f78e8-b3fd-4fc8-9778-850b2750d55f-etc-systemd\") pod \"tuned-crtmj\" (UID: \"086f78e8-b3fd-4fc8-9778-850b2750d55f\") " pod="openshift-cluster-node-tuning-operator/tuned-crtmj"
Jul 06 22:20:00.649430 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.648437    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/38ae4b4b-d53d-4dbc-bba1-0b252c243af3-etc-selinux\") pod \"aws-ebs-csi-driver-node-57fr6\" (UID: \"38ae4b4b-d53d-4dbc-bba1-0b252c243af3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57fr6"
Jul 06 22:20:00.649430 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.648452    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ae29cca7-c528-42da-bc42-0c0961f7638f-system-cni-dir\") pod \"multus-additional-cni-plugins-2gn7f\" (UID: \"ae29cca7-c528-42da-bc42-0c0961f7638f\") " pod="openshift-multus/multus-additional-cni-plugins-2gn7f"
Jul 06 22:20:00.649430 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.648478    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ae29cca7-c528-42da-bc42-0c0961f7638f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2gn7f\" (UID: \"ae29cca7-c528-42da-bc42-0c0961f7638f\") " pod="openshift-multus/multus-additional-cni-plugins-2gn7f"
Jul 06 22:20:00.649430 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.648501    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eeb26f6e-20ef-4054-9dd6-c362f392c2e1-system-cni-dir\") pod \"multus-q9jfs\" (UID: \"eeb26f6e-20ef-4054-9dd6-c362f392c2e1\") " pod="openshift-multus/multus-q9jfs"
Jul 06 22:20:00.649430 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.648511    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ae29cca7-c528-42da-bc42-0c0961f7638f-system-cni-dir\") pod \"multus-additional-cni-plugins-2gn7f\" (UID: \"ae29cca7-c528-42da-bc42-0c0961f7638f\") " pod="openshift-multus/multus-additional-cni-plugins-2gn7f"
Jul 06 22:20:00.649430 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.648524    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eeb26f6e-20ef-4054-9dd6-c362f392c2e1-cnibin\") pod \"multus-q9jfs\" (UID: \"eeb26f6e-20ef-4054-9dd6-c362f392c2e1\") " pod="openshift-multus/multus-q9jfs"
Jul 06 22:20:00.649430 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.648576    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/49cd65b9-2343-4e21-8907-73358ec673ee-var-lib-openvswitch\") pod \"ovnkube-node-mxl25\" (UID: \"49cd65b9-2343-4e21-8907-73358ec673ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxl25"
Jul 06 22:20:00.649430 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.648610    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/49cd65b9-2343-4e21-8907-73358ec673ee-host-cni-bin\") pod \"ovnkube-node-mxl25\" (UID: \"49cd65b9-2343-4e21-8907-73358ec673ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxl25"
Jul 06 22:20:00.649430 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.648645    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztplj\" (UniqueName: \"kubernetes.io/projected/086f78e8-b3fd-4fc8-9778-850b2750d55f-kube-api-access-ztplj\") pod \"tuned-crtmj\" (UID: \"086f78e8-b3fd-4fc8-9778-850b2750d55f\") " pod="openshift-cluster-node-tuning-operator/tuned-crtmj"
Jul 06 22:20:00.649430 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.648675    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/eeb26f6e-20ef-4054-9dd6-c362f392c2e1-multus-daemon-config\") pod \"multus-q9jfs\" (UID: \"eeb26f6e-20ef-4054-9dd6-c362f392c2e1\") " pod="openshift-multus/multus-q9jfs"
Jul 06 22:20:00.649430 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.648701    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r47dj\" (UniqueName: \"kubernetes.io/projected/53db0d7a-f95e-4101-9677-2e12ea5f8b26-kube-api-access-r47dj\") pod \"node-ca-t4r7v\" (UID: \"53db0d7a-f95e-4101-9677-2e12ea5f8b26\") " pod="openshift-image-registry/node-ca-t4r7v"
Jul 06 22:20:00.649430 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.648746    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/49cd65b9-2343-4e21-8907-73358ec673ee-ovnkube-config\") pod \"ovnkube-node-mxl25\" (UID: \"49cd65b9-2343-4e21-8907-73358ec673ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxl25"
Jul 06 22:20:00.649430 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.648781    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ae74a76-a46c-483e-8f38-a4bc4b9f0b03-original-pull-secret\") pod \"global-pull-secret-syncer-626fl\" (UID: \"7ae74a76-a46c-483e-8f38-a4bc4b9f0b03\") " pod="kube-system/global-pull-secret-syncer-626fl"
Jul 06 22:20:00.650164 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.648807    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/086f78e8-b3fd-4fc8-9778-850b2750d55f-var-lib-kubelet\") pod \"tuned-crtmj\" (UID: \"086f78e8-b3fd-4fc8-9778-850b2750d55f\") " pod="openshift-cluster-node-tuning-operator/tuned-crtmj"
Jul 06 22:20:00.650164 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.648833    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eeb26f6e-20ef-4054-9dd6-c362f392c2e1-host-var-lib-kubelet\") pod \"multus-q9jfs\" (UID: \"eeb26f6e-20ef-4054-9dd6-c362f392c2e1\") " pod="openshift-multus/multus-q9jfs"
Jul 06 22:20:00.650164 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.648858    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1b5d7713-5335-4f89-a52b-26c16df76095-host-slash\") pod \"iptables-alerter-hn4dg\" (UID: \"1b5d7713-5335-4f89-a52b-26c16df76095\") " pod="openshift-network-operator/iptables-alerter-hn4dg"
Jul 06 22:20:00.650164 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.648883    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/49cd65b9-2343-4e21-8907-73358ec673ee-run-ovn\") pod \"ovnkube-node-mxl25\" (UID: \"49cd65b9-2343-4e21-8907-73358ec673ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxl25"
Jul 06 22:20:00.650164 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.648932    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7ae74a76-a46c-483e-8f38-a4bc4b9f0b03-dbus\") pod \"global-pull-secret-syncer-626fl\" (UID: \"7ae74a76-a46c-483e-8f38-a4bc4b9f0b03\") " pod="kube-system/global-pull-secret-syncer-626fl"
Jul 06 22:20:00.650164 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.648961    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ae29cca7-c528-42da-bc42-0c0961f7638f-os-release\") pod \"multus-additional-cni-plugins-2gn7f\" (UID: \"ae29cca7-c528-42da-bc42-0c0961f7638f\") " pod="openshift-multus/multus-additional-cni-plugins-2gn7f"
Jul 06 22:20:00.650164 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.648982    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ae29cca7-c528-42da-bc42-0c0961f7638f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2gn7f\" (UID: \"ae29cca7-c528-42da-bc42-0c0961f7638f\") " pod="openshift-multus/multus-additional-cni-plugins-2gn7f"
Jul 06 22:20:00.650164 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.649000    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/38ae4b4b-d53d-4dbc-bba1-0b252c243af3-socket-dir\") pod \"aws-ebs-csi-driver-node-57fr6\" (UID: \"38ae4b4b-d53d-4dbc-bba1-0b252c243af3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57fr6"
Jul 06 22:20:00.650164 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.649038    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/38ae4b4b-d53d-4dbc-bba1-0b252c243af3-sys-fs\") pod \"aws-ebs-csi-driver-node-57fr6\" (UID: \"38ae4b4b-d53d-4dbc-bba1-0b252c243af3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57fr6"
Jul 06 22:20:00.650164 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.649067    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/49cd65b9-2343-4e21-8907-73358ec673ee-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mxl25\" (UID: \"49cd65b9-2343-4e21-8907-73358ec673ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxl25"
Jul 06 22:20:00.650164 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.649097    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/53db0d7a-f95e-4101-9677-2e12ea5f8b26-serviceca\") pod \"node-ca-t4r7v\" (UID: \"53db0d7a-f95e-4101-9677-2e12ea5f8b26\") " pod="openshift-image-registry/node-ca-t4r7v"
Jul 06 22:20:00.650164 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.649113    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/38ae4b4b-d53d-4dbc-bba1-0b252c243af3-socket-dir\") pod \"aws-ebs-csi-driver-node-57fr6\" (UID: \"38ae4b4b-d53d-4dbc-bba1-0b252c243af3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57fr6"
Jul 06 22:20:00.650164 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.649103    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ae29cca7-c528-42da-bc42-0c0961f7638f-os-release\") pod \"multus-additional-cni-plugins-2gn7f\" (UID: \"ae29cca7-c528-42da-bc42-0c0961f7638f\") " pod="openshift-multus/multus-additional-cni-plugins-2gn7f"
Jul 06 22:20:00.650164 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.649129    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/38ae4b4b-d53d-4dbc-bba1-0b252c243af3-sys-fs\") pod \"aws-ebs-csi-driver-node-57fr6\" (UID: \"38ae4b4b-d53d-4dbc-bba1-0b252c243af3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57fr6"
Jul 06 22:20:00.650640 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.649122    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1b5d7713-5335-4f89-a52b-26c16df76095-iptables-alerter-script\") pod \"iptables-alerter-hn4dg\" (UID: \"1b5d7713-5335-4f89-a52b-26c16df76095\") " pod="openshift-network-operator/iptables-alerter-hn4dg"
Jul 06 22:20:00.650640 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.649170    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/49cd65b9-2343-4e21-8907-73358ec673ee-host-slash\") pod \"ovnkube-node-mxl25\" (UID: \"49cd65b9-2343-4e21-8907-73358ec673ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxl25"
Jul 06 22:20:00.650640 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.649210    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvf6t\" (UniqueName: \"kubernetes.io/projected/49cd65b9-2343-4e21-8907-73358ec673ee-kube-api-access-tvf6t\") pod \"ovnkube-node-mxl25\" (UID: \"49cd65b9-2343-4e21-8907-73358ec673ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxl25"
Jul 06 22:20:00.650640 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.649235    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/086f78e8-b3fd-4fc8-9778-850b2750d55f-etc-kubernetes\") pod \"tuned-crtmj\" (UID: \"086f78e8-b3fd-4fc8-9778-850b2750d55f\") " pod="openshift-cluster-node-tuning-operator/tuned-crtmj"
Jul 06 22:20:00.650640 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.649275    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/eeb26f6e-20ef-4054-9dd6-c362f392c2e1-host-run-multus-certs\") pod \"multus-q9jfs\" (UID: \"eeb26f6e-20ef-4054-9dd6-c362f392c2e1\") " pod="openshift-multus/multus-q9jfs"
Jul 06 22:20:00.650640 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.649298    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eeb26f6e-20ef-4054-9dd6-c362f392c2e1-etc-kubernetes\") pod \"multus-q9jfs\" (UID: \"eeb26f6e-20ef-4054-9dd6-c362f392c2e1\") " pod="openshift-multus/multus-q9jfs"
Jul 06 22:20:00.650640 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.649325    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ae29cca7-c528-42da-bc42-0c0961f7638f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2gn7f\" (UID: \"ae29cca7-c528-42da-bc42-0c0961f7638f\") " pod="openshift-multus/multus-additional-cni-plugins-2gn7f"
Jul 06 22:20:00.650640 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.649353    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtgz7\" (UniqueName: \"kubernetes.io/projected/38ae4b4b-d53d-4dbc-bba1-0b252c243af3-kube-api-access-qtgz7\") pod \"aws-ebs-csi-driver-node-57fr6\" (UID: \"38ae4b4b-d53d-4dbc-bba1-0b252c243af3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57fr6"
Jul 06 22:20:00.650640 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.649378    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/086f78e8-b3fd-4fc8-9778-850b2750d55f-etc-sysconfig\") pod \"tuned-crtmj\" (UID: \"086f78e8-b3fd-4fc8-9778-850b2750d55f\") " pod="openshift-cluster-node-tuning-operator/tuned-crtmj"
Jul 06 22:20:00.650640 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.649411    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/086f78e8-b3fd-4fc8-9778-850b2750d55f-run\") pod \"tuned-crtmj\" (UID: \"086f78e8-b3fd-4fc8-9778-850b2750d55f\") " pod="openshift-cluster-node-tuning-operator/tuned-crtmj"
Jul 06 22:20:00.650640 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.649434    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/53db0d7a-f95e-4101-9677-2e12ea5f8b26-serviceca\") pod \"node-ca-t4r7v\" (UID: \"53db0d7a-f95e-4101-9677-2e12ea5f8b26\") " pod="openshift-image-registry/node-ca-t4r7v"
Jul 06 22:20:00.650640 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.649444    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eeb26f6e-20ef-4054-9dd6-c362f392c2e1-multus-conf-dir\") pod \"multus-q9jfs\" (UID: \"eeb26f6e-20ef-4054-9dd6-c362f392c2e1\") " pod="openshift-multus/multus-q9jfs"
Jul 06 22:20:00.650640 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.649483    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ae29cca7-c528-42da-bc42-0c0961f7638f-cni-binary-copy\") pod \"multus-additional-cni-plugins-2gn7f\" (UID: \"ae29cca7-c528-42da-bc42-0c0961f7638f\") " pod="openshift-multus/multus-additional-cni-plugins-2gn7f"
Jul 06 22:20:00.650640 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.649501    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/38ae4b4b-d53d-4dbc-bba1-0b252c243af3-registration-dir\") pod \"aws-ebs-csi-driver-node-57fr6\" (UID: \"38ae4b4b-d53d-4dbc-bba1-0b252c243af3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57fr6"
Jul 06 22:20:00.651081 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.649518    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/086f78e8-b3fd-4fc8-9778-850b2750d55f-etc-modprobe-d\") pod \"tuned-crtmj\" (UID: \"086f78e8-b3fd-4fc8-9778-850b2750d55f\") " pod="openshift-cluster-node-tuning-operator/tuned-crtmj"
Jul 06 22:20:00.651081 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.649533    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/086f78e8-b3fd-4fc8-9778-850b2750d55f-host\") pod \"tuned-crtmj\" (UID: \"086f78e8-b3fd-4fc8-9778-850b2750d55f\") " pod="openshift-cluster-node-tuning-operator/tuned-crtmj"
Jul 06 22:20:00.651081 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.649548    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/eeb26f6e-20ef-4054-9dd6-c362f392c2e1-cni-binary-copy\") pod \"multus-q9jfs\" (UID: \"eeb26f6e-20ef-4054-9dd6-c362f392c2e1\") " pod="openshift-multus/multus-q9jfs"
Jul 06 22:20:00.651081 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.649563    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/eeb26f6e-20ef-4054-9dd6-c362f392c2e1-host-run-k8s-cni-cncf-io\") pod \"multus-q9jfs\" (UID: \"eeb26f6e-20ef-4054-9dd6-c362f392c2e1\") " pod="openshift-multus/multus-q9jfs"
Jul 06 22:20:00.651081 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.649579    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/49cd65b9-2343-4e21-8907-73358ec673ee-run-systemd\") pod \"ovnkube-node-mxl25\" (UID: \"49cd65b9-2343-4e21-8907-73358ec673ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxl25"
Jul 06 22:20:00.651081 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.649605    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/49cd65b9-2343-4e21-8907-73358ec673ee-etc-openvswitch\") pod \"ovnkube-node-mxl25\" (UID: \"49cd65b9-2343-4e21-8907-73358ec673ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxl25"
Jul 06 22:20:00.651081 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.649638    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/49cd65b9-2343-4e21-8907-73358ec673ee-run-openvswitch\") pod \"ovnkube-node-mxl25\" (UID: \"49cd65b9-2343-4e21-8907-73358ec673ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxl25"
Jul 06 22:20:00.651081 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.649644    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ae29cca7-c528-42da-bc42-0c0961f7638f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2gn7f\" (UID: \"ae29cca7-c528-42da-bc42-0c0961f7638f\") " pod="openshift-multus/multus-additional-cni-plugins-2gn7f"
Jul 06 22:20:00.651081 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.649656    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/49cd65b9-2343-4e21-8907-73358ec673ee-node-log\") pod \"ovnkube-node-mxl25\" (UID: \"49cd65b9-2343-4e21-8907-73358ec673ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxl25"
Jul 06 22:20:00.651081 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.649696    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/086f78e8-b3fd-4fc8-9778-850b2750d55f-sys\") pod \"tuned-crtmj\" (UID: \"086f78e8-b3fd-4fc8-9778-850b2750d55f\") " pod="openshift-cluster-node-tuning-operator/tuned-crtmj"
Jul 06 22:20:00.651081 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.649722    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/086f78e8-b3fd-4fc8-9778-850b2750d55f-etc-tuned\") pod \"tuned-crtmj\" (UID: \"086f78e8-b3fd-4fc8-9778-850b2750d55f\") " pod="openshift-cluster-node-tuning-operator/tuned-crtmj"
Jul 06 22:20:00.651081 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.649761    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eeb26f6e-20ef-4054-9dd6-c362f392c2e1-multus-cni-dir\") pod \"multus-q9jfs\" (UID: \"eeb26f6e-20ef-4054-9dd6-c362f392c2e1\") " pod="openshift-multus/multus-q9jfs"
Jul 06 22:20:00.651081 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.649796    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/eeb26f6e-20ef-4054-9dd6-c362f392c2e1-multus-socket-dir-parent\") pod \"multus-q9jfs\" (UID: \"eeb26f6e-20ef-4054-9dd6-c362f392c2e1\") " pod="openshift-multus/multus-q9jfs"
Jul 06 22:20:00.651081 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.649827    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlt5k\" (UniqueName: \"kubernetes.io/projected/ae29cca7-c528-42da-bc42-0c0961f7638f-kube-api-access-dlt5k\") pod \"multus-additional-cni-plugins-2gn7f\" (UID: \"ae29cca7-c528-42da-bc42-0c0961f7638f\") " pod="openshift-multus/multus-additional-cni-plugins-2gn7f"
Jul 06 22:20:00.651755 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.649864    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/49cd65b9-2343-4e21-8907-73358ec673ee-systemd-units\") pod \"ovnkube-node-mxl25\" (UID: \"49cd65b9-2343-4e21-8907-73358ec673ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxl25"
Jul 06 22:20:00.651755 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.649916    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/38ae4b4b-d53d-4dbc-bba1-0b252c243af3-registration-dir\") pod \"aws-ebs-csi-driver-node-57fr6\" (UID: \"38ae4b4b-d53d-4dbc-bba1-0b252c243af3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57fr6"
Jul 06 22:20:00.651755 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.649974    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ae29cca7-c528-42da-bc42-0c0961f7638f-cni-binary-copy\") pod \"multus-additional-cni-plugins-2gn7f\" (UID: \"ae29cca7-c528-42da-bc42-0c0961f7638f\") " pod="openshift-multus/multus-additional-cni-plugins-2gn7f"
Jul 06 22:20:00.651755 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.650018    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/49cd65b9-2343-4e21-8907-73358ec673ee-ovn-node-metrics-cert\") pod \"ovnkube-node-mxl25\" (UID: \"49cd65b9-2343-4e21-8907-73358ec673ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxl25"
Jul 06 22:20:00.651755 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.650039    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eeb26f6e-20ef-4054-9dd6-c362f392c2e1-host-var-lib-cni-bin\") pod \"multus-q9jfs\" (UID: \"eeb26f6e-20ef-4054-9dd6-c362f392c2e1\") " pod="openshift-multus/multus-q9jfs"
Jul 06 22:20:00.651755 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.650077    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/eeb26f6e-20ef-4054-9dd6-c362f392c2e1-hostroot\") pod \"multus-q9jfs\" (UID: \"eeb26f6e-20ef-4054-9dd6-c362f392c2e1\") " pod="openshift-multus/multus-q9jfs"
Jul 06 22:20:00.651755 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.650103    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/53db0d7a-f95e-4101-9677-2e12ea5f8b26-host\") pod \"node-ca-t4r7v\" (UID: \"53db0d7a-f95e-4101-9677-2e12ea5f8b26\") " pod="openshift-image-registry/node-ca-t4r7v"
Jul 06 22:20:00.651755 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.650173    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/53db0d7a-f95e-4101-9677-2e12ea5f8b26-host\") pod \"node-ca-t4r7v\" (UID: \"53db0d7a-f95e-4101-9677-2e12ea5f8b26\") " pod="openshift-image-registry/node-ca-t4r7v"
Jul 06 22:20:00.655411 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.655393    2556 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 06 22:20:00.657002 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:00.656983    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 22:20:00.657002 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:00.657004    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 22:20:00.657183 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:00.657014    2556 projected.go:196] Error preparing data for projected volume kube-api-access-f6qcl for pod openshift-network-diagnostics/network-check-target-s9ptr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 22:20:00.657183 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:00.657068    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5fa5d933-5f4e-4ac8-b844-ac59aea241cb-kube-api-access-f6qcl podName:5fa5d933-5f4e-4ac8-b844-ac59aea241cb nodeName:}" failed. No retries permitted until 2026-07-06 22:20:01.157054122 +0000 UTC m=+1.945077035 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-f6qcl" (UniqueName: "kubernetes.io/projected/5fa5d933-5f4e-4ac8-b844-ac59aea241cb-kube-api-access-f6qcl") pod "network-check-target-s9ptr" (UID: "5fa5d933-5f4e-4ac8-b844-ac59aea241cb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 22:20:00.659424 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.659398    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-775d7\" (UniqueName: \"kubernetes.io/projected/40861954-16ff-4b9b-8e92-d00574ea8a9f-kube-api-access-775d7\") pod \"network-metrics-daemon-fxpqz\" (UID: \"40861954-16ff-4b9b-8e92-d00574ea8a9f\") " pod="openshift-multus/network-metrics-daemon-fxpqz"
Jul 06 22:20:00.660394 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.660375    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtgz7\" (UniqueName: \"kubernetes.io/projected/38ae4b4b-d53d-4dbc-bba1-0b252c243af3-kube-api-access-qtgz7\") pod \"aws-ebs-csi-driver-node-57fr6\" (UID: \"38ae4b4b-d53d-4dbc-bba1-0b252c243af3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57fr6"
Jul 06 22:20:00.660479 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.660401    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r47dj\" (UniqueName: \"kubernetes.io/projected/53db0d7a-f95e-4101-9677-2e12ea5f8b26-kube-api-access-r47dj\") pod \"node-ca-t4r7v\" (UID: \"53db0d7a-f95e-4101-9677-2e12ea5f8b26\") " pod="openshift-image-registry/node-ca-t4r7v"
Jul 06 22:20:00.660707 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.660670    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jnzw\" (UniqueName: \"kubernetes.io/projected/8f22a5f0-92b2-4853-9cce-38758ed34f72-kube-api-access-4jnzw\") pod \"node-resolver-9gpdr\" (UID: \"8f22a5f0-92b2-4853-9cce-38758ed34f72\") " pod="openshift-dns/node-resolver-9gpdr"
Jul 06 22:20:00.660745 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.660734    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlt5k\" (UniqueName: \"kubernetes.io/projected/ae29cca7-c528-42da-bc42-0c0961f7638f-kube-api-access-dlt5k\") pod \"multus-additional-cni-plugins-2gn7f\" (UID: \"ae29cca7-c528-42da-bc42-0c0961f7638f\") " pod="openshift-multus/multus-additional-cni-plugins-2gn7f"
Jul 06 22:20:00.744684 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:20:00.744650    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e0af277c0cb33613563e1e2b5c15bcc.slice/crio-950f3e1fa01fcdb16f677b9daf889ca7f499fa9079d3cf3ac6787c8302049650 WatchSource:0}: Error finding container 950f3e1fa01fcdb16f677b9daf889ca7f499fa9079d3cf3ac6787c8302049650: Status 404 returned error can't find the container with id 950f3e1fa01fcdb16f677b9daf889ca7f499fa9079d3cf3ac6787c8302049650
Jul 06 22:20:00.745181 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:20:00.745147    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod329630a55090cd720672a34e51ec6742.slice/crio-15131e5513757925ac06aae4dfdf1efa5c1bf1eba54ef87ca5275e7e7ce99422 WatchSource:0}: Error finding container 15131e5513757925ac06aae4dfdf1efa5c1bf1eba54ef87ca5275e7e7ce99422: Status 404 returned error can't find the container with id 15131e5513757925ac06aae4dfdf1efa5c1bf1eba54ef87ca5275e7e7ce99422
Jul 06 22:20:00.750424 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.750401    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/086f78e8-b3fd-4fc8-9778-850b2750d55f-etc-kubernetes\") pod \"tuned-crtmj\" (UID: \"086f78e8-b3fd-4fc8-9778-850b2750d55f\") " pod="openshift-cluster-node-tuning-operator/tuned-crtmj"
Jul 06 22:20:00.750512 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.750439    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/eeb26f6e-20ef-4054-9dd6-c362f392c2e1-host-run-multus-certs\") pod \"multus-q9jfs\" (UID: \"eeb26f6e-20ef-4054-9dd6-c362f392c2e1\") " pod="openshift-multus/multus-q9jfs"
Jul 06 22:20:00.750512 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.750466    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eeb26f6e-20ef-4054-9dd6-c362f392c2e1-etc-kubernetes\") pod \"multus-q9jfs\" (UID: \"eeb26f6e-20ef-4054-9dd6-c362f392c2e1\") " pod="openshift-multus/multus-q9jfs"
Jul 06 22:20:00.750512 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.750505    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/086f78e8-b3fd-4fc8-9778-850b2750d55f-etc-sysconfig\") pod \"tuned-crtmj\" (UID: \"086f78e8-b3fd-4fc8-9778-850b2750d55f\") " pod="openshift-cluster-node-tuning-operator/tuned-crtmj"
Jul 06 22:20:00.750672 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.750512    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/eeb26f6e-20ef-4054-9dd6-c362f392c2e1-host-run-multus-certs\") pod \"multus-q9jfs\" (UID: \"eeb26f6e-20ef-4054-9dd6-c362f392c2e1\") " pod="openshift-multus/multus-q9jfs"
Jul 06 22:20:00.750672 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.750524    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/086f78e8-b3fd-4fc8-9778-850b2750d55f-etc-kubernetes\") pod \"tuned-crtmj\" (UID: \"086f78e8-b3fd-4fc8-9778-850b2750d55f\") " pod="openshift-cluster-node-tuning-operator/tuned-crtmj"
Jul 06 22:20:00.750672 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.750532    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/086f78e8-b3fd-4fc8-9778-850b2750d55f-run\") pod \"tuned-crtmj\" (UID: \"086f78e8-b3fd-4fc8-9778-850b2750d55f\") " pod="openshift-cluster-node-tuning-operator/tuned-crtmj"
Jul 06 22:20:00.750672 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.750556    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eeb26f6e-20ef-4054-9dd6-c362f392c2e1-multus-conf-dir\") pod \"multus-q9jfs\" (UID: \"eeb26f6e-20ef-4054-9dd6-c362f392c2e1\") " pod="openshift-multus/multus-q9jfs"
Jul 06 22:20:00.750672 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.750581    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/086f78e8-b3fd-4fc8-9778-850b2750d55f-etc-modprobe-d\") pod \"tuned-crtmj\" (UID: \"086f78e8-b3fd-4fc8-9778-850b2750d55f\") " pod="openshift-cluster-node-tuning-operator/tuned-crtmj"
Jul 06 22:20:00.750672 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.750583    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eeb26f6e-20ef-4054-9dd6-c362f392c2e1-etc-kubernetes\") pod \"multus-q9jfs\" (UID: \"eeb26f6e-20ef-4054-9dd6-c362f392c2e1\") " pod="openshift-multus/multus-q9jfs"
Jul 06 22:20:00.750672 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.750625    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eeb26f6e-20ef-4054-9dd6-c362f392c2e1-multus-conf-dir\") pod \"multus-q9jfs\" (UID: \"eeb26f6e-20ef-4054-9dd6-c362f392c2e1\") " pod="openshift-multus/multus-q9jfs"
Jul 06 22:20:00.750672 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.750611    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/086f78e8-b3fd-4fc8-9778-850b2750d55f-host\") pod \"tuned-crtmj\" (UID: \"086f78e8-b3fd-4fc8-9778-850b2750d55f\") " pod="openshift-cluster-node-tuning-operator/tuned-crtmj"
Jul 06 22:20:00.750672 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.750569    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/086f78e8-b3fd-4fc8-9778-850b2750d55f-etc-sysconfig\") pod \"tuned-crtmj\" (UID: \"086f78e8-b3fd-4fc8-9778-850b2750d55f\") " pod="openshift-cluster-node-tuning-operator/tuned-crtmj"
Jul 06 22:20:00.750672 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.750663    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/eeb26f6e-20ef-4054-9dd6-c362f392c2e1-cni-binary-copy\") pod \"multus-q9jfs\" (UID: \"eeb26f6e-20ef-4054-9dd6-c362f392c2e1\") " pod="openshift-multus/multus-q9jfs"
Jul 06 22:20:00.751269 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.750676    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/086f78e8-b3fd-4fc8-9778-850b2750d55f-run\") pod \"tuned-crtmj\" (UID: \"086f78e8-b3fd-4fc8-9778-850b2750d55f\") " pod="openshift-cluster-node-tuning-operator/tuned-crtmj"
Jul 06 22:20:00.751269 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.750677    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/086f78e8-b3fd-4fc8-9778-850b2750d55f-host\") pod \"tuned-crtmj\" (UID: \"086f78e8-b3fd-4fc8-9778-850b2750d55f\") " pod="openshift-cluster-node-tuning-operator/tuned-crtmj"
Jul 06 22:20:00.751269 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.750691    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/086f78e8-b3fd-4fc8-9778-850b2750d55f-etc-modprobe-d\") pod \"tuned-crtmj\" (UID: \"086f78e8-b3fd-4fc8-9778-850b2750d55f\") " pod="openshift-cluster-node-tuning-operator/tuned-crtmj"
Jul 06 22:20:00.751269 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.750730    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/eeb26f6e-20ef-4054-9dd6-c362f392c2e1-host-run-k8s-cni-cncf-io\") pod \"multus-q9jfs\" (UID: \"eeb26f6e-20ef-4054-9dd6-c362f392c2e1\") " pod="openshift-multus/multus-q9jfs"
Jul 06 22:20:00.751269 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.750692    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/eeb26f6e-20ef-4054-9dd6-c362f392c2e1-host-run-k8s-cni-cncf-io\") pod \"multus-q9jfs\" (UID: \"eeb26f6e-20ef-4054-9dd6-c362f392c2e1\") " pod="openshift-multus/multus-q9jfs"
Jul 06 22:20:00.751269 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.750773    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/49cd65b9-2343-4e21-8907-73358ec673ee-run-systemd\") pod \"ovnkube-node-mxl25\" (UID: \"49cd65b9-2343-4e21-8907-73358ec673ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxl25"
Jul 06 22:20:00.751269 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.750796    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/49cd65b9-2343-4e21-8907-73358ec673ee-etc-openvswitch\") pod \"ovnkube-node-mxl25\" (UID: \"49cd65b9-2343-4e21-8907-73358ec673ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxl25"
Jul 06 22:20:00.751269 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.750814    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/49cd65b9-2343-4e21-8907-73358ec673ee-run-systemd\") pod \"ovnkube-node-mxl25\" (UID: \"49cd65b9-2343-4e21-8907-73358ec673ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxl25"
Jul 06 22:20:00.751269 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.750852    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/49cd65b9-2343-4e21-8907-73358ec673ee-run-openvswitch\") pod \"ovnkube-node-mxl25\" (UID: \"49cd65b9-2343-4e21-8907-73358ec673ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxl25"
Jul 06 22:20:00.751269 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.750872    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/49cd65b9-2343-4e21-8907-73358ec673ee-node-log\") pod \"ovnkube-node-mxl25\" (UID: \"49cd65b9-2343-4e21-8907-73358ec673ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxl25"
Jul 06 22:20:00.751269 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.750883    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/49cd65b9-2343-4e21-8907-73358ec673ee-etc-openvswitch\") pod \"ovnkube-node-mxl25\" (UID: \"49cd65b9-2343-4e21-8907-73358ec673ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxl25"
Jul 06 22:20:00.751269 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.750887    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/086f78e8-b3fd-4fc8-9778-850b2750d55f-sys\") pod \"tuned-crtmj\" (UID: \"086f78e8-b3fd-4fc8-9778-850b2750d55f\") " pod="openshift-cluster-node-tuning-operator/tuned-crtmj"
Jul 06 22:20:00.751269 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.750921    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/086f78e8-b3fd-4fc8-9778-850b2750d55f-sys\") pod \"tuned-crtmj\" (UID: \"086f78e8-b3fd-4fc8-9778-850b2750d55f\") " pod="openshift-cluster-node-tuning-operator/tuned-crtmj"
Jul 06 22:20:00.751269 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.750946    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/086f78e8-b3fd-4fc8-9778-850b2750d55f-etc-tuned\") pod \"tuned-crtmj\" (UID: \"086f78e8-b3fd-4fc8-9778-850b2750d55f\") " pod="openshift-cluster-node-tuning-operator/tuned-crtmj"
Jul 06 22:20:00.751269 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.750973    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eeb26f6e-20ef-4054-9dd6-c362f392c2e1-multus-cni-dir\") pod \"multus-q9jfs\" (UID: \"eeb26f6e-20ef-4054-9dd6-c362f392c2e1\") " pod="openshift-multus/multus-q9jfs"
Jul 06 22:20:00.751962 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.750974    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/49cd65b9-2343-4e21-8907-73358ec673ee-run-openvswitch\") pod \"ovnkube-node-mxl25\" (UID: \"49cd65b9-2343-4e21-8907-73358ec673ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxl25"
Jul 06 22:20:00.751962 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.750978    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/49cd65b9-2343-4e21-8907-73358ec673ee-node-log\") pod \"ovnkube-node-mxl25\" (UID: \"49cd65b9-2343-4e21-8907-73358ec673ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxl25"
Jul 06 22:20:00.751962 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.750998    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/eeb26f6e-20ef-4054-9dd6-c362f392c2e1-multus-socket-dir-parent\") pod \"multus-q9jfs\" (UID: \"eeb26f6e-20ef-4054-9dd6-c362f392c2e1\") " pod="openshift-multus/multus-q9jfs"
Jul 06 22:20:00.751962 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.751061    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/49cd65b9-2343-4e21-8907-73358ec673ee-systemd-units\") pod \"ovnkube-node-mxl25\" (UID: \"49cd65b9-2343-4e21-8907-73358ec673ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxl25"
Jul 06 22:20:00.751962 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.751135    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eeb26f6e-20ef-4054-9dd6-c362f392c2e1-multus-cni-dir\") pod \"multus-q9jfs\" (UID: \"eeb26f6e-20ef-4054-9dd6-c362f392c2e1\") " pod="openshift-multus/multus-q9jfs"
Jul 06 22:20:00.751962 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.751153    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/49cd65b9-2343-4e21-8907-73358ec673ee-ovn-node-metrics-cert\") pod \"ovnkube-node-mxl25\" (UID: \"49cd65b9-2343-4e21-8907-73358ec673ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxl25"
Jul 06 22:20:00.751962 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.751155    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/49cd65b9-2343-4e21-8907-73358ec673ee-systemd-units\") pod \"ovnkube-node-mxl25\" (UID: \"49cd65b9-2343-4e21-8907-73358ec673ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxl25"
Jul 06 22:20:00.751962 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.751180    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eeb26f6e-20ef-4054-9dd6-c362f392c2e1-host-var-lib-cni-bin\") pod \"multus-q9jfs\" (UID: \"eeb26f6e-20ef-4054-9dd6-c362f392c2e1\") " pod="openshift-multus/multus-q9jfs"
Jul 06 22:20:00.751962 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.751208    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/eeb26f6e-20ef-4054-9dd6-c362f392c2e1-hostroot\") pod \"multus-q9jfs\" (UID: \"eeb26f6e-20ef-4054-9dd6-c362f392c2e1\") " pod="openshift-multus/multus-q9jfs"
Jul 06 22:20:00.751962 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.751236    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/086f78e8-b3fd-4fc8-9778-850b2750d55f-lib-modules\") pod \"tuned-crtmj\" (UID: \"086f78e8-b3fd-4fc8-9778-850b2750d55f\") " pod="openshift-cluster-node-tuning-operator/tuned-crtmj"
Jul 06 22:20:00.751962 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.751139    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/eeb26f6e-20ef-4054-9dd6-c362f392c2e1-multus-socket-dir-parent\") pod \"multus-q9jfs\" (UID: \"eeb26f6e-20ef-4054-9dd6-c362f392c2e1\") " pod="openshift-multus/multus-q9jfs"
Jul 06 22:20:00.751962 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.751262    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bb153ded-966e-45d9-a254-2c3b68f5196d-konnectivity-ca\") pod \"konnectivity-agent-prtqv\" (UID: \"bb153ded-966e-45d9-a254-2c3b68f5196d\") " pod="kube-system/konnectivity-agent-prtqv"
Jul 06 22:20:00.751962 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.751309    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/eeb26f6e-20ef-4054-9dd6-c362f392c2e1-cni-binary-copy\") pod \"multus-q9jfs\" (UID: \"eeb26f6e-20ef-4054-9dd6-c362f392c2e1\") " pod="openshift-multus/multus-q9jfs"
Jul 06 22:20:00.751962 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.751328    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tb26w\" (UniqueName: \"kubernetes.io/projected/1b5d7713-5335-4f89-a52b-26c16df76095-kube-api-access-tb26w\") pod \"iptables-alerter-hn4dg\" (UID: \"1b5d7713-5335-4f89-a52b-26c16df76095\") " pod="openshift-network-operator/iptables-alerter-hn4dg"
Jul 06 22:20:00.751962 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.751385    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/49cd65b9-2343-4e21-8907-73358ec673ee-host-kubelet\") pod \"ovnkube-node-mxl25\" (UID: \"49cd65b9-2343-4e21-8907-73358ec673ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxl25"
Jul 06 22:20:00.753668 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.751430    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/49cd65b9-2343-4e21-8907-73358ec673ee-env-overrides\") pod \"ovnkube-node-mxl25\" (UID: \"49cd65b9-2343-4e21-8907-73358ec673ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxl25"
Jul 06 22:20:00.753668 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.751464    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/086f78e8-b3fd-4fc8-9778-850b2750d55f-etc-sysctl-d\") pod \"tuned-crtmj\" (UID: \"086f78e8-b3fd-4fc8-9778-850b2750d55f\") " pod="openshift-cluster-node-tuning-operator/tuned-crtmj"
Jul 06 22:20:00.753668 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.751688    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/eeb26f6e-20ef-4054-9dd6-c362f392c2e1-hostroot\") pod \"multus-q9jfs\" (UID: \"eeb26f6e-20ef-4054-9dd6-c362f392c2e1\") " pod="openshift-multus/multus-q9jfs"
Jul 06 22:20:00.753668 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.751743    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eeb26f6e-20ef-4054-9dd6-c362f392c2e1-host-var-lib-cni-bin\") pod \"multus-q9jfs\" (UID: \"eeb26f6e-20ef-4054-9dd6-c362f392c2e1\") " pod="openshift-multus/multus-q9jfs"
Jul 06 22:20:00.753668 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.751768    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/086f78e8-b3fd-4fc8-9778-850b2750d55f-tmp\") pod \"tuned-crtmj\" (UID: \"086f78e8-b3fd-4fc8-9778-850b2750d55f\") " pod="openshift-cluster-node-tuning-operator/tuned-crtmj"
Jul 06 22:20:00.753668 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.751787    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/49cd65b9-2343-4e21-8907-73358ec673ee-host-kubelet\") pod \"ovnkube-node-mxl25\" (UID: \"49cd65b9-2343-4e21-8907-73358ec673ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxl25"
Jul 06 22:20:00.753668 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.751797    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/49cd65b9-2343-4e21-8907-73358ec673ee-log-socket\") pod \"ovnkube-node-mxl25\" (UID: \"49cd65b9-2343-4e21-8907-73358ec673ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxl25"
Jul 06 22:20:00.753668 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.751895    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/086f78e8-b3fd-4fc8-9778-850b2750d55f-lib-modules\") pod \"tuned-crtmj\" (UID: \"086f78e8-b3fd-4fc8-9778-850b2750d55f\") " pod="openshift-cluster-node-tuning-operator/tuned-crtmj"
Jul 06 22:20:00.753668 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.751938    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/49cd65b9-2343-4e21-8907-73358ec673ee-log-socket\") pod \"ovnkube-node-mxl25\" (UID: \"49cd65b9-2343-4e21-8907-73358ec673ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxl25"
Jul 06 22:20:00.753668 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.751966    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/49cd65b9-2343-4e21-8907-73358ec673ee-ovnkube-script-lib\") pod \"ovnkube-node-mxl25\" (UID: \"49cd65b9-2343-4e21-8907-73358ec673ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxl25"
Jul 06 22:20:00.753668 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.751997    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7ae74a76-a46c-483e-8f38-a4bc4b9f0b03-kubelet-config\") pod \"global-pull-secret-syncer-626fl\" (UID: \"7ae74a76-a46c-483e-8f38-a4bc4b9f0b03\") " pod="kube-system/global-pull-secret-syncer-626fl"
Jul 06 22:20:00.753668 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.752024    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eeb26f6e-20ef-4054-9dd6-c362f392c2e1-host-run-netns\") pod \"multus-q9jfs\" (UID: \"eeb26f6e-20ef-4054-9dd6-c362f392c2e1\") " pod="openshift-multus/multus-q9jfs"
Jul 06 22:20:00.753668 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.752050    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/49cd65b9-2343-4e21-8907-73358ec673ee-host-run-netns\") pod \"ovnkube-node-mxl25\" (UID: \"49cd65b9-2343-4e21-8907-73358ec673ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxl25"
Jul 06 22:20:00.753668 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.752075    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/086f78e8-b3fd-4fc8-9778-850b2750d55f-etc-sysctl-conf\") pod \"tuned-crtmj\" (UID: \"086f78e8-b3fd-4fc8-9778-850b2750d55f\") " pod="openshift-cluster-node-tuning-operator/tuned-crtmj"
Jul 06 22:20:00.753668 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.752120    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/eeb26f6e-20ef-4054-9dd6-c362f392c2e1-os-release\") pod \"multus-q9jfs\" (UID: \"eeb26f6e-20ef-4054-9dd6-c362f392c2e1\") " pod="openshift-multus/multus-q9jfs"
Jul 06 22:20:00.754564 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.752156    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eeb26f6e-20ef-4054-9dd6-c362f392c2e1-host-run-netns\") pod \"multus-q9jfs\" (UID: \"eeb26f6e-20ef-4054-9dd6-c362f392c2e1\") " pod="openshift-multus/multus-q9jfs"
Jul 06 22:20:00.754564 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.752159    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/eeb26f6e-20ef-4054-9dd6-c362f392c2e1-host-var-lib-cni-multus\") pod \"multus-q9jfs\" (UID: \"eeb26f6e-20ef-4054-9dd6-c362f392c2e1\") " pod="openshift-multus/multus-q9jfs"
Jul 06 22:20:00.754564 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.752212    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/eeb26f6e-20ef-4054-9dd6-c362f392c2e1-host-var-lib-cni-multus\") pod \"multus-q9jfs\" (UID: \"eeb26f6e-20ef-4054-9dd6-c362f392c2e1\") " pod="openshift-multus/multus-q9jfs"
Jul 06 22:20:00.754564 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.752272    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/49cd65b9-2343-4e21-8907-73358ec673ee-host-run-netns\") pod \"ovnkube-node-mxl25\" (UID: \"49cd65b9-2343-4e21-8907-73358ec673ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxl25"
Jul 06 22:20:00.754564 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.752333    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7ae74a76-a46c-483e-8f38-a4bc4b9f0b03-kubelet-config\") pod \"global-pull-secret-syncer-626fl\" (UID: \"7ae74a76-a46c-483e-8f38-a4bc4b9f0b03\") " pod="kube-system/global-pull-secret-syncer-626fl"
Jul 06 22:20:00.754564 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.752343    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/49cd65b9-2343-4e21-8907-73358ec673ee-env-overrides\") pod \"ovnkube-node-mxl25\" (UID: \"49cd65b9-2343-4e21-8907-73358ec673ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxl25"
Jul 06 22:20:00.754564 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.752782    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/eeb26f6e-20ef-4054-9dd6-c362f392c2e1-os-release\") pod \"multus-q9jfs\" (UID: \"eeb26f6e-20ef-4054-9dd6-c362f392c2e1\") " pod="openshift-multus/multus-q9jfs"
Jul 06 22:20:00.754564 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.752794    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bb153ded-966e-45d9-a254-2c3b68f5196d-konnectivity-ca\") pod \"konnectivity-agent-prtqv\" (UID: \"bb153ded-966e-45d9-a254-2c3b68f5196d\") " pod="kube-system/konnectivity-agent-prtqv"
Jul 06 22:20:00.754564 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.752396    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/086f78e8-b3fd-4fc8-9778-850b2750d55f-etc-sysctl-conf\") pod \"tuned-crtmj\" (UID: \"086f78e8-b3fd-4fc8-9778-850b2750d55f\") " pod="openshift-cluster-node-tuning-operator/tuned-crtmj"
Jul 06 22:20:00.754564 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.752411    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbj72\" (UniqueName: \"kubernetes.io/projected/eeb26f6e-20ef-4054-9dd6-c362f392c2e1-kube-api-access-nbj72\") pod \"multus-q9jfs\" (UID: \"eeb26f6e-20ef-4054-9dd6-c362f392c2e1\") " pod="openshift-multus/multus-q9jfs"
Jul 06 22:20:00.754564 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.752913    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/086f78e8-b3fd-4fc8-9778-850b2750d55f-etc-sysctl-d\") pod \"tuned-crtmj\" (UID: \"086f78e8-b3fd-4fc8-9778-850b2750d55f\") " pod="openshift-cluster-node-tuning-operator/tuned-crtmj"
Jul 06 22:20:00.754564 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.752949    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/49cd65b9-2343-4e21-8907-73358ec673ee-host-run-ovn-kubernetes\") pod \"ovnkube-node-mxl25\" (UID: \"49cd65b9-2343-4e21-8907-73358ec673ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxl25"
Jul 06 22:20:00.754564 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.752994    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/49cd65b9-2343-4e21-8907-73358ec673ee-host-cni-netd\") pod \"ovnkube-node-mxl25\" (UID: \"49cd65b9-2343-4e21-8907-73358ec673ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxl25"
Jul 06 22:20:00.754564 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.753024    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bb153ded-966e-45d9-a254-2c3b68f5196d-agent-certs\") pod \"konnectivity-agent-prtqv\" (UID: \"bb153ded-966e-45d9-a254-2c3b68f5196d\") " pod="kube-system/konnectivity-agent-prtqv"
Jul 06 22:20:00.754564 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.753066    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/086f78e8-b3fd-4fc8-9778-850b2750d55f-etc-systemd\") pod \"tuned-crtmj\" (UID: \"086f78e8-b3fd-4fc8-9778-850b2750d55f\") " pod="openshift-cluster-node-tuning-operator/tuned-crtmj"
Jul 06 22:20:00.755310 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.753107    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eeb26f6e-20ef-4054-9dd6-c362f392c2e1-system-cni-dir\") pod \"multus-q9jfs\" (UID: \"eeb26f6e-20ef-4054-9dd6-c362f392c2e1\") " pod="openshift-multus/multus-q9jfs"
Jul 06 22:20:00.755310 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.753172    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eeb26f6e-20ef-4054-9dd6-c362f392c2e1-cnibin\") pod \"multus-q9jfs\" (UID: \"eeb26f6e-20ef-4054-9dd6-c362f392c2e1\") " pod="openshift-multus/multus-q9jfs"
Jul 06 22:20:00.755310 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.753205    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/49cd65b9-2343-4e21-8907-73358ec673ee-var-lib-openvswitch\") pod \"ovnkube-node-mxl25\" (UID: \"49cd65b9-2343-4e21-8907-73358ec673ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxl25"
Jul 06 22:20:00.755310 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.753238    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/49cd65b9-2343-4e21-8907-73358ec673ee-host-cni-bin\") pod \"ovnkube-node-mxl25\" (UID: \"49cd65b9-2343-4e21-8907-73358ec673ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxl25"
Jul 06 22:20:00.755310 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.753279    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztplj\" (UniqueName: \"kubernetes.io/projected/086f78e8-b3fd-4fc8-9778-850b2750d55f-kube-api-access-ztplj\") pod \"tuned-crtmj\" (UID: \"086f78e8-b3fd-4fc8-9778-850b2750d55f\") " pod="openshift-cluster-node-tuning-operator/tuned-crtmj"
Jul 06 22:20:00.755310 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.753316    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/eeb26f6e-20ef-4054-9dd6-c362f392c2e1-multus-daemon-config\") pod \"multus-q9jfs\" (UID: \"eeb26f6e-20ef-4054-9dd6-c362f392c2e1\") " pod="openshift-multus/multus-q9jfs"
Jul 06 22:20:00.755310 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.753355    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/49cd65b9-2343-4e21-8907-73358ec673ee-ovnkube-config\") pod \"ovnkube-node-mxl25\" (UID: \"49cd65b9-2343-4e21-8907-73358ec673ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxl25"
Jul 06 22:20:00.755310 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.753392    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ae74a76-a46c-483e-8f38-a4bc4b9f0b03-original-pull-secret\") pod \"global-pull-secret-syncer-626fl\" (UID: \"7ae74a76-a46c-483e-8f38-a4bc4b9f0b03\") " pod="kube-system/global-pull-secret-syncer-626fl"
Jul 06 22:20:00.755310 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.753407    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/49cd65b9-2343-4e21-8907-73358ec673ee-ovnkube-script-lib\") pod \"ovnkube-node-mxl25\" (UID: \"49cd65b9-2343-4e21-8907-73358ec673ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxl25"
Jul 06 22:20:00.755310 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.753420    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/086f78e8-b3fd-4fc8-9778-850b2750d55f-var-lib-kubelet\") pod \"tuned-crtmj\" (UID: \"086f78e8-b3fd-4fc8-9778-850b2750d55f\") " pod="openshift-cluster-node-tuning-operator/tuned-crtmj"
Jul 06 22:20:00.755310 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.753459    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eeb26f6e-20ef-4054-9dd6-c362f392c2e1-host-var-lib-kubelet\") pod \"multus-q9jfs\" (UID: \"eeb26f6e-20ef-4054-9dd6-c362f392c2e1\") " pod="openshift-multus/multus-q9jfs"
Jul 06 22:20:00.755310 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.753481    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/49cd65b9-2343-4e21-8907-73358ec673ee-var-lib-openvswitch\") pod \"ovnkube-node-mxl25\" (UID: \"49cd65b9-2343-4e21-8907-73358ec673ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxl25"
Jul 06 22:20:00.755310 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.753481    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/086f78e8-b3fd-4fc8-9778-850b2750d55f-etc-systemd\") pod \"tuned-crtmj\" (UID: \"086f78e8-b3fd-4fc8-9778-850b2750d55f\") " pod="openshift-cluster-node-tuning-operator/tuned-crtmj"
Jul 06 22:20:00.755310 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.753497    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1b5d7713-5335-4f89-a52b-26c16df76095-host-slash\") pod \"iptables-alerter-hn4dg\" (UID: \"1b5d7713-5335-4f89-a52b-26c16df76095\") " pod="openshift-network-operator/iptables-alerter-hn4dg"
Jul 06 22:20:00.755310 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.753536    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eeb26f6e-20ef-4054-9dd6-c362f392c2e1-system-cni-dir\") pod \"multus-q9jfs\" (UID: \"eeb26f6e-20ef-4054-9dd6-c362f392c2e1\") " pod="openshift-multus/multus-q9jfs"
Jul 06 22:20:00.756128 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.753553    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1b5d7713-5335-4f89-a52b-26c16df76095-host-slash\") pod \"iptables-alerter-hn4dg\" (UID: \"1b5d7713-5335-4f89-a52b-26c16df76095\") " pod="openshift-network-operator/iptables-alerter-hn4dg"
Jul 06 22:20:00.756128 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.753553    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/49cd65b9-2343-4e21-8907-73358ec673ee-run-ovn\") pod \"ovnkube-node-mxl25\" (UID: \"49cd65b9-2343-4e21-8907-73358ec673ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxl25"
Jul 06 22:20:00.756128 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.753608    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7ae74a76-a46c-483e-8f38-a4bc4b9f0b03-dbus\") pod \"global-pull-secret-syncer-626fl\" (UID: \"7ae74a76-a46c-483e-8f38-a4bc4b9f0b03\") " pod="kube-system/global-pull-secret-syncer-626fl"
Jul 06 22:20:00.756128 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.753603    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eeb26f6e-20ef-4054-9dd6-c362f392c2e1-cnibin\") pod \"multus-q9jfs\" (UID: \"eeb26f6e-20ef-4054-9dd6-c362f392c2e1\") " pod="openshift-multus/multus-q9jfs"
Jul 06 22:20:00.756128 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.753652    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/49cd65b9-2343-4e21-8907-73358ec673ee-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mxl25\" (UID: \"49cd65b9-2343-4e21-8907-73358ec673ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxl25"
Jul 06 22:20:00.756128 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.753684    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/49cd65b9-2343-4e21-8907-73358ec673ee-run-ovn\") pod \"ovnkube-node-mxl25\" (UID: \"49cd65b9-2343-4e21-8907-73358ec673ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxl25"
Jul 06 22:20:00.756128 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.753688    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1b5d7713-5335-4f89-a52b-26c16df76095-iptables-alerter-script\") pod \"iptables-alerter-hn4dg\" (UID: \"1b5d7713-5335-4f89-a52b-26c16df76095\") " pod="openshift-network-operator/iptables-alerter-hn4dg"
Jul 06 22:20:00.756128 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.753722    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/086f78e8-b3fd-4fc8-9778-850b2750d55f-etc-tuned\") pod \"tuned-crtmj\" (UID: \"086f78e8-b3fd-4fc8-9778-850b2750d55f\") " pod="openshift-cluster-node-tuning-operator/tuned-crtmj"
Jul 06 22:20:00.756128 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.753732    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/49cd65b9-2343-4e21-8907-73358ec673ee-host-slash\") pod \"ovnkube-node-mxl25\" (UID: \"49cd65b9-2343-4e21-8907-73358ec673ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxl25"
Jul 06 22:20:00.756128 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.753768    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/49cd65b9-2343-4e21-8907-73358ec673ee-host-cni-bin\") pod \"ovnkube-node-mxl25\" (UID: \"49cd65b9-2343-4e21-8907-73358ec673ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxl25"
Jul 06 22:20:00.756128 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.753779    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvf6t\" (UniqueName: \"kubernetes.io/projected/49cd65b9-2343-4e21-8907-73358ec673ee-kube-api-access-tvf6t\") pod \"ovnkube-node-mxl25\" (UID: \"49cd65b9-2343-4e21-8907-73358ec673ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxl25"
Jul 06 22:20:00.756128 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.754213    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/49cd65b9-2343-4e21-8907-73358ec673ee-host-slash\") pod \"ovnkube-node-mxl25\" (UID: \"49cd65b9-2343-4e21-8907-73358ec673ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxl25"
Jul 06 22:20:00.756128 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.754315    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1b5d7713-5335-4f89-a52b-26c16df76095-iptables-alerter-script\") pod \"iptables-alerter-hn4dg\" (UID: \"1b5d7713-5335-4f89-a52b-26c16df76095\") " pod="openshift-network-operator/iptables-alerter-hn4dg"
Jul 06 22:20:00.756128 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.754477    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 22:20:00.756128 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.754483    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eeb26f6e-20ef-4054-9dd6-c362f392c2e1-host-var-lib-kubelet\") pod \"multus-q9jfs\" (UID: \"eeb26f6e-20ef-4054-9dd6-c362f392c2e1\") " pod="openshift-multus/multus-q9jfs"
Jul 06 22:20:00.756864 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.754493    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/eeb26f6e-20ef-4054-9dd6-c362f392c2e1-multus-daemon-config\") pod \"multus-q9jfs\" (UID: \"eeb26f6e-20ef-4054-9dd6-c362f392c2e1\") " pod="openshift-multus/multus-q9jfs"
Jul 06 22:20:00.756864 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:00.754602    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 22:20:00.756864 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:00.754665    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ae74a76-a46c-483e-8f38-a4bc4b9f0b03-original-pull-secret podName:7ae74a76-a46c-483e-8f38-a4bc4b9f0b03 nodeName:}" failed. No retries permitted until 2026-07-06 22:20:01.254645329 +0000 UTC m=+2.042668260 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7ae74a76-a46c-483e-8f38-a4bc4b9f0b03-original-pull-secret") pod "global-pull-secret-syncer-626fl" (UID: "7ae74a76-a46c-483e-8f38-a4bc4b9f0b03") : object "kube-system"/"original-pull-secret" not registered
Jul 06 22:20:00.756864 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.754778    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/086f78e8-b3fd-4fc8-9778-850b2750d55f-var-lib-kubelet\") pod \"tuned-crtmj\" (UID: \"086f78e8-b3fd-4fc8-9778-850b2750d55f\") " pod="openshift-cluster-node-tuning-operator/tuned-crtmj"
Jul 06 22:20:00.756864 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.754893    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/49cd65b9-2343-4e21-8907-73358ec673ee-host-run-ovn-kubernetes\") pod \"ovnkube-node-mxl25\" (UID: \"49cd65b9-2343-4e21-8907-73358ec673ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxl25"
Jul 06 22:20:00.756864 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.754914    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/49cd65b9-2343-4e21-8907-73358ec673ee-ovnkube-config\") pod \"ovnkube-node-mxl25\" (UID: \"49cd65b9-2343-4e21-8907-73358ec673ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxl25"
Jul 06 22:20:00.756864 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.754944    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/49cd65b9-2343-4e21-8907-73358ec673ee-host-cni-netd\") pod \"ovnkube-node-mxl25\" (UID: \"49cd65b9-2343-4e21-8907-73358ec673ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxl25"
Jul 06 22:20:00.756864 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.755036    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/49cd65b9-2343-4e21-8907-73358ec673ee-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mxl25\" (UID: \"49cd65b9-2343-4e21-8907-73358ec673ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxl25"
Jul 06 22:20:00.756864 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.755069    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7ae74a76-a46c-483e-8f38-a4bc4b9f0b03-dbus\") pod \"global-pull-secret-syncer-626fl\" (UID: \"7ae74a76-a46c-483e-8f38-a4bc4b9f0b03\") " pod="kube-system/global-pull-secret-syncer-626fl"
Jul 06 22:20:00.756864 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.755384    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/086f78e8-b3fd-4fc8-9778-850b2750d55f-tmp\") pod \"tuned-crtmj\" (UID: \"086f78e8-b3fd-4fc8-9778-850b2750d55f\") " pod="openshift-cluster-node-tuning-operator/tuned-crtmj"
Jul 06 22:20:00.756864 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.755899    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bb153ded-966e-45d9-a254-2c3b68f5196d-agent-certs\") pod \"konnectivity-agent-prtqv\" (UID: \"bb153ded-966e-45d9-a254-2c3b68f5196d\") " pod="kube-system/konnectivity-agent-prtqv"
Jul 06 22:20:00.756864 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.756025    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/49cd65b9-2343-4e21-8907-73358ec673ee-ovn-node-metrics-cert\") pod \"ovnkube-node-mxl25\" (UID: \"49cd65b9-2343-4e21-8907-73358ec673ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxl25"
Jul 06 22:20:00.769416 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.769391    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztplj\" (UniqueName: \"kubernetes.io/projected/086f78e8-b3fd-4fc8-9778-850b2750d55f-kube-api-access-ztplj\") pod \"tuned-crtmj\" (UID: \"086f78e8-b3fd-4fc8-9778-850b2750d55f\") " pod="openshift-cluster-node-tuning-operator/tuned-crtmj"
Jul 06 22:20:00.769515 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.769490    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tb26w\" (UniqueName: \"kubernetes.io/projected/1b5d7713-5335-4f89-a52b-26c16df76095-kube-api-access-tb26w\") pod \"iptables-alerter-hn4dg\" (UID: \"1b5d7713-5335-4f89-a52b-26c16df76095\") " pod="openshift-network-operator/iptables-alerter-hn4dg"
Jul 06 22:20:00.769731 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.769715    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbj72\" (UniqueName: \"kubernetes.io/projected/eeb26f6e-20ef-4054-9dd6-c362f392c2e1-kube-api-access-nbj72\") pod \"multus-q9jfs\" (UID: \"eeb26f6e-20ef-4054-9dd6-c362f392c2e1\") " pod="openshift-multus/multus-q9jfs"
Jul 06 22:20:00.769836 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.769815    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvf6t\" (UniqueName: \"kubernetes.io/projected/49cd65b9-2343-4e21-8907-73358ec673ee-kube-api-access-tvf6t\") pod \"ovnkube-node-mxl25\" (UID: \"49cd65b9-2343-4e21-8907-73358ec673ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxl25"
Jul 06 22:20:00.770415 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.770396    2556 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 22:20:00.865904 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.865850    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9gpdr"
Jul 06 22:20:00.871410 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.871396    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-t4r7v"
Jul 06 22:20:00.876544 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:20:00.876512    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f22a5f0_92b2_4853_9cce_38758ed34f72.slice/crio-01b13737a6bd7dc0f888cc2f16be860f2d922bbfced4c0260a69a4677e256461 WatchSource:0}: Error finding container 01b13737a6bd7dc0f888cc2f16be860f2d922bbfced4c0260a69a4677e256461: Status 404 returned error can't find the container with id 01b13737a6bd7dc0f888cc2f16be860f2d922bbfced4c0260a69a4677e256461
Jul 06 22:20:00.880880 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:20:00.880860    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53db0d7a_f95e_4101_9677_2e12ea5f8b26.slice/crio-59ac8b63f831d190d2a8e4a777b4e14b69d8ffe1cfabfd90ee5b607688cc9674 WatchSource:0}: Error finding container 59ac8b63f831d190d2a8e4a777b4e14b69d8ffe1cfabfd90ee5b607688cc9674: Status 404 returned error can't find the container with id 59ac8b63f831d190d2a8e4a777b4e14b69d8ffe1cfabfd90ee5b607688cc9674
Jul 06 22:20:00.886023 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.886006    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2gn7f"
Jul 06 22:20:00.895046 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:20:00.895025    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae29cca7_c528_42da_bc42_0c0961f7638f.slice/crio-613cbae8188a52b0e0d05541d2e0fbe19dc5fdbd013aa9fb9bfc3824343d58e9 WatchSource:0}: Error finding container 613cbae8188a52b0e0d05541d2e0fbe19dc5fdbd013aa9fb9bfc3824343d58e9: Status 404 returned error can't find the container with id 613cbae8188a52b0e0d05541d2e0fbe19dc5fdbd013aa9fb9bfc3824343d58e9
Jul 06 22:20:00.901246 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.901226    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57fr6"
Jul 06 22:20:00.909191 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:20:00.909159    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38ae4b4b_d53d_4dbc_bba1_0b252c243af3.slice/crio-dacd97a098231398d0472708245827e69832bf2594e62153a042650a59c54db7 WatchSource:0}: Error finding container dacd97a098231398d0472708245827e69832bf2594e62153a042650a59c54db7: Status 404 returned error can't find the container with id dacd97a098231398d0472708245827e69832bf2594e62153a042650a59c54db7
Jul 06 22:20:00.921411 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.921393    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-q9jfs"
Jul 06 22:20:00.928938 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:20:00.928916    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeeb26f6e_20ef_4054_9dd6_c362f392c2e1.slice/crio-aea748f362bb0e37d9348bf6565afad61360b3f05ad0b435f9c0044b20fb2967 WatchSource:0}: Error finding container aea748f362bb0e37d9348bf6565afad61360b3f05ad0b435f9c0044b20fb2967: Status 404 returned error can't find the container with id aea748f362bb0e37d9348bf6565afad61360b3f05ad0b435f9c0044b20fb2967
Jul 06 22:20:00.938323 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.938297    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hn4dg"
Jul 06 22:20:00.945772 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:20:00.945745    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b5d7713_5335_4f89_a52b_26c16df76095.slice/crio-3e86eef79860e9dca04d2d7dd33757079c94b572c338548672178f3bc92a8097 WatchSource:0}: Error finding container 3e86eef79860e9dca04d2d7dd33757079c94b572c338548672178f3bc92a8097: Status 404 returned error can't find the container with id 3e86eef79860e9dca04d2d7dd33757079c94b572c338548672178f3bc92a8097
Jul 06 22:20:00.952247 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.952220    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mxl25"
Jul 06 22:20:00.960000 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:20:00.959983    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49cd65b9_2343_4e21_8907_73358ec673ee.slice/crio-d20bbe265d6d37db2c686a6d8da6ea771357777e072839f84d3c28861d809bf0 WatchSource:0}: Error finding container d20bbe265d6d37db2c686a6d8da6ea771357777e072839f84d3c28861d809bf0: Status 404 returned error can't find the container with id d20bbe265d6d37db2c686a6d8da6ea771357777e072839f84d3c28861d809bf0
Jul 06 22:20:00.969144 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.969125    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-prtqv"
Jul 06 22:20:00.974051 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:00.974034    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-crtmj"
Jul 06 22:20:00.976924 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:20:00.976905    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb153ded_966e_45d9_a254_2c3b68f5196d.slice/crio-59d391df7f5d28e3f7ab86baeed95b787f9192ee384012fb48568a5d13d9538e WatchSource:0}: Error finding container 59d391df7f5d28e3f7ab86baeed95b787f9192ee384012fb48568a5d13d9538e: Status 404 returned error can't find the container with id 59d391df7f5d28e3f7ab86baeed95b787f9192ee384012fb48568a5d13d9538e
Jul 06 22:20:00.982880 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:20:00.982862    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod086f78e8_b3fd_4fc8_9778_850b2750d55f.slice/crio-aa93e0f3c1a47db9ec32a3ed0fd09ea7e1f20323bf69768a6be34cc79f9d8c07 WatchSource:0}: Error finding container aa93e0f3c1a47db9ec32a3ed0fd09ea7e1f20323bf69768a6be34cc79f9d8c07: Status 404 returned error can't find the container with id aa93e0f3c1a47db9ec32a3ed0fd09ea7e1f20323bf69768a6be34cc79f9d8c07
Jul 06 22:20:01.112396 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:01.112372    2556 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 22:20:01.158425 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:01.158358    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40861954-16ff-4b9b-8e92-d00574ea8a9f-metrics-certs\") pod \"network-metrics-daemon-fxpqz\" (UID: \"40861954-16ff-4b9b-8e92-d00574ea8a9f\") " pod="openshift-multus/network-metrics-daemon-fxpqz"
Jul 06 22:20:01.158425 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:01.158394    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6qcl\" (UniqueName: \"kubernetes.io/projected/5fa5d933-5f4e-4ac8-b844-ac59aea241cb-kube-api-access-f6qcl\") pod \"network-check-target-s9ptr\" (UID: \"5fa5d933-5f4e-4ac8-b844-ac59aea241cb\") " pod="openshift-network-diagnostics/network-check-target-s9ptr"
Jul 06 22:20:01.158577 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:01.158512    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 22:20:01.158577 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:01.158535    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 22:20:01.158577 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:01.158559    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 22:20:01.158577 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:01.158565    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40861954-16ff-4b9b-8e92-d00574ea8a9f-metrics-certs podName:40861954-16ff-4b9b-8e92-d00574ea8a9f nodeName:}" failed. No retries permitted until 2026-07-06 22:20:02.158549957 +0000 UTC m=+2.946572870 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/40861954-16ff-4b9b-8e92-d00574ea8a9f-metrics-certs") pod "network-metrics-daemon-fxpqz" (UID: "40861954-16ff-4b9b-8e92-d00574ea8a9f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 22:20:01.158577 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:01.158573    2556 projected.go:196] Error preparing data for projected volume kube-api-access-f6qcl for pod openshift-network-diagnostics/network-check-target-s9ptr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 22:20:01.158765 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:01.158628    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5fa5d933-5f4e-4ac8-b844-ac59aea241cb-kube-api-access-f6qcl podName:5fa5d933-5f4e-4ac8-b844-ac59aea241cb nodeName:}" failed. No retries permitted until 2026-07-06 22:20:02.158608564 +0000 UTC m=+2.946631504 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-f6qcl" (UniqueName: "kubernetes.io/projected/5fa5d933-5f4e-4ac8-b844-ac59aea241cb-kube-api-access-f6qcl") pod "network-check-target-s9ptr" (UID: "5fa5d933-5f4e-4ac8-b844-ac59aea241cb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 22:20:01.259408 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:01.259382    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ae74a76-a46c-483e-8f38-a4bc4b9f0b03-original-pull-secret\") pod \"global-pull-secret-syncer-626fl\" (UID: \"7ae74a76-a46c-483e-8f38-a4bc4b9f0b03\") " pod="kube-system/global-pull-secret-syncer-626fl"
Jul 06 22:20:01.259533 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:01.259516    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 22:20:01.259586 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:01.259570    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ae74a76-a46c-483e-8f38-a4bc4b9f0b03-original-pull-secret podName:7ae74a76-a46c-483e-8f38-a4bc4b9f0b03 nodeName:}" failed. No retries permitted until 2026-07-06 22:20:02.259556607 +0000 UTC m=+3.047579525 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7ae74a76-a46c-483e-8f38-a4bc4b9f0b03-original-pull-secret") pod "global-pull-secret-syncer-626fl" (UID: "7ae74a76-a46c-483e-8f38-a4bc4b9f0b03") : object "kube-system"/"original-pull-secret" not registered
Jul 06 22:20:01.606911 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:01.606749    2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 22:15:01 +0000 UTC" deadline="2028-01-17 00:07:01.964300755 +0000 UTC"
Jul 06 22:20:01.606911 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:01.606790    2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13417h47m0.357515509s"
Jul 06 22:20:01.665258 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:01.665198    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-52.ec2.internal" event={"ID":"4e0af277c0cb33613563e1e2b5c15bcc","Type":"ContainerStarted","Data":"950f3e1fa01fcdb16f677b9daf889ca7f499fa9079d3cf3ac6787c8302049650"}
Jul 06 22:20:01.671127 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:01.671078    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-52.ec2.internal" event={"ID":"329630a55090cd720672a34e51ec6742","Type":"ContainerStarted","Data":"15131e5513757925ac06aae4dfdf1efa5c1bf1eba54ef87ca5275e7e7ce99422"}
Jul 06 22:20:01.682665 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:01.682595    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-crtmj" event={"ID":"086f78e8-b3fd-4fc8-9778-850b2750d55f","Type":"ContainerStarted","Data":"aa93e0f3c1a47db9ec32a3ed0fd09ea7e1f20323bf69768a6be34cc79f9d8c07"}
Jul 06 22:20:01.687879 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:01.687837    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-prtqv" event={"ID":"bb153ded-966e-45d9-a254-2c3b68f5196d","Type":"ContainerStarted","Data":"59d391df7f5d28e3f7ab86baeed95b787f9192ee384012fb48568a5d13d9538e"}
Jul 06 22:20:01.691343 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:01.691082    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mxl25" event={"ID":"49cd65b9-2343-4e21-8907-73358ec673ee","Type":"ContainerStarted","Data":"d20bbe265d6d37db2c686a6d8da6ea771357777e072839f84d3c28861d809bf0"}
Jul 06 22:20:01.695676 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:01.695642    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hn4dg" event={"ID":"1b5d7713-5335-4f89-a52b-26c16df76095","Type":"ContainerStarted","Data":"3e86eef79860e9dca04d2d7dd33757079c94b572c338548672178f3bc92a8097"}
Jul 06 22:20:01.700237 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:01.700212    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-q9jfs" event={"ID":"eeb26f6e-20ef-4054-9dd6-c362f392c2e1","Type":"ContainerStarted","Data":"aea748f362bb0e37d9348bf6565afad61360b3f05ad0b435f9c0044b20fb2967"}
Jul 06 22:20:01.713242 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:01.713215    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57fr6" event={"ID":"38ae4b4b-d53d-4dbc-bba1-0b252c243af3","Type":"ContainerStarted","Data":"dacd97a098231398d0472708245827e69832bf2594e62153a042650a59c54db7"}
Jul 06 22:20:01.717044 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:01.716977    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-t4r7v" event={"ID":"53db0d7a-f95e-4101-9677-2e12ea5f8b26","Type":"ContainerStarted","Data":"59ac8b63f831d190d2a8e4a777b4e14b69d8ffe1cfabfd90ee5b607688cc9674"}
Jul 06 22:20:01.722862 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:01.722834    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9gpdr" event={"ID":"8f22a5f0-92b2-4853-9cce-38758ed34f72","Type":"ContainerStarted","Data":"01b13737a6bd7dc0f888cc2f16be860f2d922bbfced4c0260a69a4677e256461"}
Jul 06 22:20:01.734243 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:01.734198    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2gn7f" event={"ID":"ae29cca7-c528-42da-bc42-0c0961f7638f","Type":"ContainerStarted","Data":"613cbae8188a52b0e0d05541d2e0fbe19dc5fdbd013aa9fb9bfc3824343d58e9"}
Jul 06 22:20:01.977558 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:01.977475    2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 22:20:02.168486 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:02.168450    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40861954-16ff-4b9b-8e92-d00574ea8a9f-metrics-certs\") pod \"network-metrics-daemon-fxpqz\" (UID: \"40861954-16ff-4b9b-8e92-d00574ea8a9f\") " pod="openshift-multus/network-metrics-daemon-fxpqz"
Jul 06 22:20:02.168662 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:02.168505    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6qcl\" (UniqueName: \"kubernetes.io/projected/5fa5d933-5f4e-4ac8-b844-ac59aea241cb-kube-api-access-f6qcl\") pod \"network-check-target-s9ptr\" (UID: \"5fa5d933-5f4e-4ac8-b844-ac59aea241cb\") " pod="openshift-network-diagnostics/network-check-target-s9ptr"
Jul 06 22:20:02.168737 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:02.168716    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 22:20:02.168790 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:02.168737    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 22:20:02.168790 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:02.168750    2556 projected.go:196] Error preparing data for projected volume kube-api-access-f6qcl for pod openshift-network-diagnostics/network-check-target-s9ptr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 22:20:02.168894 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:02.168815    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5fa5d933-5f4e-4ac8-b844-ac59aea241cb-kube-api-access-f6qcl podName:5fa5d933-5f4e-4ac8-b844-ac59aea241cb nodeName:}" failed. No retries permitted until 2026-07-06 22:20:04.168795452 +0000 UTC m=+4.956818368 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-f6qcl" (UniqueName: "kubernetes.io/projected/5fa5d933-5f4e-4ac8-b844-ac59aea241cb-kube-api-access-f6qcl") pod "network-check-target-s9ptr" (UID: "5fa5d933-5f4e-4ac8-b844-ac59aea241cb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 22:20:02.169290 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:02.169229    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 22:20:02.169405 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:02.169298    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40861954-16ff-4b9b-8e92-d00574ea8a9f-metrics-certs podName:40861954-16ff-4b9b-8e92-d00574ea8a9f nodeName:}" failed. No retries permitted until 2026-07-06 22:20:04.169279715 +0000 UTC m=+4.957302646 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/40861954-16ff-4b9b-8e92-d00574ea8a9f-metrics-certs") pod "network-metrics-daemon-fxpqz" (UID: "40861954-16ff-4b9b-8e92-d00574ea8a9f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 22:20:02.269886 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:02.269789    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ae74a76-a46c-483e-8f38-a4bc4b9f0b03-original-pull-secret\") pod \"global-pull-secret-syncer-626fl\" (UID: \"7ae74a76-a46c-483e-8f38-a4bc4b9f0b03\") " pod="kube-system/global-pull-secret-syncer-626fl"
Jul 06 22:20:02.270052 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:02.270003    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 22:20:02.270141 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:02.270064    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ae74a76-a46c-483e-8f38-a4bc4b9f0b03-original-pull-secret podName:7ae74a76-a46c-483e-8f38-a4bc4b9f0b03 nodeName:}" failed. No retries permitted until 2026-07-06 22:20:04.270045654 +0000 UTC m=+5.058068574 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7ae74a76-a46c-483e-8f38-a4bc4b9f0b03-original-pull-secret") pod "global-pull-secret-syncer-626fl" (UID: "7ae74a76-a46c-483e-8f38-a4bc4b9f0b03") : object "kube-system"/"original-pull-secret" not registered
Jul 06 22:20:02.607294 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:02.607125    2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 22:15:01 +0000 UTC" deadline="2028-01-17 17:03:14.370888521 +0000 UTC"
Jul 06 22:20:02.607294 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:02.607190    2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13434h43m11.763703453s"
Jul 06 22:20:02.648309 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:02.647444    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s9ptr"
Jul 06 22:20:02.648309 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:02.647574    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s9ptr" podUID="5fa5d933-5f4e-4ac8-b844-ac59aea241cb"
Jul 06 22:20:02.648309 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:02.647994    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-626fl"
Jul 06 22:20:02.648309 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:02.648083    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-626fl" podUID="7ae74a76-a46c-483e-8f38-a4bc4b9f0b03"
Jul 06 22:20:02.648309 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:02.648150    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxpqz"
Jul 06 22:20:02.648309 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:02.648253    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxpqz" podUID="40861954-16ff-4b9b-8e92-d00574ea8a9f"
Jul 06 22:20:04.187869 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:04.187834    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40861954-16ff-4b9b-8e92-d00574ea8a9f-metrics-certs\") pod \"network-metrics-daemon-fxpqz\" (UID: \"40861954-16ff-4b9b-8e92-d00574ea8a9f\") " pod="openshift-multus/network-metrics-daemon-fxpqz"
Jul 06 22:20:04.188353 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:04.187887    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6qcl\" (UniqueName: \"kubernetes.io/projected/5fa5d933-5f4e-4ac8-b844-ac59aea241cb-kube-api-access-f6qcl\") pod \"network-check-target-s9ptr\" (UID: \"5fa5d933-5f4e-4ac8-b844-ac59aea241cb\") " pod="openshift-network-diagnostics/network-check-target-s9ptr"
Jul 06 22:20:04.188353 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:04.188065    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 22:20:04.188353 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:04.188088    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 22:20:04.188353 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:04.188102    2556 projected.go:196] Error preparing data for projected volume kube-api-access-f6qcl for pod openshift-network-diagnostics/network-check-target-s9ptr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 22:20:04.188353 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:04.188180    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5fa5d933-5f4e-4ac8-b844-ac59aea241cb-kube-api-access-f6qcl podName:5fa5d933-5f4e-4ac8-b844-ac59aea241cb nodeName:}" failed. No retries permitted until 2026-07-06 22:20:08.18813769 +0000 UTC m=+8.976160626 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-f6qcl" (UniqueName: "kubernetes.io/projected/5fa5d933-5f4e-4ac8-b844-ac59aea241cb-kube-api-access-f6qcl") pod "network-check-target-s9ptr" (UID: "5fa5d933-5f4e-4ac8-b844-ac59aea241cb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 22:20:04.188353 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:04.188265    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 22:20:04.188353 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:04.188305    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40861954-16ff-4b9b-8e92-d00574ea8a9f-metrics-certs podName:40861954-16ff-4b9b-8e92-d00574ea8a9f nodeName:}" failed. No retries permitted until 2026-07-06 22:20:08.188292427 +0000 UTC m=+8.976315352 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/40861954-16ff-4b9b-8e92-d00574ea8a9f-metrics-certs") pod "network-metrics-daemon-fxpqz" (UID: "40861954-16ff-4b9b-8e92-d00574ea8a9f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 22:20:04.288529 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:04.288497    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ae74a76-a46c-483e-8f38-a4bc4b9f0b03-original-pull-secret\") pod \"global-pull-secret-syncer-626fl\" (UID: \"7ae74a76-a46c-483e-8f38-a4bc4b9f0b03\") " pod="kube-system/global-pull-secret-syncer-626fl"
Jul 06 22:20:04.288698 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:04.288685    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 22:20:04.288774 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:04.288749    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ae74a76-a46c-483e-8f38-a4bc4b9f0b03-original-pull-secret podName:7ae74a76-a46c-483e-8f38-a4bc4b9f0b03 nodeName:}" failed. No retries permitted until 2026-07-06 22:20:08.288727879 +0000 UTC m=+9.076750814 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7ae74a76-a46c-483e-8f38-a4bc4b9f0b03-original-pull-secret") pod "global-pull-secret-syncer-626fl" (UID: "7ae74a76-a46c-483e-8f38-a4bc4b9f0b03") : object "kube-system"/"original-pull-secret" not registered
Jul 06 22:20:04.647925 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:04.647258    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-626fl"
Jul 06 22:20:04.647925 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:04.647395    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-626fl" podUID="7ae74a76-a46c-483e-8f38-a4bc4b9f0b03"
Jul 06 22:20:04.647925 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:04.647798    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxpqz"
Jul 06 22:20:04.647925 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:04.647907    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxpqz" podUID="40861954-16ff-4b9b-8e92-d00574ea8a9f"
Jul 06 22:20:04.648367 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:04.647957    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s9ptr"
Jul 06 22:20:04.648367 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:04.648027    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s9ptr" podUID="5fa5d933-5f4e-4ac8-b844-ac59aea241cb"
Jul 06 22:20:06.647340 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:06.647281    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxpqz"
Jul 06 22:20:06.647340 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:06.647321    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s9ptr"
Jul 06 22:20:06.647892 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:06.647426    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxpqz" podUID="40861954-16ff-4b9b-8e92-d00574ea8a9f"
Jul 06 22:20:06.647892 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:06.647499    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s9ptr" podUID="5fa5d933-5f4e-4ac8-b844-ac59aea241cb"
Jul 06 22:20:06.647892 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:06.647559    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-626fl"
Jul 06 22:20:06.647892 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:06.647638    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-626fl" podUID="7ae74a76-a46c-483e-8f38-a4bc4b9f0b03"
Jul 06 22:20:08.223941 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:08.223889    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40861954-16ff-4b9b-8e92-d00574ea8a9f-metrics-certs\") pod \"network-metrics-daemon-fxpqz\" (UID: \"40861954-16ff-4b9b-8e92-d00574ea8a9f\") " pod="openshift-multus/network-metrics-daemon-fxpqz"
Jul 06 22:20:08.223941 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:08.223945    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6qcl\" (UniqueName: \"kubernetes.io/projected/5fa5d933-5f4e-4ac8-b844-ac59aea241cb-kube-api-access-f6qcl\") pod \"network-check-target-s9ptr\" (UID: \"5fa5d933-5f4e-4ac8-b844-ac59aea241cb\") " pod="openshift-network-diagnostics/network-check-target-s9ptr"
Jul 06 22:20:08.224514 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:08.224113    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 22:20:08.224514 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:08.224124    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 22:20:08.224514 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:08.224133    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 22:20:08.224514 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:08.224168    2556 projected.go:196] Error preparing data for projected volume kube-api-access-f6qcl for pod openshift-network-diagnostics/network-check-target-s9ptr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 22:20:08.224514 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:08.224206    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40861954-16ff-4b9b-8e92-d00574ea8a9f-metrics-certs podName:40861954-16ff-4b9b-8e92-d00574ea8a9f nodeName:}" failed. No retries permitted until 2026-07-06 22:20:16.224182547 +0000 UTC m=+17.012205475 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/40861954-16ff-4b9b-8e92-d00574ea8a9f-metrics-certs") pod "network-metrics-daemon-fxpqz" (UID: "40861954-16ff-4b9b-8e92-d00574ea8a9f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 22:20:08.224514 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:08.224231    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5fa5d933-5f4e-4ac8-b844-ac59aea241cb-kube-api-access-f6qcl podName:5fa5d933-5f4e-4ac8-b844-ac59aea241cb nodeName:}" failed. No retries permitted until 2026-07-06 22:20:16.224218827 +0000 UTC m=+17.012241750 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-f6qcl" (UniqueName: "kubernetes.io/projected/5fa5d933-5f4e-4ac8-b844-ac59aea241cb-kube-api-access-f6qcl") pod "network-check-target-s9ptr" (UID: "5fa5d933-5f4e-4ac8-b844-ac59aea241cb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 22:20:08.324754 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:08.324718    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ae74a76-a46c-483e-8f38-a4bc4b9f0b03-original-pull-secret\") pod \"global-pull-secret-syncer-626fl\" (UID: \"7ae74a76-a46c-483e-8f38-a4bc4b9f0b03\") " pod="kube-system/global-pull-secret-syncer-626fl"
Jul 06 22:20:08.324936 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:08.324905    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 22:20:08.325008 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:08.324989    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ae74a76-a46c-483e-8f38-a4bc4b9f0b03-original-pull-secret podName:7ae74a76-a46c-483e-8f38-a4bc4b9f0b03 nodeName:}" failed. No retries permitted until 2026-07-06 22:20:16.324964484 +0000 UTC m=+17.112987424 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7ae74a76-a46c-483e-8f38-a4bc4b9f0b03-original-pull-secret") pod "global-pull-secret-syncer-626fl" (UID: "7ae74a76-a46c-483e-8f38-a4bc4b9f0b03") : object "kube-system"/"original-pull-secret" not registered
Jul 06 22:20:08.647057 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:08.646940    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxpqz"
Jul 06 22:20:08.647057 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:08.646981    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s9ptr"
Jul 06 22:20:08.647057 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:08.646940    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-626fl"
Jul 06 22:20:08.647333 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:08.647083    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxpqz" podUID="40861954-16ff-4b9b-8e92-d00574ea8a9f"
Jul 06 22:20:08.647333 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:08.647174    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-626fl" podUID="7ae74a76-a46c-483e-8f38-a4bc4b9f0b03"
Jul 06 22:20:08.647333 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:08.647244    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s9ptr" podUID="5fa5d933-5f4e-4ac8-b844-ac59aea241cb"
Jul 06 22:20:10.647118 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:10.647071    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s9ptr"
Jul 06 22:20:10.647118 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:10.647111    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-626fl"
Jul 06 22:20:10.647626 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:10.647075    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxpqz"
Jul 06 22:20:10.647626 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:10.647213    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s9ptr" podUID="5fa5d933-5f4e-4ac8-b844-ac59aea241cb"
Jul 06 22:20:10.647626 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:10.647324    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxpqz" podUID="40861954-16ff-4b9b-8e92-d00574ea8a9f"
Jul 06 22:20:10.647626 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:10.647405    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-626fl" podUID="7ae74a76-a46c-483e-8f38-a4bc4b9f0b03"
Jul 06 22:20:12.647374 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:12.647340    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s9ptr"
Jul 06 22:20:12.647832 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:12.647382    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-626fl"
Jul 06 22:20:12.647832 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:12.647382    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxpqz"
Jul 06 22:20:12.647832 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:12.647466    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s9ptr" podUID="5fa5d933-5f4e-4ac8-b844-ac59aea241cb"
Jul 06 22:20:12.647832 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:12.647557    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-626fl" podUID="7ae74a76-a46c-483e-8f38-a4bc4b9f0b03"
Jul 06 22:20:12.647832 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:12.647649    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxpqz" podUID="40861954-16ff-4b9b-8e92-d00574ea8a9f"
Jul 06 22:20:14.647494 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:14.647460    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s9ptr"
Jul 06 22:20:14.647991 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:14.647505    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxpqz"
Jul 06 22:20:14.647991 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:14.647505    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-626fl"
Jul 06 22:20:14.647991 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:14.647595    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s9ptr" podUID="5fa5d933-5f4e-4ac8-b844-ac59aea241cb"
Jul 06 22:20:14.647991 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:14.647734    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxpqz" podUID="40861954-16ff-4b9b-8e92-d00574ea8a9f"
Jul 06 22:20:14.647991 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:14.647829    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-626fl" podUID="7ae74a76-a46c-483e-8f38-a4bc4b9f0b03"
Jul 06 22:20:16.288134 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:16.288085    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40861954-16ff-4b9b-8e92-d00574ea8a9f-metrics-certs\") pod \"network-metrics-daemon-fxpqz\" (UID: \"40861954-16ff-4b9b-8e92-d00574ea8a9f\") " pod="openshift-multus/network-metrics-daemon-fxpqz"
Jul 06 22:20:16.288529 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:16.288146    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6qcl\" (UniqueName: \"kubernetes.io/projected/5fa5d933-5f4e-4ac8-b844-ac59aea241cb-kube-api-access-f6qcl\") pod \"network-check-target-s9ptr\" (UID: \"5fa5d933-5f4e-4ac8-b844-ac59aea241cb\") " pod="openshift-network-diagnostics/network-check-target-s9ptr"
Jul 06 22:20:16.288529 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:16.288267    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 22:20:16.288529 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:16.288339    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 22:20:16.288529 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:16.288350    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40861954-16ff-4b9b-8e92-d00574ea8a9f-metrics-certs podName:40861954-16ff-4b9b-8e92-d00574ea8a9f nodeName:}" failed. No retries permitted until 2026-07-06 22:20:32.288328512 +0000 UTC m=+33.076351442 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/40861954-16ff-4b9b-8e92-d00574ea8a9f-metrics-certs") pod "network-metrics-daemon-fxpqz" (UID: "40861954-16ff-4b9b-8e92-d00574ea8a9f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 22:20:16.288529 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:16.288357    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 22:20:16.288529 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:16.288369    2556 projected.go:196] Error preparing data for projected volume kube-api-access-f6qcl for pod openshift-network-diagnostics/network-check-target-s9ptr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 22:20:16.288529 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:16.288406    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5fa5d933-5f4e-4ac8-b844-ac59aea241cb-kube-api-access-f6qcl podName:5fa5d933-5f4e-4ac8-b844-ac59aea241cb nodeName:}" failed. No retries permitted until 2026-07-06 22:20:32.288393105 +0000 UTC m=+33.076416032 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-f6qcl" (UniqueName: "kubernetes.io/projected/5fa5d933-5f4e-4ac8-b844-ac59aea241cb-kube-api-access-f6qcl") pod "network-check-target-s9ptr" (UID: "5fa5d933-5f4e-4ac8-b844-ac59aea241cb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 22:20:16.389157 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:16.389128    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ae74a76-a46c-483e-8f38-a4bc4b9f0b03-original-pull-secret\") pod \"global-pull-secret-syncer-626fl\" (UID: \"7ae74a76-a46c-483e-8f38-a4bc4b9f0b03\") " pod="kube-system/global-pull-secret-syncer-626fl"
Jul 06 22:20:16.389348 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:16.389253    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 22:20:16.389348 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:16.389321    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ae74a76-a46c-483e-8f38-a4bc4b9f0b03-original-pull-secret podName:7ae74a76-a46c-483e-8f38-a4bc4b9f0b03 nodeName:}" failed. No retries permitted until 2026-07-06 22:20:32.389302418 +0000 UTC m=+33.177325349 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7ae74a76-a46c-483e-8f38-a4bc4b9f0b03-original-pull-secret") pod "global-pull-secret-syncer-626fl" (UID: "7ae74a76-a46c-483e-8f38-a4bc4b9f0b03") : object "kube-system"/"original-pull-secret" not registered
Jul 06 22:20:16.646790 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:16.646714    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s9ptr"
Jul 06 22:20:16.646944 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:16.646724    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxpqz"
Jul 06 22:20:16.646944 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:16.646836    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s9ptr" podUID="5fa5d933-5f4e-4ac8-b844-ac59aea241cb"
Jul 06 22:20:16.646944 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:16.646724    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-626fl"
Jul 06 22:20:16.646944 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:16.646922    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxpqz" podUID="40861954-16ff-4b9b-8e92-d00574ea8a9f"
Jul 06 22:20:16.647176 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:16.646985    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-626fl" podUID="7ae74a76-a46c-483e-8f38-a4bc4b9f0b03"
Jul 06 22:20:18.646907 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:18.646872    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-626fl"
Jul 06 22:20:18.647371 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:18.646872    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxpqz"
Jul 06 22:20:18.647371 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:18.646989    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-626fl" podUID="7ae74a76-a46c-483e-8f38-a4bc4b9f0b03"
Jul 06 22:20:18.647371 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:18.646872    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s9ptr"
Jul 06 22:20:18.647371 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:18.647119    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxpqz" podUID="40861954-16ff-4b9b-8e92-d00574ea8a9f"
Jul 06 22:20:18.647371 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:18.647186    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s9ptr" podUID="5fa5d933-5f4e-4ac8-b844-ac59aea241cb"
Jul 06 22:20:20.647757 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:20.647530    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-626fl"
Jul 06 22:20:20.648205 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:20.647533    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxpqz"
Jul 06 22:20:20.648205 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:20.647845    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-626fl" podUID="7ae74a76-a46c-483e-8f38-a4bc4b9f0b03"
Jul 06 22:20:20.648205 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:20.647937    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxpqz" podUID="40861954-16ff-4b9b-8e92-d00574ea8a9f"
Jul 06 22:20:20.648205 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:20.647566    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s9ptr"
Jul 06 22:20:20.648205 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:20.648020    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s9ptr" podUID="5fa5d933-5f4e-4ac8-b844-ac59aea241cb"
Jul 06 22:20:21.786171 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:21.786138    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-52.ec2.internal" event={"ID":"4e0af277c0cb33613563e1e2b5c15bcc","Type":"ContainerStarted","Data":"ff74343492d3f3fb9122334ab0e83c39dce67f3aa33eed1d5f3398c641e534f3"}
Jul 06 22:20:21.787775 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:21.787753    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-crtmj" event={"ID":"086f78e8-b3fd-4fc8-9778-850b2750d55f","Type":"ContainerStarted","Data":"161081d4b5be9e900a99f6b88e1502da6fd6ed3c3870f6260304b6c6acdf0a02"}
Jul 06 22:20:21.789687 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:21.789644    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mxl25" event={"ID":"49cd65b9-2343-4e21-8907-73358ec673ee","Type":"ContainerStarted","Data":"0b6cb1fefa12657896e6877a0198fb48660f6a332d936fb272a2d9881468f2bf"}
Jul 06 22:20:21.801092 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:21.801039    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-52.ec2.internal" podStartSLOduration=20.801024441 podStartE2EDuration="20.801024441s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:20:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:20:21.800646996 +0000 UTC m=+22.588669932" watchObservedRunningTime="2026-07-06 22:20:21.801024441 +0000 UTC m=+22.589047374"
Jul 06 22:20:21.818312 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:21.818249    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-crtmj" podStartSLOduration=1.372376459 podStartE2EDuration="21.818231884s" totalImagesPullingTime="20.445855425s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:20:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:20:21.818175735 +0000 UTC m=+22.606198673" watchObservedRunningTime="2026-07-06 22:20:21.818231884 +0000 UTC m=+22.606254817"
Jul 06 22:20:22.646682 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:22.646517    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s9ptr"
Jul 06 22:20:22.646835 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:22.646573    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-626fl"
Jul 06 22:20:22.646835 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:22.646750    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s9ptr" podUID="5fa5d933-5f4e-4ac8-b844-ac59aea241cb"
Jul 06 22:20:22.646835 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:22.646824    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-626fl" podUID="7ae74a76-a46c-483e-8f38-a4bc4b9f0b03"
Jul 06 22:20:22.646942 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:22.646573    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxpqz"
Jul 06 22:20:22.646942 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:22.646904    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxpqz" podUID="40861954-16ff-4b9b-8e92-d00574ea8a9f"
Jul 06 22:20:22.794141 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:22.793944    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-prtqv" event={"ID":"bb153ded-966e-45d9-a254-2c3b68f5196d","Type":"ContainerStarted","Data":"a8fa18afca5ba43c1c1968a0fe106a5b75ff9f37baaf7939158062c3761ab318"}
Jul 06 22:20:22.796722 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:22.796705    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mxl25_49cd65b9-2343-4e21-8907-73358ec673ee/ovn-acl-logging/0.log"
Jul 06 22:20:22.796997 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:22.796979    2556 generic.go:356] "Generic (PLEG): container finished" podID="49cd65b9-2343-4e21-8907-73358ec673ee" containerID="9fdfc63820838ccfa5d692b78e2eb65343eb53d84c37ac6e17c0a2636047b5d9" exitCode=1
Jul 06 22:20:22.797081 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:22.797051    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mxl25" event={"ID":"49cd65b9-2343-4e21-8907-73358ec673ee","Type":"ContainerDied","Data":"9fdfc63820838ccfa5d692b78e2eb65343eb53d84c37ac6e17c0a2636047b5d9"}
Jul 06 22:20:22.797183 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:22.797168    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mxl25" event={"ID":"49cd65b9-2343-4e21-8907-73358ec673ee","Type":"ContainerStarted","Data":"63dde6a9d6f76fb39bef1e1827ccc54e182ea096af2101f35f62b8423d5e4847"}
Jul 06 22:20:22.797286 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:22.797226    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mxl25" event={"ID":"49cd65b9-2343-4e21-8907-73358ec673ee","Type":"ContainerStarted","Data":"d4f60596a50fbe4768d5cbb282ef821f7a237e2b3457395a9ab8d9eca1e279fc"}
Jul 06 22:20:22.797286 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:22.797274    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mxl25" event={"ID":"49cd65b9-2343-4e21-8907-73358ec673ee","Type":"ContainerStarted","Data":"1f39a6eeadee7e51f8d6fce315bac1968bd306f6e081eb304d59140a532a310a"}
Jul 06 22:20:22.797399 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:22.797323    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mxl25" event={"ID":"49cd65b9-2343-4e21-8907-73358ec673ee","Type":"ContainerStarted","Data":"1f0688057e5264c46ce60ddf78b412209f3be0005aba42059b9875b58a254218"}
Jul 06 22:20:22.798432 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:22.798414    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-q9jfs" event={"ID":"eeb26f6e-20ef-4054-9dd6-c362f392c2e1","Type":"ContainerStarted","Data":"4b786bf3ab64a8b2558317826e67df088bfb39d65a1954f4cbddb7b23b5ee69d"}
Jul 06 22:20:22.799693 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:22.799674    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57fr6" event={"ID":"38ae4b4b-d53d-4dbc-bba1-0b252c243af3","Type":"ContainerStarted","Data":"976864f241ffbd97939f8f705a524506ae2e42ac66bafe0f70959d749b8abe5d"}
Jul 06 22:20:22.800994 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:22.800973    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-t4r7v" event={"ID":"53db0d7a-f95e-4101-9677-2e12ea5f8b26","Type":"ContainerStarted","Data":"22e08c27d80a5243669458e27f351332fb9f657308d1970624dcfd771dc2b2d8"}
Jul 06 22:20:22.802221 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:22.802203    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9gpdr" event={"ID":"8f22a5f0-92b2-4853-9cce-38758ed34f72","Type":"ContainerStarted","Data":"ffee3ebb3c5172a95075566bdd74d08508f2bf6db2ef693ae55622e7f642c412"}
Jul 06 22:20:22.803484 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:22.803467    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2gn7f" event={"ID":"ae29cca7-c528-42da-bc42-0c0961f7638f","Type":"ContainerStarted","Data":"712d8f02a75b35e2ec8138d645dfb0786b5066154e15dbd78b9333ebaa746b72"}
Jul 06 22:20:22.804770 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:22.804749    2556 generic.go:356] "Generic (PLEG): container finished" podID="329630a55090cd720672a34e51ec6742" containerID="1da1fcef5ff1014cc1893bbf514f014fadd6b5b2329b9bcbff6f1a605d55377b" exitCode=0
Jul 06 22:20:22.804833 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:22.804810    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-52.ec2.internal" event={"ID":"329630a55090cd720672a34e51ec6742","Type":"ContainerDied","Data":"1da1fcef5ff1014cc1893bbf514f014fadd6b5b2329b9bcbff6f1a605d55377b"}
Jul 06 22:20:22.810637 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:22.810601    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-prtqv" podStartSLOduration=2.358707153 podStartE2EDuration="22.810588169s" totalImagesPullingTime="20.451881016s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:20:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:20:22.809980254 +0000 UTC m=+23.598003187" watchObservedRunningTime="2026-07-06 22:20:22.810588169 +0000 UTC m=+23.598611093"
Jul 06 22:20:22.827806 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:22.827751    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-t4r7v" podStartSLOduration=6.286164962 podStartE2EDuration="22.827740134s" totalImagesPullingTime="16.541575172s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:20:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:20:22.827202795 +0000 UTC m=+23.615225728" watchObservedRunningTime="2026-07-06 22:20:22.827740134 +0000 UTC m=+23.615763067"
Jul 06 22:20:22.845915 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:22.845878    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-q9jfs" podStartSLOduration=2.036216711 podStartE2EDuration="22.845866503s" totalImagesPullingTime="20.809649792s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:20:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:20:22.845637173 +0000 UTC m=+23.633660107" watchObservedRunningTime="2026-07-06 22:20:22.845866503 +0000 UTC m=+23.633889436"
Jul 06 22:20:22.883984 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:22.883931    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-9gpdr" podStartSLOduration=6.338235952 podStartE2EDuration="22.883917416s" totalImagesPullingTime="16.545681464s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:20:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:20:22.883249353 +0000 UTC m=+23.671272286" watchObservedRunningTime="2026-07-06 22:20:22.883917416 +0000 UTC m=+23.671940349"
Jul 06 22:20:23.807423 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:23.807390    2556 generic.go:356] "Generic (PLEG): container finished" podID="ae29cca7-c528-42da-bc42-0c0961f7638f" containerID="712d8f02a75b35e2ec8138d645dfb0786b5066154e15dbd78b9333ebaa746b72" exitCode=0
Jul 06 22:20:23.807854 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:23.807476    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2gn7f" event={"ID":"ae29cca7-c528-42da-bc42-0c0961f7638f","Type":"ContainerDied","Data":"712d8f02a75b35e2ec8138d645dfb0786b5066154e15dbd78b9333ebaa746b72"}
Jul 06 22:20:23.809269 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:23.809249    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-52.ec2.internal" event={"ID":"329630a55090cd720672a34e51ec6742","Type":"ContainerStarted","Data":"d343b6a565040c34652e6fba758e974a0ff0771cb5b6ee782f69d9bf660e88a2"}
Jul 06 22:20:23.810527 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:23.810499    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hn4dg" event={"ID":"1b5d7713-5335-4f89-a52b-26c16df76095","Type":"ContainerStarted","Data":"15cdecc51a23b9e51e727f8991e7f812123b7f95b811eac73f30c3c76c36241d"}
Jul 06 22:20:23.846545 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:23.846505    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-52.ec2.internal" podStartSLOduration=22.846493079 podStartE2EDuration="22.846493079s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:20:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:20:23.846474021 +0000 UTC m=+24.634496963" watchObservedRunningTime="2026-07-06 22:20:23.846493079 +0000 UTC m=+24.634516003"
Jul 06 22:20:23.863086 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:23.863053    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hn4dg" podStartSLOduration=3.380217421 podStartE2EDuration="23.863042309s" totalImagesPullingTime="20.482824888s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:20:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:20:23.860689179 +0000 UTC m=+24.648712109" watchObservedRunningTime="2026-07-06 22:20:23.863042309 +0000 UTC m=+24.651065242"
Jul 06 22:20:23.963230 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:23.963210    2556 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 06 22:20:24.297414 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:24.297393    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-prtqv"
Jul 06 22:20:24.297861 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:24.297845    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-prtqv"
Jul 06 22:20:24.620715 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:24.620614    2556 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T22:20:23.963225237Z","UUID":"5ff62626-b1c4-45d6-ae12-6de19dedc747","Handler":null,"Name":"","Endpoint":""}
Jul 06 22:20:24.622265 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:24.622243    2556 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 06 22:20:24.622380 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:24.622282    2556 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 06 22:20:24.646792 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:24.646768    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s9ptr"
Jul 06 22:20:24.646903 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:24.646865    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s9ptr" podUID="5fa5d933-5f4e-4ac8-b844-ac59aea241cb"
Jul 06 22:20:24.646903 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:24.646770    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-626fl"
Jul 06 22:20:24.647010 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:24.646770    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxpqz"
Jul 06 22:20:24.647010 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:24.646952    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-626fl" podUID="7ae74a76-a46c-483e-8f38-a4bc4b9f0b03"
Jul 06 22:20:24.647118 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:24.647066    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxpqz" podUID="40861954-16ff-4b9b-8e92-d00574ea8a9f"
Jul 06 22:20:24.815056 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:24.814990    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57fr6" event={"ID":"38ae4b4b-d53d-4dbc-bba1-0b252c243af3","Type":"ContainerStarted","Data":"c2cae236e188e4dfd33812ef81af40e23e6caec963cd8b6d3aac75c1c40d1e4f"}
Jul 06 22:20:24.818672 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:24.818649    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mxl25_49cd65b9-2343-4e21-8907-73358ec673ee/ovn-acl-logging/0.log"
Jul 06 22:20:24.819252 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:24.819227    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mxl25" event={"ID":"49cd65b9-2343-4e21-8907-73358ec673ee","Type":"ContainerStarted","Data":"994dc4f5fc961f6bc9c40893cfb288e4bad7071706ac5f17b5b9cbaa4e0e7c09"}
Jul 06 22:20:24.819669 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:24.819634    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-prtqv"
Jul 06 22:20:24.819988 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:24.819968    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-prtqv"
Jul 06 22:20:25.823333 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:25.823290    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57fr6" event={"ID":"38ae4b4b-d53d-4dbc-bba1-0b252c243af3","Type":"ContainerStarted","Data":"f3c5d991c6a23e456f95423aef1821f10714573867dd4e9bf84a8e9ead82be9a"}
Jul 06 22:20:25.843834 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:25.843766    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57fr6" podStartSLOduration=7.001416436 podStartE2EDuration="25.843746378s" totalImagesPullingTime="18.842329942s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:20:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:20:25.843176677 +0000 UTC m=+26.631199621" watchObservedRunningTime="2026-07-06 22:20:25.843746378 +0000 UTC m=+26.631769310"
Jul 06 22:20:26.647363 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:26.647231    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-626fl"
Jul 06 22:20:26.647495 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:26.647273    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxpqz"
Jul 06 22:20:26.647495 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:26.647452    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-626fl" podUID="7ae74a76-a46c-483e-8f38-a4bc4b9f0b03"
Jul 06 22:20:26.647606 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:26.647275    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s9ptr"
Jul 06 22:20:26.647606 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:26.647535    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxpqz" podUID="40861954-16ff-4b9b-8e92-d00574ea8a9f"
Jul 06 22:20:26.647701 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:26.647626    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s9ptr" podUID="5fa5d933-5f4e-4ac8-b844-ac59aea241cb"
Jul 06 22:20:26.828409 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:26.828383    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mxl25_49cd65b9-2343-4e21-8907-73358ec673ee/ovn-acl-logging/0.log"
Jul 06 22:20:26.828902 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:26.828696    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mxl25" event={"ID":"49cd65b9-2343-4e21-8907-73358ec673ee","Type":"ContainerStarted","Data":"20dc088429648b6754be3740f951442d3dfe9c62eb6eddedbe17e94ab4b20625"}
Jul 06 22:20:26.829281 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:26.829245    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mxl25"
Jul 06 22:20:26.829462 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:26.829314    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mxl25"
Jul 06 22:20:26.829462 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:26.829358    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mxl25"
Jul 06 22:20:26.829462 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:26.829403    2556 scope.go:117] "RemoveContainer" containerID="9fdfc63820838ccfa5d692b78e2eb65343eb53d84c37ac6e17c0a2636047b5d9"
Jul 06 22:20:26.846262 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:26.846192    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mxl25"
Jul 06 22:20:26.846883 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:26.846864    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mxl25"
Jul 06 22:20:27.833922 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:27.833899    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mxl25_49cd65b9-2343-4e21-8907-73358ec673ee/ovn-acl-logging/0.log"
Jul 06 22:20:27.834574 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:27.834245    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mxl25" event={"ID":"49cd65b9-2343-4e21-8907-73358ec673ee","Type":"ContainerStarted","Data":"e5f41a74fe332e888a5d37e61141ef5440a7d61524aacc260ac6c4d005063e99"}
Jul 06 22:20:27.864426 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:27.864379    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-mxl25" podStartSLOduration=7.353779908 podStartE2EDuration="27.864365456s" totalImagesPullingTime="20.510585548s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:20:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:20:27.864217568 +0000 UTC m=+28.652240500" watchObservedRunningTime="2026-07-06 22:20:27.864365456 +0000 UTC m=+28.652388389"
Jul 06 22:20:28.646973 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:28.646942    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-626fl"
Jul 06 22:20:28.647426 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:28.646942    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s9ptr"
Jul 06 22:20:28.647426 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:28.647064    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-626fl" podUID="7ae74a76-a46c-483e-8f38-a4bc4b9f0b03"
Jul 06 22:20:28.647426 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:28.646951    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxpqz"
Jul 06 22:20:28.647426 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:28.647166    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s9ptr" podUID="5fa5d933-5f4e-4ac8-b844-ac59aea241cb"
Jul 06 22:20:28.647426 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:28.647208    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxpqz" podUID="40861954-16ff-4b9b-8e92-d00574ea8a9f"
Jul 06 22:20:28.918867 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:28.918474    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-s9ptr"]
Jul 06 22:20:28.918867 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:28.918825    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s9ptr"
Jul 06 22:20:28.919304 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:28.918935    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s9ptr" podUID="5fa5d933-5f4e-4ac8-b844-ac59aea241cb"
Jul 06 22:20:28.919304 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:28.918958    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-626fl"]
Jul 06 22:20:28.919304 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:28.919041    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-626fl"
Jul 06 22:20:28.919304 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:28.919164    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-626fl" podUID="7ae74a76-a46c-483e-8f38-a4bc4b9f0b03"
Jul 06 22:20:28.920688 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:28.920662    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fxpqz"]
Jul 06 22:20:28.920823 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:28.920750    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxpqz"
Jul 06 22:20:28.920879 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:28.920824    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxpqz" podUID="40861954-16ff-4b9b-8e92-d00574ea8a9f"
Jul 06 22:20:30.647000 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:30.646961    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxpqz"
Jul 06 22:20:30.647338 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:30.646960    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-626fl"
Jul 06 22:20:30.647338 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:30.647078    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxpqz" podUID="40861954-16ff-4b9b-8e92-d00574ea8a9f"
Jul 06 22:20:30.647338 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:30.646979    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s9ptr"
Jul 06 22:20:30.647338 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:30.647186    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-626fl" podUID="7ae74a76-a46c-483e-8f38-a4bc4b9f0b03"
Jul 06 22:20:30.647338 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:30.647279    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s9ptr" podUID="5fa5d933-5f4e-4ac8-b844-ac59aea241cb"
Jul 06 22:20:30.843067 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:30.843031    2556 generic.go:356] "Generic (PLEG): container finished" podID="ae29cca7-c528-42da-bc42-0c0961f7638f" containerID="cc7f844a66e232302483cb1dcf4d59c4c5d7ec5cde79825a0756157826f9cad0" exitCode=0
Jul 06 22:20:30.843247 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:30.843077    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2gn7f" event={"ID":"ae29cca7-c528-42da-bc42-0c0961f7638f","Type":"ContainerDied","Data":"cc7f844a66e232302483cb1dcf4d59c4c5d7ec5cde79825a0756157826f9cad0"}
Jul 06 22:20:32.316040 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:32.316009    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40861954-16ff-4b9b-8e92-d00574ea8a9f-metrics-certs\") pod \"network-metrics-daemon-fxpqz\" (UID: \"40861954-16ff-4b9b-8e92-d00574ea8a9f\") " pod="openshift-multus/network-metrics-daemon-fxpqz"
Jul 06 22:20:32.316040 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:32.316042    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6qcl\" (UniqueName: \"kubernetes.io/projected/5fa5d933-5f4e-4ac8-b844-ac59aea241cb-kube-api-access-f6qcl\") pod \"network-check-target-s9ptr\" (UID: \"5fa5d933-5f4e-4ac8-b844-ac59aea241cb\") " pod="openshift-network-diagnostics/network-check-target-s9ptr"
Jul 06 22:20:32.316434 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:32.316166    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 22:20:32.316434 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:32.316188    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 22:20:32.316434 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:32.316203    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 22:20:32.316434 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:32.316213    2556 projected.go:196] Error preparing data for projected volume kube-api-access-f6qcl for pod openshift-network-diagnostics/network-check-target-s9ptr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 22:20:32.316434 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:32.316231    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40861954-16ff-4b9b-8e92-d00574ea8a9f-metrics-certs podName:40861954-16ff-4b9b-8e92-d00574ea8a9f nodeName:}" failed. No retries permitted until 2026-07-06 22:21:04.316215604 +0000 UTC m=+65.104238516 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/40861954-16ff-4b9b-8e92-d00574ea8a9f-metrics-certs") pod "network-metrics-daemon-fxpqz" (UID: "40861954-16ff-4b9b-8e92-d00574ea8a9f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 22:20:32.316434 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:32.316251    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5fa5d933-5f4e-4ac8-b844-ac59aea241cb-kube-api-access-f6qcl podName:5fa5d933-5f4e-4ac8-b844-ac59aea241cb nodeName:}" failed. No retries permitted until 2026-07-06 22:21:04.316239862 +0000 UTC m=+65.104262774 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-f6qcl" (UniqueName: "kubernetes.io/projected/5fa5d933-5f4e-4ac8-b844-ac59aea241cb-kube-api-access-f6qcl") pod "network-check-target-s9ptr" (UID: "5fa5d933-5f4e-4ac8-b844-ac59aea241cb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 22:20:32.416998 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:32.416972    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ae74a76-a46c-483e-8f38-a4bc4b9f0b03-original-pull-secret\") pod \"global-pull-secret-syncer-626fl\" (UID: \"7ae74a76-a46c-483e-8f38-a4bc4b9f0b03\") " pod="kube-system/global-pull-secret-syncer-626fl"
Jul 06 22:20:32.417132 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:32.417084    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 22:20:32.417189 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:32.417143    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ae74a76-a46c-483e-8f38-a4bc4b9f0b03-original-pull-secret podName:7ae74a76-a46c-483e-8f38-a4bc4b9f0b03 nodeName:}" failed. No retries permitted until 2026-07-06 22:21:04.417131028 +0000 UTC m=+65.205153940 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7ae74a76-a46c-483e-8f38-a4bc4b9f0b03-original-pull-secret") pod "global-pull-secret-syncer-626fl" (UID: "7ae74a76-a46c-483e-8f38-a4bc4b9f0b03") : object "kube-system"/"original-pull-secret" not registered
Jul 06 22:20:32.647168 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:32.647069    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s9ptr"
Jul 06 22:20:32.647317 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:32.647176    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxpqz"
Jul 06 22:20:32.647317 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:32.647182    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s9ptr" podUID="5fa5d933-5f4e-4ac8-b844-ac59aea241cb"
Jul 06 22:20:32.647317 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:32.647209    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-626fl"
Jul 06 22:20:32.647317 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:32.647305    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxpqz" podUID="40861954-16ff-4b9b-8e92-d00574ea8a9f"
Jul 06 22:20:32.647492 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:32.647399    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-626fl" podUID="7ae74a76-a46c-483e-8f38-a4bc4b9f0b03"
Jul 06 22:20:32.849402 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:32.849372    2556 generic.go:356] "Generic (PLEG): container finished" podID="ae29cca7-c528-42da-bc42-0c0961f7638f" containerID="c6272400f78beebdb1d742e9eda804fc9a81a2183b0bf638d031855020a37335" exitCode=0
Jul 06 22:20:32.849549 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:32.849416    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2gn7f" event={"ID":"ae29cca7-c528-42da-bc42-0c0961f7638f","Type":"ContainerDied","Data":"c6272400f78beebdb1d742e9eda804fc9a81a2183b0bf638d031855020a37335"}
Jul 06 22:20:33.494983 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:33.494921    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-52.ec2.internal" event="NodeReady"
Jul 06 22:20:33.495330 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:33.495055    2556 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 06 22:20:33.550386 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:33.550356    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-grc74"]
Jul 06 22:20:33.562947 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:33.562926    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-2vdl9"]
Jul 06 22:20:33.563058 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:33.563041    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-grc74"
Jul 06 22:20:33.565779 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:33.565658    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 06 22:20:33.565950 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:33.565929    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 06 22:20:33.566579 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:33.566561    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2q2fk\""
Jul 06 22:20:33.583366 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:33.583216    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-grc74"]
Jul 06 22:20:33.583447 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:33.583386    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2vdl9"]
Jul 06 22:20:33.583447 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:33.583313    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2vdl9"
Jul 06 22:20:33.586405 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:33.586386    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 06 22:20:33.586689 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:33.586673    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 06 22:20:33.586753 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:33.586707    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 06 22:20:33.587013 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:33.586999    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-gmtbp\""
Jul 06 22:20:33.725853 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:33.725817    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d5aca2ef-cead-468c-ae99-bb4988f0b2aa-tmp-dir\") pod \"dns-default-grc74\" (UID: \"d5aca2ef-cead-468c-ae99-bb4988f0b2aa\") " pod="openshift-dns/dns-default-grc74"
Jul 06 22:20:33.725853 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:33.725851    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d02ab32f-a098-478f-a12a-f5bfc6096e27-cert\") pod \"ingress-canary-2vdl9\" (UID: \"d02ab32f-a098-478f-a12a-f5bfc6096e27\") " pod="openshift-ingress-canary/ingress-canary-2vdl9"
Jul 06 22:20:33.726018 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:33.725873    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xr5dc\" (UniqueName: \"kubernetes.io/projected/d5aca2ef-cead-468c-ae99-bb4988f0b2aa-kube-api-access-xr5dc\") pod \"dns-default-grc74\" (UID: \"d5aca2ef-cead-468c-ae99-bb4988f0b2aa\") " pod="openshift-dns/dns-default-grc74"
Jul 06 22:20:33.726018 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:33.725896    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d5aca2ef-cead-468c-ae99-bb4988f0b2aa-config-volume\") pod \"dns-default-grc74\" (UID: \"d5aca2ef-cead-468c-ae99-bb4988f0b2aa\") " pod="openshift-dns/dns-default-grc74"
Jul 06 22:20:33.726018 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:33.725919    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9wv8\" (UniqueName: \"kubernetes.io/projected/d02ab32f-a098-478f-a12a-f5bfc6096e27-kube-api-access-k9wv8\") pod \"ingress-canary-2vdl9\" (UID: \"d02ab32f-a098-478f-a12a-f5bfc6096e27\") " pod="openshift-ingress-canary/ingress-canary-2vdl9"
Jul 06 22:20:33.726018 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:33.725968    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d5aca2ef-cead-468c-ae99-bb4988f0b2aa-metrics-tls\") pod \"dns-default-grc74\" (UID: \"d5aca2ef-cead-468c-ae99-bb4988f0b2aa\") " pod="openshift-dns/dns-default-grc74"
Jul 06 22:20:33.827178 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:33.827149    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d5aca2ef-cead-468c-ae99-bb4988f0b2aa-metrics-tls\") pod \"dns-default-grc74\" (UID: \"d5aca2ef-cead-468c-ae99-bb4988f0b2aa\") " pod="openshift-dns/dns-default-grc74"
Jul 06 22:20:33.827308 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:33.827214    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d5aca2ef-cead-468c-ae99-bb4988f0b2aa-tmp-dir\") pod \"dns-default-grc74\" (UID: \"d5aca2ef-cead-468c-ae99-bb4988f0b2aa\") " pod="openshift-dns/dns-default-grc74"
Jul 06 22:20:33.827308 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:33.827247    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d02ab32f-a098-478f-a12a-f5bfc6096e27-cert\") pod \"ingress-canary-2vdl9\" (UID: \"d02ab32f-a098-478f-a12a-f5bfc6096e27\") " pod="openshift-ingress-canary/ingress-canary-2vdl9"
Jul 06 22:20:33.827308 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:33.827275    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xr5dc\" (UniqueName: \"kubernetes.io/projected/d5aca2ef-cead-468c-ae99-bb4988f0b2aa-kube-api-access-xr5dc\") pod \"dns-default-grc74\" (UID: \"d5aca2ef-cead-468c-ae99-bb4988f0b2aa\") " pod="openshift-dns/dns-default-grc74"
Jul 06 22:20:33.827308 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:33.827296    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d5aca2ef-cead-468c-ae99-bb4988f0b2aa-config-volume\") pod \"dns-default-grc74\" (UID: \"d5aca2ef-cead-468c-ae99-bb4988f0b2aa\") " pod="openshift-dns/dns-default-grc74"
Jul 06 22:20:33.827507 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:33.827324    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 22:20:33.827507 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:33.827316    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9wv8\" (UniqueName: \"kubernetes.io/projected/d02ab32f-a098-478f-a12a-f5bfc6096e27-kube-api-access-k9wv8\") pod \"ingress-canary-2vdl9\" (UID: \"d02ab32f-a098-478f-a12a-f5bfc6096e27\") " pod="openshift-ingress-canary/ingress-canary-2vdl9"
Jul 06 22:20:33.827507 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:33.827391    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5aca2ef-cead-468c-ae99-bb4988f0b2aa-metrics-tls podName:d5aca2ef-cead-468c-ae99-bb4988f0b2aa nodeName:}" failed. No retries permitted until 2026-07-06 22:20:34.327368989 +0000 UTC m=+35.115391903 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d5aca2ef-cead-468c-ae99-bb4988f0b2aa-metrics-tls") pod "dns-default-grc74" (UID: "d5aca2ef-cead-468c-ae99-bb4988f0b2aa") : secret "dns-default-metrics-tls" not found
Jul 06 22:20:33.827780 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:33.827753    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d5aca2ef-cead-468c-ae99-bb4988f0b2aa-tmp-dir\") pod \"dns-default-grc74\" (UID: \"d5aca2ef-cead-468c-ae99-bb4988f0b2aa\") " pod="openshift-dns/dns-default-grc74"
Jul 06 22:20:33.828004 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:33.827984    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d5aca2ef-cead-468c-ae99-bb4988f0b2aa-config-volume\") pod \"dns-default-grc74\" (UID: \"d5aca2ef-cead-468c-ae99-bb4988f0b2aa\") " pod="openshift-dns/dns-default-grc74"
Jul 06 22:20:33.831854 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:33.831828    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d02ab32f-a098-478f-a12a-f5bfc6096e27-cert\") pod \"ingress-canary-2vdl9\" (UID: \"d02ab32f-a098-478f-a12a-f5bfc6096e27\") " pod="openshift-ingress-canary/ingress-canary-2vdl9"
Jul 06 22:20:33.838010 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:33.837978    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9wv8\" (UniqueName: \"kubernetes.io/projected/d02ab32f-a098-478f-a12a-f5bfc6096e27-kube-api-access-k9wv8\") pod \"ingress-canary-2vdl9\" (UID: \"d02ab32f-a098-478f-a12a-f5bfc6096e27\") " pod="openshift-ingress-canary/ingress-canary-2vdl9"
Jul 06 22:20:33.838488 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:33.838470    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xr5dc\" (UniqueName: \"kubernetes.io/projected/d5aca2ef-cead-468c-ae99-bb4988f0b2aa-kube-api-access-xr5dc\") pod \"dns-default-grc74\" (UID: \"d5aca2ef-cead-468c-ae99-bb4988f0b2aa\") " pod="openshift-dns/dns-default-grc74"
Jul 06 22:20:33.891132 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:33.891092    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2vdl9"
Jul 06 22:20:34.103776 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:34.103707    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2vdl9"]
Jul 06 22:20:34.110571 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:20:34.110541    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd02ab32f_a098_478f_a12a_f5bfc6096e27.slice/crio-4b5aac4345620bfd1c455ca7eb00f45e17ac6fb338cddd56825895ee3a44a63f WatchSource:0}: Error finding container 4b5aac4345620bfd1c455ca7eb00f45e17ac6fb338cddd56825895ee3a44a63f: Status 404 returned error can't find the container with id 4b5aac4345620bfd1c455ca7eb00f45e17ac6fb338cddd56825895ee3a44a63f
Jul 06 22:20:34.331590 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:34.331559    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d5aca2ef-cead-468c-ae99-bb4988f0b2aa-metrics-tls\") pod \"dns-default-grc74\" (UID: \"d5aca2ef-cead-468c-ae99-bb4988f0b2aa\") " pod="openshift-dns/dns-default-grc74"
Jul 06 22:20:34.331743 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:34.331704    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 22:20:34.331789 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:34.331763    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5aca2ef-cead-468c-ae99-bb4988f0b2aa-metrics-tls podName:d5aca2ef-cead-468c-ae99-bb4988f0b2aa nodeName:}" failed. No retries permitted until 2026-07-06 22:20:35.33174721 +0000 UTC m=+36.119770121 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d5aca2ef-cead-468c-ae99-bb4988f0b2aa-metrics-tls") pod "dns-default-grc74" (UID: "d5aca2ef-cead-468c-ae99-bb4988f0b2aa") : secret "dns-default-metrics-tls" not found
Jul 06 22:20:34.646525 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:34.646491    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-626fl"
Jul 06 22:20:34.647282 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:34.646500    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxpqz"
Jul 06 22:20:34.647282 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:34.646631    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s9ptr"
Jul 06 22:20:34.649526 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:34.649506    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 22:20:34.649626 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:34.649612    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 22:20:34.650281 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:34.650265    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 22:20:34.650355 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:34.650282    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 22:20:34.650413 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:34.650377    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zplcn\""
Jul 06 22:20:34.650462 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:34.650438    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-t8ckr\""
Jul 06 22:20:34.859496 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:34.859460    2556 generic.go:356] "Generic (PLEG): container finished" podID="ae29cca7-c528-42da-bc42-0c0961f7638f" containerID="5cf7479a845d3173ade4ee2db85a53e2df9728b49e461e18bf89ed6da435728c" exitCode=0
Jul 06 22:20:34.859644 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:34.859539    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2gn7f" event={"ID":"ae29cca7-c528-42da-bc42-0c0961f7638f","Type":"ContainerDied","Data":"5cf7479a845d3173ade4ee2db85a53e2df9728b49e461e18bf89ed6da435728c"}
Jul 06 22:20:34.860979 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:34.860883    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2vdl9" event={"ID":"d02ab32f-a098-478f-a12a-f5bfc6096e27","Type":"ContainerStarted","Data":"4b5aac4345620bfd1c455ca7eb00f45e17ac6fb338cddd56825895ee3a44a63f"}
Jul 06 22:20:35.339165 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:35.339133    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d5aca2ef-cead-468c-ae99-bb4988f0b2aa-metrics-tls\") pod \"dns-default-grc74\" (UID: \"d5aca2ef-cead-468c-ae99-bb4988f0b2aa\") " pod="openshift-dns/dns-default-grc74"
Jul 06 22:20:35.339374 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:35.339304    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 22:20:35.339446 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:35.339400    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5aca2ef-cead-468c-ae99-bb4988f0b2aa-metrics-tls podName:d5aca2ef-cead-468c-ae99-bb4988f0b2aa nodeName:}" failed. No retries permitted until 2026-07-06 22:20:37.339377132 +0000 UTC m=+38.127400056 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d5aca2ef-cead-468c-ae99-bb4988f0b2aa-metrics-tls") pod "dns-default-grc74" (UID: "d5aca2ef-cead-468c-ae99-bb4988f0b2aa") : secret "dns-default-metrics-tls" not found
Jul 06 22:20:37.355384 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:37.355342    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d5aca2ef-cead-468c-ae99-bb4988f0b2aa-metrics-tls\") pod \"dns-default-grc74\" (UID: \"d5aca2ef-cead-468c-ae99-bb4988f0b2aa\") " pod="openshift-dns/dns-default-grc74"
Jul 06 22:20:37.355869 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:37.355536    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 22:20:37.355869 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:37.355620    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5aca2ef-cead-468c-ae99-bb4988f0b2aa-metrics-tls podName:d5aca2ef-cead-468c-ae99-bb4988f0b2aa nodeName:}" failed. No retries permitted until 2026-07-06 22:20:41.355598199 +0000 UTC m=+42.143621113 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d5aca2ef-cead-468c-ae99-bb4988f0b2aa-metrics-tls") pod "dns-default-grc74" (UID: "d5aca2ef-cead-468c-ae99-bb4988f0b2aa") : secret "dns-default-metrics-tls" not found
Jul 06 22:20:37.868437 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:37.868404    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2vdl9" event={"ID":"d02ab32f-a098-478f-a12a-f5bfc6096e27","Type":"ContainerStarted","Data":"24c449bd48bef03743c59f5e055f350e585b8061bebc9603ac96062781359aa4"}
Jul 06 22:20:37.887150 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:37.887077    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-2vdl9" podStartSLOduration=1.8678703749999999 podStartE2EDuration="4.887056864s" totalImagesPullingTime="3.019186489s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:20:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:20:37.886812136 +0000 UTC m=+38.674835069" watchObservedRunningTime="2026-07-06 22:20:37.887056864 +0000 UTC m=+38.675079796"
Jul 06 22:20:39.531760 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.531724    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-dw9bg"]
Jul 06 22:20:39.563587 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.563556    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6pj82"]
Jul 06 22:20:39.563761 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.563721    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-dw9bg"
Jul 06 22:20:39.565986 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.565959    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-dv9ls\""
Jul 06 22:20:39.566135 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.566000    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 06 22:20:39.566415 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.566400    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 06 22:20:39.577468 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.577447    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-px5rm"]
Jul 06 22:20:39.577588 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.577571    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6pj82"
Jul 06 22:20:39.581259 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.581236    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 06 22:20:39.581365 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.581346    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 06 22:20:39.581427 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.581347    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-2lm9t\""
Jul 06 22:20:39.581477 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.581345    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 06 22:20:39.581477 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.581449    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 06 22:20:39.595615 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.595583    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-57c9599b87-5gwnz"]
Jul 06 22:20:39.595726 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.595713    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-px5rm"
Jul 06 22:20:39.598057 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.598027    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 06 22:20:39.598057 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.598034    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 06 22:20:39.598280 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.598172    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 06 22:20:39.598280 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.598239    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-dw4w2\""
Jul 06 22:20:39.598449 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.598429    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 06 22:20:39.604284 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.604266    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 06 22:20:39.619600 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.619582    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-dw9bg"]
Jul 06 22:20:39.619703 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.619616    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6pj82"]
Jul 06 22:20:39.619703 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.619638    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-px5rm"]
Jul 06 22:20:39.619703 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.619656    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-57c9599b87-5gwnz"]
Jul 06 22:20:39.619703 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.619698    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-57c9599b87-5gwnz"
Jul 06 22:20:39.621696 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.621677    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 06 22:20:39.621979 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.621954    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 06 22:20:39.622232 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.622208    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 06 22:20:39.622333 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.622274    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 06 22:20:39.622333 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.622274    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 06 22:20:39.622453 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.622339    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 06 22:20:39.622453 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.622410    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-qvbkz\""
Jul 06 22:20:39.671318 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.671289    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsn47\" (UniqueName: \"kubernetes.io/projected/74fd4789-fb73-431e-98a6-d4785a776a04-kube-api-access-bsn47\") pod \"cluster-monitoring-operator-64786d9cbb-6pj82\" (UID: \"74fd4789-fb73-431e-98a6-d4785a776a04\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6pj82"
Jul 06 22:20:39.671474 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.671352    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkqnl\" (UniqueName: \"kubernetes.io/projected/20e777ec-fc6d-4976-9fb2-2fcf68fd492d-kube-api-access-xkqnl\") pod \"volume-data-source-validator-5d456fdbcd-dw9bg\" (UID: \"20e777ec-fc6d-4976-9fb2-2fcf68fd492d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-dw9bg"
Jul 06 22:20:39.671474 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.671400    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/74fd4789-fb73-431e-98a6-d4785a776a04-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-6pj82\" (UID: \"74fd4789-fb73-431e-98a6-d4785a776a04\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6pj82"
Jul 06 22:20:39.671474 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.671427    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/74fd4789-fb73-431e-98a6-d4785a776a04-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-6pj82\" (UID: \"74fd4789-fb73-431e-98a6-d4785a776a04\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6pj82"
Jul 06 22:20:39.772028 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.771992    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkqnl\" (UniqueName: \"kubernetes.io/projected/20e777ec-fc6d-4976-9fb2-2fcf68fd492d-kube-api-access-xkqnl\") pod \"volume-data-source-validator-5d456fdbcd-dw9bg\" (UID: \"20e777ec-fc6d-4976-9fb2-2fcf68fd492d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-dw9bg"
Jul 06 22:20:39.772028 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.772035    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6f201e5f-d7c9-456c-b7b4-05c2542e5933-snapshots\") pod \"insights-operator-5c847dcfc4-px5rm\" (UID: \"6f201e5f-d7c9-456c-b7b4-05c2542e5933\") " pod="openshift-insights/insights-operator-5c847dcfc4-px5rm"
Jul 06 22:20:39.772250 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.772052    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxdc8\" (UniqueName: \"kubernetes.io/projected/6f201e5f-d7c9-456c-b7b4-05c2542e5933-kube-api-access-dxdc8\") pod \"insights-operator-5c847dcfc4-px5rm\" (UID: \"6f201e5f-d7c9-456c-b7b4-05c2542e5933\") " pod="openshift-insights/insights-operator-5c847dcfc4-px5rm"
Jul 06 22:20:39.772250 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.772205    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/74fd4789-fb73-431e-98a6-d4785a776a04-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-6pj82\" (UID: \"74fd4789-fb73-431e-98a6-d4785a776a04\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6pj82"
Jul 06 22:20:39.772350 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.772251    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6f201e5f-d7c9-456c-b7b4-05c2542e5933-tmp\") pod \"insights-operator-5c847dcfc4-px5rm\" (UID: \"6f201e5f-d7c9-456c-b7b4-05c2542e5933\") " pod="openshift-insights/insights-operator-5c847dcfc4-px5rm"
Jul 06 22:20:39.772350 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.772287    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/6d3dbf73-97c0-4313-938f-10000be128f8-stats-auth\") pod \"router-default-57c9599b87-5gwnz\" (UID: \"6d3dbf73-97c0-4313-938f-10000be128f8\") " pod="openshift-ingress/router-default-57c9599b87-5gwnz"
Jul 06 22:20:39.772350 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.772313    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btf7c\" (UniqueName: \"kubernetes.io/projected/6d3dbf73-97c0-4313-938f-10000be128f8-kube-api-access-btf7c\") pod \"router-default-57c9599b87-5gwnz\" (UID: \"6d3dbf73-97c0-4313-938f-10000be128f8\") " pod="openshift-ingress/router-default-57c9599b87-5gwnz"
Jul 06 22:20:39.772350 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:39.772321    2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 22:20:39.772529 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:39.772382    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74fd4789-fb73-431e-98a6-d4785a776a04-cluster-monitoring-operator-tls podName:74fd4789-fb73-431e-98a6-d4785a776a04 nodeName:}" failed. No retries permitted until 2026-07-06 22:20:40.27236246 +0000 UTC m=+41.060385375 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/74fd4789-fb73-431e-98a6-d4785a776a04-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-6pj82" (UID: "74fd4789-fb73-431e-98a6-d4785a776a04") : secret "cluster-monitoring-operator-tls" not found
Jul 06 22:20:39.772529 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.772447    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/74fd4789-fb73-431e-98a6-d4785a776a04-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-6pj82\" (UID: \"74fd4789-fb73-431e-98a6-d4785a776a04\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6pj82"
Jul 06 22:20:39.772529 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.772492    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6f201e5f-d7c9-456c-b7b4-05c2542e5933-serving-cert\") pod \"insights-operator-5c847dcfc4-px5rm\" (UID: \"6f201e5f-d7c9-456c-b7b4-05c2542e5933\") " pod="openshift-insights/insights-operator-5c847dcfc4-px5rm"
Jul 06 22:20:39.772529 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.772517    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/6d3dbf73-97c0-4313-938f-10000be128f8-default-certificate\") pod \"router-default-57c9599b87-5gwnz\" (UID: \"6d3dbf73-97c0-4313-938f-10000be128f8\") " pod="openshift-ingress/router-default-57c9599b87-5gwnz"
Jul 06 22:20:39.772792 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.772545    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d3dbf73-97c0-4313-938f-10000be128f8-service-ca-bundle\") pod \"router-default-57c9599b87-5gwnz\" (UID: \"6d3dbf73-97c0-4313-938f-10000be128f8\") " pod="openshift-ingress/router-default-57c9599b87-5gwnz"
Jul 06 22:20:39.772792 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.772584    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f201e5f-d7c9-456c-b7b4-05c2542e5933-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-px5rm\" (UID: \"6f201e5f-d7c9-456c-b7b4-05c2542e5933\") " pod="openshift-insights/insights-operator-5c847dcfc4-px5rm"
Jul 06 22:20:39.772792 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.772684    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsn47\" (UniqueName: \"kubernetes.io/projected/74fd4789-fb73-431e-98a6-d4785a776a04-kube-api-access-bsn47\") pod \"cluster-monitoring-operator-64786d9cbb-6pj82\" (UID: \"74fd4789-fb73-431e-98a6-d4785a776a04\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6pj82"
Jul 06 22:20:39.772792 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.772712    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f201e5f-d7c9-456c-b7b4-05c2542e5933-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-px5rm\" (UID: \"6f201e5f-d7c9-456c-b7b4-05c2542e5933\") " pod="openshift-insights/insights-operator-5c847dcfc4-px5rm"
Jul 06 22:20:39.772792 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.772734    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d3dbf73-97c0-4313-938f-10000be128f8-metrics-certs\") pod \"router-default-57c9599b87-5gwnz\" (UID: \"6d3dbf73-97c0-4313-938f-10000be128f8\") " pod="openshift-ingress/router-default-57c9599b87-5gwnz"
Jul 06 22:20:39.773217 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.773202    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/74fd4789-fb73-431e-98a6-d4785a776a04-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-6pj82\" (UID: \"74fd4789-fb73-431e-98a6-d4785a776a04\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6pj82"
Jul 06 22:20:39.785162 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.785085    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsn47\" (UniqueName: \"kubernetes.io/projected/74fd4789-fb73-431e-98a6-d4785a776a04-kube-api-access-bsn47\") pod \"cluster-monitoring-operator-64786d9cbb-6pj82\" (UID: \"74fd4789-fb73-431e-98a6-d4785a776a04\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6pj82"
Jul 06 22:20:39.785162 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.785089    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkqnl\" (UniqueName: \"kubernetes.io/projected/20e777ec-fc6d-4976-9fb2-2fcf68fd492d-kube-api-access-xkqnl\") pod \"volume-data-source-validator-5d456fdbcd-dw9bg\" (UID: \"20e777ec-fc6d-4976-9fb2-2fcf68fd492d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-dw9bg"
Jul 06 22:20:39.857225 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.857190    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-776f784d57-w8vnh"]
Jul 06 22:20:39.873244 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.873212    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f201e5f-d7c9-456c-b7b4-05c2542e5933-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-px5rm\" (UID: \"6f201e5f-d7c9-456c-b7b4-05c2542e5933\") " pod="openshift-insights/insights-operator-5c847dcfc4-px5rm"
Jul 06 22:20:39.873244 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.873253    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d3dbf73-97c0-4313-938f-10000be128f8-metrics-certs\") pod \"router-default-57c9599b87-5gwnz\" (UID: \"6d3dbf73-97c0-4313-938f-10000be128f8\") " pod="openshift-ingress/router-default-57c9599b87-5gwnz"
Jul 06 22:20:39.873475 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.873322    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6f201e5f-d7c9-456c-b7b4-05c2542e5933-snapshots\") pod \"insights-operator-5c847dcfc4-px5rm\" (UID: \"6f201e5f-d7c9-456c-b7b4-05c2542e5933\") " pod="openshift-insights/insights-operator-5c847dcfc4-px5rm"
Jul 06 22:20:39.873475 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.873350    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxdc8\" (UniqueName: \"kubernetes.io/projected/6f201e5f-d7c9-456c-b7b4-05c2542e5933-kube-api-access-dxdc8\") pod \"insights-operator-5c847dcfc4-px5rm\" (UID: \"6f201e5f-d7c9-456c-b7b4-05c2542e5933\") " pod="openshift-insights/insights-operator-5c847dcfc4-px5rm"
Jul 06 22:20:39.873475 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.873406    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6f201e5f-d7c9-456c-b7b4-05c2542e5933-tmp\") pod \"insights-operator-5c847dcfc4-px5rm\" (UID: \"6f201e5f-d7c9-456c-b7b4-05c2542e5933\") " pod="openshift-insights/insights-operator-5c847dcfc4-px5rm"
Jul 06 22:20:39.873475 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.873434    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/6d3dbf73-97c0-4313-938f-10000be128f8-stats-auth\") pod \"router-default-57c9599b87-5gwnz\" (UID: \"6d3dbf73-97c0-4313-938f-10000be128f8\") " pod="openshift-ingress/router-default-57c9599b87-5gwnz"
Jul 06 22:20:39.873475 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.873457    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btf7c\" (UniqueName: \"kubernetes.io/projected/6d3dbf73-97c0-4313-938f-10000be128f8-kube-api-access-btf7c\") pod \"router-default-57c9599b87-5gwnz\" (UID: \"6d3dbf73-97c0-4313-938f-10000be128f8\") " pod="openshift-ingress/router-default-57c9599b87-5gwnz"
Jul 06 22:20:39.873771 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.873494    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6f201e5f-d7c9-456c-b7b4-05c2542e5933-serving-cert\") pod \"insights-operator-5c847dcfc4-px5rm\" (UID: \"6f201e5f-d7c9-456c-b7b4-05c2542e5933\") " pod="openshift-insights/insights-operator-5c847dcfc4-px5rm"
Jul 06 22:20:39.873771 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.873516    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/6d3dbf73-97c0-4313-938f-10000be128f8-default-certificate\") pod \"router-default-57c9599b87-5gwnz\" (UID: \"6d3dbf73-97c0-4313-938f-10000be128f8\") " pod="openshift-ingress/router-default-57c9599b87-5gwnz"
Jul 06 22:20:39.873771 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.873544    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d3dbf73-97c0-4313-938f-10000be128f8-service-ca-bundle\") pod \"router-default-57c9599b87-5gwnz\" (UID: \"6d3dbf73-97c0-4313-938f-10000be128f8\") " pod="openshift-ingress/router-default-57c9599b87-5gwnz"
Jul 06 22:20:39.873771 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.873577    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f201e5f-d7c9-456c-b7b4-05c2542e5933-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-px5rm\" (UID: \"6f201e5f-d7c9-456c-b7b4-05c2542e5933\") " pod="openshift-insights/insights-operator-5c847dcfc4-px5rm"
Jul 06 22:20:39.873996 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:39.873842    2556 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 22:20:39.873996 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:39.873908    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d3dbf73-97c0-4313-938f-10000be128f8-metrics-certs podName:6d3dbf73-97c0-4313-938f-10000be128f8 nodeName:}" failed. No retries permitted until 2026-07-06 22:20:40.373885901 +0000 UTC m=+41.161908817 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d3dbf73-97c0-4313-938f-10000be128f8-metrics-certs") pod "router-default-57c9599b87-5gwnz" (UID: "6d3dbf73-97c0-4313-938f-10000be128f8") : secret "router-metrics-certs-default" not found
Jul 06 22:20:39.874270 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.874161    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6f201e5f-d7c9-456c-b7b4-05c2542e5933-tmp\") pod \"insights-operator-5c847dcfc4-px5rm\" (UID: \"6f201e5f-d7c9-456c-b7b4-05c2542e5933\") " pod="openshift-insights/insights-operator-5c847dcfc4-px5rm"
Jul 06 22:20:39.874355 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.874280    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f201e5f-d7c9-456c-b7b4-05c2542e5933-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-px5rm\" (UID: \"6f201e5f-d7c9-456c-b7b4-05c2542e5933\") " pod="openshift-insights/insights-operator-5c847dcfc4-px5rm"
Jul 06 22:20:39.874355 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:39.874309    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6d3dbf73-97c0-4313-938f-10000be128f8-service-ca-bundle podName:6d3dbf73-97c0-4313-938f-10000be128f8 nodeName:}" failed. No retries permitted until 2026-07-06 22:20:40.374292933 +0000 UTC m=+41.162315875 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6d3dbf73-97c0-4313-938f-10000be128f8-service-ca-bundle") pod "router-default-57c9599b87-5gwnz" (UID: "6d3dbf73-97c0-4313-938f-10000be128f8") : configmap references non-existent config key: service-ca.crt
Jul 06 22:20:39.874683 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.874662    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-dw9bg"
Jul 06 22:20:39.874774 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.874670    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6f201e5f-d7c9-456c-b7b4-05c2542e5933-snapshots\") pod \"insights-operator-5c847dcfc4-px5rm\" (UID: \"6f201e5f-d7c9-456c-b7b4-05c2542e5933\") " pod="openshift-insights/insights-operator-5c847dcfc4-px5rm"
Jul 06 22:20:39.875089 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.875067    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f201e5f-d7c9-456c-b7b4-05c2542e5933-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-px5rm\" (UID: \"6f201e5f-d7c9-456c-b7b4-05c2542e5933\") " pod="openshift-insights/insights-operator-5c847dcfc4-px5rm"
Jul 06 22:20:39.877027 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.877003    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6f201e5f-d7c9-456c-b7b4-05c2542e5933-serving-cert\") pod \"insights-operator-5c847dcfc4-px5rm\" (UID: \"6f201e5f-d7c9-456c-b7b4-05c2542e5933\") " pod="openshift-insights/insights-operator-5c847dcfc4-px5rm"
Jul 06 22:20:39.877148 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.877135    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/6d3dbf73-97c0-4313-938f-10000be128f8-default-certificate\") pod \"router-default-57c9599b87-5gwnz\" (UID: \"6d3dbf73-97c0-4313-938f-10000be128f8\") " pod="openshift-ingress/router-default-57c9599b87-5gwnz"
Jul 06 22:20:39.877429 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.877412    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/6d3dbf73-97c0-4313-938f-10000be128f8-stats-auth\") pod \"router-default-57c9599b87-5gwnz\" (UID: \"6d3dbf73-97c0-4313-938f-10000be128f8\") " pod="openshift-ingress/router-default-57c9599b87-5gwnz"
Jul 06 22:20:39.878752 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.878733    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-776f784d57-w8vnh"]
Jul 06 22:20:39.878852 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.878819    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-776f784d57-w8vnh"
Jul 06 22:20:39.881148 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.880926    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 06 22:20:39.881148 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.880938    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 06 22:20:39.881148 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.881027    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mnwqj\""
Jul 06 22:20:39.881337 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.881219    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 06 22:20:39.884002 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.883978    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxdc8\" (UniqueName: \"kubernetes.io/projected/6f201e5f-d7c9-456c-b7b4-05c2542e5933-kube-api-access-dxdc8\") pod \"insights-operator-5c847dcfc4-px5rm\" (UID: \"6f201e5f-d7c9-456c-b7b4-05c2542e5933\") " pod="openshift-insights/insights-operator-5c847dcfc4-px5rm"
Jul 06 22:20:39.886582 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.886538    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-btf7c\" (UniqueName: \"kubernetes.io/projected/6d3dbf73-97c0-4313-938f-10000be128f8-kube-api-access-btf7c\") pod \"router-default-57c9599b87-5gwnz\" (UID: \"6d3dbf73-97c0-4313-938f-10000be128f8\") " pod="openshift-ingress/router-default-57c9599b87-5gwnz"
Jul 06 22:20:39.887158 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.887137    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 06 22:20:39.905819 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.905795    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-px5rm"
Jul 06 22:20:39.974301 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.974258    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/882825d8-10f4-4768-b9a2-c6465b118b95-ca-trust-extracted\") pod \"image-registry-776f784d57-w8vnh\" (UID: \"882825d8-10f4-4768-b9a2-c6465b118b95\") " pod="openshift-image-registry/image-registry-776f784d57-w8vnh"
Jul 06 22:20:39.974483 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.974336    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/882825d8-10f4-4768-b9a2-c6465b118b95-installation-pull-secrets\") pod \"image-registry-776f784d57-w8vnh\" (UID: \"882825d8-10f4-4768-b9a2-c6465b118b95\") " pod="openshift-image-registry/image-registry-776f784d57-w8vnh"
Jul 06 22:20:39.974483 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.974451    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cvxw\" (UniqueName: \"kubernetes.io/projected/882825d8-10f4-4768-b9a2-c6465b118b95-kube-api-access-4cvxw\") pod \"image-registry-776f784d57-w8vnh\" (UID: \"882825d8-10f4-4768-b9a2-c6465b118b95\") " pod="openshift-image-registry/image-registry-776f784d57-w8vnh"
Jul 06 22:20:39.974612 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.974494    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/882825d8-10f4-4768-b9a2-c6465b118b95-registry-tls\") pod \"image-registry-776f784d57-w8vnh\" (UID: \"882825d8-10f4-4768-b9a2-c6465b118b95\") " pod="openshift-image-registry/image-registry-776f784d57-w8vnh"
Jul 06 22:20:39.974612 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.974534    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/882825d8-10f4-4768-b9a2-c6465b118b95-image-registry-private-configuration\") pod \"image-registry-776f784d57-w8vnh\" (UID: \"882825d8-10f4-4768-b9a2-c6465b118b95\") " pod="openshift-image-registry/image-registry-776f784d57-w8vnh"
Jul 06 22:20:39.974612 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.974563    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/882825d8-10f4-4768-b9a2-c6465b118b95-registry-certificates\") pod \"image-registry-776f784d57-w8vnh\" (UID: \"882825d8-10f4-4768-b9a2-c6465b118b95\") " pod="openshift-image-registry/image-registry-776f784d57-w8vnh"
Jul 06 22:20:39.974612 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.974584    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/882825d8-10f4-4768-b9a2-c6465b118b95-bound-sa-token\") pod \"image-registry-776f784d57-w8vnh\" (UID: \"882825d8-10f4-4768-b9a2-c6465b118b95\") " pod="openshift-image-registry/image-registry-776f784d57-w8vnh"
Jul 06 22:20:39.974800 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:39.974679    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/882825d8-10f4-4768-b9a2-c6465b118b95-trusted-ca\") pod \"image-registry-776f784d57-w8vnh\" (UID: \"882825d8-10f4-4768-b9a2-c6465b118b95\") " pod="openshift-image-registry/image-registry-776f784d57-w8vnh"
Jul 06 22:20:40.076157 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:40.076053    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/882825d8-10f4-4768-b9a2-c6465b118b95-trusted-ca\") pod \"image-registry-776f784d57-w8vnh\" (UID: \"882825d8-10f4-4768-b9a2-c6465b118b95\") " pod="openshift-image-registry/image-registry-776f784d57-w8vnh"
Jul 06 22:20:40.076157 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:40.076128    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/882825d8-10f4-4768-b9a2-c6465b118b95-ca-trust-extracted\") pod \"image-registry-776f784d57-w8vnh\" (UID: \"882825d8-10f4-4768-b9a2-c6465b118b95\") " pod="openshift-image-registry/image-registry-776f784d57-w8vnh"
Jul 06 22:20:40.076157 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:40.076159    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/882825d8-10f4-4768-b9a2-c6465b118b95-installation-pull-secrets\") pod \"image-registry-776f784d57-w8vnh\" (UID: \"882825d8-10f4-4768-b9a2-c6465b118b95\") " pod="openshift-image-registry/image-registry-776f784d57-w8vnh"
Jul 06 22:20:40.076442 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:40.076395    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cvxw\" (UniqueName: \"kubernetes.io/projected/882825d8-10f4-4768-b9a2-c6465b118b95-kube-api-access-4cvxw\") pod \"image-registry-776f784d57-w8vnh\" (UID: \"882825d8-10f4-4768-b9a2-c6465b118b95\") " pod="openshift-image-registry/image-registry-776f784d57-w8vnh"
Jul 06 22:20:40.076499 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:40.076456    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/882825d8-10f4-4768-b9a2-c6465b118b95-registry-tls\") pod \"image-registry-776f784d57-w8vnh\" (UID: \"882825d8-10f4-4768-b9a2-c6465b118b95\") " pod="openshift-image-registry/image-registry-776f784d57-w8vnh"
Jul 06 22:20:40.076554 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:40.076519    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/882825d8-10f4-4768-b9a2-c6465b118b95-image-registry-private-configuration\") pod \"image-registry-776f784d57-w8vnh\" (UID: \"882825d8-10f4-4768-b9a2-c6465b118b95\") " pod="openshift-image-registry/image-registry-776f784d57-w8vnh"
Jul 06 22:20:40.076606 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:40.076571    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/882825d8-10f4-4768-b9a2-c6465b118b95-registry-certificates\") pod \"image-registry-776f784d57-w8vnh\" (UID: \"882825d8-10f4-4768-b9a2-c6465b118b95\") " pod="openshift-image-registry/image-registry-776f784d57-w8vnh"
Jul 06 22:20:40.076606 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:40.076582    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/882825d8-10f4-4768-b9a2-c6465b118b95-ca-trust-extracted\") pod \"image-registry-776f784d57-w8vnh\" (UID: \"882825d8-10f4-4768-b9a2-c6465b118b95\") " pod="openshift-image-registry/image-registry-776f784d57-w8vnh"
Jul 06 22:20:40.076699 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:40.076602    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/882825d8-10f4-4768-b9a2-c6465b118b95-bound-sa-token\") pod \"image-registry-776f784d57-w8vnh\" (UID: \"882825d8-10f4-4768-b9a2-c6465b118b95\") " pod="openshift-image-registry/image-registry-776f784d57-w8vnh"
Jul 06 22:20:40.076699 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:40.076617    2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 22:20:40.076699 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:40.076644    2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-776f784d57-w8vnh: secret "image-registry-tls" not found
Jul 06 22:20:40.076827 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:40.076708    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/882825d8-10f4-4768-b9a2-c6465b118b95-registry-tls podName:882825d8-10f4-4768-b9a2-c6465b118b95 nodeName:}" failed. No retries permitted until 2026-07-06 22:20:40.576687883 +0000 UTC m=+41.364710819 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/882825d8-10f4-4768-b9a2-c6465b118b95-registry-tls") pod "image-registry-776f784d57-w8vnh" (UID: "882825d8-10f4-4768-b9a2-c6465b118b95") : secret "image-registry-tls" not found
Jul 06 22:20:40.077215 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:40.077159    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/882825d8-10f4-4768-b9a2-c6465b118b95-registry-certificates\") pod \"image-registry-776f784d57-w8vnh\" (UID: \"882825d8-10f4-4768-b9a2-c6465b118b95\") " pod="openshift-image-registry/image-registry-776f784d57-w8vnh"
Jul 06 22:20:40.077506 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:40.077485    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/882825d8-10f4-4768-b9a2-c6465b118b95-trusted-ca\") pod \"image-registry-776f784d57-w8vnh\" (UID: \"882825d8-10f4-4768-b9a2-c6465b118b95\") " pod="openshift-image-registry/image-registry-776f784d57-w8vnh"
Jul 06 22:20:40.079148 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:40.079124    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/882825d8-10f4-4768-b9a2-c6465b118b95-installation-pull-secrets\") pod \"image-registry-776f784d57-w8vnh\" (UID: \"882825d8-10f4-4768-b9a2-c6465b118b95\") " pod="openshift-image-registry/image-registry-776f784d57-w8vnh"
Jul 06 22:20:40.079379 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:40.079352    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/882825d8-10f4-4768-b9a2-c6465b118b95-image-registry-private-configuration\") pod \"image-registry-776f784d57-w8vnh\" (UID: \"882825d8-10f4-4768-b9a2-c6465b118b95\") " pod="openshift-image-registry/image-registry-776f784d57-w8vnh"
Jul 06 22:20:40.085905 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:40.085886    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/882825d8-10f4-4768-b9a2-c6465b118b95-bound-sa-token\") pod \"image-registry-776f784d57-w8vnh\" (UID: \"882825d8-10f4-4768-b9a2-c6465b118b95\") " pod="openshift-image-registry/image-registry-776f784d57-w8vnh"
Jul 06 22:20:40.086009 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:40.085958    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cvxw\" (UniqueName: \"kubernetes.io/projected/882825d8-10f4-4768-b9a2-c6465b118b95-kube-api-access-4cvxw\") pod \"image-registry-776f784d57-w8vnh\" (UID: \"882825d8-10f4-4768-b9a2-c6465b118b95\") " pod="openshift-image-registry/image-registry-776f784d57-w8vnh"
Jul 06 22:20:40.278191 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:40.278156    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/74fd4789-fb73-431e-98a6-d4785a776a04-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-6pj82\" (UID: \"74fd4789-fb73-431e-98a6-d4785a776a04\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6pj82"
Jul 06 22:20:40.278328 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:40.278308    2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 22:20:40.278399 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:40.278377    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74fd4789-fb73-431e-98a6-d4785a776a04-cluster-monitoring-operator-tls podName:74fd4789-fb73-431e-98a6-d4785a776a04 nodeName:}" failed. No retries permitted until 2026-07-06 22:20:41.278361707 +0000 UTC m=+42.066384655 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/74fd4789-fb73-431e-98a6-d4785a776a04-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-6pj82" (UID: "74fd4789-fb73-431e-98a6-d4785a776a04") : secret "cluster-monitoring-operator-tls" not found
Jul 06 22:20:40.379335 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:40.379134    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d3dbf73-97c0-4313-938f-10000be128f8-service-ca-bundle\") pod \"router-default-57c9599b87-5gwnz\" (UID: \"6d3dbf73-97c0-4313-938f-10000be128f8\") " pod="openshift-ingress/router-default-57c9599b87-5gwnz"
Jul 06 22:20:40.379335 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:40.379200    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d3dbf73-97c0-4313-938f-10000be128f8-metrics-certs\") pod \"router-default-57c9599b87-5gwnz\" (UID: \"6d3dbf73-97c0-4313-938f-10000be128f8\") " pod="openshift-ingress/router-default-57c9599b87-5gwnz"
Jul 06 22:20:40.380181 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:40.379856    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6d3dbf73-97c0-4313-938f-10000be128f8-service-ca-bundle podName:6d3dbf73-97c0-4313-938f-10000be128f8 nodeName:}" failed. No retries permitted until 2026-07-06 22:20:41.379832438 +0000 UTC m=+42.167855357 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6d3dbf73-97c0-4313-938f-10000be128f8-service-ca-bundle") pod "router-default-57c9599b87-5gwnz" (UID: "6d3dbf73-97c0-4313-938f-10000be128f8") : configmap references non-existent config key: service-ca.crt
Jul 06 22:20:40.380181 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:40.380060    2556 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 22:20:40.380181 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:40.380142    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d3dbf73-97c0-4313-938f-10000be128f8-metrics-certs podName:6d3dbf73-97c0-4313-938f-10000be128f8 nodeName:}" failed. No retries permitted until 2026-07-06 22:20:41.38012491 +0000 UTC m=+42.168147837 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d3dbf73-97c0-4313-938f-10000be128f8-metrics-certs") pod "router-default-57c9599b87-5gwnz" (UID: "6d3dbf73-97c0-4313-938f-10000be128f8") : secret "router-metrics-certs-default" not found
Jul 06 22:20:40.445750 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:40.445718    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-px5rm"]
Jul 06 22:20:40.449208 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:20:40.449161    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f201e5f_d7c9_456c_b7b4_05c2542e5933.slice/crio-6f4bf9f51029f3ec1a3275a19b1716f8bdc86d2aae5ebe32667259059cda346c WatchSource:0}: Error finding container 6f4bf9f51029f3ec1a3275a19b1716f8bdc86d2aae5ebe32667259059cda346c: Status 404 returned error can't find the container with id 6f4bf9f51029f3ec1a3275a19b1716f8bdc86d2aae5ebe32667259059cda346c
Jul 06 22:20:40.461063 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:40.461035    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-dw9bg"]
Jul 06 22:20:40.463672 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:20:40.463650    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20e777ec_fc6d_4976_9fb2_2fcf68fd492d.slice/crio-8a1d3e9c2a8816b7d3b1a71cf2611f0a76df9dda6f69f14a371f9b7dafd0992c WatchSource:0}: Error finding container 8a1d3e9c2a8816b7d3b1a71cf2611f0a76df9dda6f69f14a371f9b7dafd0992c: Status 404 returned error can't find the container with id 8a1d3e9c2a8816b7d3b1a71cf2611f0a76df9dda6f69f14a371f9b7dafd0992c
Jul 06 22:20:40.582445 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:40.582387    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/882825d8-10f4-4768-b9a2-c6465b118b95-registry-tls\") pod \"image-registry-776f784d57-w8vnh\" (UID: \"882825d8-10f4-4768-b9a2-c6465b118b95\") " pod="openshift-image-registry/image-registry-776f784d57-w8vnh"
Jul 06 22:20:40.582737 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:40.582519    2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 22:20:40.582737 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:40.582536    2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-776f784d57-w8vnh: secret "image-registry-tls" not found
Jul 06 22:20:40.582737 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:40.582583    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/882825d8-10f4-4768-b9a2-c6465b118b95-registry-tls podName:882825d8-10f4-4768-b9a2-c6465b118b95 nodeName:}" failed. No retries permitted until 2026-07-06 22:20:41.582569597 +0000 UTC m=+42.370592512 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/882825d8-10f4-4768-b9a2-c6465b118b95-registry-tls") pod "image-registry-776f784d57-w8vnh" (UID: "882825d8-10f4-4768-b9a2-c6465b118b95") : secret "image-registry-tls" not found
Jul 06 22:20:40.883617 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:40.881583    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2gn7f" event={"ID":"ae29cca7-c528-42da-bc42-0c0961f7638f","Type":"ContainerStarted","Data":"cee4f7cf9b8d5e6b11d4f6afb32144e3fb140aca07375ede2f4f02d811f42c38"}
Jul 06 22:20:40.883617 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:40.883145    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-dw9bg" event={"ID":"20e777ec-fc6d-4976-9fb2-2fcf68fd492d","Type":"ContainerStarted","Data":"8a1d3e9c2a8816b7d3b1a71cf2611f0a76df9dda6f69f14a371f9b7dafd0992c"}
Jul 06 22:20:40.884842 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:40.884804    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-px5rm" event={"ID":"6f201e5f-d7c9-456c-b7b4-05c2542e5933","Type":"ContainerStarted","Data":"6f4bf9f51029f3ec1a3275a19b1716f8bdc86d2aae5ebe32667259059cda346c"}
Jul 06 22:20:41.288339 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:41.288263    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/74fd4789-fb73-431e-98a6-d4785a776a04-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-6pj82\" (UID: \"74fd4789-fb73-431e-98a6-d4785a776a04\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6pj82"
Jul 06 22:20:41.288533 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:41.288517    2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 22:20:41.288603 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:41.288591    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74fd4789-fb73-431e-98a6-d4785a776a04-cluster-monitoring-operator-tls podName:74fd4789-fb73-431e-98a6-d4785a776a04 nodeName:}" failed. No retries permitted until 2026-07-06 22:20:43.288570856 +0000 UTC m=+44.076593781 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/74fd4789-fb73-431e-98a6-d4785a776a04-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-6pj82" (UID: "74fd4789-fb73-431e-98a6-d4785a776a04") : secret "cluster-monitoring-operator-tls" not found
Jul 06 22:20:41.389026 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:41.388987    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d5aca2ef-cead-468c-ae99-bb4988f0b2aa-metrics-tls\") pod \"dns-default-grc74\" (UID: \"d5aca2ef-cead-468c-ae99-bb4988f0b2aa\") " pod="openshift-dns/dns-default-grc74"
Jul 06 22:20:41.389219 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:41.389119    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d3dbf73-97c0-4313-938f-10000be128f8-service-ca-bundle\") pod \"router-default-57c9599b87-5gwnz\" (UID: \"6d3dbf73-97c0-4313-938f-10000be128f8\") " pod="openshift-ingress/router-default-57c9599b87-5gwnz"
Jul 06 22:20:41.389219 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:41.389168    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 22:20:41.389381 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:41.389241    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5aca2ef-cead-468c-ae99-bb4988f0b2aa-metrics-tls podName:d5aca2ef-cead-468c-ae99-bb4988f0b2aa nodeName:}" failed. No retries permitted until 2026-07-06 22:20:49.389219981 +0000 UTC m=+50.177242892 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d5aca2ef-cead-468c-ae99-bb4988f0b2aa-metrics-tls") pod "dns-default-grc74" (UID: "d5aca2ef-cead-468c-ae99-bb4988f0b2aa") : secret "dns-default-metrics-tls" not found
Jul 06 22:20:41.389381 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:41.389265    2556 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 22:20:41.389381 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:41.389337    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d3dbf73-97c0-4313-938f-10000be128f8-metrics-certs podName:6d3dbf73-97c0-4313-938f-10000be128f8 nodeName:}" failed. No retries permitted until 2026-07-06 22:20:43.389321133 +0000 UTC m=+44.177344058 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d3dbf73-97c0-4313-938f-10000be128f8-metrics-certs") pod "router-default-57c9599b87-5gwnz" (UID: "6d3dbf73-97c0-4313-938f-10000be128f8") : secret "router-metrics-certs-default" not found
Jul 06 22:20:41.389532 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:41.389409    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6d3dbf73-97c0-4313-938f-10000be128f8-service-ca-bundle podName:6d3dbf73-97c0-4313-938f-10000be128f8 nodeName:}" failed. No retries permitted until 2026-07-06 22:20:43.389398537 +0000 UTC m=+44.177421467 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6d3dbf73-97c0-4313-938f-10000be128f8-service-ca-bundle") pod "router-default-57c9599b87-5gwnz" (UID: "6d3dbf73-97c0-4313-938f-10000be128f8") : configmap references non-existent config key: service-ca.crt
Jul 06 22:20:41.389532 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:41.389177    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d3dbf73-97c0-4313-938f-10000be128f8-metrics-certs\") pod \"router-default-57c9599b87-5gwnz\" (UID: \"6d3dbf73-97c0-4313-938f-10000be128f8\") " pod="openshift-ingress/router-default-57c9599b87-5gwnz"
Jul 06 22:20:41.591171 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:41.591083    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/882825d8-10f4-4768-b9a2-c6465b118b95-registry-tls\") pod \"image-registry-776f784d57-w8vnh\" (UID: \"882825d8-10f4-4768-b9a2-c6465b118b95\") " pod="openshift-image-registry/image-registry-776f784d57-w8vnh"
Jul 06 22:20:41.591540 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:41.591216    2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 22:20:41.591540 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:41.591236    2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-776f784d57-w8vnh: secret "image-registry-tls" not found
Jul 06 22:20:41.591540 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:41.591298    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/882825d8-10f4-4768-b9a2-c6465b118b95-registry-tls podName:882825d8-10f4-4768-b9a2-c6465b118b95 nodeName:}" failed. No retries permitted until 2026-07-06 22:20:43.591282612 +0000 UTC m=+44.379305524 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/882825d8-10f4-4768-b9a2-c6465b118b95-registry-tls") pod "image-registry-776f784d57-w8vnh" (UID: "882825d8-10f4-4768-b9a2-c6465b118b95") : secret "image-registry-tls" not found
Jul 06 22:20:41.890891 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:41.890816    2556 generic.go:356] "Generic (PLEG): container finished" podID="ae29cca7-c528-42da-bc42-0c0961f7638f" containerID="cee4f7cf9b8d5e6b11d4f6afb32144e3fb140aca07375ede2f4f02d811f42c38" exitCode=0
Jul 06 22:20:41.890891 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:41.890846    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2gn7f" event={"ID":"ae29cca7-c528-42da-bc42-0c0961f7638f","Type":"ContainerDied","Data":"cee4f7cf9b8d5e6b11d4f6afb32144e3fb140aca07375ede2f4f02d811f42c38"}
Jul 06 22:20:42.896215 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:42.896181    2556 generic.go:356] "Generic (PLEG): container finished" podID="ae29cca7-c528-42da-bc42-0c0961f7638f" containerID="2dace7b9ea1caa5f23c7f03e412b16ce636722d7ba4a9bf01813b172af30f21a" exitCode=0
Jul 06 22:20:42.896610 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:42.896230    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2gn7f" event={"ID":"ae29cca7-c528-42da-bc42-0c0961f7638f","Type":"ContainerDied","Data":"2dace7b9ea1caa5f23c7f03e412b16ce636722d7ba4a9bf01813b172af30f21a"}
Jul 06 22:20:43.304825 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:43.304803    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/74fd4789-fb73-431e-98a6-d4785a776a04-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-6pj82\" (UID: \"74fd4789-fb73-431e-98a6-d4785a776a04\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6pj82"
Jul 06 22:20:43.304965 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:43.304950    2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 22:20:43.305026 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:43.305012    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74fd4789-fb73-431e-98a6-d4785a776a04-cluster-monitoring-operator-tls podName:74fd4789-fb73-431e-98a6-d4785a776a04 nodeName:}" failed. No retries permitted until 2026-07-06 22:20:47.30499628 +0000 UTC m=+48.093019191 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/74fd4789-fb73-431e-98a6-d4785a776a04-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-6pj82" (UID: "74fd4789-fb73-431e-98a6-d4785a776a04") : secret "cluster-monitoring-operator-tls" not found
Jul 06 22:20:43.405507 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:43.405477    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d3dbf73-97c0-4313-938f-10000be128f8-service-ca-bundle\") pod \"router-default-57c9599b87-5gwnz\" (UID: \"6d3dbf73-97c0-4313-938f-10000be128f8\") " pod="openshift-ingress/router-default-57c9599b87-5gwnz"
Jul 06 22:20:43.405593 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:43.405521    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d3dbf73-97c0-4313-938f-10000be128f8-metrics-certs\") pod \"router-default-57c9599b87-5gwnz\" (UID: \"6d3dbf73-97c0-4313-938f-10000be128f8\") " pod="openshift-ingress/router-default-57c9599b87-5gwnz"
Jul 06 22:20:43.405635 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:43.405619    2556 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 22:20:43.405671 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:43.405652    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6d3dbf73-97c0-4313-938f-10000be128f8-service-ca-bundle podName:6d3dbf73-97c0-4313-938f-10000be128f8 nodeName:}" failed. No retries permitted until 2026-07-06 22:20:47.405631604 +0000 UTC m=+48.193654515 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6d3dbf73-97c0-4313-938f-10000be128f8-service-ca-bundle") pod "router-default-57c9599b87-5gwnz" (UID: "6d3dbf73-97c0-4313-938f-10000be128f8") : configmap references non-existent config key: service-ca.crt
Jul 06 22:20:43.405711 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:43.405673    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d3dbf73-97c0-4313-938f-10000be128f8-metrics-certs podName:6d3dbf73-97c0-4313-938f-10000be128f8 nodeName:}" failed. No retries permitted until 2026-07-06 22:20:47.405666847 +0000 UTC m=+48.193689758 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d3dbf73-97c0-4313-938f-10000be128f8-metrics-certs") pod "router-default-57c9599b87-5gwnz" (UID: "6d3dbf73-97c0-4313-938f-10000be128f8") : secret "router-metrics-certs-default" not found
Jul 06 22:20:43.512563 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:43.512533    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rcl6h"]
Jul 06 22:20:43.534268 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:43.534242    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rcl6h"]
Jul 06 22:20:43.534396 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:43.534332    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rcl6h"
Jul 06 22:20:43.536712 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:43.536686    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 06 22:20:43.536854 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:43.536768    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 06 22:20:43.536854 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:43.536806    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 06 22:20:43.536854 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:43.536814    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 06 22:20:43.536854 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:43.536830    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-2m28g\""
Jul 06 22:20:43.608153 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:43.608043    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hh2rr\" (UniqueName: \"kubernetes.io/projected/4d32d357-4d65-41d8-b9a1-82a5900859f9-kube-api-access-hh2rr\") pod \"service-ca-operator-5d46d9ffd4-rcl6h\" (UID: \"4d32d357-4d65-41d8-b9a1-82a5900859f9\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rcl6h"
Jul 06 22:20:43.608153 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:43.608094    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4d32d357-4d65-41d8-b9a1-82a5900859f9-config\") pod \"service-ca-operator-5d46d9ffd4-rcl6h\" (UID: \"4d32d357-4d65-41d8-b9a1-82a5900859f9\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rcl6h"
Jul 06 22:20:43.608336 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:43.608261    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/882825d8-10f4-4768-b9a2-c6465b118b95-registry-tls\") pod \"image-registry-776f784d57-w8vnh\" (UID: \"882825d8-10f4-4768-b9a2-c6465b118b95\") " pod="openshift-image-registry/image-registry-776f784d57-w8vnh"
Jul 06 22:20:43.608336 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:43.608322    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4d32d357-4d65-41d8-b9a1-82a5900859f9-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-rcl6h\" (UID: \"4d32d357-4d65-41d8-b9a1-82a5900859f9\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rcl6h"
Jul 06 22:20:43.608424 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:43.608406    2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 22:20:43.608463 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:43.608425    2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-776f784d57-w8vnh: secret "image-registry-tls" not found
Jul 06 22:20:43.608495 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:43.608473    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/882825d8-10f4-4768-b9a2-c6465b118b95-registry-tls podName:882825d8-10f4-4768-b9a2-c6465b118b95 nodeName:}" failed. No retries permitted until 2026-07-06 22:20:47.608457657 +0000 UTC m=+48.396480568 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/882825d8-10f4-4768-b9a2-c6465b118b95-registry-tls") pod "image-registry-776f784d57-w8vnh" (UID: "882825d8-10f4-4768-b9a2-c6465b118b95") : secret "image-registry-tls" not found
Jul 06 22:20:43.709241 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:43.709196    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hh2rr\" (UniqueName: \"kubernetes.io/projected/4d32d357-4d65-41d8-b9a1-82a5900859f9-kube-api-access-hh2rr\") pod \"service-ca-operator-5d46d9ffd4-rcl6h\" (UID: \"4d32d357-4d65-41d8-b9a1-82a5900859f9\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rcl6h"
Jul 06 22:20:43.709241 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:43.709238    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4d32d357-4d65-41d8-b9a1-82a5900859f9-config\") pod \"service-ca-operator-5d46d9ffd4-rcl6h\" (UID: \"4d32d357-4d65-41d8-b9a1-82a5900859f9\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rcl6h"
Jul 06 22:20:43.709492 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:43.709361    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4d32d357-4d65-41d8-b9a1-82a5900859f9-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-rcl6h\" (UID: \"4d32d357-4d65-41d8-b9a1-82a5900859f9\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rcl6h"
Jul 06 22:20:43.709866 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:43.709845    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4d32d357-4d65-41d8-b9a1-82a5900859f9-config\") pod \"service-ca-operator-5d46d9ffd4-rcl6h\" (UID: \"4d32d357-4d65-41d8-b9a1-82a5900859f9\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rcl6h"
Jul 06 22:20:43.711604 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:43.711570    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4d32d357-4d65-41d8-b9a1-82a5900859f9-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-rcl6h\" (UID: \"4d32d357-4d65-41d8-b9a1-82a5900859f9\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rcl6h"
Jul 06 22:20:43.719942 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:43.719910    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hh2rr\" (UniqueName: \"kubernetes.io/projected/4d32d357-4d65-41d8-b9a1-82a5900859f9-kube-api-access-hh2rr\") pod \"service-ca-operator-5d46d9ffd4-rcl6h\" (UID: \"4d32d357-4d65-41d8-b9a1-82a5900859f9\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rcl6h"
Jul 06 22:20:43.845200 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:43.845167    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rcl6h"
Jul 06 22:20:43.902252 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:43.902215    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2gn7f" event={"ID":"ae29cca7-c528-42da-bc42-0c0961f7638f","Type":"ContainerStarted","Data":"5f79f853ff076529bdb1a3b08633fac6ad55f8193af9fe17cad7f0b793436264"}
Jul 06 22:20:43.903823 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:43.903795    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-dw9bg" event={"ID":"20e777ec-fc6d-4976-9fb2-2fcf68fd492d","Type":"ContainerStarted","Data":"99d4082e2d0c8043e06ff4402879b0da42b6cbc607d93f6416cb077df54d5078"}
Jul 06 22:20:43.905406 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:43.905385    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-px5rm" event={"ID":"6f201e5f-d7c9-456c-b7b4-05c2542e5933","Type":"ContainerStarted","Data":"353958fb15a4e3018232fea52323c5812ccdbbe0e8a7e1d7b55f1746542c548d"}
Jul 06 22:20:43.930874 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:43.930820    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-2gn7f" podStartSLOduration=9.415604833 podStartE2EDuration="43.930801158s" totalImagesPullingTime="34.515196325s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:20:00 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:20:43.929815224 +0000 UTC m=+44.717838159" watchObservedRunningTime="2026-07-06 22:20:43.930801158 +0000 UTC m=+44.718824091"
Jul 06 22:20:43.950973 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:43.950914    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-dw9bg" podStartSLOduration=2.438991244 podStartE2EDuration="4.950893399s" totalImagesPullingTime="2.511902155s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:20:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:20:43.949853701 +0000 UTC m=+44.737876632" watchObservedRunningTime="2026-07-06 22:20:43.950893399 +0000 UTC m=+44.738916332"
Jul 06 22:20:43.969480 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:43.969321    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-px5rm" podStartSLOduration=2.114508105 podStartE2EDuration="4.969302778s" totalImagesPullingTime="2.854794673s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:20:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:20:43.969134544 +0000 UTC m=+44.757157474" watchObservedRunningTime="2026-07-06 22:20:43.969302778 +0000 UTC m=+44.757325715"
Jul 06 22:20:44.009647 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:44.009620    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rcl6h"]
Jul 06 22:20:44.013145 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:20:44.013121    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d32d357_4d65_41d8_b9a1_82a5900859f9.slice/crio-4b6db10a24343e7d39275c77202439b6760984bc1ab6fdb7d5c2a183e5b6dc75 WatchSource:0}: Error finding container 4b6db10a24343e7d39275c77202439b6760984bc1ab6fdb7d5c2a183e5b6dc75: Status 404 returned error can't find the container with id 4b6db10a24343e7d39275c77202439b6760984bc1ab6fdb7d5c2a183e5b6dc75
Jul 06 22:20:44.909553 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:44.909512    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rcl6h" event={"ID":"4d32d357-4d65-41d8-b9a1-82a5900859f9","Type":"ContainerStarted","Data":"4b6db10a24343e7d39275c77202439b6760984bc1ab6fdb7d5c2a183e5b6dc75"}
Jul 06 22:20:45.195200 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:45.195112    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-kwlvj"]
Jul 06 22:20:45.217846 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:45.217798    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kwlvj"]
Jul 06 22:20:45.218015 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:45.217939    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kwlvj"
Jul 06 22:20:45.220315 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:45.220288    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 06 22:20:45.220315 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:45.220338    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-dhrwd\""
Jul 06 22:20:45.220682 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:45.220290    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 06 22:20:45.323937 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:45.323899    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3d153f53-015d-4cae-a617-0f5e4d745e80-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kwlvj\" (UID: \"3d153f53-015d-4cae-a617-0f5e4d745e80\") " pod="openshift-insights/insights-runtime-extractor-kwlvj"
Jul 06 22:20:45.324129 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:45.323951    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4b67\" (UniqueName: \"kubernetes.io/projected/3d153f53-015d-4cae-a617-0f5e4d745e80-kube-api-access-s4b67\") pod \"insights-runtime-extractor-kwlvj\" (UID: \"3d153f53-015d-4cae-a617-0f5e4d745e80\") " pod="openshift-insights/insights-runtime-extractor-kwlvj"
Jul 06 22:20:45.324129 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:45.324026    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3d153f53-015d-4cae-a617-0f5e4d745e80-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kwlvj\" (UID: \"3d153f53-015d-4cae-a617-0f5e4d745e80\") " pod="openshift-insights/insights-runtime-extractor-kwlvj"
Jul 06 22:20:45.324129 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:45.324076    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3d153f53-015d-4cae-a617-0f5e4d745e80-crio-socket\") pod \"insights-runtime-extractor-kwlvj\" (UID: \"3d153f53-015d-4cae-a617-0f5e4d745e80\") " pod="openshift-insights/insights-runtime-extractor-kwlvj"
Jul 06 22:20:45.324129 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:45.324092    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3d153f53-015d-4cae-a617-0f5e4d745e80-data-volume\") pod \"insights-runtime-extractor-kwlvj\" (UID: \"3d153f53-015d-4cae-a617-0f5e4d745e80\") " pod="openshift-insights/insights-runtime-extractor-kwlvj"
Jul 06 22:20:45.424556 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:45.424520    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4b67\" (UniqueName: \"kubernetes.io/projected/3d153f53-015d-4cae-a617-0f5e4d745e80-kube-api-access-s4b67\") pod \"insights-runtime-extractor-kwlvj\" (UID: \"3d153f53-015d-4cae-a617-0f5e4d745e80\") " pod="openshift-insights/insights-runtime-extractor-kwlvj"
Jul 06 22:20:45.424714 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:45.424582    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3d153f53-015d-4cae-a617-0f5e4d745e80-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kwlvj\" (UID: \"3d153f53-015d-4cae-a617-0f5e4d745e80\") " pod="openshift-insights/insights-runtime-extractor-kwlvj"
Jul 06 22:20:45.424714 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:45.424619    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3d153f53-015d-4cae-a617-0f5e4d745e80-crio-socket\") pod \"insights-runtime-extractor-kwlvj\" (UID: \"3d153f53-015d-4cae-a617-0f5e4d745e80\") " pod="openshift-insights/insights-runtime-extractor-kwlvj"
Jul 06 22:20:45.424714 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:45.424637    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3d153f53-015d-4cae-a617-0f5e4d745e80-data-volume\") pod \"insights-runtime-extractor-kwlvj\" (UID: \"3d153f53-015d-4cae-a617-0f5e4d745e80\") " pod="openshift-insights/insights-runtime-extractor-kwlvj"
Jul 06 22:20:45.424830 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:45.424728    2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 22:20:45.424830 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:45.424795    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d153f53-015d-4cae-a617-0f5e4d745e80-insights-runtime-extractor-tls podName:3d153f53-015d-4cae-a617-0f5e4d745e80 nodeName:}" failed. No retries permitted until 2026-07-06 22:20:45.924780155 +0000 UTC m=+46.712803066 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3d153f53-015d-4cae-a617-0f5e4d745e80-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kwlvj" (UID: "3d153f53-015d-4cae-a617-0f5e4d745e80") : secret "insights-runtime-extractor-tls" not found
Jul 06 22:20:45.424953 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:45.424833    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3d153f53-015d-4cae-a617-0f5e4d745e80-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kwlvj\" (UID: \"3d153f53-015d-4cae-a617-0f5e4d745e80\") " pod="openshift-insights/insights-runtime-extractor-kwlvj"
Jul 06 22:20:45.424953 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:45.424844    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3d153f53-015d-4cae-a617-0f5e4d745e80-crio-socket\") pod \"insights-runtime-extractor-kwlvj\" (UID: \"3d153f53-015d-4cae-a617-0f5e4d745e80\") " pod="openshift-insights/insights-runtime-extractor-kwlvj"
Jul 06 22:20:45.424953 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:45.424892    2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 22:20:45.424953 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:45.424917    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3d153f53-015d-4cae-a617-0f5e4d745e80-kube-rbac-proxy-cm podName:3d153f53-015d-4cae-a617-0f5e4d745e80 nodeName:}" failed. No retries permitted until 2026-07-06 22:20:45.924908724 +0000 UTC m=+46.712931635 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3d153f53-015d-4cae-a617-0f5e4d745e80-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kwlvj" (UID: "3d153f53-015d-4cae-a617-0f5e4d745e80") : configmap "kube-rbac-proxy" not found
Jul 06 22:20:45.425118 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:45.424975    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3d153f53-015d-4cae-a617-0f5e4d745e80-data-volume\") pod \"insights-runtime-extractor-kwlvj\" (UID: \"3d153f53-015d-4cae-a617-0f5e4d745e80\") " pod="openshift-insights/insights-runtime-extractor-kwlvj"
Jul 06 22:20:45.433824 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:45.433805    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4b67\" (UniqueName: \"kubernetes.io/projected/3d153f53-015d-4cae-a617-0f5e4d745e80-kube-api-access-s4b67\") pod \"insights-runtime-extractor-kwlvj\" (UID: \"3d153f53-015d-4cae-a617-0f5e4d745e80\") " pod="openshift-insights/insights-runtime-extractor-kwlvj"
Jul 06 22:20:45.929973 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:45.929941    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3d153f53-015d-4cae-a617-0f5e4d745e80-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kwlvj\" (UID: \"3d153f53-015d-4cae-a617-0f5e4d745e80\") " pod="openshift-insights/insights-runtime-extractor-kwlvj"
Jul 06 22:20:45.930426 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:45.930019    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3d153f53-015d-4cae-a617-0f5e4d745e80-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kwlvj\" (UID: \"3d153f53-015d-4cae-a617-0f5e4d745e80\") " pod="openshift-insights/insights-runtime-extractor-kwlvj"
Jul 06 22:20:45.930426 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:45.930109    2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 22:20:45.930426 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:45.930165    2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 22:20:45.930426 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:45.930178    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3d153f53-015d-4cae-a617-0f5e4d745e80-kube-rbac-proxy-cm podName:3d153f53-015d-4cae-a617-0f5e4d745e80 nodeName:}" failed. No retries permitted until 2026-07-06 22:20:46.930159324 +0000 UTC m=+47.718182245 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3d153f53-015d-4cae-a617-0f5e4d745e80-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kwlvj" (UID: "3d153f53-015d-4cae-a617-0f5e4d745e80") : configmap "kube-rbac-proxy" not found
Jul 06 22:20:45.930426 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:45.930210    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d153f53-015d-4cae-a617-0f5e4d745e80-insights-runtime-extractor-tls podName:3d153f53-015d-4cae-a617-0f5e4d745e80 nodeName:}" failed. No retries permitted until 2026-07-06 22:20:46.930200738 +0000 UTC m=+47.718223655 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3d153f53-015d-4cae-a617-0f5e4d745e80-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kwlvj" (UID: "3d153f53-015d-4cae-a617-0f5e4d745e80") : secret "insights-runtime-extractor-tls" not found
Jul 06 22:20:46.916056 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:46.916019    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rcl6h" event={"ID":"4d32d357-4d65-41d8-b9a1-82a5900859f9","Type":"ContainerStarted","Data":"3e59d571103991414657c296d66f6eb86af93b480a574031821d3501f102d689"}
Jul 06 22:20:46.936626 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:46.936576    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rcl6h" podStartSLOduration=1.231431497 podStartE2EDuration="3.936563084s" totalImagesPullingTime="2.705131587s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:20:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:20:46.935857586 +0000 UTC m=+47.723880516" watchObservedRunningTime="2026-07-06 22:20:46.936563084 +0000 UTC m=+47.724586017"
Jul 06 22:20:46.941820 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:46.941795    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3d153f53-015d-4cae-a617-0f5e4d745e80-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kwlvj\" (UID: \"3d153f53-015d-4cae-a617-0f5e4d745e80\") " pod="openshift-insights/insights-runtime-extractor-kwlvj"
Jul 06 22:20:46.941973 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:46.941959    2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 22:20:46.942038 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:46.942016    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3d153f53-015d-4cae-a617-0f5e4d745e80-kube-rbac-proxy-cm podName:3d153f53-015d-4cae-a617-0f5e4d745e80 nodeName:}" failed. No retries permitted until 2026-07-06 22:20:48.942000116 +0000 UTC m=+49.730023040 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3d153f53-015d-4cae-a617-0f5e4d745e80-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kwlvj" (UID: "3d153f53-015d-4cae-a617-0f5e4d745e80") : configmap "kube-rbac-proxy" not found
Jul 06 22:20:46.942132 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:46.942116    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3d153f53-015d-4cae-a617-0f5e4d745e80-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kwlvj\" (UID: \"3d153f53-015d-4cae-a617-0f5e4d745e80\") " pod="openshift-insights/insights-runtime-extractor-kwlvj"
Jul 06 22:20:46.942298 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:46.942278    2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 22:20:46.942358 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:46.942339    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d153f53-015d-4cae-a617-0f5e4d745e80-insights-runtime-extractor-tls podName:3d153f53-015d-4cae-a617-0f5e4d745e80 nodeName:}" failed. No retries permitted until 2026-07-06 22:20:48.942323337 +0000 UTC m=+49.730346265 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3d153f53-015d-4cae-a617-0f5e4d745e80-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kwlvj" (UID: "3d153f53-015d-4cae-a617-0f5e4d745e80") : secret "insights-runtime-extractor-tls" not found
Jul 06 22:20:47.346919 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:47.346884    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/74fd4789-fb73-431e-98a6-d4785a776a04-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-6pj82\" (UID: \"74fd4789-fb73-431e-98a6-d4785a776a04\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6pj82"
Jul 06 22:20:47.347112 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:47.347044    2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 22:20:47.347180 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:47.347146    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74fd4789-fb73-431e-98a6-d4785a776a04-cluster-monitoring-operator-tls podName:74fd4789-fb73-431e-98a6-d4785a776a04 nodeName:}" failed. No retries permitted until 2026-07-06 22:20:55.347122097 +0000 UTC m=+56.135145024 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/74fd4789-fb73-431e-98a6-d4785a776a04-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-6pj82" (UID: "74fd4789-fb73-431e-98a6-d4785a776a04") : secret "cluster-monitoring-operator-tls" not found
Jul 06 22:20:47.447594 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:47.447558    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d3dbf73-97c0-4313-938f-10000be128f8-metrics-certs\") pod \"router-default-57c9599b87-5gwnz\" (UID: \"6d3dbf73-97c0-4313-938f-10000be128f8\") " pod="openshift-ingress/router-default-57c9599b87-5gwnz"
Jul 06 22:20:47.447729 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:47.447684    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d3dbf73-97c0-4313-938f-10000be128f8-service-ca-bundle\") pod \"router-default-57c9599b87-5gwnz\" (UID: \"6d3dbf73-97c0-4313-938f-10000be128f8\") " pod="openshift-ingress/router-default-57c9599b87-5gwnz"
Jul 06 22:20:47.447729 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:47.447704    2556 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 22:20:47.447808 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:47.447764    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d3dbf73-97c0-4313-938f-10000be128f8-metrics-certs podName:6d3dbf73-97c0-4313-938f-10000be128f8 nodeName:}" failed. No retries permitted until 2026-07-06 22:20:55.447747496 +0000 UTC m=+56.235770407 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d3dbf73-97c0-4313-938f-10000be128f8-metrics-certs") pod "router-default-57c9599b87-5gwnz" (UID: "6d3dbf73-97c0-4313-938f-10000be128f8") : secret "router-metrics-certs-default" not found
Jul 06 22:20:47.447853 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:47.447814    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6d3dbf73-97c0-4313-938f-10000be128f8-service-ca-bundle podName:6d3dbf73-97c0-4313-938f-10000be128f8 nodeName:}" failed. No retries permitted until 2026-07-06 22:20:55.447796498 +0000 UTC m=+56.235819424 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6d3dbf73-97c0-4313-938f-10000be128f8-service-ca-bundle") pod "router-default-57c9599b87-5gwnz" (UID: "6d3dbf73-97c0-4313-938f-10000be128f8") : configmap references non-existent config key: service-ca.crt
Jul 06 22:20:47.649429 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:47.649350    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/882825d8-10f4-4768-b9a2-c6465b118b95-registry-tls\") pod \"image-registry-776f784d57-w8vnh\" (UID: \"882825d8-10f4-4768-b9a2-c6465b118b95\") " pod="openshift-image-registry/image-registry-776f784d57-w8vnh"
Jul 06 22:20:47.649590 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:47.649482    2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 22:20:47.649590 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:47.649493    2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-776f784d57-w8vnh: secret "image-registry-tls" not found
Jul 06 22:20:47.649590 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:47.649544    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/882825d8-10f4-4768-b9a2-c6465b118b95-registry-tls podName:882825d8-10f4-4768-b9a2-c6465b118b95 nodeName:}" failed. No retries permitted until 2026-07-06 22:20:55.649530753 +0000 UTC m=+56.437553665 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/882825d8-10f4-4768-b9a2-c6465b118b95-registry-tls") pod "image-registry-776f784d57-w8vnh" (UID: "882825d8-10f4-4768-b9a2-c6465b118b95") : secret "image-registry-tls" not found
Jul 06 22:20:47.784830 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:47.784805    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9gpdr_8f22a5f0-92b2-4853-9cce-38758ed34f72/dns-node-resolver/0.log"
Jul 06 22:20:48.793459 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:48.793432    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-t4r7v_53db0d7a-f95e-4101-9677-2e12ea5f8b26/node-ca/0.log"
Jul 06 22:20:48.959808 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:48.959771    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3d153f53-015d-4cae-a617-0f5e4d745e80-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kwlvj\" (UID: \"3d153f53-015d-4cae-a617-0f5e4d745e80\") " pod="openshift-insights/insights-runtime-extractor-kwlvj"
Jul 06 22:20:48.959989 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:48.959839    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3d153f53-015d-4cae-a617-0f5e4d745e80-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kwlvj\" (UID: \"3d153f53-015d-4cae-a617-0f5e4d745e80\") " pod="openshift-insights/insights-runtime-extractor-kwlvj"
Jul 06 22:20:48.959989 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:48.959909    2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 22:20:48.959989 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:48.959982    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3d153f53-015d-4cae-a617-0f5e4d745e80-kube-rbac-proxy-cm podName:3d153f53-015d-4cae-a617-0f5e4d745e80 nodeName:}" failed. No retries permitted until 2026-07-06 22:20:52.959962484 +0000 UTC m=+53.747985396 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3d153f53-015d-4cae-a617-0f5e4d745e80-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kwlvj" (UID: "3d153f53-015d-4cae-a617-0f5e4d745e80") : configmap "kube-rbac-proxy" not found
Jul 06 22:20:48.960138 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:48.959987    2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 22:20:48.960138 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:48.960057    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d153f53-015d-4cae-a617-0f5e4d745e80-insights-runtime-extractor-tls podName:3d153f53-015d-4cae-a617-0f5e4d745e80 nodeName:}" failed. No retries permitted until 2026-07-06 22:20:52.960040822 +0000 UTC m=+53.748063750 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3d153f53-015d-4cae-a617-0f5e4d745e80-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kwlvj" (UID: "3d153f53-015d-4cae-a617-0f5e4d745e80") : secret "insights-runtime-extractor-tls" not found
Jul 06 22:20:49.464081 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:49.464045    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d5aca2ef-cead-468c-ae99-bb4988f0b2aa-metrics-tls\") pod \"dns-default-grc74\" (UID: \"d5aca2ef-cead-468c-ae99-bb4988f0b2aa\") " pod="openshift-dns/dns-default-grc74"
Jul 06 22:20:49.464269 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:49.464202    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 22:20:49.464315 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:49.464278    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5aca2ef-cead-468c-ae99-bb4988f0b2aa-metrics-tls podName:d5aca2ef-cead-468c-ae99-bb4988f0b2aa nodeName:}" failed. No retries permitted until 2026-07-06 22:21:05.464260812 +0000 UTC m=+66.252283729 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d5aca2ef-cead-468c-ae99-bb4988f0b2aa-metrics-tls") pod "dns-default-grc74" (UID: "d5aca2ef-cead-468c-ae99-bb4988f0b2aa") : secret "dns-default-metrics-tls" not found
Jul 06 22:20:49.783183 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:49.783162    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2vdl9_d02ab32f-a098-478f-a12a-f5bfc6096e27/serve-healthcheck-canary/0.log"
Jul 06 22:20:52.995752 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:52.995718    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3d153f53-015d-4cae-a617-0f5e4d745e80-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kwlvj\" (UID: \"3d153f53-015d-4cae-a617-0f5e4d745e80\") " pod="openshift-insights/insights-runtime-extractor-kwlvj"
Jul 06 22:20:52.996229 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:52.995790    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3d153f53-015d-4cae-a617-0f5e4d745e80-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kwlvj\" (UID: \"3d153f53-015d-4cae-a617-0f5e4d745e80\") " pod="openshift-insights/insights-runtime-extractor-kwlvj"
Jul 06 22:20:52.996229 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:52.995853    2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 22:20:52.996229 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:52.995921    2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 22:20:52.996229 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:52.995927    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3d153f53-015d-4cae-a617-0f5e4d745e80-kube-rbac-proxy-cm podName:3d153f53-015d-4cae-a617-0f5e4d745e80 nodeName:}" failed. No retries permitted until 2026-07-06 22:21:00.995909722 +0000 UTC m=+61.783932650 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3d153f53-015d-4cae-a617-0f5e4d745e80-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kwlvj" (UID: "3d153f53-015d-4cae-a617-0f5e4d745e80") : configmap "kube-rbac-proxy" not found
Jul 06 22:20:52.996229 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:52.995961    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d153f53-015d-4cae-a617-0f5e4d745e80-insights-runtime-extractor-tls podName:3d153f53-015d-4cae-a617-0f5e4d745e80 nodeName:}" failed. No retries permitted until 2026-07-06 22:21:00.995949486 +0000 UTC m=+61.783972397 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3d153f53-015d-4cae-a617-0f5e4d745e80-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kwlvj" (UID: "3d153f53-015d-4cae-a617-0f5e4d745e80") : secret "insights-runtime-extractor-tls" not found
Jul 06 22:20:55.417782 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:55.417727    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/74fd4789-fb73-431e-98a6-d4785a776a04-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-6pj82\" (UID: \"74fd4789-fb73-431e-98a6-d4785a776a04\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6pj82"
Jul 06 22:20:55.418198 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:55.417873    2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 22:20:55.418198 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:55.417940    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74fd4789-fb73-431e-98a6-d4785a776a04-cluster-monitoring-operator-tls podName:74fd4789-fb73-431e-98a6-d4785a776a04 nodeName:}" failed. No retries permitted until 2026-07-06 22:21:11.417924164 +0000 UTC m=+72.205947075 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/74fd4789-fb73-431e-98a6-d4785a776a04-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-6pj82" (UID: "74fd4789-fb73-431e-98a6-d4785a776a04") : secret "cluster-monitoring-operator-tls" not found
Jul 06 22:20:55.518227 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:55.518195    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d3dbf73-97c0-4313-938f-10000be128f8-service-ca-bundle\") pod \"router-default-57c9599b87-5gwnz\" (UID: \"6d3dbf73-97c0-4313-938f-10000be128f8\") " pod="openshift-ingress/router-default-57c9599b87-5gwnz"
Jul 06 22:20:55.518381 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:55.518244    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d3dbf73-97c0-4313-938f-10000be128f8-metrics-certs\") pod \"router-default-57c9599b87-5gwnz\" (UID: \"6d3dbf73-97c0-4313-938f-10000be128f8\") " pod="openshift-ingress/router-default-57c9599b87-5gwnz"
Jul 06 22:20:55.518381 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:55.518374    2556 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 22:20:55.518450 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:55.518377    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6d3dbf73-97c0-4313-938f-10000be128f8-service-ca-bundle podName:6d3dbf73-97c0-4313-938f-10000be128f8 nodeName:}" failed. No retries permitted until 2026-07-06 22:21:11.518360613 +0000 UTC m=+72.306383540 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6d3dbf73-97c0-4313-938f-10000be128f8-service-ca-bundle") pod "router-default-57c9599b87-5gwnz" (UID: "6d3dbf73-97c0-4313-938f-10000be128f8") : configmap references non-existent config key: service-ca.crt
Jul 06 22:20:55.518450 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:55.518418    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d3dbf73-97c0-4313-938f-10000be128f8-metrics-certs podName:6d3dbf73-97c0-4313-938f-10000be128f8 nodeName:}" failed. No retries permitted until 2026-07-06 22:21:11.518408268 +0000 UTC m=+72.306431179 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d3dbf73-97c0-4313-938f-10000be128f8-metrics-certs") pod "router-default-57c9599b87-5gwnz" (UID: "6d3dbf73-97c0-4313-938f-10000be128f8") : secret "router-metrics-certs-default" not found
Jul 06 22:20:55.719397 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:55.719310    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/882825d8-10f4-4768-b9a2-c6465b118b95-registry-tls\") pod \"image-registry-776f784d57-w8vnh\" (UID: \"882825d8-10f4-4768-b9a2-c6465b118b95\") " pod="openshift-image-registry/image-registry-776f784d57-w8vnh"
Jul 06 22:20:55.719541 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:55.719429    2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 22:20:55.719541 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:55.719441    2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-776f784d57-w8vnh: secret "image-registry-tls" not found
Jul 06 22:20:55.719541 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:20:55.719490    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/882825d8-10f4-4768-b9a2-c6465b118b95-registry-tls podName:882825d8-10f4-4768-b9a2-c6465b118b95 nodeName:}" failed. No retries permitted until 2026-07-06 22:21:11.719475946 +0000 UTC m=+72.507498871 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/882825d8-10f4-4768-b9a2-c6465b118b95-registry-tls") pod "image-registry-776f784d57-w8vnh" (UID: "882825d8-10f4-4768-b9a2-c6465b118b95") : secret "image-registry-tls" not found
Jul 06 22:20:58.847298 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:20:58.847268    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mxl25"
Jul 06 22:21:01.066843 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:01.066801    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3d153f53-015d-4cae-a617-0f5e4d745e80-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kwlvj\" (UID: \"3d153f53-015d-4cae-a617-0f5e4d745e80\") " pod="openshift-insights/insights-runtime-extractor-kwlvj"
Jul 06 22:21:01.067264 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:01.066947    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3d153f53-015d-4cae-a617-0f5e4d745e80-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kwlvj\" (UID: \"3d153f53-015d-4cae-a617-0f5e4d745e80\") " pod="openshift-insights/insights-runtime-extractor-kwlvj"
Jul 06 22:21:01.067264 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:21:01.067052    2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 22:21:01.067264 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:21:01.067136    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d153f53-015d-4cae-a617-0f5e4d745e80-insights-runtime-extractor-tls podName:3d153f53-015d-4cae-a617-0f5e4d745e80 nodeName:}" failed. No retries permitted until 2026-07-06 22:21:17.067122282 +0000 UTC m=+77.855145193 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3d153f53-015d-4cae-a617-0f5e4d745e80-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kwlvj" (UID: "3d153f53-015d-4cae-a617-0f5e4d745e80") : secret "insights-runtime-extractor-tls" not found
Jul 06 22:21:01.067373 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:01.067325    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3d153f53-015d-4cae-a617-0f5e4d745e80-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kwlvj\" (UID: \"3d153f53-015d-4cae-a617-0f5e4d745e80\") " pod="openshift-insights/insights-runtime-extractor-kwlvj"
Jul 06 22:21:04.391169 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:04.391133    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6qcl\" (UniqueName: \"kubernetes.io/projected/5fa5d933-5f4e-4ac8-b844-ac59aea241cb-kube-api-access-f6qcl\") pod \"network-check-target-s9ptr\" (UID: \"5fa5d933-5f4e-4ac8-b844-ac59aea241cb\") " pod="openshift-network-diagnostics/network-check-target-s9ptr"
Jul 06 22:21:04.391536 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:04.391255    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40861954-16ff-4b9b-8e92-d00574ea8a9f-metrics-certs\") pod \"network-metrics-daemon-fxpqz\" (UID: \"40861954-16ff-4b9b-8e92-d00574ea8a9f\") " pod="openshift-multus/network-metrics-daemon-fxpqz"
Jul 06 22:21:04.393681 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:04.393664    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 22:21:04.393726 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:04.393718    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 22:21:04.403753 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:04.403731    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40861954-16ff-4b9b-8e92-d00574ea8a9f-metrics-certs\") pod \"network-metrics-daemon-fxpqz\" (UID: \"40861954-16ff-4b9b-8e92-d00574ea8a9f\") " pod="openshift-multus/network-metrics-daemon-fxpqz"
Jul 06 22:21:04.404061 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:04.404048    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 22:21:04.414232 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:04.414212    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6qcl\" (UniqueName: \"kubernetes.io/projected/5fa5d933-5f4e-4ac8-b844-ac59aea241cb-kube-api-access-f6qcl\") pod \"network-check-target-s9ptr\" (UID: \"5fa5d933-5f4e-4ac8-b844-ac59aea241cb\") " pod="openshift-network-diagnostics/network-check-target-s9ptr"
Jul 06 22:21:04.492199 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:04.492154    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ae74a76-a46c-483e-8f38-a4bc4b9f0b03-original-pull-secret\") pod \"global-pull-secret-syncer-626fl\" (UID: \"7ae74a76-a46c-483e-8f38-a4bc4b9f0b03\") " pod="kube-system/global-pull-secret-syncer-626fl"
Jul 06 22:21:04.494925 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:04.494908    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 22:21:04.505059 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:04.505039    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ae74a76-a46c-483e-8f38-a4bc4b9f0b03-original-pull-secret\") pod \"global-pull-secret-syncer-626fl\" (UID: \"7ae74a76-a46c-483e-8f38-a4bc4b9f0b03\") " pod="kube-system/global-pull-secret-syncer-626fl"
Jul 06 22:21:04.656490 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:04.656389    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-626fl"
Jul 06 22:21:04.663462 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:04.663437    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-t8ckr\""
Jul 06 22:21:04.667578 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:04.667557    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zplcn\""
Jul 06 22:21:04.671442 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:04.671421    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxpqz"
Jul 06 22:21:04.676209 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:04.676191    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s9ptr"
Jul 06 22:21:04.806998 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:04.806967    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-626fl"]
Jul 06 22:21:04.809852 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:21:04.809827    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ae74a76_a46c_483e_8f38_a4bc4b9f0b03.slice/crio-2605887bd233e7b2dbd3fd491e9d8ef35def3f89455bfe9d6b122ca4fa52781a WatchSource:0}: Error finding container 2605887bd233e7b2dbd3fd491e9d8ef35def3f89455bfe9d6b122ca4fa52781a: Status 404 returned error can't find the container with id 2605887bd233e7b2dbd3fd491e9d8ef35def3f89455bfe9d6b122ca4fa52781a
Jul 06 22:21:04.958641 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:04.958558    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-626fl" event={"ID":"7ae74a76-a46c-483e-8f38-a4bc4b9f0b03","Type":"ContainerStarted","Data":"2605887bd233e7b2dbd3fd491e9d8ef35def3f89455bfe9d6b122ca4fa52781a"}
Jul 06 22:21:05.025461 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:05.025417    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-s9ptr"]
Jul 06 22:21:05.026732 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:05.026708    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fxpqz"]
Jul 06 22:21:05.028398 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:21:05.028371    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40861954_16ff_4b9b_8e92_d00574ea8a9f.slice/crio-dc3ad073309df3c87de2c35428cd8fbf1e114b39c45a2982a69b77223ec35893 WatchSource:0}: Error finding container dc3ad073309df3c87de2c35428cd8fbf1e114b39c45a2982a69b77223ec35893: Status 404 returned error can't find the container with id dc3ad073309df3c87de2c35428cd8fbf1e114b39c45a2982a69b77223ec35893
Jul 06 22:21:05.029042 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:21:05.029023    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fa5d933_5f4e_4ac8_b844_ac59aea241cb.slice/crio-d8e59b3ae59692621ec897a13429097c2758991e1a5d21a23c1dee8e78fe3d28 WatchSource:0}: Error finding container d8e59b3ae59692621ec897a13429097c2758991e1a5d21a23c1dee8e78fe3d28: Status 404 returned error can't find the container with id d8e59b3ae59692621ec897a13429097c2758991e1a5d21a23c1dee8e78fe3d28
Jul 06 22:21:05.502197 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:05.502160    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d5aca2ef-cead-468c-ae99-bb4988f0b2aa-metrics-tls\") pod \"dns-default-grc74\" (UID: \"d5aca2ef-cead-468c-ae99-bb4988f0b2aa\") " pod="openshift-dns/dns-default-grc74"
Jul 06 22:21:05.505225 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:05.505200    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d5aca2ef-cead-468c-ae99-bb4988f0b2aa-metrics-tls\") pod \"dns-default-grc74\" (UID: \"d5aca2ef-cead-468c-ae99-bb4988f0b2aa\") " pod="openshift-dns/dns-default-grc74"
Jul 06 22:21:05.675298 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:05.675267    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2q2fk\""
Jul 06 22:21:05.684092 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:05.683881    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-grc74"
Jul 06 22:21:05.847299 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:05.847218    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-grc74"]
Jul 06 22:21:05.853037 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:21:05.853003    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5aca2ef_cead_468c_ae99_bb4988f0b2aa.slice/crio-f7ad9e7f34b6f41e93364379d3c595218a267c7cf4c4711190bc63d59b33ed18 WatchSource:0}: Error finding container f7ad9e7f34b6f41e93364379d3c595218a267c7cf4c4711190bc63d59b33ed18: Status 404 returned error can't find the container with id f7ad9e7f34b6f41e93364379d3c595218a267c7cf4c4711190bc63d59b33ed18
Jul 06 22:21:05.964401 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:05.964363    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-s9ptr" event={"ID":"5fa5d933-5f4e-4ac8-b844-ac59aea241cb","Type":"ContainerStarted","Data":"d8e59b3ae59692621ec897a13429097c2758991e1a5d21a23c1dee8e78fe3d28"}
Jul 06 22:21:05.967483 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:05.967450    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fxpqz" event={"ID":"40861954-16ff-4b9b-8e92-d00574ea8a9f","Type":"ContainerStarted","Data":"dc3ad073309df3c87de2c35428cd8fbf1e114b39c45a2982a69b77223ec35893"}
Jul 06 22:21:05.970469 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:05.970442    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-grc74" event={"ID":"d5aca2ef-cead-468c-ae99-bb4988f0b2aa","Type":"ContainerStarted","Data":"f7ad9e7f34b6f41e93364379d3c595218a267c7cf4c4711190bc63d59b33ed18"}
Jul 06 22:21:06.977869 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:06.977021    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fxpqz" event={"ID":"40861954-16ff-4b9b-8e92-d00574ea8a9f","Type":"ContainerStarted","Data":"acc028ddf2bb8acce2cb5972829bdee2df45d530aa4f16bafcd667ad2e69b72d"}
Jul 06 22:21:06.977869 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:06.977086    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fxpqz" event={"ID":"40861954-16ff-4b9b-8e92-d00574ea8a9f","Type":"ContainerStarted","Data":"7702331115f46824e1d7622803d40e77abf21e92f2b6e840787b86abcefb714e"}
Jul 06 22:21:06.997205 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:06.997153    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-fxpqz" podStartSLOduration=65.659252372 podStartE2EDuration="1m6.99713506s" totalImagesPullingTime="1.337882688s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:20:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:21:06.995173693 +0000 UTC m=+67.783196627" watchObservedRunningTime="2026-07-06 22:21:06.99713506 +0000 UTC m=+67.785157996"
Jul 06 22:21:10.992116 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:10.992066    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-grc74" event={"ID":"d5aca2ef-cead-468c-ae99-bb4988f0b2aa","Type":"ContainerStarted","Data":"b08b74aef13b01db3cc0d83d4a8a52da5e1b5e2fa708ffda03154a99f01b0712"}
Jul 06 22:21:10.992584 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:10.992180    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-grc74" event={"ID":"d5aca2ef-cead-468c-ae99-bb4988f0b2aa","Type":"ContainerStarted","Data":"7afd005ca12a90904a66a7da8cdede76802934b88f7b8e0d358941133a156648"}
Jul 06 22:21:10.992584 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:10.992217    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-grc74"
Jul 06 22:21:10.993566 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:10.993543    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-s9ptr" event={"ID":"5fa5d933-5f4e-4ac8-b844-ac59aea241cb","Type":"ContainerStarted","Data":"8ad42fd439ccb91bf4d362842b959237bdcbba651547d9bc1138101919f20f7d"}
Jul 06 22:21:10.993681 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:10.993611    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-s9ptr"
Jul 06 22:21:10.994855 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:10.994834    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-626fl" event={"ID":"7ae74a76-a46c-483e-8f38-a4bc4b9f0b03","Type":"ContainerStarted","Data":"9961b0f1f45816042877a2a3e583431afd44bfdcc3b220bfc06086d0deda70ba"}
Jul 06 22:21:11.013070 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:11.013026    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-grc74" podStartSLOduration=33.685450376 podStartE2EDuration="38.013014011s" totalImagesPullingTime="4.327563635s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:20:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:21:11.012043608 +0000 UTC m=+71.800066538" watchObservedRunningTime="2026-07-06 22:21:11.013014011 +0000 UTC m=+71.801036937"
Jul 06 22:21:11.030464 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:11.030419    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-s9ptr" podStartSLOduration=65.865943244 podStartE2EDuration="1m11.0304071s" totalImagesPullingTime="5.164463856s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:20:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:21:11.030126013 +0000 UTC m=+71.818148943" watchObservedRunningTime="2026-07-06 22:21:11.0304071 +0000 UTC m=+71.818430061"
Jul 06 22:21:11.048050 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:11.048005    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-626fl" podStartSLOduration=65.657929491 podStartE2EDuration="1m11.047990446s" totalImagesPullingTime="5.390060955s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:20:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:21:11.047334088 +0000 UTC m=+71.835357020" watchObservedRunningTime="2026-07-06 22:21:11.047990446 +0000 UTC m=+71.836013378"
Jul 06 22:21:11.456823 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:11.456771    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/74fd4789-fb73-431e-98a6-d4785a776a04-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-6pj82\" (UID: \"74fd4789-fb73-431e-98a6-d4785a776a04\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6pj82"
Jul 06 22:21:11.459234 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:11.459213    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/74fd4789-fb73-431e-98a6-d4785a776a04-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-6pj82\" (UID: \"74fd4789-fb73-431e-98a6-d4785a776a04\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6pj82"
Jul 06 22:21:11.557408 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:11.557357    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d3dbf73-97c0-4313-938f-10000be128f8-service-ca-bundle\") pod \"router-default-57c9599b87-5gwnz\" (UID: \"6d3dbf73-97c0-4313-938f-10000be128f8\") " pod="openshift-ingress/router-default-57c9599b87-5gwnz"
Jul 06 22:21:11.557408 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:11.557419    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d3dbf73-97c0-4313-938f-10000be128f8-metrics-certs\") pod \"router-default-57c9599b87-5gwnz\" (UID: \"6d3dbf73-97c0-4313-938f-10000be128f8\") " pod="openshift-ingress/router-default-57c9599b87-5gwnz"
Jul 06 22:21:11.557962 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:11.557939    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d3dbf73-97c0-4313-938f-10000be128f8-service-ca-bundle\") pod \"router-default-57c9599b87-5gwnz\" (UID: \"6d3dbf73-97c0-4313-938f-10000be128f8\") " pod="openshift-ingress/router-default-57c9599b87-5gwnz"
Jul 06 22:21:11.559711 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:11.559689    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d3dbf73-97c0-4313-938f-10000be128f8-metrics-certs\") pod \"router-default-57c9599b87-5gwnz\" (UID: \"6d3dbf73-97c0-4313-938f-10000be128f8\") " pod="openshift-ingress/router-default-57c9599b87-5gwnz"
Jul 06 22:21:11.669435 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:11.669403    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-776f784d57-w8vnh"]
Jul 06 22:21:11.669621 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:21:11.669604    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-776f784d57-w8vnh" podUID="882825d8-10f4-4768-b9a2-c6465b118b95"
Jul 06 22:21:11.690365 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:11.690338    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-2lm9t\""
Jul 06 22:21:11.696360 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:11.696339    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6pj82"
Jul 06 22:21:11.733130 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:11.733084    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-qvbkz\""
Jul 06 22:21:11.740554 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:11.740532    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-57c9599b87-5gwnz"
Jul 06 22:21:11.759067 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:11.759035    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/882825d8-10f4-4768-b9a2-c6465b118b95-registry-tls\") pod \"image-registry-776f784d57-w8vnh\" (UID: \"882825d8-10f4-4768-b9a2-c6465b118b95\") " pod="openshift-image-registry/image-registry-776f784d57-w8vnh"
Jul 06 22:21:11.762065 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:11.762036    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/882825d8-10f4-4768-b9a2-c6465b118b95-registry-tls\") pod \"image-registry-776f784d57-w8vnh\" (UID: \"882825d8-10f4-4768-b9a2-c6465b118b95\") " pod="openshift-image-registry/image-registry-776f784d57-w8vnh"
Jul 06 22:21:11.799054 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:11.798877    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-klb8g"]
Jul 06 22:21:11.806437 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:11.806416    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5cdbd5f6f7-klz5q"]
Jul 06 22:21:11.806589 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:11.806569    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-klb8g"
Jul 06 22:21:11.809585 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:11.809374    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-6p5hb\""
Jul 06 22:21:11.809585 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:11.809461    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cdbd5f6f7-klz5q"
Jul 06 22:21:11.809798 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:11.809634    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 06 22:21:11.809798 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:11.809760    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 06 22:21:11.815177 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:11.815152    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-klb8g"]
Jul 06 22:21:11.821854 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:11.821829    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5cdbd5f6f7-klz5q"]
Jul 06 22:21:11.842197 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:11.842161    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6pj82"]
Jul 06 22:21:11.846505 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:21:11.846481    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74fd4789_fb73_431e_98a6_d4785a776a04.slice/crio-5d46d82715a7b7f60de1ba5e2e02b6b994a0f38b286711c04e6aad205e79a123 WatchSource:0}: Error finding container 5d46d82715a7b7f60de1ba5e2e02b6b994a0f38b286711c04e6aad205e79a123: Status 404 returned error can't find the container with id 5d46d82715a7b7f60de1ba5e2e02b6b994a0f38b286711c04e6aad205e79a123
Jul 06 22:21:11.885918 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:11.885891    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-57c9599b87-5gwnz"]
Jul 06 22:21:11.888736 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:21:11.888711    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d3dbf73_97c0_4313_938f_10000be128f8.slice/crio-4b6e74ab3ff3d48116dacd26c655bd284d3792e3ac2c9c0716577839cb1208af WatchSource:0}: Error finding container 4b6e74ab3ff3d48116dacd26c655bd284d3792e3ac2c9c0716577839cb1208af: Status 404 returned error can't find the container with id 4b6e74ab3ff3d48116dacd26c655bd284d3792e3ac2c9c0716577839cb1208af
Jul 06 22:21:11.961400 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:11.961349    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fafe1b2c-711e-4f13-9ec8-31882c89af4e-ca-trust-extracted\") pod \"image-registry-5cdbd5f6f7-klz5q\" (UID: \"fafe1b2c-711e-4f13-9ec8-31882c89af4e\") " pod="openshift-image-registry/image-registry-5cdbd5f6f7-klz5q"
Jul 06 22:21:11.961400 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:11.961386    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fafe1b2c-711e-4f13-9ec8-31882c89af4e-installation-pull-secrets\") pod \"image-registry-5cdbd5f6f7-klz5q\" (UID: \"fafe1b2c-711e-4f13-9ec8-31882c89af4e\") " pod="openshift-image-registry/image-registry-5cdbd5f6f7-klz5q"
Jul 06 22:21:11.961530 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:11.961403    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fafe1b2c-711e-4f13-9ec8-31882c89af4e-bound-sa-token\") pod \"image-registry-5cdbd5f6f7-klz5q\" (UID: \"fafe1b2c-711e-4f13-9ec8-31882c89af4e\") " pod="openshift-image-registry/image-registry-5cdbd5f6f7-klz5q"
Jul 06 22:21:11.961530 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:11.961442    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9dqr\" (UniqueName: \"kubernetes.io/projected/fafe1b2c-711e-4f13-9ec8-31882c89af4e-kube-api-access-z9dqr\") pod \"image-registry-5cdbd5f6f7-klz5q\" (UID: \"fafe1b2c-711e-4f13-9ec8-31882c89af4e\") " pod="openshift-image-registry/image-registry-5cdbd5f6f7-klz5q"
Jul 06 22:21:11.961530 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:11.961500    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fafe1b2c-711e-4f13-9ec8-31882c89af4e-trusted-ca\") pod \"image-registry-5cdbd5f6f7-klz5q\" (UID: \"fafe1b2c-711e-4f13-9ec8-31882c89af4e\") " pod="openshift-image-registry/image-registry-5cdbd5f6f7-klz5q"
Jul 06 22:21:11.961705 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:11.961530    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fafe1b2c-711e-4f13-9ec8-31882c89af4e-registry-certificates\") pod \"image-registry-5cdbd5f6f7-klz5q\" (UID: \"fafe1b2c-711e-4f13-9ec8-31882c89af4e\") " pod="openshift-image-registry/image-registry-5cdbd5f6f7-klz5q"
Jul 06 22:21:11.961705 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:11.961550    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fafe1b2c-711e-4f13-9ec8-31882c89af4e-registry-tls\") pod \"image-registry-5cdbd5f6f7-klz5q\" (UID: \"fafe1b2c-711e-4f13-9ec8-31882c89af4e\") " pod="openshift-image-registry/image-registry-5cdbd5f6f7-klz5q"
Jul 06 22:21:11.961705 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:11.961600    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/611ceaf8-f1df-4077-9881-4f7291342c79-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-klb8g\" (UID: \"611ceaf8-f1df-4077-9881-4f7291342c79\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-klb8g"
Jul 06 22:21:11.961705 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:11.961631    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fafe1b2c-711e-4f13-9ec8-31882c89af4e-image-registry-private-configuration\") pod \"image-registry-5cdbd5f6f7-klz5q\" (UID: \"fafe1b2c-711e-4f13-9ec8-31882c89af4e\") " pod="openshift-image-registry/image-registry-5cdbd5f6f7-klz5q"
Jul 06 22:21:11.961705 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:11.961653    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/611ceaf8-f1df-4077-9881-4f7291342c79-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-klb8g\" (UID: \"611ceaf8-f1df-4077-9881-4f7291342c79\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-klb8g"
Jul 06 22:21:11.998965 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:11.998924    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6pj82" event={"ID":"74fd4789-fb73-431e-98a6-d4785a776a04","Type":"ContainerStarted","Data":"5d46d82715a7b7f60de1ba5e2e02b6b994a0f38b286711c04e6aad205e79a123"}
Jul 06 22:21:12.000940 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:12.000912    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-57c9599b87-5gwnz" event={"ID":"6d3dbf73-97c0-4313-938f-10000be128f8","Type":"ContainerStarted","Data":"2d3978a9b78805c9cacf993d27101a06e70d450e1d91536894443a31c8210759"}
Jul 06 22:21:12.001043 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:12.000959    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-57c9599b87-5gwnz" event={"ID":"6d3dbf73-97c0-4313-938f-10000be128f8","Type":"ContainerStarted","Data":"4b6e74ab3ff3d48116dacd26c655bd284d3792e3ac2c9c0716577839cb1208af"}
Jul 06 22:21:12.001140 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:12.001048    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-776f784d57-w8vnh"
Jul 06 22:21:12.007384 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:12.007366    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-776f784d57-w8vnh"
Jul 06 22:21:12.033018 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:12.032945    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-57c9599b87-5gwnz" podStartSLOduration=33.032928944 podStartE2EDuration="33.032928944s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:20:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:21:12.032344483 +0000 UTC m=+72.820367416" watchObservedRunningTime="2026-07-06 22:21:12.032928944 +0000 UTC m=+72.820951877"
Jul 06 22:21:12.062009 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:12.061979    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fafe1b2c-711e-4f13-9ec8-31882c89af4e-registry-tls\") pod \"image-registry-5cdbd5f6f7-klz5q\" (UID: \"fafe1b2c-711e-4f13-9ec8-31882c89af4e\") " pod="openshift-image-registry/image-registry-5cdbd5f6f7-klz5q"
Jul 06 22:21:12.062127 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:12.062021    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/611ceaf8-f1df-4077-9881-4f7291342c79-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-klb8g\" (UID: \"611ceaf8-f1df-4077-9881-4f7291342c79\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-klb8g"
Jul 06 22:21:12.062127 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:12.062043    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fafe1b2c-711e-4f13-9ec8-31882c89af4e-image-registry-private-configuration\") pod \"image-registry-5cdbd5f6f7-klz5q\" (UID: \"fafe1b2c-711e-4f13-9ec8-31882c89af4e\") " pod="openshift-image-registry/image-registry-5cdbd5f6f7-klz5q"
Jul 06 22:21:12.062127 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:12.062062    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/611ceaf8-f1df-4077-9881-4f7291342c79-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-klb8g\" (UID: \"611ceaf8-f1df-4077-9881-4f7291342c79\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-klb8g"
Jul 06 22:21:12.062127 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:12.062089    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fafe1b2c-711e-4f13-9ec8-31882c89af4e-ca-trust-extracted\") pod \"image-registry-5cdbd5f6f7-klz5q\" (UID: \"fafe1b2c-711e-4f13-9ec8-31882c89af4e\") " pod="openshift-image-registry/image-registry-5cdbd5f6f7-klz5q"
Jul 06 22:21:12.062336 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:12.062136    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fafe1b2c-711e-4f13-9ec8-31882c89af4e-installation-pull-secrets\") pod \"image-registry-5cdbd5f6f7-klz5q\" (UID: \"fafe1b2c-711e-4f13-9ec8-31882c89af4e\") " pod="openshift-image-registry/image-registry-5cdbd5f6f7-klz5q"
Jul 06 22:21:12.062336 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:12.062153    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fafe1b2c-711e-4f13-9ec8-31882c89af4e-bound-sa-token\") pod \"image-registry-5cdbd5f6f7-klz5q\" (UID: \"fafe1b2c-711e-4f13-9ec8-31882c89af4e\") " pod="openshift-image-registry/image-registry-5cdbd5f6f7-klz5q"
Jul 06 22:21:12.062336 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:12.062169    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9dqr\" (UniqueName: \"kubernetes.io/projected/fafe1b2c-711e-4f13-9ec8-31882c89af4e-kube-api-access-z9dqr\") pod \"image-registry-5cdbd5f6f7-klz5q\" (UID: \"fafe1b2c-711e-4f13-9ec8-31882c89af4e\") " pod="openshift-image-registry/image-registry-5cdbd5f6f7-klz5q"
Jul 06 22:21:12.062597 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:12.062571    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fafe1b2c-711e-4f13-9ec8-31882c89af4e-trusted-ca\") pod \"image-registry-5cdbd5f6f7-klz5q\" (UID: \"fafe1b2c-711e-4f13-9ec8-31882c89af4e\") " pod="openshift-image-registry/image-registry-5cdbd5f6f7-klz5q"
Jul 06 22:21:12.062729 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:12.062616    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fafe1b2c-711e-4f13-9ec8-31882c89af4e-registry-certificates\") pod \"image-registry-5cdbd5f6f7-klz5q\" (UID: \"fafe1b2c-711e-4f13-9ec8-31882c89af4e\") " pod="openshift-image-registry/image-registry-5cdbd5f6f7-klz5q"
Jul 06 22:21:12.062729 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:12.062684    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fafe1b2c-711e-4f13-9ec8-31882c89af4e-ca-trust-extracted\") pod \"image-registry-5cdbd5f6f7-klz5q\" (UID: \"fafe1b2c-711e-4f13-9ec8-31882c89af4e\") " pod="openshift-image-registry/image-registry-5cdbd5f6f7-klz5q"
Jul 06 22:21:12.062887 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:12.062861    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/611ceaf8-f1df-4077-9881-4f7291342c79-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-klb8g\" (UID: \"611ceaf8-f1df-4077-9881-4f7291342c79\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-klb8g"
Jul 06 22:21:12.063531 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:12.063510    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fafe1b2c-711e-4f13-9ec8-31882c89af4e-registry-certificates\") pod \"image-registry-5cdbd5f6f7-klz5q\" (UID: \"fafe1b2c-711e-4f13-9ec8-31882c89af4e\") " pod="openshift-image-registry/image-registry-5cdbd5f6f7-klz5q"
Jul 06 22:21:12.063789 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:12.063767    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fafe1b2c-711e-4f13-9ec8-31882c89af4e-trusted-ca\") pod \"image-registry-5cdbd5f6f7-klz5q\" (UID: \"fafe1b2c-711e-4f13-9ec8-31882c89af4e\") " pod="openshift-image-registry/image-registry-5cdbd5f6f7-klz5q"
Jul 06 22:21:12.064600 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:12.064574    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fafe1b2c-711e-4f13-9ec8-31882c89af4e-registry-tls\") pod \"image-registry-5cdbd5f6f7-klz5q\" (UID: \"fafe1b2c-711e-4f13-9ec8-31882c89af4e\") " pod="openshift-image-registry/image-registry-5cdbd5f6f7-klz5q"
Jul 06 22:21:12.064696 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:12.064675    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fafe1b2c-711e-4f13-9ec8-31882c89af4e-image-registry-private-configuration\") pod \"image-registry-5cdbd5f6f7-klz5q\" (UID: \"fafe1b2c-711e-4f13-9ec8-31882c89af4e\") " pod="openshift-image-registry/image-registry-5cdbd5f6f7-klz5q"
Jul 06 22:21:12.064744 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:12.064702    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/611ceaf8-f1df-4077-9881-4f7291342c79-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-klb8g\" (UID: \"611ceaf8-f1df-4077-9881-4f7291342c79\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-klb8g"
Jul 06 22:21:12.064789 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:12.064773    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fafe1b2c-711e-4f13-9ec8-31882c89af4e-installation-pull-secrets\") pod \"image-registry-5cdbd5f6f7-klz5q\" (UID: \"fafe1b2c-711e-4f13-9ec8-31882c89af4e\") " pod="openshift-image-registry/image-registry-5cdbd5f6f7-klz5q"
Jul 06 22:21:12.074308 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:12.074284    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fafe1b2c-711e-4f13-9ec8-31882c89af4e-bound-sa-token\") pod \"image-registry-5cdbd5f6f7-klz5q\" (UID: \"fafe1b2c-711e-4f13-9ec8-31882c89af4e\") " pod="openshift-image-registry/image-registry-5cdbd5f6f7-klz5q"
Jul 06 22:21:12.074585 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:12.074570    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9dqr\" (UniqueName: \"kubernetes.io/projected/fafe1b2c-711e-4f13-9ec8-31882c89af4e-kube-api-access-z9dqr\") pod \"image-registry-5cdbd5f6f7-klz5q\" (UID: \"fafe1b2c-711e-4f13-9ec8-31882c89af4e\") " pod="openshift-image-registry/image-registry-5cdbd5f6f7-klz5q"
Jul 06 22:21:12.122480 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:12.122458    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-klb8g"
Jul 06 22:21:12.130904 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:12.130885    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mnwqj\""
Jul 06 22:21:12.138896 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:12.138879    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cdbd5f6f7-klz5q"
Jul 06 22:21:12.163538 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:12.163508    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/882825d8-10f4-4768-b9a2-c6465b118b95-ca-trust-extracted\") pod \"882825d8-10f4-4768-b9a2-c6465b118b95\" (UID: \"882825d8-10f4-4768-b9a2-c6465b118b95\") "
Jul 06 22:21:12.163677 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:12.163557    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/882825d8-10f4-4768-b9a2-c6465b118b95-bound-sa-token\") pod \"882825d8-10f4-4768-b9a2-c6465b118b95\" (UID: \"882825d8-10f4-4768-b9a2-c6465b118b95\") "
Jul 06 22:21:12.163677 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:12.163613    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/882825d8-10f4-4768-b9a2-c6465b118b95-installation-pull-secrets\") pod \"882825d8-10f4-4768-b9a2-c6465b118b95\" (UID: \"882825d8-10f4-4768-b9a2-c6465b118b95\") "
Jul 06 22:21:12.163677 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:12.163646    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/882825d8-10f4-4768-b9a2-c6465b118b95-image-registry-private-configuration\") pod \"882825d8-10f4-4768-b9a2-c6465b118b95\" (UID: \"882825d8-10f4-4768-b9a2-c6465b118b95\") "
Jul 06 22:21:12.163835 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:12.163688    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/882825d8-10f4-4768-b9a2-c6465b118b95-registry-certificates\") pod \"882825d8-10f4-4768-b9a2-c6465b118b95\" (UID: \"882825d8-10f4-4768-b9a2-c6465b118b95\") "
Jul 06 22:21:12.163835 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:12.163744    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/882825d8-10f4-4768-b9a2-c6465b118b95-trusted-ca\") pod \"882825d8-10f4-4768-b9a2-c6465b118b95\" (UID: \"882825d8-10f4-4768-b9a2-c6465b118b95\") "
Jul 06 22:21:12.163835 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:12.163773    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4cvxw\" (UniqueName: \"kubernetes.io/projected/882825d8-10f4-4768-b9a2-c6465b118b95-kube-api-access-4cvxw\") pod \"882825d8-10f4-4768-b9a2-c6465b118b95\" (UID: \"882825d8-10f4-4768-b9a2-c6465b118b95\") "
Jul 06 22:21:12.163835 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:12.163798    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/882825d8-10f4-4768-b9a2-c6465b118b95-registry-tls\") pod \"882825d8-10f4-4768-b9a2-c6465b118b95\" (UID: \"882825d8-10f4-4768-b9a2-c6465b118b95\") "
Jul 06 22:21:12.163835 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:12.163801    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/882825d8-10f4-4768-b9a2-c6465b118b95-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "882825d8-10f4-4768-b9a2-c6465b118b95" (UID: "882825d8-10f4-4768-b9a2-c6465b118b95"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 22:21:12.165354 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:12.164140    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/882825d8-10f4-4768-b9a2-c6465b118b95-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "882825d8-10f4-4768-b9a2-c6465b118b95" (UID: "882825d8-10f4-4768-b9a2-c6465b118b95"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 22:21:12.165354 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:12.164197    2556 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/882825d8-10f4-4768-b9a2-c6465b118b95-ca-trust-extracted\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\""
Jul 06 22:21:12.165713 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:12.165598    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/882825d8-10f4-4768-b9a2-c6465b118b95-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "882825d8-10f4-4768-b9a2-c6465b118b95" (UID: "882825d8-10f4-4768-b9a2-c6465b118b95"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 22:21:12.166417 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:12.166386    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/882825d8-10f4-4768-b9a2-c6465b118b95-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "882825d8-10f4-4768-b9a2-c6465b118b95" (UID: "882825d8-10f4-4768-b9a2-c6465b118b95"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 22:21:12.166513 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:12.166492    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/882825d8-10f4-4768-b9a2-c6465b118b95-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "882825d8-10f4-4768-b9a2-c6465b118b95" (UID: "882825d8-10f4-4768-b9a2-c6465b118b95"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 22:21:12.166776 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:12.166752    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/882825d8-10f4-4768-b9a2-c6465b118b95-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "882825d8-10f4-4768-b9a2-c6465b118b95" (UID: "882825d8-10f4-4768-b9a2-c6465b118b95"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 22:21:12.167567 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:12.167531    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/882825d8-10f4-4768-b9a2-c6465b118b95-kube-api-access-4cvxw" (OuterVolumeSpecName: "kube-api-access-4cvxw") pod "882825d8-10f4-4768-b9a2-c6465b118b95" (UID: "882825d8-10f4-4768-b9a2-c6465b118b95"). InnerVolumeSpecName "kube-api-access-4cvxw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 22:21:12.167670 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:12.167644    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/882825d8-10f4-4768-b9a2-c6465b118b95-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "882825d8-10f4-4768-b9a2-c6465b118b95" (UID: "882825d8-10f4-4768-b9a2-c6465b118b95"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 22:21:12.253827 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:12.253789    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-klb8g"]
Jul 06 22:21:12.256768 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:21:12.256739    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod611ceaf8_f1df_4077_9881_4f7291342c79.slice/crio-fb2261103e9a21c7cc4a6ce1ef4f0e4b9c46e80cf75bb0910b62c15367aeed44 WatchSource:0}: Error finding container fb2261103e9a21c7cc4a6ce1ef4f0e4b9c46e80cf75bb0910b62c15367aeed44: Status 404 returned error can't find the container with id fb2261103e9a21c7cc4a6ce1ef4f0e4b9c46e80cf75bb0910b62c15367aeed44
Jul 06 22:21:12.265430 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:12.265410    2556 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/882825d8-10f4-4768-b9a2-c6465b118b95-installation-pull-secrets\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\""
Jul 06 22:21:12.265430 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:12.265432    2556 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/882825d8-10f4-4768-b9a2-c6465b118b95-image-registry-private-configuration\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\""
Jul 06 22:21:12.265545 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:12.265441    2556 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/882825d8-10f4-4768-b9a2-c6465b118b95-registry-certificates\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\""
Jul 06 22:21:12.265545 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:12.265450    2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/882825d8-10f4-4768-b9a2-c6465b118b95-trusted-ca\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\""
Jul 06 22:21:12.265545 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:12.265459    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4cvxw\" (UniqueName: \"kubernetes.io/projected/882825d8-10f4-4768-b9a2-c6465b118b95-kube-api-access-4cvxw\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\""
Jul 06 22:21:12.265545 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:12.265467    2556 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/882825d8-10f4-4768-b9a2-c6465b118b95-registry-tls\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\""
Jul 06 22:21:12.265545 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:12.265475    2556 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/882825d8-10f4-4768-b9a2-c6465b118b95-bound-sa-token\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\""
Jul 06 22:21:12.276967 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:12.276946    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5cdbd5f6f7-klz5q"]
Jul 06 22:21:12.278901 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:21:12.278873    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfafe1b2c_711e_4f13_9ec8_31882c89af4e.slice/crio-39f235c2df2ec1ce78fb5307a93e3bfb2f3beb3cddb5d890348d1805e3a109fd WatchSource:0}: Error finding container 39f235c2df2ec1ce78fb5307a93e3bfb2f3beb3cddb5d890348d1805e3a109fd: Status 404 returned error can't find the container with id 39f235c2df2ec1ce78fb5307a93e3bfb2f3beb3cddb5d890348d1805e3a109fd
Jul 06 22:21:12.741692 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:12.741621    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-57c9599b87-5gwnz"
Jul 06 22:21:12.743883 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:12.743862    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-57c9599b87-5gwnz"
Jul 06 22:21:13.007570 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:13.007473    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5cdbd5f6f7-klz5q" event={"ID":"fafe1b2c-711e-4f13-9ec8-31882c89af4e","Type":"ContainerStarted","Data":"d75155374249ef1fc542dac972e43926eadb0f1c27ff4c3dc8421b2f2de84b7c"}
Jul 06 22:21:13.007570 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:13.007548    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5cdbd5f6f7-klz5q"
Jul 06 22:21:13.008049 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:13.007570    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5cdbd5f6f7-klz5q" event={"ID":"fafe1b2c-711e-4f13-9ec8-31882c89af4e","Type":"ContainerStarted","Data":"39f235c2df2ec1ce78fb5307a93e3bfb2f3beb3cddb5d890348d1805e3a109fd"}
Jul 06 22:21:13.008616 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:13.008580    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-klb8g" event={"ID":"611ceaf8-f1df-4077-9881-4f7291342c79","Type":"ContainerStarted","Data":"fb2261103e9a21c7cc4a6ce1ef4f0e4b9c46e80cf75bb0910b62c15367aeed44"}
Jul 06 22:21:13.008778 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:13.008754    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-776f784d57-w8vnh"
Jul 06 22:21:13.008959 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:13.008940    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-57c9599b87-5gwnz"
Jul 06 22:21:13.010228 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:13.010211    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-57c9599b87-5gwnz"
Jul 06 22:21:13.034215 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:13.034172    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5cdbd5f6f7-klz5q" podStartSLOduration=2.034158552 podStartE2EDuration="2.034158552s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:21:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:21:13.033373117 +0000 UTC m=+73.821396050" watchObservedRunningTime="2026-07-06 22:21:13.034158552 +0000 UTC m=+73.822181485"
Jul 06 22:21:13.082030 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:13.082004    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-776f784d57-w8vnh"]
Jul 06 22:21:13.087600 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:13.087576    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-776f784d57-w8vnh"]
Jul 06 22:21:13.651180 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:13.651151    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="882825d8-10f4-4768-b9a2-c6465b118b95" path="/var/lib/kubelet/pods/882825d8-10f4-4768-b9a2-c6465b118b95/volumes"
Jul 06 22:21:15.017438 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:15.017351    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6pj82" event={"ID":"74fd4789-fb73-431e-98a6-d4785a776a04","Type":"ContainerStarted","Data":"375e383822c1fc645c2b20eae9a882709770bd24020c738835e74ac454262878"}
Jul 06 22:21:15.019072 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:15.019041    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-klb8g" event={"ID":"611ceaf8-f1df-4077-9881-4f7291342c79","Type":"ContainerStarted","Data":"a2365e59c7d4ef179afa29eff511056fbc99d6af17f5a3514927f5e5b68992de"}
Jul 06 22:21:15.036919 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:15.036879    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6pj82" podStartSLOduration=33.254965281 podStartE2EDuration="36.036866526s" totalImagesPullingTime="2.781901245s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:20:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:21:15.035210957 +0000 UTC m=+75.823233890" watchObservedRunningTime="2026-07-06 22:21:15.036866526 +0000 UTC m=+75.824889458"
Jul 06 22:21:15.051726 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:15.051683    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-klb8g" podStartSLOduration=1.683822813 podStartE2EDuration="4.051670582s" totalImagesPullingTime="2.367847769s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:21:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:21:15.051667243 +0000 UTC m=+75.839690174" watchObservedRunningTime="2026-07-06 22:21:15.051670582 +0000 UTC m=+75.839693514"
Jul 06 22:21:15.224113 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:15.224071    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-95fln"]
Jul 06 22:21:15.255364 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:15.255334    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-95fln"]
Jul 06 22:21:15.255477 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:15.255415    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-95fln"
Jul 06 22:21:15.258140 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:15.258121    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 06 22:21:15.258258 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:15.258167    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-25mch\""
Jul 06 22:21:15.391901 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:15.391870    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/fd85eeec-c642-44d8-a0aa-dc207c328d21-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-95fln\" (UID: \"fd85eeec-c642-44d8-a0aa-dc207c328d21\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-95fln"
Jul 06 22:21:15.492286 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:15.492254    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/fd85eeec-c642-44d8-a0aa-dc207c328d21-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-95fln\" (UID: \"fd85eeec-c642-44d8-a0aa-dc207c328d21\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-95fln"
Jul 06 22:21:15.494620 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:15.494590    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/fd85eeec-c642-44d8-a0aa-dc207c328d21-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-95fln\" (UID: \"fd85eeec-c642-44d8-a0aa-dc207c328d21\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-95fln"
Jul 06 22:21:15.564812 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:15.564784    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-95fln"
Jul 06 22:21:15.711766 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:15.711428    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-95fln"]
Jul 06 22:21:15.714195 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:21:15.714171    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd85eeec_c642_44d8_a0aa_dc207c328d21.slice/crio-ffc009e33d819aef056c0106f9b1ea97e35a33115d5a770df6675cd5314afe19 WatchSource:0}: Error finding container ffc009e33d819aef056c0106f9b1ea97e35a33115d5a770df6675cd5314afe19: Status 404 returned error can't find the container with id ffc009e33d819aef056c0106f9b1ea97e35a33115d5a770df6675cd5314afe19
Jul 06 22:21:16.023241 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:16.023164    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-95fln" event={"ID":"fd85eeec-c642-44d8-a0aa-dc207c328d21","Type":"ContainerStarted","Data":"ffc009e33d819aef056c0106f9b1ea97e35a33115d5a770df6675cd5314afe19"}
Jul 06 22:21:17.104313 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:17.104280    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3d153f53-015d-4cae-a617-0f5e4d745e80-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kwlvj\" (UID: \"3d153f53-015d-4cae-a617-0f5e4d745e80\") " pod="openshift-insights/insights-runtime-extractor-kwlvj"
Jul 06 22:21:17.106434 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:17.106415    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3d153f53-015d-4cae-a617-0f5e4d745e80-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kwlvj\" (UID: \"3d153f53-015d-4cae-a617-0f5e4d745e80\") " pod="openshift-insights/insights-runtime-extractor-kwlvj"
Jul 06 22:21:17.332670 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:17.332652    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-dhrwd\""
Jul 06 22:21:17.340673 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:17.340657    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kwlvj"
Jul 06 22:21:17.469489 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:17.469460    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kwlvj"]
Jul 06 22:21:17.472480 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:21:17.472454    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d153f53_015d_4cae_a617_0f5e4d745e80.slice/crio-b17c4517509f95149319199a8c5ce3a28290d9e880c766648a8e31d62f127e9a WatchSource:0}: Error finding container b17c4517509f95149319199a8c5ce3a28290d9e880c766648a8e31d62f127e9a: Status 404 returned error can't find the container with id b17c4517509f95149319199a8c5ce3a28290d9e880c766648a8e31d62f127e9a
Jul 06 22:21:18.034249 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:18.034212    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-95fln" event={"ID":"fd85eeec-c642-44d8-a0aa-dc207c328d21","Type":"ContainerStarted","Data":"9db8cd2c155998f7b1cb5f7ff554f817e0ba88b5d6f46026967e700affed402a"}
Jul 06 22:21:18.035159 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:18.035136    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-95fln"
Jul 06 22:21:18.038197 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:18.038169    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kwlvj" event={"ID":"3d153f53-015d-4cae-a617-0f5e4d745e80","Type":"ContainerStarted","Data":"b17c4517509f95149319199a8c5ce3a28290d9e880c766648a8e31d62f127e9a"}
Jul 06 22:21:18.041681 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:18.041650    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-95fln"
Jul 06 22:21:18.087109 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:18.087014    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-95fln" podStartSLOduration=1.4699099869999999 podStartE2EDuration="3.086993519s" totalImagesPullingTime="1.617083532s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:21:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:21:18.057431268 +0000 UTC m=+78.845454201" watchObservedRunningTime="2026-07-06 22:21:18.086993519 +0000 UTC m=+78.875016453"
Jul 06 22:21:18.355411 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:18.354080    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-mgt48"]
Jul 06 22:21:18.358085 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:18.357734    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-mgt48"
Jul 06 22:21:18.362070 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:18.362048    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 06 22:21:18.363038 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:18.363017    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-jdpll\""
Jul 06 22:21:18.363489 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:18.363321    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 06 22:21:18.363586 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:18.363492    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 06 22:21:18.369673 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:18.369605    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-mgt48"]
Jul 06 22:21:18.514404 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:18.514371    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8255ff86-cf58-4957-a4f1-d994d79137a7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-mgt48\" (UID: \"8255ff86-cf58-4957-a4f1-d994d79137a7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-mgt48"
Jul 06 22:21:18.514570 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:18.514433    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8255ff86-cf58-4957-a4f1-d994d79137a7-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-mgt48\" (UID: \"8255ff86-cf58-4957-a4f1-d994d79137a7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-mgt48"
Jul 06 22:21:18.514570 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:18.514495    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8255ff86-cf58-4957-a4f1-d994d79137a7-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-mgt48\" (UID: \"8255ff86-cf58-4957-a4f1-d994d79137a7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-mgt48"
Jul 06 22:21:18.514570 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:18.514547    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xl4nz\" (UniqueName: \"kubernetes.io/projected/8255ff86-cf58-4957-a4f1-d994d79137a7-kube-api-access-xl4nz\") pod \"prometheus-operator-567f7b8b7c-mgt48\" (UID: \"8255ff86-cf58-4957-a4f1-d994d79137a7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-mgt48"
Jul 06 22:21:18.615974 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:18.615886    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8255ff86-cf58-4957-a4f1-d994d79137a7-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-mgt48\" (UID: \"8255ff86-cf58-4957-a4f1-d994d79137a7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-mgt48"
Jul 06 22:21:18.615974 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:18.615947    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8255ff86-cf58-4957-a4f1-d994d79137a7-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-mgt48\" (UID: \"8255ff86-cf58-4957-a4f1-d994d79137a7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-mgt48"
Jul 06 22:21:18.616207 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:18.615979    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xl4nz\" (UniqueName: \"kubernetes.io/projected/8255ff86-cf58-4957-a4f1-d994d79137a7-kube-api-access-xl4nz\") pod \"prometheus-operator-567f7b8b7c-mgt48\" (UID: \"8255ff86-cf58-4957-a4f1-d994d79137a7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-mgt48"
Jul 06 22:21:18.616207 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:18.616033    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8255ff86-cf58-4957-a4f1-d994d79137a7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-mgt48\" (UID: \"8255ff86-cf58-4957-a4f1-d994d79137a7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-mgt48"
Jul 06 22:21:18.616207 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:21:18.616080    2556 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 06 22:21:18.616207 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:21:18.616171    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8255ff86-cf58-4957-a4f1-d994d79137a7-prometheus-operator-tls podName:8255ff86-cf58-4957-a4f1-d994d79137a7 nodeName:}" failed. No retries permitted until 2026-07-06 22:21:19.116147769 +0000 UTC m=+79.904170697 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/8255ff86-cf58-4957-a4f1-d994d79137a7-prometheus-operator-tls") pod "prometheus-operator-567f7b8b7c-mgt48" (UID: "8255ff86-cf58-4957-a4f1-d994d79137a7") : secret "prometheus-operator-tls" not found
Jul 06 22:21:18.616711 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:18.616685    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8255ff86-cf58-4957-a4f1-d994d79137a7-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-mgt48\" (UID: \"8255ff86-cf58-4957-a4f1-d994d79137a7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-mgt48"
Jul 06 22:21:18.618827 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:18.618801    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8255ff86-cf58-4957-a4f1-d994d79137a7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-mgt48\" (UID: \"8255ff86-cf58-4957-a4f1-d994d79137a7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-mgt48"
Jul 06 22:21:18.628040 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:18.628017    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xl4nz\" (UniqueName: \"kubernetes.io/projected/8255ff86-cf58-4957-a4f1-d994d79137a7-kube-api-access-xl4nz\") pod \"prometheus-operator-567f7b8b7c-mgt48\" (UID: \"8255ff86-cf58-4957-a4f1-d994d79137a7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-mgt48"
Jul 06 22:21:19.120753 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:19.120709    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8255ff86-cf58-4957-a4f1-d994d79137a7-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-mgt48\" (UID: \"8255ff86-cf58-4957-a4f1-d994d79137a7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-mgt48"
Jul 06 22:21:19.123568 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:19.123516    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8255ff86-cf58-4957-a4f1-d994d79137a7-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-mgt48\" (UID: \"8255ff86-cf58-4957-a4f1-d994d79137a7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-mgt48"
Jul 06 22:21:19.270729 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:19.270692    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-mgt48"
Jul 06 22:21:21.004061 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:21.004031    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-grc74"
Jul 06 22:21:21.244897 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:21.244871    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-mgt48"]
Jul 06 22:21:21.246651 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:21:21.246582    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8255ff86_cf58_4957_a4f1_d994d79137a7.slice/crio-3b1b89f8eb1cb9f91175185fb751893ba111cc4c79dc0ea8fd4b2f279b1bf85a WatchSource:0}: Error finding container 3b1b89f8eb1cb9f91175185fb751893ba111cc4c79dc0ea8fd4b2f279b1bf85a: Status 404 returned error can't find the container with id 3b1b89f8eb1cb9f91175185fb751893ba111cc4c79dc0ea8fd4b2f279b1bf85a
Jul 06 22:21:22.055215 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:22.055176    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kwlvj" event={"ID":"3d153f53-015d-4cae-a617-0f5e4d745e80","Type":"ContainerStarted","Data":"10e15ae72a57f44adefa6b705ab2da184d72a5d268898fe589a8e864036377da"}
Jul 06 22:21:22.055578 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:22.055241    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kwlvj" event={"ID":"3d153f53-015d-4cae-a617-0f5e4d745e80","Type":"ContainerStarted","Data":"23e039f8bcb13204e7ec6b1082e4b2349d4bdbca80224033f5d8fb22018daf67"}
Jul 06 22:21:22.056706 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:22.056684    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-mgt48" event={"ID":"8255ff86-cf58-4957-a4f1-d994d79137a7","Type":"ContainerStarted","Data":"3b1b89f8eb1cb9f91175185fb751893ba111cc4c79dc0ea8fd4b2f279b1bf85a"}
Jul 06 22:21:23.062877 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:23.062840    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-mgt48" event={"ID":"8255ff86-cf58-4957-a4f1-d994d79137a7","Type":"ContainerStarted","Data":"926ace67e908ef76b07cec4b2f911f7502dd8b02eff18f49b1ea4bf681ae0fcb"}
Jul 06 22:21:23.063355 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:23.062903    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-mgt48" event={"ID":"8255ff86-cf58-4957-a4f1-d994d79137a7","Type":"ContainerStarted","Data":"a4c68b1d111ff1480afdbae5c49682dd6e843569ef41da357c90082ace511b31"}
Jul 06 22:21:23.089945 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:23.089889    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-mgt48" podStartSLOduration=3.590829721 podStartE2EDuration="5.089872487s" totalImagesPullingTime="1.499042766s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:21:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:21:23.088377237 +0000 UTC m=+83.876400216" watchObservedRunningTime="2026-07-06 22:21:23.089872487 +0000 UTC m=+83.877895420"
Jul 06 22:21:24.985688 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:24.985658    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-t92w6"]
Jul 06 22:21:24.988976 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:24.988954    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-t92w6"
Jul 06 22:21:24.992398 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:24.992379    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-qgwgf\""
Jul 06 22:21:24.992666 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:24.992652    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 06 22:21:24.992840 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:24.992822    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 06 22:21:24.993243 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:24.993230    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 06 22:21:25.074404 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:25.074369    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kwlvj" event={"ID":"3d153f53-015d-4cae-a617-0f5e4d745e80","Type":"ContainerStarted","Data":"c94471d193b2fff0f3ab00035f8e6c2df601898ffb50eb462e53cd0270c655f2"}
Jul 06 22:21:25.100509 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:25.100458    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-kwlvj" podStartSLOduration=33.27399217 podStartE2EDuration="40.100440287s" totalImagesPullingTime="6.826448117s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:20:45 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:21:25.099635365 +0000 UTC m=+85.887658309" watchObservedRunningTime="2026-07-06 22:21:25.100440287 +0000 UTC m=+85.888463220"
Jul 06 22:21:25.169696 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:25.169658    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/50d6e796-47fe-446b-841e-2af7e38bf5ad-node-exporter-accelerators-collector-config\") pod \"node-exporter-t92w6\" (UID: \"50d6e796-47fe-446b-841e-2af7e38bf5ad\") " pod="openshift-monitoring/node-exporter-t92w6"
Jul 06 22:21:25.169696 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:25.169703    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/50d6e796-47fe-446b-841e-2af7e38bf5ad-sys\") pod \"node-exporter-t92w6\" (UID: \"50d6e796-47fe-446b-841e-2af7e38bf5ad\") " pod="openshift-monitoring/node-exporter-t92w6"
Jul 06 22:21:25.169909 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:25.169724    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/50d6e796-47fe-446b-841e-2af7e38bf5ad-node-exporter-textfile\") pod \"node-exporter-t92w6\" (UID: \"50d6e796-47fe-446b-841e-2af7e38bf5ad\") " pod="openshift-monitoring/node-exporter-t92w6"
Jul 06 22:21:25.169909 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:25.169810    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/50d6e796-47fe-446b-841e-2af7e38bf5ad-metrics-client-ca\") pod \"node-exporter-t92w6\" (UID: \"50d6e796-47fe-446b-841e-2af7e38bf5ad\") " pod="openshift-monitoring/node-exporter-t92w6"
Jul 06 22:21:25.169909 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:25.169869    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/50d6e796-47fe-446b-841e-2af7e38bf5ad-node-exporter-tls\") pod \"node-exporter-t92w6\" (UID: \"50d6e796-47fe-446b-841e-2af7e38bf5ad\") " pod="openshift-monitoring/node-exporter-t92w6"
Jul 06 22:21:25.170005 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:25.169906    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flcl9\" (UniqueName: \"kubernetes.io/projected/50d6e796-47fe-446b-841e-2af7e38bf5ad-kube-api-access-flcl9\") pod \"node-exporter-t92w6\" (UID: \"50d6e796-47fe-446b-841e-2af7e38bf5ad\") " pod="openshift-monitoring/node-exporter-t92w6"
Jul 06 22:21:25.170005 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:25.169958    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/50d6e796-47fe-446b-841e-2af7e38bf5ad-root\") pod \"node-exporter-t92w6\" (UID: \"50d6e796-47fe-446b-841e-2af7e38bf5ad\") " pod="openshift-monitoring/node-exporter-t92w6"
Jul 06 22:21:25.170005 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:25.169981    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/50d6e796-47fe-446b-841e-2af7e38bf5ad-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t92w6\" (UID: \"50d6e796-47fe-446b-841e-2af7e38bf5ad\") " pod="openshift-monitoring/node-exporter-t92w6"
Jul 06 22:21:25.170092 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:25.170047    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/50d6e796-47fe-446b-841e-2af7e38bf5ad-node-exporter-wtmp\") pod \"node-exporter-t92w6\" (UID: \"50d6e796-47fe-446b-841e-2af7e38bf5ad\") " pod="openshift-monitoring/node-exporter-t92w6"
Jul 06 22:21:25.270522 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:25.270446    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/50d6e796-47fe-446b-841e-2af7e38bf5ad-node-exporter-tls\") pod \"node-exporter-t92w6\" (UID: \"50d6e796-47fe-446b-841e-2af7e38bf5ad\") " pod="openshift-monitoring/node-exporter-t92w6"
Jul 06 22:21:25.270522 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:25.270481    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flcl9\" (UniqueName: \"kubernetes.io/projected/50d6e796-47fe-446b-841e-2af7e38bf5ad-kube-api-access-flcl9\") pod \"node-exporter-t92w6\" (UID: \"50d6e796-47fe-446b-841e-2af7e38bf5ad\") " pod="openshift-monitoring/node-exporter-t92w6"
Jul 06 22:21:25.270522 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:25.270517    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/50d6e796-47fe-446b-841e-2af7e38bf5ad-root\") pod \"node-exporter-t92w6\" (UID: \"50d6e796-47fe-446b-841e-2af7e38bf5ad\") " pod="openshift-monitoring/node-exporter-t92w6"
Jul 06 22:21:25.270769 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:25.270542    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/50d6e796-47fe-446b-841e-2af7e38bf5ad-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t92w6\" (UID: \"50d6e796-47fe-446b-841e-2af7e38bf5ad\") " pod="openshift-monitoring/node-exporter-t92w6"
Jul 06 22:21:25.270769 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:25.270575    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/50d6e796-47fe-446b-841e-2af7e38bf5ad-node-exporter-wtmp\") pod \"node-exporter-t92w6\" (UID: \"50d6e796-47fe-446b-841e-2af7e38bf5ad\") " pod="openshift-monitoring/node-exporter-t92w6"
Jul 06 22:21:25.270769 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:25.270594    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/50d6e796-47fe-446b-841e-2af7e38bf5ad-root\") pod \"node-exporter-t92w6\" (UID: \"50d6e796-47fe-446b-841e-2af7e38bf5ad\") " pod="openshift-monitoring/node-exporter-t92w6"
Jul 06 22:21:25.270769 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:25.270601    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/50d6e796-47fe-446b-841e-2af7e38bf5ad-node-exporter-accelerators-collector-config\") pod \"node-exporter-t92w6\" (UID: \"50d6e796-47fe-446b-841e-2af7e38bf5ad\") " pod="openshift-monitoring/node-exporter-t92w6"
Jul 06 22:21:25.270769 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:25.270664    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/50d6e796-47fe-446b-841e-2af7e38bf5ad-sys\") pod \"node-exporter-t92w6\" (UID: \"50d6e796-47fe-446b-841e-2af7e38bf5ad\") " pod="openshift-monitoring/node-exporter-t92w6"
Jul 06 22:21:25.270769 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:25.270691    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/50d6e796-47fe-446b-841e-2af7e38bf5ad-node-exporter-textfile\") pod \"node-exporter-t92w6\" (UID: \"50d6e796-47fe-446b-841e-2af7e38bf5ad\") " pod="openshift-monitoring/node-exporter-t92w6"
Jul 06 22:21:25.270769 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:25.270758    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/50d6e796-47fe-446b-841e-2af7e38bf5ad-metrics-client-ca\") pod \"node-exporter-t92w6\" (UID: \"50d6e796-47fe-446b-841e-2af7e38bf5ad\") " pod="openshift-monitoring/node-exporter-t92w6"
Jul 06 22:21:25.271170 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:25.271077    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/50d6e796-47fe-446b-841e-2af7e38bf5ad-node-exporter-textfile\") pod \"node-exporter-t92w6\" (UID: \"50d6e796-47fe-446b-841e-2af7e38bf5ad\") " pod="openshift-monitoring/node-exporter-t92w6"
Jul 06 22:21:25.271170 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:25.271128    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/50d6e796-47fe-446b-841e-2af7e38bf5ad-sys\") pod \"node-exporter-t92w6\" (UID: \"50d6e796-47fe-446b-841e-2af7e38bf5ad\") " pod="openshift-monitoring/node-exporter-t92w6"
Jul 06 22:21:25.271170 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:25.271145    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/50d6e796-47fe-446b-841e-2af7e38bf5ad-node-exporter-wtmp\") pod \"node-exporter-t92w6\" (UID: \"50d6e796-47fe-446b-841e-2af7e38bf5ad\") " pod="openshift-monitoring/node-exporter-t92w6"
Jul 06 22:21:25.271335 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:25.271199    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/50d6e796-47fe-446b-841e-2af7e38bf5ad-node-exporter-accelerators-collector-config\") pod \"node-exporter-t92w6\" (UID: \"50d6e796-47fe-446b-841e-2af7e38bf5ad\") " pod="openshift-monitoring/node-exporter-t92w6"
Jul 06 22:21:25.271478 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:25.271460    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/50d6e796-47fe-446b-841e-2af7e38bf5ad-metrics-client-ca\") pod \"node-exporter-t92w6\" (UID: \"50d6e796-47fe-446b-841e-2af7e38bf5ad\") " pod="openshift-monitoring/node-exporter-t92w6"
Jul 06 22:21:25.273152 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:25.273128    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/50d6e796-47fe-446b-841e-2af7e38bf5ad-node-exporter-tls\") pod \"node-exporter-t92w6\" (UID: \"50d6e796-47fe-446b-841e-2af7e38bf5ad\") " pod="openshift-monitoring/node-exporter-t92w6"
Jul 06 22:21:25.273263 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:25.273154    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/50d6e796-47fe-446b-841e-2af7e38bf5ad-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t92w6\" (UID: \"50d6e796-47fe-446b-841e-2af7e38bf5ad\") " pod="openshift-monitoring/node-exporter-t92w6"
Jul 06 22:21:25.281027 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:25.281005    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-flcl9\" (UniqueName: \"kubernetes.io/projected/50d6e796-47fe-446b-841e-2af7e38bf5ad-kube-api-access-flcl9\") pod \"node-exporter-t92w6\" (UID: \"50d6e796-47fe-446b-841e-2af7e38bf5ad\") " pod="openshift-monitoring/node-exporter-t92w6"
Jul 06 22:21:25.298004 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:25.297975    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-t92w6"
Jul 06 22:21:25.309586 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:21:25.309555    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50d6e796_47fe_446b_841e_2af7e38bf5ad.slice/crio-b1fb5b903ed7ca6b788574a4bb129a56faed6cbdf1a5edb2d7f76b361bb0435e WatchSource:0}: Error finding container b1fb5b903ed7ca6b788574a4bb129a56faed6cbdf1a5edb2d7f76b361bb0435e: Status 404 returned error can't find the container with id b1fb5b903ed7ca6b788574a4bb129a56faed6cbdf1a5edb2d7f76b361bb0435e
Jul 06 22:21:25.900759 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:25.900718    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 22:21:25.905578 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:25.905555    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:21:25.907872 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:25.907850    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 06 22:21:25.907986 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:25.907890    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 06 22:21:25.907986 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:25.907898    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 06 22:21:25.907986 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:25.907902    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 06 22:21:25.908313 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:25.908281    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 06 22:21:25.908313 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:25.908301    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 06 22:21:25.908313 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:25.908280    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-4rflj\""
Jul 06 22:21:25.908583 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:25.908405    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 06 22:21:25.908583 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:25.908575    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 06 22:21:25.909080 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:25.909062    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 06 22:21:25.919740 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:25.919713    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 22:21:25.976560 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:25.976525    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c870cbd8-ee95-417e-bcf0-85aa85acdb78-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c870cbd8-ee95-417e-bcf0-85aa85acdb78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:21:25.976723 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:25.976578    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c870cbd8-ee95-417e-bcf0-85aa85acdb78-config-out\") pod \"alertmanager-main-0\" (UID: \"c870cbd8-ee95-417e-bcf0-85aa85acdb78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:21:25.976723 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:25.976623    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c870cbd8-ee95-417e-bcf0-85aa85acdb78-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c870cbd8-ee95-417e-bcf0-85aa85acdb78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:21:25.976861 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:25.976731    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c870cbd8-ee95-417e-bcf0-85aa85acdb78-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c870cbd8-ee95-417e-bcf0-85aa85acdb78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:21:25.976861 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:25.976763    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c870cbd8-ee95-417e-bcf0-85aa85acdb78-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c870cbd8-ee95-417e-bcf0-85aa85acdb78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:21:25.976861 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:25.976800    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c870cbd8-ee95-417e-bcf0-85aa85acdb78-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c870cbd8-ee95-417e-bcf0-85aa85acdb78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:21:25.976861 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:25.976845    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c870cbd8-ee95-417e-bcf0-85aa85acdb78-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c870cbd8-ee95-417e-bcf0-85aa85acdb78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:21:25.977020 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:25.976883    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c870cbd8-ee95-417e-bcf0-85aa85acdb78-web-config\") pod \"alertmanager-main-0\" (UID: \"c870cbd8-ee95-417e-bcf0-85aa85acdb78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:21:25.977020 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:25.976905    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c870cbd8-ee95-417e-bcf0-85aa85acdb78-config-volume\") pod \"alertmanager-main-0\" (UID: \"c870cbd8-ee95-417e-bcf0-85aa85acdb78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:21:25.977020 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:25.976928    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c870cbd8-ee95-417e-bcf0-85aa85acdb78-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c870cbd8-ee95-417e-bcf0-85aa85acdb78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:21:25.977020 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:25.976950    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c870cbd8-ee95-417e-bcf0-85aa85acdb78-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c870cbd8-ee95-417e-bcf0-85aa85acdb78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:21:25.977020 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:25.976975    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c870cbd8-ee95-417e-bcf0-85aa85acdb78-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c870cbd8-ee95-417e-bcf0-85aa85acdb78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:21:25.977020 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:25.977007    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vh5gw\" (UniqueName: \"kubernetes.io/projected/c870cbd8-ee95-417e-bcf0-85aa85acdb78-kube-api-access-vh5gw\") pod \"alertmanager-main-0\" (UID: \"c870cbd8-ee95-417e-bcf0-85aa85acdb78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:21:26.077552 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:26.077508    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c870cbd8-ee95-417e-bcf0-85aa85acdb78-config-out\") pod \"alertmanager-main-0\" (UID: \"c870cbd8-ee95-417e-bcf0-85aa85acdb78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:21:26.077552 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:26.077557    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c870cbd8-ee95-417e-bcf0-85aa85acdb78-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c870cbd8-ee95-417e-bcf0-85aa85acdb78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:21:26.078071 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:26.077592    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c870cbd8-ee95-417e-bcf0-85aa85acdb78-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c870cbd8-ee95-417e-bcf0-85aa85acdb78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:21:26.078071 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:21:26.077706    2556 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 06 22:21:26.078071 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:21:26.077799    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c870cbd8-ee95-417e-bcf0-85aa85acdb78-secret-alertmanager-main-tls podName:c870cbd8-ee95-417e-bcf0-85aa85acdb78 nodeName:}" failed. No retries permitted until 2026-07-06 22:21:26.577777568 +0000 UTC m=+87.365800479 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/c870cbd8-ee95-417e-bcf0-85aa85acdb78-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "c870cbd8-ee95-417e-bcf0-85aa85acdb78") : secret "alertmanager-main-tls" not found
Jul 06 22:21:26.078376 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:26.078353    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c870cbd8-ee95-417e-bcf0-85aa85acdb78-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c870cbd8-ee95-417e-bcf0-85aa85acdb78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:21:26.078464 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:26.078426    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c870cbd8-ee95-417e-bcf0-85aa85acdb78-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c870cbd8-ee95-417e-bcf0-85aa85acdb78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:21:26.078517 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:26.078483    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c870cbd8-ee95-417e-bcf0-85aa85acdb78-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c870cbd8-ee95-417e-bcf0-85aa85acdb78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:21:26.078571 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:26.078513    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c870cbd8-ee95-417e-bcf0-85aa85acdb78-web-config\") pod \"alertmanager-main-0\" (UID: \"c870cbd8-ee95-417e-bcf0-85aa85acdb78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:21:26.078571 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:26.078540    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c870cbd8-ee95-417e-bcf0-85aa85acdb78-config-volume\") pod \"alertmanager-main-0\" (UID: \"c870cbd8-ee95-417e-bcf0-85aa85acdb78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:21:26.078673 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:26.078587    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c870cbd8-ee95-417e-bcf0-85aa85acdb78-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c870cbd8-ee95-417e-bcf0-85aa85acdb78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:21:26.078673 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:26.078612    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c870cbd8-ee95-417e-bcf0-85aa85acdb78-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c870cbd8-ee95-417e-bcf0-85aa85acdb78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:21:26.078673 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:26.078665    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c870cbd8-ee95-417e-bcf0-85aa85acdb78-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c870cbd8-ee95-417e-bcf0-85aa85acdb78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:21:26.078813 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:26.078714    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vh5gw\" (UniqueName: \"kubernetes.io/projected/c870cbd8-ee95-417e-bcf0-85aa85acdb78-kube-api-access-vh5gw\") pod \"alertmanager-main-0\" (UID: \"c870cbd8-ee95-417e-bcf0-85aa85acdb78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:21:26.078813 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:26.078796    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c870cbd8-ee95-417e-bcf0-85aa85acdb78-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c870cbd8-ee95-417e-bcf0-85aa85acdb78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:21:26.080212 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:26.079882    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c870cbd8-ee95-417e-bcf0-85aa85acdb78-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c870cbd8-ee95-417e-bcf0-85aa85acdb78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:21:26.080372 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:26.080333    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c870cbd8-ee95-417e-bcf0-85aa85acdb78-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c870cbd8-ee95-417e-bcf0-85aa85acdb78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:21:26.082938 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:26.082873    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c870cbd8-ee95-417e-bcf0-85aa85acdb78-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c870cbd8-ee95-417e-bcf0-85aa85acdb78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:21:26.083157 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:26.083033    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c870cbd8-ee95-417e-bcf0-85aa85acdb78-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c870cbd8-ee95-417e-bcf0-85aa85acdb78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:21:26.083809 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:26.083787    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c870cbd8-ee95-417e-bcf0-85aa85acdb78-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c870cbd8-ee95-417e-bcf0-85aa85acdb78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:21:26.084677 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:26.084211    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c870cbd8-ee95-417e-bcf0-85aa85acdb78-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c870cbd8-ee95-417e-bcf0-85aa85acdb78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:21:26.084677 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:26.084625    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t92w6" event={"ID":"50d6e796-47fe-446b-841e-2af7e38bf5ad","Type":"ContainerStarted","Data":"b1fb5b903ed7ca6b788574a4bb129a56faed6cbdf1a5edb2d7f76b361bb0435e"}
Jul 06 22:21:26.085068 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:26.085006    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c870cbd8-ee95-417e-bcf0-85aa85acdb78-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c870cbd8-ee95-417e-bcf0-85aa85acdb78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:21:26.085439 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:26.085417    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c870cbd8-ee95-417e-bcf0-85aa85acdb78-config-out\") pod \"alertmanager-main-0\" (UID: \"c870cbd8-ee95-417e-bcf0-85aa85acdb78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:21:26.086244 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:26.086218    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c870cbd8-ee95-417e-bcf0-85aa85acdb78-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c870cbd8-ee95-417e-bcf0-85aa85acdb78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:21:26.086345 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:26.086248    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c870cbd8-ee95-417e-bcf0-85aa85acdb78-web-config\") pod \"alertmanager-main-0\" (UID: \"c870cbd8-ee95-417e-bcf0-85aa85acdb78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:21:26.087140 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:26.087122    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c870cbd8-ee95-417e-bcf0-85aa85acdb78-config-volume\") pod \"alertmanager-main-0\" (UID: \"c870cbd8-ee95-417e-bcf0-85aa85acdb78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:21:26.091110 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:26.090999    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vh5gw\" (UniqueName: \"kubernetes.io/projected/c870cbd8-ee95-417e-bcf0-85aa85acdb78-kube-api-access-vh5gw\") pod \"alertmanager-main-0\" (UID: \"c870cbd8-ee95-417e-bcf0-85aa85acdb78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:21:26.584392 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:26.584369    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c870cbd8-ee95-417e-bcf0-85aa85acdb78-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c870cbd8-ee95-417e-bcf0-85aa85acdb78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:21:26.586772 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:26.586748    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c870cbd8-ee95-417e-bcf0-85aa85acdb78-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c870cbd8-ee95-417e-bcf0-85aa85acdb78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:21:26.816054 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:26.815969    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:21:26.861918 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:26.861886    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-67b94b7755-9bmsj"]
Jul 06 22:21:26.866849 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:26.866814    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-67b94b7755-9bmsj"
Jul 06 22:21:26.869546 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:26.869337    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 06 22:21:26.869984 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:26.869740    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 06 22:21:26.869984 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:26.869802    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 06 22:21:26.870154 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:26.870076    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 06 22:21:26.870230 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:26.870202    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-ng58n\""
Jul 06 22:21:26.870312 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:26.870293    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 06 22:21:26.870510 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:26.870398    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-89a68dr7dd8fs\""
Jul 06 22:21:26.884415 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:26.884314    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-67b94b7755-9bmsj"]
Jul 06 22:21:26.887613 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:26.887583    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/71ff7249-17a8-4172-a5ee-4ff3c599bae6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-67b94b7755-9bmsj\" (UID: \"71ff7249-17a8-4172-a5ee-4ff3c599bae6\") " pod="openshift-monitoring/thanos-querier-67b94b7755-9bmsj"
Jul 06 22:21:26.887890 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:26.887635    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/71ff7249-17a8-4172-a5ee-4ff3c599bae6-metrics-client-ca\") pod \"thanos-querier-67b94b7755-9bmsj\" (UID: \"71ff7249-17a8-4172-a5ee-4ff3c599bae6\") " pod="openshift-monitoring/thanos-querier-67b94b7755-9bmsj"
Jul 06 22:21:26.887890 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:26.887676    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/71ff7249-17a8-4172-a5ee-4ff3c599bae6-secret-grpc-tls\") pod \"thanos-querier-67b94b7755-9bmsj\" (UID: \"71ff7249-17a8-4172-a5ee-4ff3c599bae6\") " pod="openshift-monitoring/thanos-querier-67b94b7755-9bmsj"
Jul 06 22:21:26.887890 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:26.887710    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6kmz\" (UniqueName: \"kubernetes.io/projected/71ff7249-17a8-4172-a5ee-4ff3c599bae6-kube-api-access-m6kmz\") pod \"thanos-querier-67b94b7755-9bmsj\" (UID: \"71ff7249-17a8-4172-a5ee-4ff3c599bae6\") " pod="openshift-monitoring/thanos-querier-67b94b7755-9bmsj"
Jul 06 22:21:26.887890 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:26.887783    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/71ff7249-17a8-4172-a5ee-4ff3c599bae6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-67b94b7755-9bmsj\" (UID: \"71ff7249-17a8-4172-a5ee-4ff3c599bae6\") " pod="openshift-monitoring/thanos-querier-67b94b7755-9bmsj"
Jul 06 22:21:26.887890 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:26.887864    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/71ff7249-17a8-4172-a5ee-4ff3c599bae6-secret-thanos-querier-tls\") pod \"thanos-querier-67b94b7755-9bmsj\" (UID: \"71ff7249-17a8-4172-a5ee-4ff3c599bae6\") " pod="openshift-monitoring/thanos-querier-67b94b7755-9bmsj"
Jul 06 22:21:26.888280 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:26.887897    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/71ff7249-17a8-4172-a5ee-4ff3c599bae6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-67b94b7755-9bmsj\" (UID: \"71ff7249-17a8-4172-a5ee-4ff3c599bae6\") " pod="openshift-monitoring/thanos-querier-67b94b7755-9bmsj"
Jul 06 22:21:26.888280 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:26.887921    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/71ff7249-17a8-4172-a5ee-4ff3c599bae6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-67b94b7755-9bmsj\" (UID: \"71ff7249-17a8-4172-a5ee-4ff3c599bae6\") " pod="openshift-monitoring/thanos-querier-67b94b7755-9bmsj"
Jul 06 22:21:26.972262 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:26.972231    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 22:21:26.974912 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:21:26.974887    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc870cbd8_ee95_417e_bcf0_85aa85acdb78.slice/crio-6b46843ee5910b8da255d281e47bc21b58e69accfcf99c7243c0e9c5a6b0fc48 WatchSource:0}: Error finding container 6b46843ee5910b8da255d281e47bc21b58e69accfcf99c7243c0e9c5a6b0fc48: Status 404 returned error can't find the container with id 6b46843ee5910b8da255d281e47bc21b58e69accfcf99c7243c0e9c5a6b0fc48
Jul 06 22:21:26.988907 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:26.988884    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/71ff7249-17a8-4172-a5ee-4ff3c599bae6-secret-thanos-querier-tls\") pod \"thanos-querier-67b94b7755-9bmsj\" (UID: \"71ff7249-17a8-4172-a5ee-4ff3c599bae6\") " pod="openshift-monitoring/thanos-querier-67b94b7755-9bmsj"
Jul 06 22:21:26.989029 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:26.988922    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/71ff7249-17a8-4172-a5ee-4ff3c599bae6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-67b94b7755-9bmsj\" (UID: \"71ff7249-17a8-4172-a5ee-4ff3c599bae6\") " pod="openshift-monitoring/thanos-querier-67b94b7755-9bmsj"
Jul 06 22:21:26.989029 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:26.988943    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/71ff7249-17a8-4172-a5ee-4ff3c599bae6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-67b94b7755-9bmsj\" (UID: \"71ff7249-17a8-4172-a5ee-4ff3c599bae6\") " pod="openshift-monitoring/thanos-querier-67b94b7755-9bmsj"
Jul 06 22:21:26.989029 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:26.988971    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/71ff7249-17a8-4172-a5ee-4ff3c599bae6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-67b94b7755-9bmsj\" (UID: \"71ff7249-17a8-4172-a5ee-4ff3c599bae6\") " pod="openshift-monitoring/thanos-querier-67b94b7755-9bmsj"
Jul 06 22:21:26.989253 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:26.989153    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/71ff7249-17a8-4172-a5ee-4ff3c599bae6-metrics-client-ca\") pod \"thanos-querier-67b94b7755-9bmsj\" (UID: \"71ff7249-17a8-4172-a5ee-4ff3c599bae6\") " pod="openshift-monitoring/thanos-querier-67b94b7755-9bmsj"
Jul 06 22:21:26.989253 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:26.989213    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/71ff7249-17a8-4172-a5ee-4ff3c599bae6-secret-grpc-tls\") pod \"thanos-querier-67b94b7755-9bmsj\" (UID: \"71ff7249-17a8-4172-a5ee-4ff3c599bae6\") " pod="openshift-monitoring/thanos-querier-67b94b7755-9bmsj"
Jul 06 22:21:26.989253 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:26.989244    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6kmz\" (UniqueName: \"kubernetes.io/projected/71ff7249-17a8-4172-a5ee-4ff3c599bae6-kube-api-access-m6kmz\") pod \"thanos-querier-67b94b7755-9bmsj\" (UID: \"71ff7249-17a8-4172-a5ee-4ff3c599bae6\") " pod="openshift-monitoring/thanos-querier-67b94b7755-9bmsj"
Jul 06 22:21:26.989398 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:26.989271    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/71ff7249-17a8-4172-a5ee-4ff3c599bae6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-67b94b7755-9bmsj\" (UID: \"71ff7249-17a8-4172-a5ee-4ff3c599bae6\") " pod="openshift-monitoring/thanos-querier-67b94b7755-9bmsj"
Jul 06 22:21:26.989952 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:26.989887    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/71ff7249-17a8-4172-a5ee-4ff3c599bae6-metrics-client-ca\") pod \"thanos-querier-67b94b7755-9bmsj\" (UID: \"71ff7249-17a8-4172-a5ee-4ff3c599bae6\") " pod="openshift-monitoring/thanos-querier-67b94b7755-9bmsj"
Jul 06 22:21:26.991781 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:26.991757    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/71ff7249-17a8-4172-a5ee-4ff3c599bae6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-67b94b7755-9bmsj\" (UID: \"71ff7249-17a8-4172-a5ee-4ff3c599bae6\") " pod="openshift-monitoring/thanos-querier-67b94b7755-9bmsj"
Jul 06 22:21:26.991781 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:26.991776    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/71ff7249-17a8-4172-a5ee-4ff3c599bae6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-67b94b7755-9bmsj\" (UID: \"71ff7249-17a8-4172-a5ee-4ff3c599bae6\") " pod="openshift-monitoring/thanos-querier-67b94b7755-9bmsj"
Jul 06 22:21:26.991954 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:26.991932    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/71ff7249-17a8-4172-a5ee-4ff3c599bae6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-67b94b7755-9bmsj\" (UID: \"71ff7249-17a8-4172-a5ee-4ff3c599bae6\") " pod="openshift-monitoring/thanos-querier-67b94b7755-9bmsj"
Jul 06 22:21:26.991990 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:26.991951    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/71ff7249-17a8-4172-a5ee-4ff3c599bae6-secret-thanos-querier-tls\") pod \"thanos-querier-67b94b7755-9bmsj\" (UID: \"71ff7249-17a8-4172-a5ee-4ff3c599bae6\") " pod="openshift-monitoring/thanos-querier-67b94b7755-9bmsj"
Jul 06 22:21:26.992057 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:26.992040    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/71ff7249-17a8-4172-a5ee-4ff3c599bae6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-67b94b7755-9bmsj\" (UID: \"71ff7249-17a8-4172-a5ee-4ff3c599bae6\") " pod="openshift-monitoring/thanos-querier-67b94b7755-9bmsj"
Jul 06 22:21:26.992169 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:26.992146    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/71ff7249-17a8-4172-a5ee-4ff3c599bae6-secret-grpc-tls\") pod \"thanos-querier-67b94b7755-9bmsj\" (UID: \"71ff7249-17a8-4172-a5ee-4ff3c599bae6\") " pod="openshift-monitoring/thanos-querier-67b94b7755-9bmsj"
Jul 06 22:21:26.999559 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:26.999540    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6kmz\" (UniqueName: \"kubernetes.io/projected/71ff7249-17a8-4172-a5ee-4ff3c599bae6-kube-api-access-m6kmz\") pod \"thanos-querier-67b94b7755-9bmsj\" (UID: \"71ff7249-17a8-4172-a5ee-4ff3c599bae6\") " pod="openshift-monitoring/thanos-querier-67b94b7755-9bmsj"
Jul 06 22:21:27.093146 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:27.093030    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c870cbd8-ee95-417e-bcf0-85aa85acdb78","Type":"ContainerStarted","Data":"6b46843ee5910b8da255d281e47bc21b58e69accfcf99c7243c0e9c5a6b0fc48"}
Jul 06 22:21:27.094619 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:27.094598    2556 generic.go:356] "Generic (PLEG): container finished" podID="50d6e796-47fe-446b-841e-2af7e38bf5ad" containerID="bd434ee16e3a0b8ddb72a75e601304b3a3ca745fdfe806f82dddfabf359ded73" exitCode=0
Jul 06 22:21:27.094701 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:27.094628    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t92w6" event={"ID":"50d6e796-47fe-446b-841e-2af7e38bf5ad","Type":"ContainerDied","Data":"bd434ee16e3a0b8ddb72a75e601304b3a3ca745fdfe806f82dddfabf359ded73"}
Jul 06 22:21:27.180575 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:27.180554    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-67b94b7755-9bmsj"
Jul 06 22:21:27.321278 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:27.321223    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-67b94b7755-9bmsj"]
Jul 06 22:21:27.324783 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:21:27.324761    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71ff7249_17a8_4172_a5ee_4ff3c599bae6.slice/crio-93fbb3992ff9b0991cad6b85c39b4fd3832960a02ffd0e3a450b51880194f1b4 WatchSource:0}: Error finding container 93fbb3992ff9b0991cad6b85c39b4fd3832960a02ffd0e3a450b51880194f1b4: Status 404 returned error can't find the container with id 93fbb3992ff9b0991cad6b85c39b4fd3832960a02ffd0e3a450b51880194f1b4
Jul 06 22:21:27.953543 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:27.953513    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-s29sb"]
Jul 06 22:21:27.956645 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:27.956626    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-s29sb"
Jul 06 22:21:27.959474 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:27.959439    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-8wrvm\""
Jul 06 22:21:27.959589 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:27.959475    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 06 22:21:27.959589 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:27.959526    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 06 22:21:27.967127 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:27.967078    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-s29sb"]
Jul 06 22:21:27.997838 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:27.997810    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpbc6\" (UniqueName: \"kubernetes.io/projected/cc894bc2-0569-476b-9806-277a81ba1da6-kube-api-access-rpbc6\") pod \"downloads-685bfb5f64-s29sb\" (UID: \"cc894bc2-0569-476b-9806-277a81ba1da6\") " pod="openshift-console/downloads-685bfb5f64-s29sb"
Jul 06 22:21:28.098970 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:28.098943    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpbc6\" (UniqueName: \"kubernetes.io/projected/cc894bc2-0569-476b-9806-277a81ba1da6-kube-api-access-rpbc6\") pod \"downloads-685bfb5f64-s29sb\" (UID: \"cc894bc2-0569-476b-9806-277a81ba1da6\") " pod="openshift-console/downloads-685bfb5f64-s29sb"
Jul 06 22:21:28.101159 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:28.101130    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t92w6" event={"ID":"50d6e796-47fe-446b-841e-2af7e38bf5ad","Type":"ContainerStarted","Data":"f3c6fb54b6d2978d4150288fceec71c4e6303adbc021e0739676bb83c3a989a5"}
Jul 06 22:21:28.101267 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:28.101198    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t92w6" event={"ID":"50d6e796-47fe-446b-841e-2af7e38bf5ad","Type":"ContainerStarted","Data":"50de56c2a6cc71b21e41b813968f9fa923d179173436ac4596d5af728177d4d9"}
Jul 06 22:21:28.102293 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:28.102269    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67b94b7755-9bmsj" event={"ID":"71ff7249-17a8-4172-a5ee-4ff3c599bae6","Type":"ContainerStarted","Data":"93fbb3992ff9b0991cad6b85c39b4fd3832960a02ffd0e3a450b51880194f1b4"}
Jul 06 22:21:28.103726 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:28.103704    2556 generic.go:356] "Generic (PLEG): container finished" podID="c870cbd8-ee95-417e-bcf0-85aa85acdb78" containerID="26b9d7b3fe7a0b81eaececa8e13387e8a18f15d4e039f38ba03bed375d87b1ab" exitCode=0
Jul 06 22:21:28.103831 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:28.103736    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c870cbd8-ee95-417e-bcf0-85aa85acdb78","Type":"ContainerDied","Data":"26b9d7b3fe7a0b81eaececa8e13387e8a18f15d4e039f38ba03bed375d87b1ab"}
Jul 06 22:21:28.107899 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:28.107880    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpbc6\" (UniqueName: \"kubernetes.io/projected/cc894bc2-0569-476b-9806-277a81ba1da6-kube-api-access-rpbc6\") pod \"downloads-685bfb5f64-s29sb\" (UID: \"cc894bc2-0569-476b-9806-277a81ba1da6\") " pod="openshift-console/downloads-685bfb5f64-s29sb"
Jul 06 22:21:28.120702 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:28.120655    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-t92w6" podStartSLOduration=2.807346055 podStartE2EDuration="4.120640588s" totalImagesPullingTime="1.249003374s" totalInitContainerRuntime="64.291159ms" isStatefulPod=true podCreationTimestamp="2026-07-06 22:21:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:21:28.119299162 +0000 UTC m=+88.907322108" watchObservedRunningTime="2026-07-06 22:21:28.120640588 +0000 UTC m=+88.908663536"
Jul 06 22:21:28.266402 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:28.266314    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-s29sb"
Jul 06 22:21:28.416045 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:28.416022    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-s29sb"]
Jul 06 22:21:28.418616 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:21:28.418580    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc894bc2_0569_476b_9806_277a81ba1da6.slice/crio-5f07a21d82430732bea2a93b2cf3a4be8791c722fc3f3ab078e4b19834a2d612 WatchSource:0}: Error finding container 5f07a21d82430732bea2a93b2cf3a4be8791c722fc3f3ab078e4b19834a2d612: Status 404 returned error can't find the container with id 5f07a21d82430732bea2a93b2cf3a4be8791c722fc3f3ab078e4b19834a2d612
Jul 06 22:21:29.110278 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:29.110227    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-s29sb" event={"ID":"cc894bc2-0569-476b-9806-277a81ba1da6","Type":"ContainerStarted","Data":"5f07a21d82430732bea2a93b2cf3a4be8791c722fc3f3ab078e4b19834a2d612"}
Jul 06 22:21:29.510593 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:29.510512    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-2gkx6"]
Jul 06 22:21:29.514244 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:29.514216    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-2gkx6"
Jul 06 22:21:29.516833 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:29.516803    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 06 22:21:29.516833 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:29.516819    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-9d52f\""
Jul 06 22:21:29.523704 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:29.523679    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-2gkx6"]
Jul 06 22:21:29.531362 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:29.531115    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-574f878cfc-gt2fx"]
Jul 06 22:21:29.535380 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:29.535294    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-574f878cfc-gt2fx"
Jul 06 22:21:29.537916 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:29.537889    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-c5c8t8hqrmsj6\""
Jul 06 22:21:29.538151 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:29.538124    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-6krnk\""
Jul 06 22:21:29.538438 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:29.538419    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 06 22:21:29.538699 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:29.538679    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 06 22:21:29.539038 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:29.539021    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 06 22:21:29.539275 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:29.539260    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 06 22:21:29.547573 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:29.547519    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-574f878cfc-gt2fx"]
Jul 06 22:21:29.612718 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:29.612679    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cd760c0a-43cf-4a91-9004-46309e9fa553-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-2gkx6\" (UID: \"cd760c0a-43cf-4a91-9004-46309e9fa553\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-2gkx6"
Jul 06 22:21:29.612888 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:29.612759    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4ed30170-54eb-482a-8a74-7eb82a044d08-metrics-server-audit-profiles\") pod \"metrics-server-574f878cfc-gt2fx\" (UID: \"4ed30170-54eb-482a-8a74-7eb82a044d08\") " pod="openshift-monitoring/metrics-server-574f878cfc-gt2fx"
Jul 06 22:21:29.612888 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:29.612801    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4ed30170-54eb-482a-8a74-7eb82a044d08-secret-metrics-server-tls\") pod \"metrics-server-574f878cfc-gt2fx\" (UID: \"4ed30170-54eb-482a-8a74-7eb82a044d08\") " pod="openshift-monitoring/metrics-server-574f878cfc-gt2fx"
Jul 06 22:21:29.612888 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:29.612841    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4ed30170-54eb-482a-8a74-7eb82a044d08-audit-log\") pod \"metrics-server-574f878cfc-gt2fx\" (UID: \"4ed30170-54eb-482a-8a74-7eb82a044d08\") " pod="openshift-monitoring/metrics-server-574f878cfc-gt2fx"
Jul 06 22:21:29.613049 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:29.612913    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4ed30170-54eb-482a-8a74-7eb82a044d08-secret-metrics-server-client-certs\") pod \"metrics-server-574f878cfc-gt2fx\" (UID: \"4ed30170-54eb-482a-8a74-7eb82a044d08\") " pod="openshift-monitoring/metrics-server-574f878cfc-gt2fx"
Jul 06 22:21:29.613049 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:29.612938    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ed30170-54eb-482a-8a74-7eb82a044d08-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-574f878cfc-gt2fx\" (UID: \"4ed30170-54eb-482a-8a74-7eb82a044d08\") " pod="openshift-monitoring/metrics-server-574f878cfc-gt2fx"
Jul 06 22:21:29.613049 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:29.612995    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9pck\" (UniqueName: \"kubernetes.io/projected/cd760c0a-43cf-4a91-9004-46309e9fa553-kube-api-access-v9pck\") pod \"monitoring-plugin-d5dcff7cf-2gkx6\" (UID: \"cd760c0a-43cf-4a91-9004-46309e9fa553\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-2gkx6"
Jul 06 22:21:29.613230 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:29.613062    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4ed30170-54eb-482a-8a74-7eb82a044d08-client-ca-bundle\") pod \"metrics-server-574f878cfc-gt2fx\" (UID: \"4ed30170-54eb-482a-8a74-7eb82a044d08\") " pod="openshift-monitoring/metrics-server-574f878cfc-gt2fx"
Jul 06 22:21:29.613230 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:29.613086    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktzvl\" (UniqueName: \"kubernetes.io/projected/4ed30170-54eb-482a-8a74-7eb82a044d08-kube-api-access-ktzvl\") pod \"metrics-server-574f878cfc-gt2fx\" (UID: \"4ed30170-54eb-482a-8a74-7eb82a044d08\") " pod="openshift-monitoring/metrics-server-574f878cfc-gt2fx"
Jul 06 22:21:29.714334 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:29.714296    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4ed30170-54eb-482a-8a74-7eb82a044d08-secret-metrics-server-tls\") pod \"metrics-server-574f878cfc-gt2fx\" (UID: \"4ed30170-54eb-482a-8a74-7eb82a044d08\") " pod="openshift-monitoring/metrics-server-574f878cfc-gt2fx"
Jul 06 22:21:29.714334 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:29.714355    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4ed30170-54eb-482a-8a74-7eb82a044d08-audit-log\") pod \"metrics-server-574f878cfc-gt2fx\" (UID: \"4ed30170-54eb-482a-8a74-7eb82a044d08\") " pod="openshift-monitoring/metrics-server-574f878cfc-gt2fx"
Jul 06 22:21:29.714334 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:29.714408    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4ed30170-54eb-482a-8a74-7eb82a044d08-secret-metrics-server-client-certs\") pod \"metrics-server-574f878cfc-gt2fx\" (UID: \"4ed30170-54eb-482a-8a74-7eb82a044d08\") " pod="openshift-monitoring/metrics-server-574f878cfc-gt2fx"
Jul 06 22:21:29.714712 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:29.714438    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ed30170-54eb-482a-8a74-7eb82a044d08-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-574f878cfc-gt2fx\" (UID: \"4ed30170-54eb-482a-8a74-7eb82a044d08\") " pod="openshift-monitoring/metrics-server-574f878cfc-gt2fx"
Jul 06 22:21:29.714712 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:29.714480    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9pck\" (UniqueName: \"kubernetes.io/projected/cd760c0a-43cf-4a91-9004-46309e9fa553-kube-api-access-v9pck\") pod \"monitoring-plugin-d5dcff7cf-2gkx6\" (UID: \"cd760c0a-43cf-4a91-9004-46309e9fa553\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-2gkx6"
Jul 06 22:21:29.714712 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:29.714522    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4ed30170-54eb-482a-8a74-7eb82a044d08-client-ca-bundle\") pod \"metrics-server-574f878cfc-gt2fx\" (UID: \"4ed30170-54eb-482a-8a74-7eb82a044d08\") " pod="openshift-monitoring/metrics-server-574f878cfc-gt2fx"
Jul 06 22:21:29.714712 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:29.714630    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktzvl\" (UniqueName: \"kubernetes.io/projected/4ed30170-54eb-482a-8a74-7eb82a044d08-kube-api-access-ktzvl\") pod \"metrics-server-574f878cfc-gt2fx\" (UID: \"4ed30170-54eb-482a-8a74-7eb82a044d08\") " pod="openshift-monitoring/metrics-server-574f878cfc-gt2fx"
Jul 06 22:21:29.714897 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:29.714715    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cd760c0a-43cf-4a91-9004-46309e9fa553-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-2gkx6\" (UID: \"cd760c0a-43cf-4a91-9004-46309e9fa553\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-2gkx6"
Jul 06 22:21:29.714897 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:29.714751    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4ed30170-54eb-482a-8a74-7eb82a044d08-metrics-server-audit-profiles\") pod \"metrics-server-574f878cfc-gt2fx\" (UID: \"4ed30170-54eb-482a-8a74-7eb82a044d08\") " pod="openshift-monitoring/metrics-server-574f878cfc-gt2fx"
Jul 06 22:21:29.714897 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:21:29.714873    2556 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 06 22:21:29.715042 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:21:29.714963    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd760c0a-43cf-4a91-9004-46309e9fa553-monitoring-plugin-cert podName:cd760c0a-43cf-4a91-9004-46309e9fa553 nodeName:}" failed. No retries permitted until 2026-07-06 22:21:30.2149412 +0000 UTC m=+91.002964113 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/cd760c0a-43cf-4a91-9004-46309e9fa553-monitoring-plugin-cert") pod "monitoring-plugin-d5dcff7cf-2gkx6" (UID: "cd760c0a-43cf-4a91-9004-46309e9fa553") : secret "monitoring-plugin-cert" not found
Jul 06 22:21:29.715382 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:29.715360    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4ed30170-54eb-482a-8a74-7eb82a044d08-audit-log\") pod \"metrics-server-574f878cfc-gt2fx\" (UID: \"4ed30170-54eb-482a-8a74-7eb82a044d08\") " pod="openshift-monitoring/metrics-server-574f878cfc-gt2fx"
Jul 06 22:21:29.715531 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:29.715510    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ed30170-54eb-482a-8a74-7eb82a044d08-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-574f878cfc-gt2fx\" (UID: \"4ed30170-54eb-482a-8a74-7eb82a044d08\") " pod="openshift-monitoring/metrics-server-574f878cfc-gt2fx"
Jul 06 22:21:29.715996 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:29.715968    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4ed30170-54eb-482a-8a74-7eb82a044d08-metrics-server-audit-profiles\") pod \"metrics-server-574f878cfc-gt2fx\" (UID: \"4ed30170-54eb-482a-8a74-7eb82a044d08\") " pod="openshift-monitoring/metrics-server-574f878cfc-gt2fx"
Jul 06 22:21:29.717488 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:29.717451    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4ed30170-54eb-482a-8a74-7eb82a044d08-client-ca-bundle\") pod \"metrics-server-574f878cfc-gt2fx\" (UID: \"4ed30170-54eb-482a-8a74-7eb82a044d08\") " pod="openshift-monitoring/metrics-server-574f878cfc-gt2fx"
Jul 06 22:21:29.717596 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:29.717570    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4ed30170-54eb-482a-8a74-7eb82a044d08-secret-metrics-server-client-certs\") pod \"metrics-server-574f878cfc-gt2fx\" (UID: \"4ed30170-54eb-482a-8a74-7eb82a044d08\") " pod="openshift-monitoring/metrics-server-574f878cfc-gt2fx"
Jul 06 22:21:29.718041 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:29.718020    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4ed30170-54eb-482a-8a74-7eb82a044d08-secret-metrics-server-tls\") pod \"metrics-server-574f878cfc-gt2fx\" (UID: \"4ed30170-54eb-482a-8a74-7eb82a044d08\") " pod="openshift-monitoring/metrics-server-574f878cfc-gt2fx"
Jul 06 22:21:29.727125 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:29.727082    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktzvl\" (UniqueName: \"kubernetes.io/projected/4ed30170-54eb-482a-8a74-7eb82a044d08-kube-api-access-ktzvl\") pod \"metrics-server-574f878cfc-gt2fx\" (UID: \"4ed30170-54eb-482a-8a74-7eb82a044d08\") " pod="openshift-monitoring/metrics-server-574f878cfc-gt2fx"
Jul 06 22:21:29.727125 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:29.727092    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9pck\" (UniqueName: \"kubernetes.io/projected/cd760c0a-43cf-4a91-9004-46309e9fa553-kube-api-access-v9pck\") pod \"monitoring-plugin-d5dcff7cf-2gkx6\" (UID: \"cd760c0a-43cf-4a91-9004-46309e9fa553\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-2gkx6"
Jul 06 22:21:29.849555 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:29.849519    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-574f878cfc-gt2fx"
Jul 06 22:21:30.179123 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:30.179012    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-55cb77ff94-sd8kq"]
Jul 06 22:21:30.183270 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:30.183244    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-55cb77ff94-sd8kq"
Jul 06 22:21:30.186312 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:30.186156    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 06 22:21:30.186312 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:30.186178    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 06 22:21:30.186501 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:30.186457    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 06 22:21:30.186805 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:30.186775    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 06 22:21:30.186890 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:30.186831    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 06 22:21:30.186890 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:30.186877    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-z44r9\""
Jul 06 22:21:30.193354 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:30.193181    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 06 22:21:30.199827 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:30.199805    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-55cb77ff94-sd8kq"]
Jul 06 22:21:30.218697 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:30.218668    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ed6a64a-3a0b-4933-b99b-90d8a0c3e1fe-telemeter-trusted-ca-bundle\") pod \"telemeter-client-55cb77ff94-sd8kq\" (UID: \"7ed6a64a-3a0b-4933-b99b-90d8a0c3e1fe\") " pod="openshift-monitoring/telemeter-client-55cb77ff94-sd8kq"
Jul 06 22:21:30.218840 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:30.218719    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7ed6a64a-3a0b-4933-b99b-90d8a0c3e1fe-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-55cb77ff94-sd8kq\" (UID: \"7ed6a64a-3a0b-4933-b99b-90d8a0c3e1fe\") " pod="openshift-monitoring/telemeter-client-55cb77ff94-sd8kq"
Jul 06 22:21:30.218840 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:30.218788    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ed6a64a-3a0b-4933-b99b-90d8a0c3e1fe-metrics-client-ca\") pod \"telemeter-client-55cb77ff94-sd8kq\" (UID: \"7ed6a64a-3a0b-4933-b99b-90d8a0c3e1fe\") " pod="openshift-monitoring/telemeter-client-55cb77ff94-sd8kq"
Jul 06 22:21:30.218949 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:30.218841    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ed6a64a-3a0b-4933-b99b-90d8a0c3e1fe-serving-certs-ca-bundle\") pod \"telemeter-client-55cb77ff94-sd8kq\" (UID: \"7ed6a64a-3a0b-4933-b99b-90d8a0c3e1fe\") " pod="openshift-monitoring/telemeter-client-55cb77ff94-sd8kq"
Jul 06 22:21:30.218949 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:30.218886    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7w55p\" (UniqueName: \"kubernetes.io/projected/7ed6a64a-3a0b-4933-b99b-90d8a0c3e1fe-kube-api-access-7w55p\") pod \"telemeter-client-55cb77ff94-sd8kq\" (UID: \"7ed6a64a-3a0b-4933-b99b-90d8a0c3e1fe\") " pod="openshift-monitoring/telemeter-client-55cb77ff94-sd8kq"
Jul 06 22:21:30.218949 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:30.218925    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7ed6a64a-3a0b-4933-b99b-90d8a0c3e1fe-secret-telemeter-client\") pod \"telemeter-client-55cb77ff94-sd8kq\" (UID: \"7ed6a64a-3a0b-4933-b99b-90d8a0c3e1fe\") " pod="openshift-monitoring/telemeter-client-55cb77ff94-sd8kq"
Jul 06 22:21:30.219118 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:30.218952    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7ed6a64a-3a0b-4933-b99b-90d8a0c3e1fe-telemeter-client-tls\") pod \"telemeter-client-55cb77ff94-sd8kq\" (UID: \"7ed6a64a-3a0b-4933-b99b-90d8a0c3e1fe\") " pod="openshift-monitoring/telemeter-client-55cb77ff94-sd8kq"
Jul 06 22:21:30.219118 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:30.218983    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7ed6a64a-3a0b-4933-b99b-90d8a0c3e1fe-federate-client-tls\") pod \"telemeter-client-55cb77ff94-sd8kq\" (UID: \"7ed6a64a-3a0b-4933-b99b-90d8a0c3e1fe\") " pod="openshift-monitoring/telemeter-client-55cb77ff94-sd8kq"
Jul 06 22:21:30.219118 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:30.219051    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cd760c0a-43cf-4a91-9004-46309e9fa553-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-2gkx6\" (UID: \"cd760c0a-43cf-4a91-9004-46309e9fa553\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-2gkx6"
Jul 06 22:21:30.222708 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:30.222662    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cd760c0a-43cf-4a91-9004-46309e9fa553-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-2gkx6\" (UID: \"cd760c0a-43cf-4a91-9004-46309e9fa553\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-2gkx6"
Jul 06 22:21:30.320247 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:30.320204    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7ed6a64a-3a0b-4933-b99b-90d8a0c3e1fe-secret-telemeter-client\") pod \"telemeter-client-55cb77ff94-sd8kq\" (UID: \"7ed6a64a-3a0b-4933-b99b-90d8a0c3e1fe\") " pod="openshift-monitoring/telemeter-client-55cb77ff94-sd8kq"
Jul 06 22:21:30.320437 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:30.320253    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7ed6a64a-3a0b-4933-b99b-90d8a0c3e1fe-telemeter-client-tls\") pod \"telemeter-client-55cb77ff94-sd8kq\" (UID: \"7ed6a64a-3a0b-4933-b99b-90d8a0c3e1fe\") " pod="openshift-monitoring/telemeter-client-55cb77ff94-sd8kq"
Jul 06 22:21:30.320437 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:30.320282    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7ed6a64a-3a0b-4933-b99b-90d8a0c3e1fe-federate-client-tls\") pod \"telemeter-client-55cb77ff94-sd8kq\" (UID: \"7ed6a64a-3a0b-4933-b99b-90d8a0c3e1fe\") " pod="openshift-monitoring/telemeter-client-55cb77ff94-sd8kq"
Jul 06 22:21:30.320437 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:30.320372    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ed6a64a-3a0b-4933-b99b-90d8a0c3e1fe-telemeter-trusted-ca-bundle\") pod \"telemeter-client-55cb77ff94-sd8kq\" (UID: \"7ed6a64a-3a0b-4933-b99b-90d8a0c3e1fe\") " pod="openshift-monitoring/telemeter-client-55cb77ff94-sd8kq"
Jul 06 22:21:30.320437 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:30.320408    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7ed6a64a-3a0b-4933-b99b-90d8a0c3e1fe-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-55cb77ff94-sd8kq\" (UID: \"7ed6a64a-3a0b-4933-b99b-90d8a0c3e1fe\") " pod="openshift-monitoring/telemeter-client-55cb77ff94-sd8kq"
Jul 06 22:21:30.320437 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:30.320435    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ed6a64a-3a0b-4933-b99b-90d8a0c3e1fe-metrics-client-ca\") pod \"telemeter-client-55cb77ff94-sd8kq\" (UID: \"7ed6a64a-3a0b-4933-b99b-90d8a0c3e1fe\") " pod="openshift-monitoring/telemeter-client-55cb77ff94-sd8kq"
Jul 06 22:21:30.320696 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:30.320487    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ed6a64a-3a0b-4933-b99b-90d8a0c3e1fe-serving-certs-ca-bundle\") pod \"telemeter-client-55cb77ff94-sd8kq\" (UID: \"7ed6a64a-3a0b-4933-b99b-90d8a0c3e1fe\") " pod="openshift-monitoring/telemeter-client-55cb77ff94-sd8kq"
Jul 06 22:21:30.320696 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:30.320515    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7w55p\" (UniqueName: \"kubernetes.io/projected/7ed6a64a-3a0b-4933-b99b-90d8a0c3e1fe-kube-api-access-7w55p\") pod \"telemeter-client-55cb77ff94-sd8kq\" (UID: \"7ed6a64a-3a0b-4933-b99b-90d8a0c3e1fe\") " pod="openshift-monitoring/telemeter-client-55cb77ff94-sd8kq"
Jul 06 22:21:30.321668 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:30.321634    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ed6a64a-3a0b-4933-b99b-90d8a0c3e1fe-metrics-client-ca\") pod \"telemeter-client-55cb77ff94-sd8kq\" (UID: \"7ed6a64a-3a0b-4933-b99b-90d8a0c3e1fe\") " pod="openshift-monitoring/telemeter-client-55cb77ff94-sd8kq"
Jul 06 22:21:30.321785 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:30.321765    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ed6a64a-3a0b-4933-b99b-90d8a0c3e1fe-telemeter-trusted-ca-bundle\") pod \"telemeter-client-55cb77ff94-sd8kq\" (UID: \"7ed6a64a-3a0b-4933-b99b-90d8a0c3e1fe\") " pod="openshift-monitoring/telemeter-client-55cb77ff94-sd8kq"
Jul 06 22:21:30.322416 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:30.322391    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ed6a64a-3a0b-4933-b99b-90d8a0c3e1fe-serving-certs-ca-bundle\") pod \"telemeter-client-55cb77ff94-sd8kq\" (UID: \"7ed6a64a-3a0b-4933-b99b-90d8a0c3e1fe\") " pod="openshift-monitoring/telemeter-client-55cb77ff94-sd8kq"
Jul 06 22:21:30.323883 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:30.323856    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7ed6a64a-3a0b-4933-b99b-90d8a0c3e1fe-telemeter-client-tls\") pod \"telemeter-client-55cb77ff94-sd8kq\" (UID: \"7ed6a64a-3a0b-4933-b99b-90d8a0c3e1fe\") " pod="openshift-monitoring/telemeter-client-55cb77ff94-sd8kq"
Jul 06 22:21:30.323974 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:30.323858    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7ed6a64a-3a0b-4933-b99b-90d8a0c3e1fe-federate-client-tls\") pod \"telemeter-client-55cb77ff94-sd8kq\" (UID: \"7ed6a64a-3a0b-4933-b99b-90d8a0c3e1fe\") " pod="openshift-monitoring/telemeter-client-55cb77ff94-sd8kq"
Jul 06 22:21:30.324689 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:30.324642    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7ed6a64a-3a0b-4933-b99b-90d8a0c3e1fe-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-55cb77ff94-sd8kq\" (UID: \"7ed6a64a-3a0b-4933-b99b-90d8a0c3e1fe\") " pod="openshift-monitoring/telemeter-client-55cb77ff94-sd8kq"
Jul 06 22:21:30.324689 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:30.324676    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7ed6a64a-3a0b-4933-b99b-90d8a0c3e1fe-secret-telemeter-client\") pod \"telemeter-client-55cb77ff94-sd8kq\" (UID: \"7ed6a64a-3a0b-4933-b99b-90d8a0c3e1fe\") " pod="openshift-monitoring/telemeter-client-55cb77ff94-sd8kq"
Jul 06 22:21:30.330830 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:30.330805    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7w55p\" (UniqueName: \"kubernetes.io/projected/7ed6a64a-3a0b-4933-b99b-90d8a0c3e1fe-kube-api-access-7w55p\") pod \"telemeter-client-55cb77ff94-sd8kq\" (UID: \"7ed6a64a-3a0b-4933-b99b-90d8a0c3e1fe\") " pod="openshift-monitoring/telemeter-client-55cb77ff94-sd8kq"
Jul 06 22:21:30.428073 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:30.427876    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-2gkx6"
Jul 06 22:21:30.497834 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:30.497796    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-55cb77ff94-sd8kq"
Jul 06 22:21:30.823978 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:30.823601    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-574f878cfc-gt2fx"]
Jul 06 22:21:30.870416 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:30.870285    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-2gkx6"]
Jul 06 22:21:30.873353 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:21:30.873322    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd760c0a_43cf_4a91_9004_46309e9fa553.slice/crio-8dee25463cefd00e83b31b7b45c57f39932f07bdd7e555c10a402e35d6808002 WatchSource:0}: Error finding container 8dee25463cefd00e83b31b7b45c57f39932f07bdd7e555c10a402e35d6808002: Status 404 returned error can't find the container with id 8dee25463cefd00e83b31b7b45c57f39932f07bdd7e555c10a402e35d6808002
Jul 06 22:21:31.063688 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:31.063658    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-55cb77ff94-sd8kq"]
Jul 06 22:21:31.067589 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:21:31.067561    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ed6a64a_3a0b_4933_b99b_90d8a0c3e1fe.slice/crio-fccc8a47f4ea8d4127106c6af17e79121478190b7d77ab9d4386d4ad13d14040 WatchSource:0}: Error finding container fccc8a47f4ea8d4127106c6af17e79121478190b7d77ab9d4386d4ad13d14040: Status 404 returned error can't find the container with id fccc8a47f4ea8d4127106c6af17e79121478190b7d77ab9d4386d4ad13d14040
Jul 06 22:21:31.124782 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:31.124752    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c870cbd8-ee95-417e-bcf0-85aa85acdb78","Type":"ContainerStarted","Data":"64a11600a808981d8d481b2b6d553e66e2437157483d20a36056223b9dac257e"}
Jul 06 22:21:31.124901 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:31.124855    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c870cbd8-ee95-417e-bcf0-85aa85acdb78","Type":"ContainerStarted","Data":"b5bd5fb3e47ce6899b0df99497558d068e17068b6280c8178a80bf8b91cb0aa1"}
Jul 06 22:21:31.124901 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:31.124899    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c870cbd8-ee95-417e-bcf0-85aa85acdb78","Type":"ContainerStarted","Data":"a829e7ae0ae6ff8efe11733dc9e4cd94fe0221a40a3c98dccd6c541dcb17a94e"}
Jul 06 22:21:31.125018 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:31.124928    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c870cbd8-ee95-417e-bcf0-85aa85acdb78","Type":"ContainerStarted","Data":"fa507882728ad69848ab7b491fac2c50ea58aab52fba5b5e1b00a15d63926c1d"}
Jul 06 22:21:31.126417 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:31.126378    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-55cb77ff94-sd8kq" event={"ID":"7ed6a64a-3a0b-4933-b99b-90d8a0c3e1fe","Type":"ContainerStarted","Data":"fccc8a47f4ea8d4127106c6af17e79121478190b7d77ab9d4386d4ad13d14040"}
Jul 06 22:21:31.127863 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:31.127831    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-2gkx6" event={"ID":"cd760c0a-43cf-4a91-9004-46309e9fa553","Type":"ContainerStarted","Data":"8dee25463cefd00e83b31b7b45c57f39932f07bdd7e555c10a402e35d6808002"}
Jul 06 22:21:31.129143 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:31.129046    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-574f878cfc-gt2fx" event={"ID":"4ed30170-54eb-482a-8a74-7eb82a044d08","Type":"ContainerStarted","Data":"879c2b13cbaa86ac4003faa7ae5339baf85d308d230c16b3ee344d8cac953ba9"}
Jul 06 22:21:31.131747 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:31.131705    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67b94b7755-9bmsj" event={"ID":"71ff7249-17a8-4172-a5ee-4ff3c599bae6","Type":"ContainerStarted","Data":"12e3c05135d9d6fc22b8ff0638caeff5d4291df85397b14361868e331f3c12f2"}
Jul 06 22:21:31.131837 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:31.131771    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67b94b7755-9bmsj" event={"ID":"71ff7249-17a8-4172-a5ee-4ff3c599bae6","Type":"ContainerStarted","Data":"15c2528f8dbf5159179f943579cf3dd39acdbde013cd72034964d43166d7c273"}
Jul 06 22:21:31.131837 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:31.131813    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67b94b7755-9bmsj" event={"ID":"71ff7249-17a8-4172-a5ee-4ff3c599bae6","Type":"ContainerStarted","Data":"af3a92f4434ce916a2758070527e0a124dbc3502f5cc315421cc495b3cbd464f"}
Jul 06 22:21:32.146664 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:32.146536    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c870cbd8-ee95-417e-bcf0-85aa85acdb78","Type":"ContainerStarted","Data":"f29ee632abc39890b815e04c2967e4c2124d8abc9186b1c9a2550545e35b6a69"}
Jul 06 22:21:34.017899 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:34.017825    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5cdbd5f6f7-klz5q"
Jul 06 22:21:34.159374 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:34.159309    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67b94b7755-9bmsj" event={"ID":"71ff7249-17a8-4172-a5ee-4ff3c599bae6","Type":"ContainerStarted","Data":"641839d3b432376c572e7ca623a4322ebaca3d79ea639f427136a0fb7842b26a"}
Jul 06 22:21:34.159546 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:34.159416    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67b94b7755-9bmsj" event={"ID":"71ff7249-17a8-4172-a5ee-4ff3c599bae6","Type":"ContainerStarted","Data":"a377b47c3e04e439faab74cee3fb57b796dfb1e0568a39b49809be2f5ba1fa09"}
Jul 06 22:21:34.159656 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:34.159617    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-67b94b7755-9bmsj"
Jul 06 22:21:34.159779 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:34.159686    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67b94b7755-9bmsj" event={"ID":"71ff7249-17a8-4172-a5ee-4ff3c599bae6","Type":"ContainerStarted","Data":"49a546a7e47598c1953557b0f35fbe39718af0ac6a1e12cb0204a163f766e298"}
Jul 06 22:21:34.163502 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:34.163474    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c870cbd8-ee95-417e-bcf0-85aa85acdb78","Type":"ContainerStarted","Data":"27c8559d2da6b29c0d397b3400e4a6b200032d18b0110db681f2e5e68a2f7714"}
Jul 06 22:21:34.165928 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:34.165904    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-55cb77ff94-sd8kq" event={"ID":"7ed6a64a-3a0b-4933-b99b-90d8a0c3e1fe","Type":"ContainerStarted","Data":"7248a5c5270262fbc252c9a19978aed34f10126d9e0916f396debbe69f6e2a68"}
Jul 06 22:21:34.166016 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:34.165956    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-55cb77ff94-sd8kq" event={"ID":"7ed6a64a-3a0b-4933-b99b-90d8a0c3e1fe","Type":"ContainerStarted","Data":"f80e8bd5797217dbc5178106337f0a0ab5b54077708b662e84f0fd042ab86522"}
Jul 06 22:21:34.166016 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:34.165985    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-55cb77ff94-sd8kq" event={"ID":"7ed6a64a-3a0b-4933-b99b-90d8a0c3e1fe","Type":"ContainerStarted","Data":"211fff9049f21ae5235b594ac02f785aacd580b2ea7738787844e75721cd906d"}
Jul 06 22:21:34.167788 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:34.167767    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-2gkx6" event={"ID":"cd760c0a-43cf-4a91-9004-46309e9fa553","Type":"ContainerStarted","Data":"b8aea4670726cced5a2510b604a1ed2a7d1d2b86de93d5111ee4a920017821f8"}
Jul 06 22:21:34.167985 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:34.167969    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-2gkx6"
Jul 06 22:21:34.169703 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:34.169675    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-574f878cfc-gt2fx" event={"ID":"4ed30170-54eb-482a-8a74-7eb82a044d08","Type":"ContainerStarted","Data":"0a04fef0ffc0ecdfd3b3da1387367adcea747fbebe33e08bd1e592a1ae84e6b8"}
Jul 06 22:21:34.173962 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:34.173939    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-2gkx6"
Jul 06 22:21:34.188616 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:34.188562    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-67b94b7755-9bmsj" podStartSLOduration=3.699850632 podStartE2EDuration="8.188545157s" totalImagesPullingTime="4.488694525s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:21:26 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:21:34.186927882 +0000 UTC m=+94.974950816" watchObservedRunningTime="2026-07-06 22:21:34.188545157 +0000 UTC m=+94.976568094"
Jul 06 22:21:34.210745 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:34.210701    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-574f878cfc-gt2fx" podStartSLOduration=2.48342027 podStartE2EDuration="5.210687484s" totalImagesPullingTime="2.727267214s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:21:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:21:34.208869674 +0000 UTC m=+94.996892619" watchObservedRunningTime="2026-07-06 22:21:34.210687484 +0000 UTC m=+94.998710417"
Jul 06 22:21:34.230748 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:34.230695    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-2gkx6" podStartSLOduration=2.545804719 podStartE2EDuration="5.230680559s" totalImagesPullingTime="2.68487584s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:21:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:21:34.229508728 +0000 UTC m=+95.017531664" watchObservedRunningTime="2026-07-06 22:21:34.230680559 +0000 UTC m=+95.018703491"
Jul 06 22:21:34.258472 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:34.258424    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-55cb77ff94-sd8kq" podStartSLOduration=1.765610438 podStartE2EDuration="4.25840986s" totalImagesPullingTime="2.492799422s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:21:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:21:34.255408459 +0000 UTC m=+95.043431418" watchObservedRunningTime="2026-07-06 22:21:34.25840986 +0000 UTC m=+95.046432793"
Jul 06 22:21:34.283320 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:34.283272    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.292510369 podStartE2EDuration="9.283256351s" totalImagesPullingTime="5.971603099s" totalInitContainerRuntime="19.142883ms" isStatefulPod=false podCreationTimestamp="2026-07-06 22:21:25 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:21:34.282239319 +0000 UTC m=+95.070262278" watchObservedRunningTime="2026-07-06 22:21:34.283256351 +0000 UTC m=+95.071279284"
Jul 06 22:21:35.181663 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:35.181634    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-67b94b7755-9bmsj"
Jul 06 22:21:41.525684 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:41.525649    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-68db98f99d-dq6tc"]
Jul 06 22:21:41.558049 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:41.558021    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68db98f99d-dq6tc"]
Jul 06 22:21:41.558223 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:41.558158    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68db98f99d-dq6tc"
Jul 06 22:21:41.564386 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:41.564365    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 06 22:21:41.564511 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:41.564487    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 06 22:21:41.564665 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:41.564639    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 06 22:21:41.565345 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:41.565307    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 06 22:21:41.565345 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:41.565343    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-p5gt7\""
Jul 06 22:21:41.565591 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:41.565578    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 06 22:21:41.635555 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:41.635530    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4f73730b-bed7-498c-b898-9e3f94b8e029-oauth-serving-cert\") pod \"console-68db98f99d-dq6tc\" (UID: \"4f73730b-bed7-498c-b898-9e3f94b8e029\") " pod="openshift-console/console-68db98f99d-dq6tc"
Jul 06 22:21:41.635701 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:41.635571    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4f73730b-bed7-498c-b898-9e3f94b8e029-service-ca\") pod \"console-68db98f99d-dq6tc\" (UID: \"4f73730b-bed7-498c-b898-9e3f94b8e029\") " pod="openshift-console/console-68db98f99d-dq6tc"
Jul 06 22:21:41.635701 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:41.635670    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4f73730b-bed7-498c-b898-9e3f94b8e029-console-config\") pod \"console-68db98f99d-dq6tc\" (UID: \"4f73730b-bed7-498c-b898-9e3f94b8e029\") " pod="openshift-console/console-68db98f99d-dq6tc"
Jul 06 22:21:41.635804 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:41.635719    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4f73730b-bed7-498c-b898-9e3f94b8e029-console-oauth-config\") pod \"console-68db98f99d-dq6tc\" (UID: \"4f73730b-bed7-498c-b898-9e3f94b8e029\") " pod="openshift-console/console-68db98f99d-dq6tc"
Jul 06 22:21:41.635804 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:41.635773    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chm74\" (UniqueName: \"kubernetes.io/projected/4f73730b-bed7-498c-b898-9e3f94b8e029-kube-api-access-chm74\") pod \"console-68db98f99d-dq6tc\" (UID: \"4f73730b-bed7-498c-b898-9e3f94b8e029\") " pod="openshift-console/console-68db98f99d-dq6tc"
Jul 06 22:21:41.635949 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:41.635827    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f73730b-bed7-498c-b898-9e3f94b8e029-console-serving-cert\") pod \"console-68db98f99d-dq6tc\" (UID: \"4f73730b-bed7-498c-b898-9e3f94b8e029\") " pod="openshift-console/console-68db98f99d-dq6tc"
Jul 06 22:21:41.736435 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:41.736403    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f73730b-bed7-498c-b898-9e3f94b8e029-console-serving-cert\") pod \"console-68db98f99d-dq6tc\" (UID: \"4f73730b-bed7-498c-b898-9e3f94b8e029\") " pod="openshift-console/console-68db98f99d-dq6tc"
Jul 06 22:21:41.736601 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:41.736452    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4f73730b-bed7-498c-b898-9e3f94b8e029-oauth-serving-cert\") pod \"console-68db98f99d-dq6tc\" (UID: \"4f73730b-bed7-498c-b898-9e3f94b8e029\") " pod="openshift-console/console-68db98f99d-dq6tc"
Jul 06 22:21:41.736601 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:41.736494    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4f73730b-bed7-498c-b898-9e3f94b8e029-service-ca\") pod \"console-68db98f99d-dq6tc\" (UID: \"4f73730b-bed7-498c-b898-9e3f94b8e029\") " pod="openshift-console/console-68db98f99d-dq6tc"
Jul 06 22:21:41.736601 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:41.736567    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4f73730b-bed7-498c-b898-9e3f94b8e029-console-config\") pod \"console-68db98f99d-dq6tc\" (UID: \"4f73730b-bed7-498c-b898-9e3f94b8e029\") " pod="openshift-console/console-68db98f99d-dq6tc"
Jul 06 22:21:41.736764 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:41.736603    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4f73730b-bed7-498c-b898-9e3f94b8e029-console-oauth-config\") pod \"console-68db98f99d-dq6tc\" (UID: \"4f73730b-bed7-498c-b898-9e3f94b8e029\") " pod="openshift-console/console-68db98f99d-dq6tc"
Jul 06 22:21:41.736764 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:41.736627    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chm74\" (UniqueName: \"kubernetes.io/projected/4f73730b-bed7-498c-b898-9e3f94b8e029-kube-api-access-chm74\") pod \"console-68db98f99d-dq6tc\" (UID: \"4f73730b-bed7-498c-b898-9e3f94b8e029\") " pod="openshift-console/console-68db98f99d-dq6tc"
Jul 06 22:21:41.737671 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:41.737618    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4f73730b-bed7-498c-b898-9e3f94b8e029-console-config\") pod \"console-68db98f99d-dq6tc\" (UID: \"4f73730b-bed7-498c-b898-9e3f94b8e029\") " pod="openshift-console/console-68db98f99d-dq6tc"
Jul 06 22:21:41.737791 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:41.737718    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4f73730b-bed7-498c-b898-9e3f94b8e029-service-ca\") pod \"console-68db98f99d-dq6tc\" (UID: \"4f73730b-bed7-498c-b898-9e3f94b8e029\") " pod="openshift-console/console-68db98f99d-dq6tc"
Jul 06 22:21:41.738174 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:41.738151    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4f73730b-bed7-498c-b898-9e3f94b8e029-oauth-serving-cert\") pod \"console-68db98f99d-dq6tc\" (UID: \"4f73730b-bed7-498c-b898-9e3f94b8e029\") " pod="openshift-console/console-68db98f99d-dq6tc"
Jul 06 22:21:41.739453 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:41.739428    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f73730b-bed7-498c-b898-9e3f94b8e029-console-serving-cert\") pod \"console-68db98f99d-dq6tc\" (UID: \"4f73730b-bed7-498c-b898-9e3f94b8e029\") " pod="openshift-console/console-68db98f99d-dq6tc"
Jul 06 22:21:41.739535 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:41.739461    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4f73730b-bed7-498c-b898-9e3f94b8e029-console-oauth-config\") pod \"console-68db98f99d-dq6tc\" (UID: \"4f73730b-bed7-498c-b898-9e3f94b8e029\") " pod="openshift-console/console-68db98f99d-dq6tc"
Jul 06 22:21:41.746623 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:41.746601    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chm74\" (UniqueName: \"kubernetes.io/projected/4f73730b-bed7-498c-b898-9e3f94b8e029-kube-api-access-chm74\") pod \"console-68db98f99d-dq6tc\" (UID: \"4f73730b-bed7-498c-b898-9e3f94b8e029\") " pod="openshift-console/console-68db98f99d-dq6tc"
Jul 06 22:21:41.870248 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:41.870163    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68db98f99d-dq6tc"
Jul 06 22:21:42.004358 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:42.004325    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-s9ptr"
Jul 06 22:21:43.793556 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:43.793520    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-784d5f44d9-6k9b7"]
Jul 06 22:21:43.797497 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:43.797470    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-784d5f44d9-6k9b7"
Jul 06 22:21:43.805318 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:43.805297    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 06 22:21:43.814064 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:43.809980    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-784d5f44d9-6k9b7"]
Jul 06 22:21:43.855605 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:43.855572    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97b419e1-9bec-43e6-9166-42d2221cbcde-trusted-ca-bundle\") pod \"console-784d5f44d9-6k9b7\" (UID: \"97b419e1-9bec-43e6-9166-42d2221cbcde\") " pod="openshift-console/console-784d5f44d9-6k9b7"
Jul 06 22:21:43.855758 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:43.855636    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9ffg\" (UniqueName: \"kubernetes.io/projected/97b419e1-9bec-43e6-9166-42d2221cbcde-kube-api-access-v9ffg\") pod \"console-784d5f44d9-6k9b7\" (UID: \"97b419e1-9bec-43e6-9166-42d2221cbcde\") " pod="openshift-console/console-784d5f44d9-6k9b7"
Jul 06 22:21:43.855758 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:43.855657    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/97b419e1-9bec-43e6-9166-42d2221cbcde-service-ca\") pod \"console-784d5f44d9-6k9b7\" (UID: \"97b419e1-9bec-43e6-9166-42d2221cbcde\") " pod="openshift-console/console-784d5f44d9-6k9b7"
Jul 06 22:21:43.855758 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:43.855682    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/97b419e1-9bec-43e6-9166-42d2221cbcde-console-serving-cert\") pod \"console-784d5f44d9-6k9b7\" (UID: \"97b419e1-9bec-43e6-9166-42d2221cbcde\") " pod="openshift-console/console-784d5f44d9-6k9b7"
Jul 06 22:21:43.855758 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:43.855709    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/97b419e1-9bec-43e6-9166-42d2221cbcde-oauth-serving-cert\") pod \"console-784d5f44d9-6k9b7\" (UID: \"97b419e1-9bec-43e6-9166-42d2221cbcde\") " pod="openshift-console/console-784d5f44d9-6k9b7"
Jul 06 22:21:43.855917 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:43.855768    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/97b419e1-9bec-43e6-9166-42d2221cbcde-console-config\") pod \"console-784d5f44d9-6k9b7\" (UID: \"97b419e1-9bec-43e6-9166-42d2221cbcde\") " pod="openshift-console/console-784d5f44d9-6k9b7"
Jul 06 22:21:43.855917 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:43.855793    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/97b419e1-9bec-43e6-9166-42d2221cbcde-console-oauth-config\") pod \"console-784d5f44d9-6k9b7\" (UID: \"97b419e1-9bec-43e6-9166-42d2221cbcde\") " pod="openshift-console/console-784d5f44d9-6k9b7"
Jul 06 22:21:43.956720 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:43.956678    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97b419e1-9bec-43e6-9166-42d2221cbcde-trusted-ca-bundle\") pod \"console-784d5f44d9-6k9b7\" (UID: \"97b419e1-9bec-43e6-9166-42d2221cbcde\") " pod="openshift-console/console-784d5f44d9-6k9b7"
Jul 06 22:21:43.956927 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:43.956751    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9ffg\" (UniqueName: \"kubernetes.io/projected/97b419e1-9bec-43e6-9166-42d2221cbcde-kube-api-access-v9ffg\") pod \"console-784d5f44d9-6k9b7\" (UID: \"97b419e1-9bec-43e6-9166-42d2221cbcde\") " pod="openshift-console/console-784d5f44d9-6k9b7"
Jul 06 22:21:43.956927 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:43.956782    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/97b419e1-9bec-43e6-9166-42d2221cbcde-service-ca\") pod \"console-784d5f44d9-6k9b7\" (UID: \"97b419e1-9bec-43e6-9166-42d2221cbcde\") " pod="openshift-console/console-784d5f44d9-6k9b7"
Jul 06 22:21:43.956927 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:43.956816    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/97b419e1-9bec-43e6-9166-42d2221cbcde-console-serving-cert\") pod \"console-784d5f44d9-6k9b7\" (UID: \"97b419e1-9bec-43e6-9166-42d2221cbcde\") " pod="openshift-console/console-784d5f44d9-6k9b7"
Jul 06 22:21:43.957394 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:43.957175    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/97b419e1-9bec-43e6-9166-42d2221cbcde-oauth-serving-cert\") pod \"console-784d5f44d9-6k9b7\" (UID: \"97b419e1-9bec-43e6-9166-42d2221cbcde\") " pod="openshift-console/console-784d5f44d9-6k9b7"
Jul 06 22:21:43.957394 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:43.957262    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/97b419e1-9bec-43e6-9166-42d2221cbcde-console-config\") pod \"console-784d5f44d9-6k9b7\" (UID: \"97b419e1-9bec-43e6-9166-42d2221cbcde\") " pod="openshift-console/console-784d5f44d9-6k9b7"
Jul 06 22:21:43.957394 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:43.957299    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/97b419e1-9bec-43e6-9166-42d2221cbcde-console-oauth-config\") pod \"console-784d5f44d9-6k9b7\" (UID: \"97b419e1-9bec-43e6-9166-42d2221cbcde\") " pod="openshift-console/console-784d5f44d9-6k9b7"
Jul 06 22:21:43.957767 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:43.957742    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97b419e1-9bec-43e6-9166-42d2221cbcde-trusted-ca-bundle\") pod \"console-784d5f44d9-6k9b7\" (UID: \"97b419e1-9bec-43e6-9166-42d2221cbcde\") " pod="openshift-console/console-784d5f44d9-6k9b7"
Jul 06 22:21:43.958236 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:43.958214    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/97b419e1-9bec-43e6-9166-42d2221cbcde-oauth-serving-cert\") pod \"console-784d5f44d9-6k9b7\" (UID: \"97b419e1-9bec-43e6-9166-42d2221cbcde\") " pod="openshift-console/console-784d5f44d9-6k9b7"
Jul 06 22:21:43.958794 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:43.958770    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/97b419e1-9bec-43e6-9166-42d2221cbcde-service-ca\") pod \"console-784d5f44d9-6k9b7\" (UID: \"97b419e1-9bec-43e6-9166-42d2221cbcde\") " pod="openshift-console/console-784d5f44d9-6k9b7"
Jul 06 22:21:43.958891 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:43.958776    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/97b419e1-9bec-43e6-9166-42d2221cbcde-console-config\") pod \"console-784d5f44d9-6k9b7\" (UID: \"97b419e1-9bec-43e6-9166-42d2221cbcde\") " pod="openshift-console/console-784d5f44d9-6k9b7"
Jul 06 22:21:43.959792 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:43.959769    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/97b419e1-9bec-43e6-9166-42d2221cbcde-console-serving-cert\") pod \"console-784d5f44d9-6k9b7\" (UID: \"97b419e1-9bec-43e6-9166-42d2221cbcde\") " pod="openshift-console/console-784d5f44d9-6k9b7"
Jul 06 22:21:43.960725 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:43.960696    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/97b419e1-9bec-43e6-9166-42d2221cbcde-console-oauth-config\") pod \"console-784d5f44d9-6k9b7\" (UID: \"97b419e1-9bec-43e6-9166-42d2221cbcde\") " pod="openshift-console/console-784d5f44d9-6k9b7"
Jul 06 22:21:43.967927 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:43.967899    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9ffg\" (UniqueName: \"kubernetes.io/projected/97b419e1-9bec-43e6-9166-42d2221cbcde-kube-api-access-v9ffg\") pod \"console-784d5f44d9-6k9b7\" (UID: \"97b419e1-9bec-43e6-9166-42d2221cbcde\") " pod="openshift-console/console-784d5f44d9-6k9b7"
Jul 06 22:21:44.109950 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:44.109872    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-784d5f44d9-6k9b7"
Jul 06 22:21:46.629220 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:46.629183    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-784d5f44d9-6k9b7"]
Jul 06 22:21:46.647878 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:46.647857    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68db98f99d-dq6tc"]
Jul 06 22:21:46.784067 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:21:46.784034    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97b419e1_9bec_43e6_9166_42d2221cbcde.slice/crio-e5dda612e7aa96f4553cb41eae5cc2c9281e9a1daf31f5c3add09ddb77a188b3 WatchSource:0}: Error finding container e5dda612e7aa96f4553cb41eae5cc2c9281e9a1daf31f5c3add09ddb77a188b3: Status 404 returned error can't find the container with id e5dda612e7aa96f4553cb41eae5cc2c9281e9a1daf31f5c3add09ddb77a188b3
Jul 06 22:21:46.785031 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:21:46.784994    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f73730b_bed7_498c_b898_9e3f94b8e029.slice/crio-b9ddef640fcc7611c193bdf25574579beb367e8b695f15b0cfe662e6e8f0e4a4 WatchSource:0}: Error finding container b9ddef640fcc7611c193bdf25574579beb367e8b695f15b0cfe662e6e8f0e4a4: Status 404 returned error can't find the container with id b9ddef640fcc7611c193bdf25574579beb367e8b695f15b0cfe662e6e8f0e4a4
Jul 06 22:21:47.237943 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:47.237854    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-s29sb" event={"ID":"cc894bc2-0569-476b-9806-277a81ba1da6","Type":"ContainerStarted","Data":"fb4cb24491e02b982886d1f419b2cbb45d5c50a0d221829f5ddcf33d6823fa99"}
Jul 06 22:21:47.238138 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:47.238049    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-s29sb"
Jul 06 22:21:47.239606 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:47.239572    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68db98f99d-dq6tc" event={"ID":"4f73730b-bed7-498c-b898-9e3f94b8e029","Type":"ContainerStarted","Data":"b9ddef640fcc7611c193bdf25574579beb367e8b695f15b0cfe662e6e8f0e4a4"}
Jul 06 22:21:47.240999 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:47.240968    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-784d5f44d9-6k9b7" event={"ID":"97b419e1-9bec-43e6-9166-42d2221cbcde","Type":"ContainerStarted","Data":"e5dda612e7aa96f4553cb41eae5cc2c9281e9a1daf31f5c3add09ddb77a188b3"}
Jul 06 22:21:47.260494 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:47.260457    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-s29sb"
Jul 06 22:21:47.268072 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:47.268008    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-s29sb" podStartSLOduration=1.834011549 podStartE2EDuration="20.267988081s" totalImagesPullingTime="18.433976532s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:21:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:21:47.267166759 +0000 UTC m=+108.055189694" watchObservedRunningTime="2026-07-06 22:21:47.267988081 +0000 UTC m=+108.056011017"
Jul 06 22:21:49.850114 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:49.850033    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-574f878cfc-gt2fx"
Jul 06 22:21:49.850789 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:49.850195    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-574f878cfc-gt2fx"
Jul 06 22:21:51.266006 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:51.265919    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68db98f99d-dq6tc" event={"ID":"4f73730b-bed7-498c-b898-9e3f94b8e029","Type":"ContainerStarted","Data":"9e59761078990a6d0cac500a56d4b309e371e05a9cd3d79f2c109076cf59f28b"}
Jul 06 22:21:51.267838 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:51.267806    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-784d5f44d9-6k9b7" event={"ID":"97b419e1-9bec-43e6-9166-42d2221cbcde","Type":"ContainerStarted","Data":"93244ed0465f535721836f9cdb6c7756e0b84748ac62c24079b2adac25659a4d"}
Jul 06 22:21:51.289203 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:51.289149    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-68db98f99d-dq6tc" podStartSLOduration=6.104956741 podStartE2EDuration="10.289133821s" totalImagesPullingTime="4.18417708s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:21:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:21:51.286875561 +0000 UTC m=+112.074898494" watchObservedRunningTime="2026-07-06 22:21:51.289133821 +0000 UTC m=+112.077156754"
Jul 06 22:21:51.309414 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:51.309354    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-784d5f44d9-6k9b7" podStartSLOduration=4.117705279 podStartE2EDuration="8.309333797s" totalImagesPullingTime="4.191628518s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:21:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:21:51.309229982 +0000 UTC m=+112.097252905" watchObservedRunningTime="2026-07-06 22:21:51.309333797 +0000 UTC m=+112.097356730"
Jul 06 22:21:51.870853 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:51.870813    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-68db98f99d-dq6tc"
Jul 06 22:21:51.871023 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:51.870890    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-68db98f99d-dq6tc"
Jul 06 22:21:51.876233 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:51.876207    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-68db98f99d-dq6tc"
Jul 06 22:21:52.278064 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:52.278033    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-68db98f99d-dq6tc"
Jul 06 22:21:54.110018 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:54.109977    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-784d5f44d9-6k9b7"
Jul 06 22:21:54.110482 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:54.110149    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-784d5f44d9-6k9b7"
Jul 06 22:21:54.115742 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:54.115719    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-784d5f44d9-6k9b7"
Jul 06 22:21:54.288800 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:54.288769    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-784d5f44d9-6k9b7"
Jul 06 22:21:54.341455 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:54.341419    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-68db98f99d-dq6tc"]
Jul 06 22:21:55.290781 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:55.290745    2556 generic.go:356] "Generic (PLEG): container finished" podID="6f201e5f-d7c9-456c-b7b4-05c2542e5933" containerID="353958fb15a4e3018232fea52323c5812ccdbbe0e8a7e1d7b55f1746542c548d" exitCode=0
Jul 06 22:21:55.291250 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:55.290803    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-px5rm" event={"ID":"6f201e5f-d7c9-456c-b7b4-05c2542e5933","Type":"ContainerDied","Data":"353958fb15a4e3018232fea52323c5812ccdbbe0e8a7e1d7b55f1746542c548d"}
Jul 06 22:21:55.291367 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:55.291333    2556 scope.go:117] "RemoveContainer" containerID="353958fb15a4e3018232fea52323c5812ccdbbe0e8a7e1d7b55f1746542c548d"
Jul 06 22:21:56.297711 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:21:56.297678    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-px5rm" event={"ID":"6f201e5f-d7c9-456c-b7b4-05c2542e5933","Type":"ContainerStarted","Data":"d7449f64f5eb2e56e5dfa727056ec83447b6abb415a979f50304de8a3c52dbd3"}
Jul 06 22:22:09.854920 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:09.854889    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-574f878cfc-gt2fx"
Jul 06 22:22:09.858638 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:09.858618    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-574f878cfc-gt2fx"
Jul 06 22:22:13.378644 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:13.378611    2556 generic.go:356] "Generic (PLEG): container finished" podID="4d32d357-4d65-41d8-b9a1-82a5900859f9" containerID="3e59d571103991414657c296d66f6eb86af93b480a574031821d3501f102d689" exitCode=0
Jul 06 22:22:13.379130 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:13.378689    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rcl6h" event={"ID":"4d32d357-4d65-41d8-b9a1-82a5900859f9","Type":"ContainerDied","Data":"3e59d571103991414657c296d66f6eb86af93b480a574031821d3501f102d689"}
Jul 06 22:22:13.379294 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:13.379267    2556 scope.go:117] "RemoveContainer" containerID="3e59d571103991414657c296d66f6eb86af93b480a574031821d3501f102d689"
Jul 06 22:22:14.384520 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:14.384484    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rcl6h" event={"ID":"4d32d357-4d65-41d8-b9a1-82a5900859f9","Type":"ContainerStarted","Data":"79b3fefdda9080e4b1237cdaefa70d7c7814f031336c7761c5a4116197f7c236"}
Jul 06 22:22:20.317384 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:20.317341    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-68db98f99d-dq6tc" podUID="4f73730b-bed7-498c-b898-9e3f94b8e029" containerName="console" containerID="cri-o://9e59761078990a6d0cac500a56d4b309e371e05a9cd3d79f2c109076cf59f28b" gracePeriod=15
Jul 06 22:22:20.594877 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:20.594809    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68db98f99d-dq6tc"
Jul 06 22:22:20.691899 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:20.691867    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-chm74\" (UniqueName: \"kubernetes.io/projected/4f73730b-bed7-498c-b898-9e3f94b8e029-kube-api-access-chm74\") pod \"4f73730b-bed7-498c-b898-9e3f94b8e029\" (UID: \"4f73730b-bed7-498c-b898-9e3f94b8e029\") "
Jul 06 22:22:20.691899 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:20.691900    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f73730b-bed7-498c-b898-9e3f94b8e029-console-serving-cert\") pod \"4f73730b-bed7-498c-b898-9e3f94b8e029\" (UID: \"4f73730b-bed7-498c-b898-9e3f94b8e029\") "
Jul 06 22:22:20.692132 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:20.691949    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4f73730b-bed7-498c-b898-9e3f94b8e029-oauth-serving-cert\") pod \"4f73730b-bed7-498c-b898-9e3f94b8e029\" (UID: \"4f73730b-bed7-498c-b898-9e3f94b8e029\") "
Jul 06 22:22:20.692183 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:20.692128    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4f73730b-bed7-498c-b898-9e3f94b8e029-console-config\") pod \"4f73730b-bed7-498c-b898-9e3f94b8e029\" (UID: \"4f73730b-bed7-498c-b898-9e3f94b8e029\") "
Jul 06 22:22:20.692236 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:20.692180    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4f73730b-bed7-498c-b898-9e3f94b8e029-service-ca\") pod \"4f73730b-bed7-498c-b898-9e3f94b8e029\" (UID: \"4f73730b-bed7-498c-b898-9e3f94b8e029\") "
Jul 06 22:22:20.692236 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:20.692209    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4f73730b-bed7-498c-b898-9e3f94b8e029-console-oauth-config\") pod \"4f73730b-bed7-498c-b898-9e3f94b8e029\" (UID: \"4f73730b-bed7-498c-b898-9e3f94b8e029\") "
Jul 06 22:22:20.692344 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:20.692289    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f73730b-bed7-498c-b898-9e3f94b8e029-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4f73730b-bed7-498c-b898-9e3f94b8e029" (UID: "4f73730b-bed7-498c-b898-9e3f94b8e029"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 22:22:20.692525 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:20.692502    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f73730b-bed7-498c-b898-9e3f94b8e029-service-ca" (OuterVolumeSpecName: "service-ca") pod "4f73730b-bed7-498c-b898-9e3f94b8e029" (UID: "4f73730b-bed7-498c-b898-9e3f94b8e029"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 22:22:20.692525 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:20.692517    2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4f73730b-bed7-498c-b898-9e3f94b8e029-oauth-serving-cert\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\""
Jul 06 22:22:20.692525 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:20.692513    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f73730b-bed7-498c-b898-9e3f94b8e029-console-config" (OuterVolumeSpecName: "console-config") pod "4f73730b-bed7-498c-b898-9e3f94b8e029" (UID: "4f73730b-bed7-498c-b898-9e3f94b8e029"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 22:22:20.694144 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:20.694120    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f73730b-bed7-498c-b898-9e3f94b8e029-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4f73730b-bed7-498c-b898-9e3f94b8e029" (UID: "4f73730b-bed7-498c-b898-9e3f94b8e029"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 22:22:20.694230 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:20.694186    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f73730b-bed7-498c-b898-9e3f94b8e029-kube-api-access-chm74" (OuterVolumeSpecName: "kube-api-access-chm74") pod "4f73730b-bed7-498c-b898-9e3f94b8e029" (UID: "4f73730b-bed7-498c-b898-9e3f94b8e029"). InnerVolumeSpecName "kube-api-access-chm74". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 22:22:20.694297 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:20.694274    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f73730b-bed7-498c-b898-9e3f94b8e029-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4f73730b-bed7-498c-b898-9e3f94b8e029" (UID: "4f73730b-bed7-498c-b898-9e3f94b8e029"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 22:22:20.793697 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:20.793663    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-chm74\" (UniqueName: \"kubernetes.io/projected/4f73730b-bed7-498c-b898-9e3f94b8e029-kube-api-access-chm74\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\""
Jul 06 22:22:20.793697 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:20.793690    2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f73730b-bed7-498c-b898-9e3f94b8e029-console-serving-cert\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\""
Jul 06 22:22:20.793697 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:20.793700    2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4f73730b-bed7-498c-b898-9e3f94b8e029-console-config\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\""
Jul 06 22:22:20.793906 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:20.793708    2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4f73730b-bed7-498c-b898-9e3f94b8e029-service-ca\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\""
Jul 06 22:22:20.793906 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:20.793716    2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4f73730b-bed7-498c-b898-9e3f94b8e029-console-oauth-config\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\""
Jul 06 22:22:21.415438 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:21.415401    2556 generic.go:356] "Generic (PLEG): container finished" podID="4f73730b-bed7-498c-b898-9e3f94b8e029" containerID="9e59761078990a6d0cac500a56d4b309e371e05a9cd3d79f2c109076cf59f28b" exitCode=0
Jul 06 22:22:21.415831 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:21.415442    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68db98f99d-dq6tc"
Jul 06 22:22:21.415831 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:21.415487    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68db98f99d-dq6tc" event={"ID":"4f73730b-bed7-498c-b898-9e3f94b8e029","Type":"ContainerDied","Data":"9e59761078990a6d0cac500a56d4b309e371e05a9cd3d79f2c109076cf59f28b"}
Jul 06 22:22:21.415831 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:21.415539    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68db98f99d-dq6tc" event={"ID":"4f73730b-bed7-498c-b898-9e3f94b8e029","Type":"ContainerDied","Data":"b9ddef640fcc7611c193bdf25574579beb367e8b695f15b0cfe662e6e8f0e4a4"}
Jul 06 22:22:21.415831 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:21.415559    2556 scope.go:117] "RemoveContainer" containerID="9e59761078990a6d0cac500a56d4b309e371e05a9cd3d79f2c109076cf59f28b"
Jul 06 22:22:21.425510 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:21.425493    2556 scope.go:117] "RemoveContainer" containerID="9e59761078990a6d0cac500a56d4b309e371e05a9cd3d79f2c109076cf59f28b"
Jul 06 22:22:21.425751 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:22:21.425733    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e59761078990a6d0cac500a56d4b309e371e05a9cd3d79f2c109076cf59f28b\": container with ID starting with 9e59761078990a6d0cac500a56d4b309e371e05a9cd3d79f2c109076cf59f28b not found: ID does not exist" containerID="9e59761078990a6d0cac500a56d4b309e371e05a9cd3d79f2c109076cf59f28b"
Jul 06 22:22:21.425800 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:21.425757    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e59761078990a6d0cac500a56d4b309e371e05a9cd3d79f2c109076cf59f28b"} err="failed to get container status \"9e59761078990a6d0cac500a56d4b309e371e05a9cd3d79f2c109076cf59f28b\": rpc error: code = NotFound desc = could not find container \"9e59761078990a6d0cac500a56d4b309e371e05a9cd3d79f2c109076cf59f28b\": container with ID starting with 9e59761078990a6d0cac500a56d4b309e371e05a9cd3d79f2c109076cf59f28b not found: ID does not exist"
Jul 06 22:22:21.440700 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:21.440676    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-68db98f99d-dq6tc"]
Jul 06 22:22:21.445857 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:21.445838    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-68db98f99d-dq6tc"]
Jul 06 22:22:21.657821 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:21.657778    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f73730b-bed7-498c-b898-9e3f94b8e029" path="/var/lib/kubelet/pods/4f73730b-bed7-498c-b898-9e3f94b8e029/volumes"
Jul 06 22:22:43.827081 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:43.827047    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f55fb8956-88zgj"]
Jul 06 22:22:43.827615 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:43.827394    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f73730b-bed7-498c-b898-9e3f94b8e029" containerName="console"
Jul 06 22:22:43.827615 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:43.827406    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f73730b-bed7-498c-b898-9e3f94b8e029" containerName="console"
Jul 06 22:22:43.827615 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:43.827483    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f73730b-bed7-498c-b898-9e3f94b8e029" containerName="console"
Jul 06 22:22:43.830024 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:43.830008    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f55fb8956-88zgj"
Jul 06 22:22:43.839013 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:43.838977    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f55fb8956-88zgj"]
Jul 06 22:22:43.998798 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:43.998753    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c-trusted-ca-bundle\") pod \"console-7f55fb8956-88zgj\" (UID: \"aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c\") " pod="openshift-console/console-7f55fb8956-88zgj"
Jul 06 22:22:43.998798 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:43.998802    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c-console-oauth-config\") pod \"console-7f55fb8956-88zgj\" (UID: \"aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c\") " pod="openshift-console/console-7f55fb8956-88zgj"
Jul 06 22:22:43.999030 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:43.998827    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c-oauth-serving-cert\") pod \"console-7f55fb8956-88zgj\" (UID: \"aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c\") " pod="openshift-console/console-7f55fb8956-88zgj"
Jul 06 22:22:43.999030 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:43.998960    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c-service-ca\") pod \"console-7f55fb8956-88zgj\" (UID: \"aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c\") " pod="openshift-console/console-7f55fb8956-88zgj"
Jul 06 22:22:43.999030 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:43.999006    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c-console-serving-cert\") pod \"console-7f55fb8956-88zgj\" (UID: \"aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c\") " pod="openshift-console/console-7f55fb8956-88zgj"
Jul 06 22:22:43.999030 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:43.999025    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvspn\" (UniqueName: \"kubernetes.io/projected/aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c-kube-api-access-gvspn\") pod \"console-7f55fb8956-88zgj\" (UID: \"aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c\") " pod="openshift-console/console-7f55fb8956-88zgj"
Jul 06 22:22:43.999214 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:43.999068    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c-console-config\") pod \"console-7f55fb8956-88zgj\" (UID: \"aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c\") " pod="openshift-console/console-7f55fb8956-88zgj"
Jul 06 22:22:44.099954 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:44.099840    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c-service-ca\") pod \"console-7f55fb8956-88zgj\" (UID: \"aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c\") " pod="openshift-console/console-7f55fb8956-88zgj"
Jul 06 22:22:44.099954 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:44.099906    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c-console-serving-cert\") pod \"console-7f55fb8956-88zgj\" (UID: \"aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c\") " pod="openshift-console/console-7f55fb8956-88zgj"
Jul 06 22:22:44.099954 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:44.099924    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvspn\" (UniqueName: \"kubernetes.io/projected/aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c-kube-api-access-gvspn\") pod \"console-7f55fb8956-88zgj\" (UID: \"aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c\") " pod="openshift-console/console-7f55fb8956-88zgj"
Jul 06 22:22:44.099954 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:44.099948    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c-console-config\") pod \"console-7f55fb8956-88zgj\" (UID: \"aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c\") " pod="openshift-console/console-7f55fb8956-88zgj"
Jul 06 22:22:44.100323 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:44.099974    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c-trusted-ca-bundle\") pod \"console-7f55fb8956-88zgj\" (UID: \"aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c\") " pod="openshift-console/console-7f55fb8956-88zgj"
Jul 06 22:22:44.100323 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:44.100155    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c-console-oauth-config\") pod \"console-7f55fb8956-88zgj\" (UID: \"aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c\") " pod="openshift-console/console-7f55fb8956-88zgj"
Jul 06 22:22:44.100323 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:44.100190    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c-oauth-serving-cert\") pod \"console-7f55fb8956-88zgj\" (UID: \"aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c\") " pod="openshift-console/console-7f55fb8956-88zgj"
Jul 06 22:22:44.100745 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:44.100714    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c-console-config\") pod \"console-7f55fb8956-88zgj\" (UID: \"aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c\") " pod="openshift-console/console-7f55fb8956-88zgj"
Jul 06 22:22:44.100866 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:44.100765    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c-service-ca\") pod \"console-7f55fb8956-88zgj\" (UID: \"aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c\") " pod="openshift-console/console-7f55fb8956-88zgj"
Jul 06 22:22:44.100911 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:44.100898    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c-oauth-serving-cert\") pod \"console-7f55fb8956-88zgj\" (UID: \"aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c\") " pod="openshift-console/console-7f55fb8956-88zgj"
Jul 06 22:22:44.100956 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:44.100898    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c-trusted-ca-bundle\") pod \"console-7f55fb8956-88zgj\" (UID: \"aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c\") " pod="openshift-console/console-7f55fb8956-88zgj"
Jul 06 22:22:44.102455 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:44.102438    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c-console-serving-cert\") pod \"console-7f55fb8956-88zgj\" (UID: \"aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c\") " pod="openshift-console/console-7f55fb8956-88zgj"
Jul 06 22:22:44.102567 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:44.102545    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c-console-oauth-config\") pod \"console-7f55fb8956-88zgj\" (UID: \"aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c\") " pod="openshift-console/console-7f55fb8956-88zgj"
Jul 06 22:22:44.109757 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:44.109737    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvspn\" (UniqueName: \"kubernetes.io/projected/aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c-kube-api-access-gvspn\") pod \"console-7f55fb8956-88zgj\" (UID: \"aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c\") " pod="openshift-console/console-7f55fb8956-88zgj"
Jul 06 22:22:44.139377 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:44.139345    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f55fb8956-88zgj"
Jul 06 22:22:44.278051 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:44.277608    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f55fb8956-88zgj"]
Jul 06 22:22:44.280832 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:22:44.280799    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa34675c_bc12_4fd0_b0c8_b5634e9e6c6c.slice/crio-5b36fcaec491d6e3ff3d8bf2d086d93e3445a341906bebd3d341db60006cf5bc WatchSource:0}: Error finding container 5b36fcaec491d6e3ff3d8bf2d086d93e3445a341906bebd3d341db60006cf5bc: Status 404 returned error can't find the container with id 5b36fcaec491d6e3ff3d8bf2d086d93e3445a341906bebd3d341db60006cf5bc
Jul 06 22:22:44.517153 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:44.517035    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f55fb8956-88zgj" event={"ID":"aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c","Type":"ContainerStarted","Data":"d2cc23804f63a5ae0d1fae2634719a4d55a67280fc6d718828dceefba7f75c3c"}
Jul 06 22:22:44.517153 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:44.517093    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f55fb8956-88zgj" event={"ID":"aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c","Type":"ContainerStarted","Data":"5b36fcaec491d6e3ff3d8bf2d086d93e3445a341906bebd3d341db60006cf5bc"}
Jul 06 22:22:44.535931 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:44.535875    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7f55fb8956-88zgj" podStartSLOduration=1.535860708 podStartE2EDuration="1.535860708s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:22:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:22:44.534759747 +0000 UTC m=+165.322782679" watchObservedRunningTime="2026-07-06 22:22:44.535860708 +0000 UTC m=+165.323883641"
Jul 06 22:22:45.421197 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:45.421155    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 22:22:45.421624 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:45.421592    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c870cbd8-ee95-417e-bcf0-85aa85acdb78" containerName="alertmanager" containerID="cri-o://fa507882728ad69848ab7b491fac2c50ea58aab52fba5b5e1b00a15d63926c1d" gracePeriod=120
Jul 06 22:22:45.421696 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:45.421651    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c870cbd8-ee95-417e-bcf0-85aa85acdb78" containerName="kube-rbac-proxy-metric" containerID="cri-o://f29ee632abc39890b815e04c2967e4c2124d8abc9186b1c9a2550545e35b6a69" gracePeriod=120
Jul 06 22:22:45.421749 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:45.421675    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c870cbd8-ee95-417e-bcf0-85aa85acdb78" containerName="kube-rbac-proxy-web" containerID="cri-o://b5bd5fb3e47ce6899b0df99497558d068e17068b6280c8178a80bf8b91cb0aa1" gracePeriod=120
Jul 06 22:22:45.421803 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:45.421694    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c870cbd8-ee95-417e-bcf0-85aa85acdb78" containerName="kube-rbac-proxy" containerID="cri-o://64a11600a808981d8d481b2b6d553e66e2437157483d20a36056223b9dac257e" gracePeriod=120
Jul 06 22:22:45.421803 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:45.421738    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c870cbd8-ee95-417e-bcf0-85aa85acdb78" containerName="prom-label-proxy" containerID="cri-o://27c8559d2da6b29c0d397b3400e4a6b200032d18b0110db681f2e5e68a2f7714" gracePeriod=120
Jul 06 22:22:45.421901 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:45.421765    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c870cbd8-ee95-417e-bcf0-85aa85acdb78" containerName="config-reloader" containerID="cri-o://a829e7ae0ae6ff8efe11733dc9e4cd94fe0221a40a3c98dccd6c541dcb17a94e" gracePeriod=120
Jul 06 22:22:46.529077 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:46.529049    2556 generic.go:356] "Generic (PLEG): container finished" podID="c870cbd8-ee95-417e-bcf0-85aa85acdb78" containerID="27c8559d2da6b29c0d397b3400e4a6b200032d18b0110db681f2e5e68a2f7714" exitCode=0
Jul 06 22:22:46.529077 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:46.529073    2556 generic.go:356] "Generic (PLEG): container finished" podID="c870cbd8-ee95-417e-bcf0-85aa85acdb78" containerID="64a11600a808981d8d481b2b6d553e66e2437157483d20a36056223b9dac257e" exitCode=0
Jul 06 22:22:46.529077 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:46.529080    2556 generic.go:356] "Generic (PLEG): container finished" podID="c870cbd8-ee95-417e-bcf0-85aa85acdb78" containerID="b5bd5fb3e47ce6899b0df99497558d068e17068b6280c8178a80bf8b91cb0aa1" exitCode=0
Jul 06 22:22:46.529522 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:46.529088    2556 generic.go:356] "Generic (PLEG): container finished" podID="c870cbd8-ee95-417e-bcf0-85aa85acdb78" containerID="a829e7ae0ae6ff8efe11733dc9e4cd94fe0221a40a3c98dccd6c541dcb17a94e" exitCode=0
Jul 06 22:22:46.529522 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:46.529093    2556 generic.go:356] "Generic (PLEG): container finished" podID="c870cbd8-ee95-417e-bcf0-85aa85acdb78" containerID="fa507882728ad69848ab7b491fac2c50ea58aab52fba5b5e1b00a15d63926c1d" exitCode=0
Jul 06 22:22:46.529522 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:46.529141    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c870cbd8-ee95-417e-bcf0-85aa85acdb78","Type":"ContainerDied","Data":"27c8559d2da6b29c0d397b3400e4a6b200032d18b0110db681f2e5e68a2f7714"}
Jul 06 22:22:46.529522 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:46.529268    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c870cbd8-ee95-417e-bcf0-85aa85acdb78","Type":"ContainerDied","Data":"64a11600a808981d8d481b2b6d553e66e2437157483d20a36056223b9dac257e"}
Jul 06 22:22:46.529522 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:46.529313    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c870cbd8-ee95-417e-bcf0-85aa85acdb78","Type":"ContainerDied","Data":"b5bd5fb3e47ce6899b0df99497558d068e17068b6280c8178a80bf8b91cb0aa1"}
Jul 06 22:22:46.529522 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:46.529355    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c870cbd8-ee95-417e-bcf0-85aa85acdb78","Type":"ContainerDied","Data":"a829e7ae0ae6ff8efe11733dc9e4cd94fe0221a40a3c98dccd6c541dcb17a94e"}
Jul 06 22:22:46.529522 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:46.529395    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c870cbd8-ee95-417e-bcf0-85aa85acdb78","Type":"ContainerDied","Data":"fa507882728ad69848ab7b491fac2c50ea58aab52fba5b5e1b00a15d63926c1d"}
Jul 06 22:22:46.681811 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:46.681788    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:22:46.824018 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:46.823986    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c870cbd8-ee95-417e-bcf0-85aa85acdb78-config-volume\") pod \"c870cbd8-ee95-417e-bcf0-85aa85acdb78\" (UID: \"c870cbd8-ee95-417e-bcf0-85aa85acdb78\") "
Jul 06 22:22:46.824230 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:46.824032    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c870cbd8-ee95-417e-bcf0-85aa85acdb78-alertmanager-trusted-ca-bundle\") pod \"c870cbd8-ee95-417e-bcf0-85aa85acdb78\" (UID: \"c870cbd8-ee95-417e-bcf0-85aa85acdb78\") "
Jul 06 22:22:46.824230 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:46.824052    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c870cbd8-ee95-417e-bcf0-85aa85acdb78-secret-alertmanager-kube-rbac-proxy\") pod \"c870cbd8-ee95-417e-bcf0-85aa85acdb78\" (UID: \"c870cbd8-ee95-417e-bcf0-85aa85acdb78\") "
Jul 06 22:22:46.824230 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:46.824086    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c870cbd8-ee95-417e-bcf0-85aa85acdb78-secret-alertmanager-kube-rbac-proxy-web\") pod \"c870cbd8-ee95-417e-bcf0-85aa85acdb78\" (UID: \"c870cbd8-ee95-417e-bcf0-85aa85acdb78\") "
Jul 06 22:22:46.824390 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:46.824247    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c870cbd8-ee95-417e-bcf0-85aa85acdb78-web-config\") pod \"c870cbd8-ee95-417e-bcf0-85aa85acdb78\" (UID: \"c870cbd8-ee95-417e-bcf0-85aa85acdb78\") "
Jul 06 22:22:46.824390 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:46.824309    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c870cbd8-ee95-417e-bcf0-85aa85acdb78-config-out\") pod \"c870cbd8-ee95-417e-bcf0-85aa85acdb78\" (UID: \"c870cbd8-ee95-417e-bcf0-85aa85acdb78\") "
Jul 06 22:22:46.824390 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:46.824347    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c870cbd8-ee95-417e-bcf0-85aa85acdb78-metrics-client-ca\") pod \"c870cbd8-ee95-417e-bcf0-85aa85acdb78\" (UID: \"c870cbd8-ee95-417e-bcf0-85aa85acdb78\") "
Jul 06 22:22:46.824540 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:46.824395    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c870cbd8-ee95-417e-bcf0-85aa85acdb78-secret-alertmanager-main-tls\") pod \"c870cbd8-ee95-417e-bcf0-85aa85acdb78\" (UID: \"c870cbd8-ee95-417e-bcf0-85aa85acdb78\") "
Jul 06 22:22:46.824540 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:46.824422    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c870cbd8-ee95-417e-bcf0-85aa85acdb78-tls-assets\") pod \"c870cbd8-ee95-417e-bcf0-85aa85acdb78\" (UID: \"c870cbd8-ee95-417e-bcf0-85aa85acdb78\") "
Jul 06 22:22:46.824540 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:46.824445    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vh5gw\" (UniqueName: \"kubernetes.io/projected/c870cbd8-ee95-417e-bcf0-85aa85acdb78-kube-api-access-vh5gw\") pod \"c870cbd8-ee95-417e-bcf0-85aa85acdb78\" (UID: \"c870cbd8-ee95-417e-bcf0-85aa85acdb78\") "
Jul 06 22:22:46.824540 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:46.824481    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c870cbd8-ee95-417e-bcf0-85aa85acdb78-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "c870cbd8-ee95-417e-bcf0-85aa85acdb78" (UID: "c870cbd8-ee95-417e-bcf0-85aa85acdb78"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 22:22:46.824540 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:46.824491    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c870cbd8-ee95-417e-bcf0-85aa85acdb78-alertmanager-main-db\") pod \"c870cbd8-ee95-417e-bcf0-85aa85acdb78\" (UID: \"c870cbd8-ee95-417e-bcf0-85aa85acdb78\") "
Jul 06 22:22:46.824781 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:46.824590    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c870cbd8-ee95-417e-bcf0-85aa85acdb78-cluster-tls-config\") pod \"c870cbd8-ee95-417e-bcf0-85aa85acdb78\" (UID: \"c870cbd8-ee95-417e-bcf0-85aa85acdb78\") "
Jul 06 22:22:46.824781 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:46.824741    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c870cbd8-ee95-417e-bcf0-85aa85acdb78-secret-alertmanager-kube-rbac-proxy-metric\") pod \"c870cbd8-ee95-417e-bcf0-85aa85acdb78\" (UID: \"c870cbd8-ee95-417e-bcf0-85aa85acdb78\") "
Jul 06 22:22:46.824781 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:46.824750    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c870cbd8-ee95-417e-bcf0-85aa85acdb78-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "c870cbd8-ee95-417e-bcf0-85aa85acdb78" (UID: "c870cbd8-ee95-417e-bcf0-85aa85acdb78"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 22:22:46.825355 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:46.825061    2556 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c870cbd8-ee95-417e-bcf0-85aa85acdb78-alertmanager-main-db\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\""
Jul 06 22:22:46.825355 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:46.825087    2556 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c870cbd8-ee95-417e-bcf0-85aa85acdb78-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\""
Jul 06 22:22:46.825355 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:46.825317    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c870cbd8-ee95-417e-bcf0-85aa85acdb78-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "c870cbd8-ee95-417e-bcf0-85aa85acdb78" (UID: "c870cbd8-ee95-417e-bcf0-85aa85acdb78"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 22:22:46.827686 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:46.827658    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c870cbd8-ee95-417e-bcf0-85aa85acdb78-kube-api-access-vh5gw" (OuterVolumeSpecName: "kube-api-access-vh5gw") pod "c870cbd8-ee95-417e-bcf0-85aa85acdb78" (UID: "c870cbd8-ee95-417e-bcf0-85aa85acdb78"). InnerVolumeSpecName "kube-api-access-vh5gw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 22:22:46.827686 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:46.827675    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c870cbd8-ee95-417e-bcf0-85aa85acdb78-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "c870cbd8-ee95-417e-bcf0-85aa85acdb78" (UID: "c870cbd8-ee95-417e-bcf0-85aa85acdb78"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 22:22:46.827852 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:46.827787    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c870cbd8-ee95-417e-bcf0-85aa85acdb78-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "c870cbd8-ee95-417e-bcf0-85aa85acdb78" (UID: "c870cbd8-ee95-417e-bcf0-85aa85acdb78"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 22:22:46.827852 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:46.827830    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c870cbd8-ee95-417e-bcf0-85aa85acdb78-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "c870cbd8-ee95-417e-bcf0-85aa85acdb78" (UID: "c870cbd8-ee95-417e-bcf0-85aa85acdb78"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 22:22:46.828289 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:46.828251    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c870cbd8-ee95-417e-bcf0-85aa85acdb78-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "c870cbd8-ee95-417e-bcf0-85aa85acdb78" (UID: "c870cbd8-ee95-417e-bcf0-85aa85acdb78"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 22:22:46.828445 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:46.828412    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c870cbd8-ee95-417e-bcf0-85aa85acdb78-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "c870cbd8-ee95-417e-bcf0-85aa85acdb78" (UID: "c870cbd8-ee95-417e-bcf0-85aa85acdb78"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 22:22:46.828558 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:46.828467    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c870cbd8-ee95-417e-bcf0-85aa85acdb78-config-volume" (OuterVolumeSpecName: "config-volume") pod "c870cbd8-ee95-417e-bcf0-85aa85acdb78" (UID: "c870cbd8-ee95-417e-bcf0-85aa85acdb78"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 22:22:46.829695 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:46.829668    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c870cbd8-ee95-417e-bcf0-85aa85acdb78-config-out" (OuterVolumeSpecName: "config-out") pod "c870cbd8-ee95-417e-bcf0-85aa85acdb78" (UID: "c870cbd8-ee95-417e-bcf0-85aa85acdb78"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 22:22:46.832245 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:46.832214    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c870cbd8-ee95-417e-bcf0-85aa85acdb78-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "c870cbd8-ee95-417e-bcf0-85aa85acdb78" (UID: "c870cbd8-ee95-417e-bcf0-85aa85acdb78"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 22:22:46.840153 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:46.840123    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c870cbd8-ee95-417e-bcf0-85aa85acdb78-web-config" (OuterVolumeSpecName: "web-config") pod "c870cbd8-ee95-417e-bcf0-85aa85acdb78" (UID: "c870cbd8-ee95-417e-bcf0-85aa85acdb78"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 22:22:46.925512 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:46.925479    2556 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c870cbd8-ee95-417e-bcf0-85aa85acdb78-cluster-tls-config\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\""
Jul 06 22:22:46.925512 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:46.925507    2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c870cbd8-ee95-417e-bcf0-85aa85acdb78-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\""
Jul 06 22:22:46.925512 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:46.925520    2556 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c870cbd8-ee95-417e-bcf0-85aa85acdb78-config-volume\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\""
Jul 06 22:22:46.925739 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:46.925528    2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c870cbd8-ee95-417e-bcf0-85aa85acdb78-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\""
Jul 06 22:22:46.925739 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:46.925539    2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c870cbd8-ee95-417e-bcf0-85aa85acdb78-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\""
Jul 06 22:22:46.925739 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:46.925547    2556 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c870cbd8-ee95-417e-bcf0-85aa85acdb78-web-config\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\""
Jul 06 22:22:46.925739 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:46.925555    2556 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c870cbd8-ee95-417e-bcf0-85aa85acdb78-config-out\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\""
Jul 06 22:22:46.925739 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:46.925563    2556 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c870cbd8-ee95-417e-bcf0-85aa85acdb78-metrics-client-ca\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\""
Jul 06 22:22:46.925739 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:46.925574    2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c870cbd8-ee95-417e-bcf0-85aa85acdb78-secret-alertmanager-main-tls\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\""
Jul 06 22:22:46.925739 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:46.925582    2556 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c870cbd8-ee95-417e-bcf0-85aa85acdb78-tls-assets\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\""
Jul 06 22:22:46.925739 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:46.925590    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vh5gw\" (UniqueName: \"kubernetes.io/projected/c870cbd8-ee95-417e-bcf0-85aa85acdb78-kube-api-access-vh5gw\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\""
Jul 06 22:22:47.536396 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.536358    2556 generic.go:356] "Generic (PLEG): container finished" podID="c870cbd8-ee95-417e-bcf0-85aa85acdb78" containerID="f29ee632abc39890b815e04c2967e4c2124d8abc9186b1c9a2550545e35b6a69" exitCode=0
Jul 06 22:22:47.536789 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.536412    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c870cbd8-ee95-417e-bcf0-85aa85acdb78","Type":"ContainerDied","Data":"f29ee632abc39890b815e04c2967e4c2124d8abc9186b1c9a2550545e35b6a69"}
Jul 06 22:22:47.536789 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.536442    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:22:47.536789 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.536468    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c870cbd8-ee95-417e-bcf0-85aa85acdb78","Type":"ContainerDied","Data":"6b46843ee5910b8da255d281e47bc21b58e69accfcf99c7243c0e9c5a6b0fc48"}
Jul 06 22:22:47.536789 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.536499    2556 scope.go:117] "RemoveContainer" containerID="27c8559d2da6b29c0d397b3400e4a6b200032d18b0110db681f2e5e68a2f7714"
Jul 06 22:22:47.545171 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.545152    2556 scope.go:117] "RemoveContainer" containerID="f29ee632abc39890b815e04c2967e4c2124d8abc9186b1c9a2550545e35b6a69"
Jul 06 22:22:47.553922 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.553905    2556 scope.go:117] "RemoveContainer" containerID="64a11600a808981d8d481b2b6d553e66e2437157483d20a36056223b9dac257e"
Jul 06 22:22:47.560541 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.560523    2556 scope.go:117] "RemoveContainer" containerID="b5bd5fb3e47ce6899b0df99497558d068e17068b6280c8178a80bf8b91cb0aa1"
Jul 06 22:22:47.567202 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.567177    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 22:22:47.568179 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.568164    2556 scope.go:117] "RemoveContainer" containerID="a829e7ae0ae6ff8efe11733dc9e4cd94fe0221a40a3c98dccd6c541dcb17a94e"
Jul 06 22:22:47.571232 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.571213    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 22:22:47.575374 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.575356    2556 scope.go:117] "RemoveContainer" containerID="fa507882728ad69848ab7b491fac2c50ea58aab52fba5b5e1b00a15d63926c1d"
Jul 06 22:22:47.582121 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.582085    2556 scope.go:117] "RemoveContainer" containerID="26b9d7b3fe7a0b81eaececa8e13387e8a18f15d4e039f38ba03bed375d87b1ab"
Jul 06 22:22:47.588851 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.588835    2556 scope.go:117] "RemoveContainer" containerID="27c8559d2da6b29c0d397b3400e4a6b200032d18b0110db681f2e5e68a2f7714"
Jul 06 22:22:47.589113 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:22:47.589082    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27c8559d2da6b29c0d397b3400e4a6b200032d18b0110db681f2e5e68a2f7714\": container with ID starting with 27c8559d2da6b29c0d397b3400e4a6b200032d18b0110db681f2e5e68a2f7714 not found: ID does not exist" containerID="27c8559d2da6b29c0d397b3400e4a6b200032d18b0110db681f2e5e68a2f7714"
Jul 06 22:22:47.589163 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.589126    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27c8559d2da6b29c0d397b3400e4a6b200032d18b0110db681f2e5e68a2f7714"} err="failed to get container status \"27c8559d2da6b29c0d397b3400e4a6b200032d18b0110db681f2e5e68a2f7714\": rpc error: code = NotFound desc = could not find container \"27c8559d2da6b29c0d397b3400e4a6b200032d18b0110db681f2e5e68a2f7714\": container with ID starting with 27c8559d2da6b29c0d397b3400e4a6b200032d18b0110db681f2e5e68a2f7714 not found: ID does not exist"
Jul 06 22:22:47.589163 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.589147    2556 scope.go:117] "RemoveContainer" containerID="f29ee632abc39890b815e04c2967e4c2124d8abc9186b1c9a2550545e35b6a69"
Jul 06 22:22:47.589376 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:22:47.589360    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f29ee632abc39890b815e04c2967e4c2124d8abc9186b1c9a2550545e35b6a69\": container with ID starting with f29ee632abc39890b815e04c2967e4c2124d8abc9186b1c9a2550545e35b6a69 not found: ID does not exist" containerID="f29ee632abc39890b815e04c2967e4c2124d8abc9186b1c9a2550545e35b6a69"
Jul 06 22:22:47.589416 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.589379    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f29ee632abc39890b815e04c2967e4c2124d8abc9186b1c9a2550545e35b6a69"} err="failed to get container status \"f29ee632abc39890b815e04c2967e4c2124d8abc9186b1c9a2550545e35b6a69\": rpc error: code = NotFound desc = could not find container \"f29ee632abc39890b815e04c2967e4c2124d8abc9186b1c9a2550545e35b6a69\": container with ID starting with f29ee632abc39890b815e04c2967e4c2124d8abc9186b1c9a2550545e35b6a69 not found: ID does not exist"
Jul 06 22:22:47.589416 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.589392    2556 scope.go:117] "RemoveContainer" containerID="64a11600a808981d8d481b2b6d553e66e2437157483d20a36056223b9dac257e"
Jul 06 22:22:47.589638 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:22:47.589621    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64a11600a808981d8d481b2b6d553e66e2437157483d20a36056223b9dac257e\": container with ID starting with 64a11600a808981d8d481b2b6d553e66e2437157483d20a36056223b9dac257e not found: ID does not exist" containerID="64a11600a808981d8d481b2b6d553e66e2437157483d20a36056223b9dac257e"
Jul 06 22:22:47.589677 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.589644    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64a11600a808981d8d481b2b6d553e66e2437157483d20a36056223b9dac257e"} err="failed to get container status \"64a11600a808981d8d481b2b6d553e66e2437157483d20a36056223b9dac257e\": rpc error: code = NotFound desc = could not find container \"64a11600a808981d8d481b2b6d553e66e2437157483d20a36056223b9dac257e\": container with ID starting with 64a11600a808981d8d481b2b6d553e66e2437157483d20a36056223b9dac257e not found: ID does not exist"
Jul 06 22:22:47.589677 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.589660    2556 scope.go:117] "RemoveContainer" containerID="b5bd5fb3e47ce6899b0df99497558d068e17068b6280c8178a80bf8b91cb0aa1"
Jul 06 22:22:47.589848 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:22:47.589833    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5bd5fb3e47ce6899b0df99497558d068e17068b6280c8178a80bf8b91cb0aa1\": container with ID starting with b5bd5fb3e47ce6899b0df99497558d068e17068b6280c8178a80bf8b91cb0aa1 not found: ID does not exist" containerID="b5bd5fb3e47ce6899b0df99497558d068e17068b6280c8178a80bf8b91cb0aa1"
Jul 06 22:22:47.589892 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.589851    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5bd5fb3e47ce6899b0df99497558d068e17068b6280c8178a80bf8b91cb0aa1"} err="failed to get container status \"b5bd5fb3e47ce6899b0df99497558d068e17068b6280c8178a80bf8b91cb0aa1\": rpc error: code = NotFound desc = could not find container \"b5bd5fb3e47ce6899b0df99497558d068e17068b6280c8178a80bf8b91cb0aa1\": container with ID starting with b5bd5fb3e47ce6899b0df99497558d068e17068b6280c8178a80bf8b91cb0aa1 not found: ID does not exist"
Jul 06 22:22:47.589892 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.589863    2556 scope.go:117] "RemoveContainer" containerID="a829e7ae0ae6ff8efe11733dc9e4cd94fe0221a40a3c98dccd6c541dcb17a94e"
Jul 06 22:22:47.590040 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:22:47.590023    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a829e7ae0ae6ff8efe11733dc9e4cd94fe0221a40a3c98dccd6c541dcb17a94e\": container with ID starting with a829e7ae0ae6ff8efe11733dc9e4cd94fe0221a40a3c98dccd6c541dcb17a94e not found: ID does not exist" containerID="a829e7ae0ae6ff8efe11733dc9e4cd94fe0221a40a3c98dccd6c541dcb17a94e"
Jul 06 22:22:47.590078 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.590044    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a829e7ae0ae6ff8efe11733dc9e4cd94fe0221a40a3c98dccd6c541dcb17a94e"} err="failed to get container status \"a829e7ae0ae6ff8efe11733dc9e4cd94fe0221a40a3c98dccd6c541dcb17a94e\": rpc error: code = NotFound desc = could not find container \"a829e7ae0ae6ff8efe11733dc9e4cd94fe0221a40a3c98dccd6c541dcb17a94e\": container with ID starting with a829e7ae0ae6ff8efe11733dc9e4cd94fe0221a40a3c98dccd6c541dcb17a94e not found: ID does not exist"
Jul 06 22:22:47.590078 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.590056    2556 scope.go:117] "RemoveContainer" containerID="fa507882728ad69848ab7b491fac2c50ea58aab52fba5b5e1b00a15d63926c1d"
Jul 06 22:22:47.590369 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:22:47.590347    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa507882728ad69848ab7b491fac2c50ea58aab52fba5b5e1b00a15d63926c1d\": container with ID starting with fa507882728ad69848ab7b491fac2c50ea58aab52fba5b5e1b00a15d63926c1d not found: ID does not exist" containerID="fa507882728ad69848ab7b491fac2c50ea58aab52fba5b5e1b00a15d63926c1d"
Jul 06 22:22:47.590413 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.590374    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa507882728ad69848ab7b491fac2c50ea58aab52fba5b5e1b00a15d63926c1d"} err="failed to get container status \"fa507882728ad69848ab7b491fac2c50ea58aab52fba5b5e1b00a15d63926c1d\": rpc error: code = NotFound desc = could not find container \"fa507882728ad69848ab7b491fac2c50ea58aab52fba5b5e1b00a15d63926c1d\": container with ID starting with fa507882728ad69848ab7b491fac2c50ea58aab52fba5b5e1b00a15d63926c1d not found: ID does not exist"
Jul 06 22:22:47.590413 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.590387    2556 scope.go:117] "RemoveContainer" containerID="26b9d7b3fe7a0b81eaececa8e13387e8a18f15d4e039f38ba03bed375d87b1ab"
Jul 06 22:22:47.590581 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:22:47.590565    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26b9d7b3fe7a0b81eaececa8e13387e8a18f15d4e039f38ba03bed375d87b1ab\": container with ID starting with 26b9d7b3fe7a0b81eaececa8e13387e8a18f15d4e039f38ba03bed375d87b1ab not found: ID does not exist" containerID="26b9d7b3fe7a0b81eaececa8e13387e8a18f15d4e039f38ba03bed375d87b1ab"
Jul 06 22:22:47.590623 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.590585    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26b9d7b3fe7a0b81eaececa8e13387e8a18f15d4e039f38ba03bed375d87b1ab"} err="failed to get container status \"26b9d7b3fe7a0b81eaececa8e13387e8a18f15d4e039f38ba03bed375d87b1ab\": rpc error: code = NotFound desc = could not find container \"26b9d7b3fe7a0b81eaececa8e13387e8a18f15d4e039f38ba03bed375d87b1ab\": container with ID starting with 26b9d7b3fe7a0b81eaececa8e13387e8a18f15d4e039f38ba03bed375d87b1ab not found: ID does not exist"
Jul 06 22:22:47.604942 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.604914    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 22:22:47.605303 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.605287    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c870cbd8-ee95-417e-bcf0-85aa85acdb78" containerName="kube-rbac-proxy-metric"
Jul 06 22:22:47.605388 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.605304    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c870cbd8-ee95-417e-bcf0-85aa85acdb78" containerName="kube-rbac-proxy-metric"
Jul 06 22:22:47.605388 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.605318    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c870cbd8-ee95-417e-bcf0-85aa85acdb78" containerName="config-reloader"
Jul 06 22:22:47.605388 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.605326    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c870cbd8-ee95-417e-bcf0-85aa85acdb78" containerName="config-reloader"
Jul 06 22:22:47.605388 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.605348    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c870cbd8-ee95-417e-bcf0-85aa85acdb78" containerName="kube-rbac-proxy"
Jul 06 22:22:47.605388 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.605356    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c870cbd8-ee95-417e-bcf0-85aa85acdb78" containerName="kube-rbac-proxy"
Jul 06 22:22:47.605388 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.605375    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c870cbd8-ee95-417e-bcf0-85aa85acdb78" containerName="init-config-reloader"
Jul 06 22:22:47.605388 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.605384    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c870cbd8-ee95-417e-bcf0-85aa85acdb78" containerName="init-config-reloader"
Jul 06 22:22:47.605800 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.605396    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c870cbd8-ee95-417e-bcf0-85aa85acdb78" containerName="alertmanager"
Jul 06 22:22:47.605800 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.605404    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c870cbd8-ee95-417e-bcf0-85aa85acdb78" containerName="alertmanager"
Jul 06 22:22:47.605800 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.605415    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c870cbd8-ee95-417e-bcf0-85aa85acdb78" containerName="kube-rbac-proxy-web"
Jul 06 22:22:47.605800 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.605426    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c870cbd8-ee95-417e-bcf0-85aa85acdb78" containerName="kube-rbac-proxy-web"
Jul 06 22:22:47.605800 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.605441    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c870cbd8-ee95-417e-bcf0-85aa85acdb78" containerName="prom-label-proxy"
Jul 06 22:22:47.605800 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.605449    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c870cbd8-ee95-417e-bcf0-85aa85acdb78" containerName="prom-label-proxy"
Jul 06 22:22:47.605800 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.605537    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="c870cbd8-ee95-417e-bcf0-85aa85acdb78" containerName="kube-rbac-proxy-web"
Jul 06 22:22:47.605800 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.605551    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="c870cbd8-ee95-417e-bcf0-85aa85acdb78" containerName="alertmanager"
Jul 06 22:22:47.605800 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.605561    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="c870cbd8-ee95-417e-bcf0-85aa85acdb78" containerName="config-reloader"
Jul 06 22:22:47.605800 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.605569    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="c870cbd8-ee95-417e-bcf0-85aa85acdb78" containerName="kube-rbac-proxy-metric"
Jul 06 22:22:47.605800 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.605580    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="c870cbd8-ee95-417e-bcf0-85aa85acdb78" containerName="kube-rbac-proxy"
Jul 06 22:22:47.605800 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.605591    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="c870cbd8-ee95-417e-bcf0-85aa85acdb78" containerName="prom-label-proxy"
Jul 06 22:22:47.610492 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.610475    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:22:47.613023 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.612994    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 06 22:22:47.613318 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.613277    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 06 22:22:47.613445 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.613355    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 06 22:22:47.613445 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.613417    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 06 22:22:47.613591 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.613473    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 06 22:22:47.613591 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.613491    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 06 22:22:47.613591 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.613498    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 06 22:22:47.613854 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.613840    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-4rflj\""
Jul 06 22:22:47.613968 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.613899    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 06 22:22:47.619962 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.619947    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 06 22:22:47.623240 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.623221    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 22:22:47.654364 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.654329    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c870cbd8-ee95-417e-bcf0-85aa85acdb78" path="/var/lib/kubelet/pods/c870cbd8-ee95-417e-bcf0-85aa85acdb78/volumes"
Jul 06 22:22:47.732744 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.732708    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/03da331d-6638-46c7-82b1-34df8ebc085b-web-config\") pod \"alertmanager-main-0\" (UID: \"03da331d-6638-46c7-82b1-34df8ebc085b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:22:47.732744 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.732747    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/03da331d-6638-46c7-82b1-34df8ebc085b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"03da331d-6638-46c7-82b1-34df8ebc085b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:22:47.732972 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.732784    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/03da331d-6638-46c7-82b1-34df8ebc085b-config-volume\") pod \"alertmanager-main-0\" (UID: \"03da331d-6638-46c7-82b1-34df8ebc085b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:22:47.732972 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.732816    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03da331d-6638-46c7-82b1-34df8ebc085b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"03da331d-6638-46c7-82b1-34df8ebc085b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:22:47.732972 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.732843    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/03da331d-6638-46c7-82b1-34df8ebc085b-config-out\") pod \"alertmanager-main-0\" (UID: \"03da331d-6638-46c7-82b1-34df8ebc085b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:22:47.732972 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.732913    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7cvj\" (UniqueName: \"kubernetes.io/projected/03da331d-6638-46c7-82b1-34df8ebc085b-kube-api-access-p7cvj\") pod \"alertmanager-main-0\" (UID: \"03da331d-6638-46c7-82b1-34df8ebc085b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:22:47.732972 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.732937    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/03da331d-6638-46c7-82b1-34df8ebc085b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"03da331d-6638-46c7-82b1-34df8ebc085b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:22:47.732972 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.732971    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/03da331d-6638-46c7-82b1-34df8ebc085b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"03da331d-6638-46c7-82b1-34df8ebc085b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:22:47.733258 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.733021    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/03da331d-6638-46c7-82b1-34df8ebc085b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"03da331d-6638-46c7-82b1-34df8ebc085b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:22:47.733258 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.733055    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/03da331d-6638-46c7-82b1-34df8ebc085b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"03da331d-6638-46c7-82b1-34df8ebc085b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:22:47.733258 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.733078    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/03da331d-6638-46c7-82b1-34df8ebc085b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"03da331d-6638-46c7-82b1-34df8ebc085b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:22:47.733258 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.733173    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/03da331d-6638-46c7-82b1-34df8ebc085b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"03da331d-6638-46c7-82b1-34df8ebc085b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:22:47.733258 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.733217    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/03da331d-6638-46c7-82b1-34df8ebc085b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"03da331d-6638-46c7-82b1-34df8ebc085b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:22:47.833817 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.833767    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03da331d-6638-46c7-82b1-34df8ebc085b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"03da331d-6638-46c7-82b1-34df8ebc085b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:22:47.833817 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.833830    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/03da331d-6638-46c7-82b1-34df8ebc085b-config-out\") pod \"alertmanager-main-0\" (UID: \"03da331d-6638-46c7-82b1-34df8ebc085b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:22:47.834169 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.833853    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7cvj\" (UniqueName: \"kubernetes.io/projected/03da331d-6638-46c7-82b1-34df8ebc085b-kube-api-access-p7cvj\") pod \"alertmanager-main-0\" (UID: \"03da331d-6638-46c7-82b1-34df8ebc085b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:22:47.834169 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.833873    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/03da331d-6638-46c7-82b1-34df8ebc085b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"03da331d-6638-46c7-82b1-34df8ebc085b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:22:47.834169 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.833897    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/03da331d-6638-46c7-82b1-34df8ebc085b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"03da331d-6638-46c7-82b1-34df8ebc085b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:22:47.834169 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.833915    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/03da331d-6638-46c7-82b1-34df8ebc085b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"03da331d-6638-46c7-82b1-34df8ebc085b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:22:47.834169 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.833949    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/03da331d-6638-46c7-82b1-34df8ebc085b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"03da331d-6638-46c7-82b1-34df8ebc085b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:22:47.834169 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.834093    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/03da331d-6638-46c7-82b1-34df8ebc085b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"03da331d-6638-46c7-82b1-34df8ebc085b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:22:47.834169 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.834160    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/03da331d-6638-46c7-82b1-34df8ebc085b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"03da331d-6638-46c7-82b1-34df8ebc085b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:22:47.834541 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.834192    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/03da331d-6638-46c7-82b1-34df8ebc085b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"03da331d-6638-46c7-82b1-34df8ebc085b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:22:47.834541 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.834238    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/03da331d-6638-46c7-82b1-34df8ebc085b-web-config\") pod \"alertmanager-main-0\" (UID: \"03da331d-6638-46c7-82b1-34df8ebc085b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:22:47.834541 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.834271    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/03da331d-6638-46c7-82b1-34df8ebc085b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"03da331d-6638-46c7-82b1-34df8ebc085b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:22:47.834541 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.834318    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/03da331d-6638-46c7-82b1-34df8ebc085b-config-volume\") pod \"alertmanager-main-0\" (UID: \"03da331d-6638-46c7-82b1-34df8ebc085b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:22:47.834541 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.834501    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/03da331d-6638-46c7-82b1-34df8ebc085b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"03da331d-6638-46c7-82b1-34df8ebc085b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:22:47.834790 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.834775    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/03da331d-6638-46c7-82b1-34df8ebc085b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"03da331d-6638-46c7-82b1-34df8ebc085b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:22:47.834860 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.834835    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03da331d-6638-46c7-82b1-34df8ebc085b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"03da331d-6638-46c7-82b1-34df8ebc085b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:22:47.837215 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.837086    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/03da331d-6638-46c7-82b1-34df8ebc085b-config-volume\") pod \"alertmanager-main-0\" (UID: \"03da331d-6638-46c7-82b1-34df8ebc085b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:22:47.837215 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.837156    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/03da331d-6638-46c7-82b1-34df8ebc085b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"03da331d-6638-46c7-82b1-34df8ebc085b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:22:47.837387 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.837254    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/03da331d-6638-46c7-82b1-34df8ebc085b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"03da331d-6638-46c7-82b1-34df8ebc085b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:22:47.837443 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.837396    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/03da331d-6638-46c7-82b1-34df8ebc085b-web-config\") pod \"alertmanager-main-0\" (UID: \"03da331d-6638-46c7-82b1-34df8ebc085b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:22:47.837496 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.837477    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/03da331d-6638-46c7-82b1-34df8ebc085b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"03da331d-6638-46c7-82b1-34df8ebc085b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:22:47.837580 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.837561    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/03da331d-6638-46c7-82b1-34df8ebc085b-config-out\") pod \"alertmanager-main-0\" (UID: \"03da331d-6638-46c7-82b1-34df8ebc085b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:22:47.837835 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.837816    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/03da331d-6638-46c7-82b1-34df8ebc085b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"03da331d-6638-46c7-82b1-34df8ebc085b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:22:47.837891 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.837877    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/03da331d-6638-46c7-82b1-34df8ebc085b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"03da331d-6638-46c7-82b1-34df8ebc085b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:22:47.839078 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.839062    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/03da331d-6638-46c7-82b1-34df8ebc085b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"03da331d-6638-46c7-82b1-34df8ebc085b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:22:47.843987 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.843968    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7cvj\" (UniqueName: \"kubernetes.io/projected/03da331d-6638-46c7-82b1-34df8ebc085b-kube-api-access-p7cvj\") pod \"alertmanager-main-0\" (UID: \"03da331d-6638-46c7-82b1-34df8ebc085b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:22:47.920048 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:47.920014    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 22:22:48.082502 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:48.082457    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 22:22:48.085924 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:22:48.085897    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03da331d_6638_46c7_82b1_34df8ebc085b.slice/crio-472e6e631f783dced24668d4d87e352f60aa115ad01b9aff394eb403359064a5 WatchSource:0}: Error finding container 472e6e631f783dced24668d4d87e352f60aa115ad01b9aff394eb403359064a5: Status 404 returned error can't find the container with id 472e6e631f783dced24668d4d87e352f60aa115ad01b9aff394eb403359064a5
Jul 06 22:22:48.543866 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:48.543824    2556 generic.go:356] "Generic (PLEG): container finished" podID="03da331d-6638-46c7-82b1-34df8ebc085b" containerID="ae572b7c0fe6f13b33084769e29966a879b960894b5403050bc0022fd6e14981" exitCode=0
Jul 06 22:22:48.544234 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:48.543889    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"03da331d-6638-46c7-82b1-34df8ebc085b","Type":"ContainerDied","Data":"ae572b7c0fe6f13b33084769e29966a879b960894b5403050bc0022fd6e14981"}
Jul 06 22:22:48.544234 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:48.543992    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"03da331d-6638-46c7-82b1-34df8ebc085b","Type":"ContainerStarted","Data":"472e6e631f783dced24668d4d87e352f60aa115ad01b9aff394eb403359064a5"}
Jul 06 22:22:49.552609 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:49.552568    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"03da331d-6638-46c7-82b1-34df8ebc085b","Type":"ContainerStarted","Data":"3ed204b3945a4e60a4a072cefc97b621ae0c4101db949c569f238675113347c8"}
Jul 06 22:22:49.553188 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:49.552636    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"03da331d-6638-46c7-82b1-34df8ebc085b","Type":"ContainerStarted","Data":"96bc85d84f90a86dd1e3bc4090f2225f13e1792374a6aad4f37cc7b67ecc5530"}
Jul 06 22:22:49.553188 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:49.552662    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"03da331d-6638-46c7-82b1-34df8ebc085b","Type":"ContainerStarted","Data":"a02e70a95a67c07cae29fce30e347412d65c758646a1635a5b39e7fb6c6f5559"}
Jul 06 22:22:49.553188 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:49.552686    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"03da331d-6638-46c7-82b1-34df8ebc085b","Type":"ContainerStarted","Data":"d135c5d871e94dd1f3b208b0cbc5cfb59cd84a648aba3dddbcba9e0e0e8d6156"}
Jul 06 22:22:49.553188 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:49.552712    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"03da331d-6638-46c7-82b1-34df8ebc085b","Type":"ContainerStarted","Data":"f409d933d0af9383ad9a21999f7927f17de9b748244058c8222f86f8d9076936"}
Jul 06 22:22:49.553188 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:49.552737    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"03da331d-6638-46c7-82b1-34df8ebc085b","Type":"ContainerStarted","Data":"9d76e64c25bf6e2f0b150397dd9a3fd8e9ab4d368e66cc1cfa80df47f409fdd4"}
Jul 06 22:22:49.582127 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:49.582048    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.568041606 podStartE2EDuration="2.58202619s" totalImagesPullingTime="0s" totalInitContainerRuntime="13.984584ms" isStatefulPod=false podCreationTimestamp="2026-07-06 22:22:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:22:49.580804202 +0000 UTC m=+170.368827191" watchObservedRunningTime="2026-07-06 22:22:49.58202619 +0000 UTC m=+170.370049126"
Jul 06 22:22:54.140306 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:54.140222    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7f55fb8956-88zgj"
Jul 06 22:22:54.140675 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:54.140317    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f55fb8956-88zgj"
Jul 06 22:22:54.145669 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:54.145646    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7f55fb8956-88zgj"
Jul 06 22:22:54.578111 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:54.578079    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7f55fb8956-88zgj"
Jul 06 22:22:54.631600 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:22:54.631570    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-784d5f44d9-6k9b7"]
Jul 06 22:23:19.652168 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:23:19.652129    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-784d5f44d9-6k9b7" podUID="97b419e1-9bec-43e6-9166-42d2221cbcde" containerName="console" containerID="cri-o://93244ed0465f535721836f9cdb6c7756e0b84748ac62c24079b2adac25659a4d" gracePeriod=15
Jul 06 22:23:19.895533 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:23:19.895511    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-784d5f44d9-6k9b7"
Jul 06 22:23:20.008863 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:23:20.008779    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/97b419e1-9bec-43e6-9166-42d2221cbcde-console-config\") pod \"97b419e1-9bec-43e6-9166-42d2221cbcde\" (UID: \"97b419e1-9bec-43e6-9166-42d2221cbcde\") "
Jul 06 22:23:20.008863 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:23:20.008820    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97b419e1-9bec-43e6-9166-42d2221cbcde-trusted-ca-bundle\") pod \"97b419e1-9bec-43e6-9166-42d2221cbcde\" (UID: \"97b419e1-9bec-43e6-9166-42d2221cbcde\") "
Jul 06 22:23:20.008863 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:23:20.008857    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/97b419e1-9bec-43e6-9166-42d2221cbcde-service-ca\") pod \"97b419e1-9bec-43e6-9166-42d2221cbcde\" (UID: \"97b419e1-9bec-43e6-9166-42d2221cbcde\") "
Jul 06 22:23:20.009152 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:23:20.008891    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v9ffg\" (UniqueName: \"kubernetes.io/projected/97b419e1-9bec-43e6-9166-42d2221cbcde-kube-api-access-v9ffg\") pod \"97b419e1-9bec-43e6-9166-42d2221cbcde\" (UID: \"97b419e1-9bec-43e6-9166-42d2221cbcde\") "
Jul 06 22:23:20.009152 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:23:20.008925    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/97b419e1-9bec-43e6-9166-42d2221cbcde-oauth-serving-cert\") pod \"97b419e1-9bec-43e6-9166-42d2221cbcde\" (UID: \"97b419e1-9bec-43e6-9166-42d2221cbcde\") "
Jul 06 22:23:20.009152 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:23:20.008953    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/97b419e1-9bec-43e6-9166-42d2221cbcde-console-serving-cert\") pod \"97b419e1-9bec-43e6-9166-42d2221cbcde\" (UID: \"97b419e1-9bec-43e6-9166-42d2221cbcde\") "
Jul 06 22:23:20.009152 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:23:20.009063    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/97b419e1-9bec-43e6-9166-42d2221cbcde-console-oauth-config\") pod \"97b419e1-9bec-43e6-9166-42d2221cbcde\" (UID: \"97b419e1-9bec-43e6-9166-42d2221cbcde\") "
Jul 06 22:23:20.009348 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:23:20.009288    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97b419e1-9bec-43e6-9166-42d2221cbcde-console-config" (OuterVolumeSpecName: "console-config") pod "97b419e1-9bec-43e6-9166-42d2221cbcde" (UID: "97b419e1-9bec-43e6-9166-42d2221cbcde"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 22:23:20.009348 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:23:20.009334    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97b419e1-9bec-43e6-9166-42d2221cbcde-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "97b419e1-9bec-43e6-9166-42d2221cbcde" (UID: "97b419e1-9bec-43e6-9166-42d2221cbcde"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 22:23:20.009460 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:23:20.009393    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97b419e1-9bec-43e6-9166-42d2221cbcde-service-ca" (OuterVolumeSpecName: "service-ca") pod "97b419e1-9bec-43e6-9166-42d2221cbcde" (UID: "97b419e1-9bec-43e6-9166-42d2221cbcde"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 22:23:20.009460 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:23:20.009412    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97b419e1-9bec-43e6-9166-42d2221cbcde-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "97b419e1-9bec-43e6-9166-42d2221cbcde" (UID: "97b419e1-9bec-43e6-9166-42d2221cbcde"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 22:23:20.011221 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:23:20.011186    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97b419e1-9bec-43e6-9166-42d2221cbcde-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "97b419e1-9bec-43e6-9166-42d2221cbcde" (UID: "97b419e1-9bec-43e6-9166-42d2221cbcde"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 22:23:20.011221 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:23:20.011210    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97b419e1-9bec-43e6-9166-42d2221cbcde-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "97b419e1-9bec-43e6-9166-42d2221cbcde" (UID: "97b419e1-9bec-43e6-9166-42d2221cbcde"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 22:23:20.011382 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:23:20.011344    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97b419e1-9bec-43e6-9166-42d2221cbcde-kube-api-access-v9ffg" (OuterVolumeSpecName: "kube-api-access-v9ffg") pod "97b419e1-9bec-43e6-9166-42d2221cbcde" (UID: "97b419e1-9bec-43e6-9166-42d2221cbcde"). InnerVolumeSpecName "kube-api-access-v9ffg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 22:23:20.109910 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:23:20.109882    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v9ffg\" (UniqueName: \"kubernetes.io/projected/97b419e1-9bec-43e6-9166-42d2221cbcde-kube-api-access-v9ffg\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\""
Jul 06 22:23:20.109910 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:23:20.109907    2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/97b419e1-9bec-43e6-9166-42d2221cbcde-oauth-serving-cert\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\""
Jul 06 22:23:20.110057 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:23:20.109921    2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/97b419e1-9bec-43e6-9166-42d2221cbcde-console-serving-cert\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\""
Jul 06 22:23:20.110057 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:23:20.109933    2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/97b419e1-9bec-43e6-9166-42d2221cbcde-console-oauth-config\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\""
Jul 06 22:23:20.110057 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:23:20.109945    2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/97b419e1-9bec-43e6-9166-42d2221cbcde-console-config\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\""
Jul 06 22:23:20.110057 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:23:20.109957    2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97b419e1-9bec-43e6-9166-42d2221cbcde-trusted-ca-bundle\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\""
Jul 06 22:23:20.110057 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:23:20.109968    2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/97b419e1-9bec-43e6-9166-42d2221cbcde-service-ca\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\""
Jul 06 22:23:20.685544 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:23:20.685513    2556 generic.go:356] "Generic (PLEG): container finished" podID="97b419e1-9bec-43e6-9166-42d2221cbcde" containerID="93244ed0465f535721836f9cdb6c7756e0b84748ac62c24079b2adac25659a4d" exitCode=0
Jul 06 22:23:20.685948 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:23:20.685556    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-784d5f44d9-6k9b7"
Jul 06 22:23:20.685948 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:23:20.685603    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-784d5f44d9-6k9b7" event={"ID":"97b419e1-9bec-43e6-9166-42d2221cbcde","Type":"ContainerDied","Data":"93244ed0465f535721836f9cdb6c7756e0b84748ac62c24079b2adac25659a4d"}
Jul 06 22:23:20.685948 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:23:20.685651    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-784d5f44d9-6k9b7" event={"ID":"97b419e1-9bec-43e6-9166-42d2221cbcde","Type":"ContainerDied","Data":"e5dda612e7aa96f4553cb41eae5cc2c9281e9a1daf31f5c3add09ddb77a188b3"}
Jul 06 22:23:20.685948 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:23:20.685671    2556 scope.go:117] "RemoveContainer" containerID="93244ed0465f535721836f9cdb6c7756e0b84748ac62c24079b2adac25659a4d"
Jul 06 22:23:20.694676 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:23:20.694662    2556 scope.go:117] "RemoveContainer" containerID="93244ed0465f535721836f9cdb6c7756e0b84748ac62c24079b2adac25659a4d"
Jul 06 22:23:20.694927 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:23:20.694904    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93244ed0465f535721836f9cdb6c7756e0b84748ac62c24079b2adac25659a4d\": container with ID starting with 93244ed0465f535721836f9cdb6c7756e0b84748ac62c24079b2adac25659a4d not found: ID does not exist" containerID="93244ed0465f535721836f9cdb6c7756e0b84748ac62c24079b2adac25659a4d"
Jul 06 22:23:20.695017 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:23:20.694932    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93244ed0465f535721836f9cdb6c7756e0b84748ac62c24079b2adac25659a4d"} err="failed to get container status \"93244ed0465f535721836f9cdb6c7756e0b84748ac62c24079b2adac25659a4d\": rpc error: code = NotFound desc = could not find container \"93244ed0465f535721836f9cdb6c7756e0b84748ac62c24079b2adac25659a4d\": container with ID starting with 93244ed0465f535721836f9cdb6c7756e0b84748ac62c24079b2adac25659a4d not found: ID does not exist"
Jul 06 22:23:20.708125 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:23:20.708087    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-784d5f44d9-6k9b7"]
Jul 06 22:23:20.713578 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:23:20.713560    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-784d5f44d9-6k9b7"]
Jul 06 22:23:21.652191 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:23:21.652156    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97b419e1-9bec-43e6-9166-42d2221cbcde" path="/var/lib/kubelet/pods/97b419e1-9bec-43e6-9166-42d2221cbcde/volumes"
Jul 06 22:24:12.588170 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:12.588113    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pghz8"]
Jul 06 22:24:12.588567 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:12.588448    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97b419e1-9bec-43e6-9166-42d2221cbcde" containerName="console"
Jul 06 22:24:12.588567 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:12.588459    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="97b419e1-9bec-43e6-9166-42d2221cbcde" containerName="console"
Jul 06 22:24:12.588567 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:12.588531    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="97b419e1-9bec-43e6-9166-42d2221cbcde" containerName="console"
Jul 06 22:24:12.592640 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:12.592624    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pghz8"
Jul 06 22:24:12.595074 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:12.595048    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 06 22:24:12.595741 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:12.595727    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 06 22:24:12.595741 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:12.595737    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-m5pf7\""
Jul 06 22:24:12.600755 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:12.600735    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pghz8"]
Jul 06 22:24:12.637541 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:12.637511    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2df6n\" (UniqueName: \"kubernetes.io/projected/775c591b-fa6d-4afd-8ce1-8cc4ebbd1f4a-kube-api-access-2df6n\") pod \"openshift-lws-operator-fd8ccff4c-pghz8\" (UID: \"775c591b-fa6d-4afd-8ce1-8cc4ebbd1f4a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pghz8"
Jul 06 22:24:12.637688 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:12.637560    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/775c591b-fa6d-4afd-8ce1-8cc4ebbd1f4a-tmp\") pod \"openshift-lws-operator-fd8ccff4c-pghz8\" (UID: \"775c591b-fa6d-4afd-8ce1-8cc4ebbd1f4a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pghz8"
Jul 06 22:24:12.738690 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:12.738655    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2df6n\" (UniqueName: \"kubernetes.io/projected/775c591b-fa6d-4afd-8ce1-8cc4ebbd1f4a-kube-api-access-2df6n\") pod \"openshift-lws-operator-fd8ccff4c-pghz8\" (UID: \"775c591b-fa6d-4afd-8ce1-8cc4ebbd1f4a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pghz8"
Jul 06 22:24:12.738878 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:12.738703    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/775c591b-fa6d-4afd-8ce1-8cc4ebbd1f4a-tmp\") pod \"openshift-lws-operator-fd8ccff4c-pghz8\" (UID: \"775c591b-fa6d-4afd-8ce1-8cc4ebbd1f4a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pghz8"
Jul 06 22:24:12.739123 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:12.739082    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/775c591b-fa6d-4afd-8ce1-8cc4ebbd1f4a-tmp\") pod \"openshift-lws-operator-fd8ccff4c-pghz8\" (UID: \"775c591b-fa6d-4afd-8ce1-8cc4ebbd1f4a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pghz8"
Jul 06 22:24:12.747865 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:12.747848    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2df6n\" (UniqueName: \"kubernetes.io/projected/775c591b-fa6d-4afd-8ce1-8cc4ebbd1f4a-kube-api-access-2df6n\") pod \"openshift-lws-operator-fd8ccff4c-pghz8\" (UID: \"775c591b-fa6d-4afd-8ce1-8cc4ebbd1f4a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pghz8"
Jul 06 22:24:12.914256 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:12.914189    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pghz8"
Jul 06 22:24:13.039200 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:13.039175    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pghz8"]
Jul 06 22:24:13.044542 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:24:13.044507    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod775c591b_fa6d_4afd_8ce1_8cc4ebbd1f4a.slice/crio-944e855407dc2fb48ae39731ed40f07aa078bf6bc6b6bb50c8cddb1d3d814aa4 WatchSource:0}: Error finding container 944e855407dc2fb48ae39731ed40f07aa078bf6bc6b6bb50c8cddb1d3d814aa4: Status 404 returned error can't find the container with id 944e855407dc2fb48ae39731ed40f07aa078bf6bc6b6bb50c8cddb1d3d814aa4
Jul 06 22:24:13.920478 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:13.920437    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pghz8" event={"ID":"775c591b-fa6d-4afd-8ce1-8cc4ebbd1f4a","Type":"ContainerStarted","Data":"944e855407dc2fb48ae39731ed40f07aa078bf6bc6b6bb50c8cddb1d3d814aa4"}
Jul 06 22:24:15.932910 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:15.932874    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pghz8" event={"ID":"775c591b-fa6d-4afd-8ce1-8cc4ebbd1f4a","Type":"ContainerStarted","Data":"911f75de17fe14ef149bca7ae6a358181b0d32338ec228d618ccbdcdd971c7ad"}
Jul 06 22:24:15.949603 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:15.949558    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pghz8" podStartSLOduration=1.469975818 podStartE2EDuration="3.949540967s" totalImagesPullingTime="2.479565149s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:24:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:24:15.94873111 +0000 UTC m=+256.736754044" watchObservedRunningTime="2026-07-06 22:24:15.949540967 +0000 UTC m=+256.737563901"
Jul 06 22:24:22.957577 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:22.957498    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-67b4867ff6-8w27h"]
Jul 06 22:24:22.960853 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:22.960829    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-67b4867ff6-8w27h"
Jul 06 22:24:22.972422 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:22.972403    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 06 22:24:22.972959 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:22.972946    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 06 22:24:22.975243 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:22.975228    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 06 22:24:22.975747 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:22.975735    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-8vjvn\""
Jul 06 22:24:22.985782 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:22.985761    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-67b4867ff6-8w27h"]
Jul 06 22:24:23.032171 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:23.032137    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c62cb91f-1180-4181-8bb7-949a202d5cf8-metrics-cert\") pod \"lws-controller-manager-67b4867ff6-8w27h\" (UID: \"c62cb91f-1180-4181-8bb7-949a202d5cf8\") " pod="openshift-lws-operator/lws-controller-manager-67b4867ff6-8w27h"
Jul 06 22:24:23.032296 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:23.032175    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdnsl\" (UniqueName: \"kubernetes.io/projected/c62cb91f-1180-4181-8bb7-949a202d5cf8-kube-api-access-sdnsl\") pod \"lws-controller-manager-67b4867ff6-8w27h\" (UID: \"c62cb91f-1180-4181-8bb7-949a202d5cf8\") " pod="openshift-lws-operator/lws-controller-manager-67b4867ff6-8w27h"
Jul 06 22:24:23.032296 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:23.032234    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c62cb91f-1180-4181-8bb7-949a202d5cf8-manager-config\") pod \"lws-controller-manager-67b4867ff6-8w27h\" (UID: \"c62cb91f-1180-4181-8bb7-949a202d5cf8\") " pod="openshift-lws-operator/lws-controller-manager-67b4867ff6-8w27h"
Jul 06 22:24:23.032296 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:23.032264    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c62cb91f-1180-4181-8bb7-949a202d5cf8-cert\") pod \"lws-controller-manager-67b4867ff6-8w27h\" (UID: \"c62cb91f-1180-4181-8bb7-949a202d5cf8\") " pod="openshift-lws-operator/lws-controller-manager-67b4867ff6-8w27h"
Jul 06 22:24:23.133510 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:23.133478    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c62cb91f-1180-4181-8bb7-949a202d5cf8-metrics-cert\") pod \"lws-controller-manager-67b4867ff6-8w27h\" (UID: \"c62cb91f-1180-4181-8bb7-949a202d5cf8\") " pod="openshift-lws-operator/lws-controller-manager-67b4867ff6-8w27h"
Jul 06 22:24:23.133659 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:23.133514    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdnsl\" (UniqueName: \"kubernetes.io/projected/c62cb91f-1180-4181-8bb7-949a202d5cf8-kube-api-access-sdnsl\") pod \"lws-controller-manager-67b4867ff6-8w27h\" (UID: \"c62cb91f-1180-4181-8bb7-949a202d5cf8\") " pod="openshift-lws-operator/lws-controller-manager-67b4867ff6-8w27h"
Jul 06 22:24:23.133659 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:23.133557    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c62cb91f-1180-4181-8bb7-949a202d5cf8-manager-config\") pod \"lws-controller-manager-67b4867ff6-8w27h\" (UID: \"c62cb91f-1180-4181-8bb7-949a202d5cf8\") " pod="openshift-lws-operator/lws-controller-manager-67b4867ff6-8w27h"
Jul 06 22:24:23.133659 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:23.133597    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c62cb91f-1180-4181-8bb7-949a202d5cf8-cert\") pod \"lws-controller-manager-67b4867ff6-8w27h\" (UID: \"c62cb91f-1180-4181-8bb7-949a202d5cf8\") " pod="openshift-lws-operator/lws-controller-manager-67b4867ff6-8w27h"
Jul 06 22:24:23.134296 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:23.134274    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c62cb91f-1180-4181-8bb7-949a202d5cf8-manager-config\") pod \"lws-controller-manager-67b4867ff6-8w27h\" (UID: \"c62cb91f-1180-4181-8bb7-949a202d5cf8\") " pod="openshift-lws-operator/lws-controller-manager-67b4867ff6-8w27h"
Jul 06 22:24:23.136202 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:23.136171    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c62cb91f-1180-4181-8bb7-949a202d5cf8-cert\") pod \"lws-controller-manager-67b4867ff6-8w27h\" (UID: \"c62cb91f-1180-4181-8bb7-949a202d5cf8\") " pod="openshift-lws-operator/lws-controller-manager-67b4867ff6-8w27h"
Jul 06 22:24:23.136202 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:23.136183    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c62cb91f-1180-4181-8bb7-949a202d5cf8-metrics-cert\") pod \"lws-controller-manager-67b4867ff6-8w27h\" (UID: \"c62cb91f-1180-4181-8bb7-949a202d5cf8\") " pod="openshift-lws-operator/lws-controller-manager-67b4867ff6-8w27h"
Jul 06 22:24:23.143055 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:23.143034    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdnsl\" (UniqueName: \"kubernetes.io/projected/c62cb91f-1180-4181-8bb7-949a202d5cf8-kube-api-access-sdnsl\") pod \"lws-controller-manager-67b4867ff6-8w27h\" (UID: \"c62cb91f-1180-4181-8bb7-949a202d5cf8\") " pod="openshift-lws-operator/lws-controller-manager-67b4867ff6-8w27h"
Jul 06 22:24:23.270091 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:23.270002    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-67b4867ff6-8w27h"
Jul 06 22:24:23.400025 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:23.400000    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-67b4867ff6-8w27h"]
Jul 06 22:24:23.402752 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:24:23.402723    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc62cb91f_1180_4181_8bb7_949a202d5cf8.slice/crio-676126f4e8df35aa66d80d58bb3bc7b2cff7c94e9bedd2b92cb0390491cc0523 WatchSource:0}: Error finding container 676126f4e8df35aa66d80d58bb3bc7b2cff7c94e9bedd2b92cb0390491cc0523: Status 404 returned error can't find the container with id 676126f4e8df35aa66d80d58bb3bc7b2cff7c94e9bedd2b92cb0390491cc0523
Jul 06 22:24:23.969611 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:23.969574    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-67b4867ff6-8w27h" event={"ID":"c62cb91f-1180-4181-8bb7-949a202d5cf8","Type":"ContainerStarted","Data":"676126f4e8df35aa66d80d58bb3bc7b2cff7c94e9bedd2b92cb0390491cc0523"}
Jul 06 22:24:25.979718 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:25.979677    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-67b4867ff6-8w27h" event={"ID":"c62cb91f-1180-4181-8bb7-949a202d5cf8","Type":"ContainerStarted","Data":"afc377c8b302c30d26ea5e7f20c0a7a71610409860648e1e5f8faa969006a007"}
Jul 06 22:24:25.980187 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:25.979759    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-67b4867ff6-8w27h"
Jul 06 22:24:25.999606 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:25.999554    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-67b4867ff6-8w27h" podStartSLOduration=2.417850992 podStartE2EDuration="3.999540877s" totalImagesPullingTime="1.581689885s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:24:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:24:25.99789805 +0000 UTC m=+266.785920983" watchObservedRunningTime="2026-07-06 22:24:25.999540877 +0000 UTC m=+266.787563810"
Jul 06 22:24:35.697154 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:35.697121    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-c6597d756-4794n"]
Jul 06 22:24:35.703605 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:35.703589    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-c6597d756-4794n"
Jul 06 22:24:35.707441 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:35.707414    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-th8c4\""
Jul 06 22:24:35.707571 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:35.707417    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 06 22:24:35.707571 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:35.707420    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 06 22:24:35.707658 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:35.707647    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 06 22:24:35.707694 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:35.707654    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 06 22:24:35.716450 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:35.716431    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-c6597d756-4794n"]
Jul 06 22:24:35.834980 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:35.834956    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/79ee8235-108b-437a-a86a-d42c4fb5d3e0-tmp\") pod \"opendatahub-operator-controller-manager-c6597d756-4794n\" (UID: \"79ee8235-108b-437a-a86a-d42c4fb5d3e0\") " pod="opendatahub/opendatahub-operator-controller-manager-c6597d756-4794n"
Jul 06 22:24:35.835122 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:35.835008    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/79ee8235-108b-437a-a86a-d42c4fb5d3e0-webhook-cert\") pod \"opendatahub-operator-controller-manager-c6597d756-4794n\" (UID: \"79ee8235-108b-437a-a86a-d42c4fb5d3e0\") " pod="opendatahub/opendatahub-operator-controller-manager-c6597d756-4794n"
Jul 06 22:24:35.835122 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:35.835028    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/79ee8235-108b-437a-a86a-d42c4fb5d3e0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-c6597d756-4794n\" (UID: \"79ee8235-108b-437a-a86a-d42c4fb5d3e0\") " pod="opendatahub/opendatahub-operator-controller-manager-c6597d756-4794n"
Jul 06 22:24:35.835122 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:35.835089    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcckp\" (UniqueName: \"kubernetes.io/projected/79ee8235-108b-437a-a86a-d42c4fb5d3e0-kube-api-access-hcckp\") pod \"opendatahub-operator-controller-manager-c6597d756-4794n\" (UID: \"79ee8235-108b-437a-a86a-d42c4fb5d3e0\") " pod="opendatahub/opendatahub-operator-controller-manager-c6597d756-4794n"
Jul 06 22:24:35.835229 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:35.835135    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/79ee8235-108b-437a-a86a-d42c4fb5d3e0-manifests\") pod \"opendatahub-operator-controller-manager-c6597d756-4794n\" (UID: \"79ee8235-108b-437a-a86a-d42c4fb5d3e0\") " pod="opendatahub/opendatahub-operator-controller-manager-c6597d756-4794n"
Jul 06 22:24:35.936117 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:35.936071    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/79ee8235-108b-437a-a86a-d42c4fb5d3e0-tmp\") pod \"opendatahub-operator-controller-manager-c6597d756-4794n\" (UID: \"79ee8235-108b-437a-a86a-d42c4fb5d3e0\") " pod="opendatahub/opendatahub-operator-controller-manager-c6597d756-4794n"
Jul 06 22:24:35.936224 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:35.936141    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/79ee8235-108b-437a-a86a-d42c4fb5d3e0-webhook-cert\") pod \"opendatahub-operator-controller-manager-c6597d756-4794n\" (UID: \"79ee8235-108b-437a-a86a-d42c4fb5d3e0\") " pod="opendatahub/opendatahub-operator-controller-manager-c6597d756-4794n"
Jul 06 22:24:35.936224 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:35.936160    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/79ee8235-108b-437a-a86a-d42c4fb5d3e0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-c6597d756-4794n\" (UID: \"79ee8235-108b-437a-a86a-d42c4fb5d3e0\") " pod="opendatahub/opendatahub-operator-controller-manager-c6597d756-4794n"
Jul 06 22:24:35.936224 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:35.936193    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcckp\" (UniqueName: \"kubernetes.io/projected/79ee8235-108b-437a-a86a-d42c4fb5d3e0-kube-api-access-hcckp\") pod \"opendatahub-operator-controller-manager-c6597d756-4794n\" (UID: \"79ee8235-108b-437a-a86a-d42c4fb5d3e0\") " pod="opendatahub/opendatahub-operator-controller-manager-c6597d756-4794n"
Jul 06 22:24:35.936224 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:35.936218    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/79ee8235-108b-437a-a86a-d42c4fb5d3e0-manifests\") pod \"opendatahub-operator-controller-manager-c6597d756-4794n\" (UID: \"79ee8235-108b-437a-a86a-d42c4fb5d3e0\") " pod="opendatahub/opendatahub-operator-controller-manager-c6597d756-4794n"
Jul 06 22:24:35.936595 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:35.936567    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/79ee8235-108b-437a-a86a-d42c4fb5d3e0-manifests\") pod \"opendatahub-operator-controller-manager-c6597d756-4794n\" (UID: \"79ee8235-108b-437a-a86a-d42c4fb5d3e0\") " pod="opendatahub/opendatahub-operator-controller-manager-c6597d756-4794n"
Jul 06 22:24:35.938421 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:35.938392    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/79ee8235-108b-437a-a86a-d42c4fb5d3e0-tmp\") pod \"opendatahub-operator-controller-manager-c6597d756-4794n\" (UID: \"79ee8235-108b-437a-a86a-d42c4fb5d3e0\") " pod="opendatahub/opendatahub-operator-controller-manager-c6597d756-4794n"
Jul 06 22:24:35.938596 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:35.938578    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/79ee8235-108b-437a-a86a-d42c4fb5d3e0-webhook-cert\") pod \"opendatahub-operator-controller-manager-c6597d756-4794n\" (UID: \"79ee8235-108b-437a-a86a-d42c4fb5d3e0\") " pod="opendatahub/opendatahub-operator-controller-manager-c6597d756-4794n"
Jul 06 22:24:35.938664 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:35.938646    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/79ee8235-108b-437a-a86a-d42c4fb5d3e0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-c6597d756-4794n\" (UID: \"79ee8235-108b-437a-a86a-d42c4fb5d3e0\") " pod="opendatahub/opendatahub-operator-controller-manager-c6597d756-4794n"
Jul 06 22:24:35.945522 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:35.945496    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcckp\" (UniqueName: \"kubernetes.io/projected/79ee8235-108b-437a-a86a-d42c4fb5d3e0-kube-api-access-hcckp\") pod \"opendatahub-operator-controller-manager-c6597d756-4794n\" (UID: \"79ee8235-108b-437a-a86a-d42c4fb5d3e0\") " pod="opendatahub/opendatahub-operator-controller-manager-c6597d756-4794n"
Jul 06 22:24:36.013815 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:36.013764    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-c6597d756-4794n"
Jul 06 22:24:36.157815 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:36.157791    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-c6597d756-4794n"]
Jul 06 22:24:36.160747 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:24:36.160721    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79ee8235_108b_437a_a86a_d42c4fb5d3e0.slice/crio-ce68676cf6c3b3532f00dc662dca05b3725c68803911b1ff9603d7957ce1c04d WatchSource:0}: Error finding container ce68676cf6c3b3532f00dc662dca05b3725c68803911b1ff9603d7957ce1c04d: Status 404 returned error can't find the container with id ce68676cf6c3b3532f00dc662dca05b3725c68803911b1ff9603d7957ce1c04d
Jul 06 22:24:36.987231 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:36.987202    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-67b4867ff6-8w27h"
Jul 06 22:24:37.033549 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:37.033496    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c6597d756-4794n" event={"ID":"79ee8235-108b-437a-a86a-d42c4fb5d3e0","Type":"ContainerStarted","Data":"ce68676cf6c3b3532f00dc662dca05b3725c68803911b1ff9603d7957ce1c04d"}
Jul 06 22:24:40.052306 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:40.052269    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c6597d756-4794n" event={"ID":"79ee8235-108b-437a-a86a-d42c4fb5d3e0","Type":"ContainerStarted","Data":"f30d97ad110e1103d904136e0c075feac97b50392a1037da641b5b3ed815e0a5"}
Jul 06 22:24:41.059846 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:41.059813    2556 generic.go:356] "Generic (PLEG): container finished" podID="79ee8235-108b-437a-a86a-d42c4fb5d3e0" containerID="f30d97ad110e1103d904136e0c075feac97b50392a1037da641b5b3ed815e0a5" exitCode=0
Jul 06 22:24:41.060327 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:41.059873    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c6597d756-4794n" event={"ID":"79ee8235-108b-437a-a86a-d42c4fb5d3e0","Type":"ContainerDied","Data":"f30d97ad110e1103d904136e0c075feac97b50392a1037da641b5b3ed815e0a5"}
Jul 06 22:24:42.066259 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:42.066228    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c6597d756-4794n" event={"ID":"79ee8235-108b-437a-a86a-d42c4fb5d3e0","Type":"ContainerStarted","Data":"149575dccbea78f950d916a0223a2ed97b561b395f14cbd513d2d2d5e75e889b"}
Jul 06 22:24:42.066649 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:42.066473    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-c6597d756-4794n"
Jul 06 22:24:42.102192 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:42.102144    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-c6597d756-4794n" podStartSLOduration=2.7173930779999997 podStartE2EDuration="7.102129231s" totalImagesPullingTime="3.253401529s" totalInitContainerRuntime="1.131334624s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:24:35 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:24:42.100399997 +0000 UTC m=+282.888422930" watchObservedRunningTime="2026-07-06 22:24:42.102129231 +0000 UTC m=+282.890152163"
Jul 06 22:24:53.073369 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:53.073342    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-c6597d756-4794n"
Jul 06 22:24:59.569478 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:59.569446    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mxl25_49cd65b9-2343-4e21-8907-73358ec673ee/ovn-acl-logging/0.log"
Jul 06 22:24:59.576719 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:59.576699    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mxl25_49cd65b9-2343-4e21-8907-73358ec673ee/ovn-acl-logging/0.log"
Jul 06 22:24:59.577563 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:24:59.577544    2556 kubelet.go:1648] "Image garbage collection succeeded"
Jul 06 22:25:03.627300 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:03.627273    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hrvw2"]
Jul 06 22:25:03.630603 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:03.630582    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hrvw2"
Jul 06 22:25:03.633058 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:03.633000    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 06 22:25:03.633192 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:03.633058    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-6szf5\""
Jul 06 22:25:03.646164 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:03.646135    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hrvw2"]
Jul 06 22:25:03.667777 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:03.667743    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc5b9738-bcee-430e-85f7-a93bb0e97426-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hrvw2\" (UID: \"cc5b9738-bcee-430e-85f7-a93bb0e97426\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hrvw2"
Jul 06 22:25:03.667929 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:03.667793    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc5b9738-bcee-430e-85f7-a93bb0e97426-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hrvw2\" (UID: \"cc5b9738-bcee-430e-85f7-a93bb0e97426\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hrvw2"
Jul 06 22:25:03.667929 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:03.667892    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htcjb\" (UniqueName: \"kubernetes.io/projected/cc5b9738-bcee-430e-85f7-a93bb0e97426-kube-api-access-htcjb\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hrvw2\" (UID: \"cc5b9738-bcee-430e-85f7-a93bb0e97426\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hrvw2"
Jul 06 22:25:03.668019 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:03.667949    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc5b9738-bcee-430e-85f7-a93bb0e97426-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hrvw2\" (UID: \"cc5b9738-bcee-430e-85f7-a93bb0e97426\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hrvw2"
Jul 06 22:25:03.668135 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:03.668026    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc5b9738-bcee-430e-85f7-a93bb0e97426-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hrvw2\" (UID: \"cc5b9738-bcee-430e-85f7-a93bb0e97426\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hrvw2"
Jul 06 22:25:03.668135 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:03.668053    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc5b9738-bcee-430e-85f7-a93bb0e97426-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hrvw2\" (UID: \"cc5b9738-bcee-430e-85f7-a93bb0e97426\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hrvw2"
Jul 06 22:25:03.668274 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:03.668138    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc5b9738-bcee-430e-85f7-a93bb0e97426-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hrvw2\" (UID: \"cc5b9738-bcee-430e-85f7-a93bb0e97426\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hrvw2"
Jul 06 22:25:03.668274 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:03.668204    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc5b9738-bcee-430e-85f7-a93bb0e97426-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hrvw2\" (UID: \"cc5b9738-bcee-430e-85f7-a93bb0e97426\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hrvw2"
Jul 06 22:25:03.668274 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:03.668235    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc5b9738-bcee-430e-85f7-a93bb0e97426-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hrvw2\" (UID: \"cc5b9738-bcee-430e-85f7-a93bb0e97426\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hrvw2"
Jul 06 22:25:03.768817 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:03.768779    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc5b9738-bcee-430e-85f7-a93bb0e97426-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hrvw2\" (UID: \"cc5b9738-bcee-430e-85f7-a93bb0e97426\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hrvw2"
Jul 06 22:25:03.768817 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:03.768820    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc5b9738-bcee-430e-85f7-a93bb0e97426-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hrvw2\" (UID: \"cc5b9738-bcee-430e-85f7-a93bb0e97426\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hrvw2"
Jul 06 22:25:03.769072 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:03.768870    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc5b9738-bcee-430e-85f7-a93bb0e97426-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hrvw2\" (UID: \"cc5b9738-bcee-430e-85f7-a93bb0e97426\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hrvw2"
Jul 06 22:25:03.769072 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:03.768991    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc5b9738-bcee-430e-85f7-a93bb0e97426-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hrvw2\" (UID: \"cc5b9738-bcee-430e-85f7-a93bb0e97426\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hrvw2"
Jul 06 22:25:03.769072 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:03.769032    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc5b9738-bcee-430e-85f7-a93bb0e97426-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hrvw2\" (UID: \"cc5b9738-bcee-430e-85f7-a93bb0e97426\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hrvw2"
Jul 06 22:25:03.769260 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:03.769082    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc5b9738-bcee-430e-85f7-a93bb0e97426-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hrvw2\" (UID: \"cc5b9738-bcee-430e-85f7-a93bb0e97426\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hrvw2"
Jul 06 22:25:03.769260 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:03.769138    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc5b9738-bcee-430e-85f7-a93bb0e97426-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hrvw2\" (UID: \"cc5b9738-bcee-430e-85f7-a93bb0e97426\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hrvw2"
Jul 06 22:25:03.769260 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:03.769173    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htcjb\" (UniqueName: \"kubernetes.io/projected/cc5b9738-bcee-430e-85f7-a93bb0e97426-kube-api-access-htcjb\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hrvw2\" (UID: \"cc5b9738-bcee-430e-85f7-a93bb0e97426\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hrvw2"
Jul 06 22:25:03.769260 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:03.769221    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc5b9738-bcee-430e-85f7-a93bb0e97426-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hrvw2\" (UID: \"cc5b9738-bcee-430e-85f7-a93bb0e97426\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hrvw2"
Jul 06 22:25:03.769662 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:03.769629    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc5b9738-bcee-430e-85f7-a93bb0e97426-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hrvw2\" (UID: \"cc5b9738-bcee-430e-85f7-a93bb0e97426\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hrvw2"
Jul 06 22:25:03.769781 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:03.769758    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc5b9738-bcee-430e-85f7-a93bb0e97426-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hrvw2\" (UID: \"cc5b9738-bcee-430e-85f7-a93bb0e97426\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hrvw2"
Jul 06 22:25:03.769894 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:03.769784    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc5b9738-bcee-430e-85f7-a93bb0e97426-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hrvw2\" (UID: \"cc5b9738-bcee-430e-85f7-a93bb0e97426\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hrvw2"
Jul 06 22:25:03.769894 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:03.769832    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc5b9738-bcee-430e-85f7-a93bb0e97426-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hrvw2\" (UID: \"cc5b9738-bcee-430e-85f7-a93bb0e97426\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hrvw2"
Jul 06 22:25:03.770034 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:03.770016    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc5b9738-bcee-430e-85f7-a93bb0e97426-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hrvw2\" (UID: \"cc5b9738-bcee-430e-85f7-a93bb0e97426\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hrvw2"
Jul 06 22:25:03.771519 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:03.771497    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc5b9738-bcee-430e-85f7-a93bb0e97426-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hrvw2\" (UID: \"cc5b9738-bcee-430e-85f7-a93bb0e97426\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hrvw2"
Jul 06 22:25:03.771651 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:03.771628    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc5b9738-bcee-430e-85f7-a93bb0e97426-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hrvw2\" (UID: \"cc5b9738-bcee-430e-85f7-a93bb0e97426\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hrvw2"
Jul 06 22:25:03.781214 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:03.781196    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc5b9738-bcee-430e-85f7-a93bb0e97426-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hrvw2\" (UID: \"cc5b9738-bcee-430e-85f7-a93bb0e97426\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hrvw2"
Jul 06 22:25:03.781719 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:03.781696    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-htcjb\" (UniqueName: \"kubernetes.io/projected/cc5b9738-bcee-430e-85f7-a93bb0e97426-kube-api-access-htcjb\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hrvw2\" (UID: \"cc5b9738-bcee-430e-85f7-a93bb0e97426\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hrvw2"
Jul 06 22:25:03.943298 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:03.943206    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hrvw2"
Jul 06 22:25:04.086494 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:04.086469    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hrvw2"]
Jul 06 22:25:04.088386 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:25:04.088359    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc5b9738_bcee_430e_85f7_a93bb0e97426.slice/crio-fe635cc07f658d44c0eb7336f3efbb303c9ee1159e44dfbab3647b37ea0ce593 WatchSource:0}: Error finding container fe635cc07f658d44c0eb7336f3efbb303c9ee1159e44dfbab3647b37ea0ce593: Status 404 returned error can't find the container with id fe635cc07f658d44c0eb7336f3efbb303c9ee1159e44dfbab3647b37ea0ce593
Jul 06 22:25:04.090464 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:04.090448    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 22:25:04.165564 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:04.165535    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hrvw2" event={"ID":"cc5b9738-bcee-430e-85f7-a93bb0e97426","Type":"ContainerStarted","Data":"fe635cc07f658d44c0eb7336f3efbb303c9ee1159e44dfbab3647b37ea0ce593"}
Jul 06 22:25:04.236596 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:04.236517    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7s5dw"]
Jul 06 22:25:04.241237 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:04.241216    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7s5dw"
Jul 06 22:25:04.243556 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:04.243538    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 06 22:25:04.244408 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:04.244384    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 06 22:25:04.244497 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:04.244420    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 06 22:25:04.244497 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:04.244440    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-6x958\""
Jul 06 22:25:04.252548 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:04.252526    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7s5dw"]
Jul 06 22:25:04.272655 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:04.272635    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssthg\" (UniqueName: \"kubernetes.io/projected/12d8be81-9a96-4462-845c-f4539e4e574c-kube-api-access-ssthg\") pod \"istiod-openshift-gateway-94bb8fbfd-7s5dw\" (UID: \"12d8be81-9a96-4462-845c-f4539e4e574c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7s5dw"
Jul 06 22:25:04.272655 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:04.272664    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/12d8be81-9a96-4462-845c-f4539e4e574c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-7s5dw\" (UID: \"12d8be81-9a96-4462-845c-f4539e4e574c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7s5dw"
Jul 06 22:25:04.272794 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:04.272751    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/12d8be81-9a96-4462-845c-f4539e4e574c-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-7s5dw\" (UID: \"12d8be81-9a96-4462-845c-f4539e4e574c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7s5dw"
Jul 06 22:25:04.272794 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:04.272784    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/12d8be81-9a96-4462-845c-f4539e4e574c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-7s5dw\" (UID: \"12d8be81-9a96-4462-845c-f4539e4e574c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7s5dw"
Jul 06 22:25:04.272869 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:04.272803    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/12d8be81-9a96-4462-845c-f4539e4e574c-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-7s5dw\" (UID: \"12d8be81-9a96-4462-845c-f4539e4e574c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7s5dw"
Jul 06 22:25:04.272904 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:04.272897    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/12d8be81-9a96-4462-845c-f4539e4e574c-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-7s5dw\" (UID: \"12d8be81-9a96-4462-845c-f4539e4e574c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7s5dw"
Jul 06 22:25:04.272944 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:04.272917    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12d8be81-9a96-4462-845c-f4539e4e574c-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-7s5dw\" (UID: \"12d8be81-9a96-4462-845c-f4539e4e574c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7s5dw"
Jul 06 22:25:04.373651 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:04.373626    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/12d8be81-9a96-4462-845c-f4539e4e574c-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-7s5dw\" (UID: \"12d8be81-9a96-4462-845c-f4539e4e574c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7s5dw"
Jul 06 22:25:04.373746 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:04.373657    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/12d8be81-9a96-4462-845c-f4539e4e574c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-7s5dw\" (UID: \"12d8be81-9a96-4462-845c-f4539e4e574c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7s5dw"
Jul 06 22:25:04.373746 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:04.373674    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/12d8be81-9a96-4462-845c-f4539e4e574c-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-7s5dw\" (UID: \"12d8be81-9a96-4462-845c-f4539e4e574c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7s5dw"
Jul 06 22:25:04.373746 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:04.373720    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/12d8be81-9a96-4462-845c-f4539e4e574c-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-7s5dw\" (UID: \"12d8be81-9a96-4462-845c-f4539e4e574c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7s5dw"
Jul 06 22:25:04.373746 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:04.373741    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12d8be81-9a96-4462-845c-f4539e4e574c-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-7s5dw\" (UID: \"12d8be81-9a96-4462-845c-f4539e4e574c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7s5dw"
Jul 06 22:25:04.373881 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:04.373766    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssthg\" (UniqueName: \"kubernetes.io/projected/12d8be81-9a96-4462-845c-f4539e4e574c-kube-api-access-ssthg\") pod \"istiod-openshift-gateway-94bb8fbfd-7s5dw\" (UID: \"12d8be81-9a96-4462-845c-f4539e4e574c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7s5dw"
Jul 06 22:25:04.373881 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:04.373787    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/12d8be81-9a96-4462-845c-f4539e4e574c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-7s5dw\" (UID: \"12d8be81-9a96-4462-845c-f4539e4e574c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7s5dw"
Jul 06 22:25:04.374798 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:04.374768    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/12d8be81-9a96-4462-845c-f4539e4e574c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-7s5dw\" (UID: \"12d8be81-9a96-4462-845c-f4539e4e574c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7s5dw"
Jul 06 22:25:04.376087 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:04.376061    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/12d8be81-9a96-4462-845c-f4539e4e574c-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-7s5dw\" (UID: \"12d8be81-9a96-4462-845c-f4539e4e574c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7s5dw"
Jul 06 22:25:04.376246 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:04.376229    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/12d8be81-9a96-4462-845c-f4539e4e574c-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-7s5dw\" (UID: \"12d8be81-9a96-4462-845c-f4539e4e574c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7s5dw"
Jul 06 22:25:04.376287 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:04.376276    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/12d8be81-9a96-4462-845c-f4539e4e574c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-7s5dw\" (UID: \"12d8be81-9a96-4462-845c-f4539e4e574c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7s5dw"
Jul 06 22:25:04.376325 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:04.376307    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/12d8be81-9a96-4462-845c-f4539e4e574c-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-7s5dw\" (UID: \"12d8be81-9a96-4462-845c-f4539e4e574c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7s5dw"
Jul 06 22:25:04.382861 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:04.382838    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12d8be81-9a96-4462-845c-f4539e4e574c-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-7s5dw\" (UID: \"12d8be81-9a96-4462-845c-f4539e4e574c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7s5dw"
Jul 06 22:25:04.383148 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:04.383132    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssthg\" (UniqueName: \"kubernetes.io/projected/12d8be81-9a96-4462-845c-f4539e4e574c-kube-api-access-ssthg\") pod \"istiod-openshift-gateway-94bb8fbfd-7s5dw\" (UID: \"12d8be81-9a96-4462-845c-f4539e4e574c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7s5dw"
Jul 06 22:25:04.551420 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:04.551393    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7s5dw"
Jul 06 22:25:04.693312 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:04.693290    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7s5dw"]
Jul 06 22:25:04.695736 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:25:04.695714    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12d8be81_9a96_4462_845c_f4539e4e574c.slice/crio-a08898004caeb467de2d0281d0a2ada12e4d9a15c9ee09a84e756138e96c36ca WatchSource:0}: Error finding container a08898004caeb467de2d0281d0a2ada12e4d9a15c9ee09a84e756138e96c36ca: Status 404 returned error can't find the container with id a08898004caeb467de2d0281d0a2ada12e4d9a15c9ee09a84e756138e96c36ca
Jul 06 22:25:05.173163 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:05.173127    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7s5dw" event={"ID":"12d8be81-9a96-4462-845c-f4539e4e574c","Type":"ContainerStarted","Data":"a08898004caeb467de2d0281d0a2ada12e4d9a15c9ee09a84e756138e96c36ca"}
Jul 06 22:25:07.888016 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:07.887966    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 22:25:07.888376 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:07.888082    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 22:25:07.888376 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:07.888145    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 22:25:07.888376 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:07.888302    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 22:25:07.888376 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:07.888353    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 22:25:08.192177 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:08.192084    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hrvw2" event={"ID":"cc5b9738-bcee-430e-85f7-a93bb0e97426","Type":"ContainerStarted","Data":"205ba6ae8893394dad266c6992133894b9c6cbf6f35f79a5ebc4608fa0834360"}
Jul 06 22:25:08.193731 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:08.193707    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7s5dw" event={"ID":"12d8be81-9a96-4462-845c-f4539e4e574c","Type":"ContainerStarted","Data":"6ec36cb7e6086d8141eb642b231c5f4d4c024678408ab744a70e5b4047c99141"}
Jul 06 22:25:08.193918 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:08.193905    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7s5dw"
Jul 06 22:25:08.195307 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:08.195285    2556 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-7s5dw container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 06 22:25:08.195397 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:08.195331    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7s5dw" podUID="12d8be81-9a96-4462-845c-f4539e4e574c" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 22:25:08.247054 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:08.247012    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hrvw2" podStartSLOduration=1.4498275729999999 podStartE2EDuration="5.246999348s" totalImagesPullingTime="3.797171775s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:25:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:25:08.241446485 +0000 UTC m=+309.029469417" watchObservedRunningTime="2026-07-06 22:25:08.246999348 +0000 UTC m=+309.035022282"
Jul 06 22:25:08.304674 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:08.304628    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7s5dw" podStartSLOduration=1.114341616 podStartE2EDuration="4.304608314s" totalImagesPullingTime="3.190266698s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:25:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:25:08.302919222 +0000 UTC m=+309.090942190" watchObservedRunningTime="2026-07-06 22:25:08.304608314 +0000 UTC m=+309.092631252"
Jul 06 22:25:08.944440 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:08.944396    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hrvw2"
Jul 06 22:25:08.949482 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:08.949459    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hrvw2"
Jul 06 22:25:09.198398 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:09.198314    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hrvw2"
Jul 06 22:25:09.198827 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:09.198803    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7s5dw"
Jul 06 22:25:09.199249 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:25:09.199233    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hrvw2"
Jul 06 22:26:47.897379 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:26:47.897345    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5477f8b68d-pfmr4"]
Jul 06 22:26:47.901079 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:26:47.901055    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5477f8b68d-pfmr4"
Jul 06 22:26:47.912381 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:26:47.912355    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5477f8b68d-pfmr4"]
Jul 06 22:26:47.930629 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:26:47.930605    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pp585\" (UniqueName: \"kubernetes.io/projected/10caf825-68fd-4303-9542-c6bc820f6044-kube-api-access-pp585\") pod \"console-5477f8b68d-pfmr4\" (UID: \"10caf825-68fd-4303-9542-c6bc820f6044\") " pod="openshift-console/console-5477f8b68d-pfmr4"
Jul 06 22:26:47.930764 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:26:47.930730    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/10caf825-68fd-4303-9542-c6bc820f6044-service-ca\") pod \"console-5477f8b68d-pfmr4\" (UID: \"10caf825-68fd-4303-9542-c6bc820f6044\") " pod="openshift-console/console-5477f8b68d-pfmr4"
Jul 06 22:26:47.930829 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:26:47.930787    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/10caf825-68fd-4303-9542-c6bc820f6044-console-config\") pod \"console-5477f8b68d-pfmr4\" (UID: \"10caf825-68fd-4303-9542-c6bc820f6044\") " pod="openshift-console/console-5477f8b68d-pfmr4"
Jul 06 22:26:47.930883 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:26:47.930821    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/10caf825-68fd-4303-9542-c6bc820f6044-console-oauth-config\") pod \"console-5477f8b68d-pfmr4\" (UID: \"10caf825-68fd-4303-9542-c6bc820f6044\") " pod="openshift-console/console-5477f8b68d-pfmr4"
Jul 06 22:26:47.930933 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:26:47.930916    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/10caf825-68fd-4303-9542-c6bc820f6044-oauth-serving-cert\") pod \"console-5477f8b68d-pfmr4\" (UID: \"10caf825-68fd-4303-9542-c6bc820f6044\") " pod="openshift-console/console-5477f8b68d-pfmr4"
Jul 06 22:26:47.930985 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:26:47.930945    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/10caf825-68fd-4303-9542-c6bc820f6044-console-serving-cert\") pod \"console-5477f8b68d-pfmr4\" (UID: \"10caf825-68fd-4303-9542-c6bc820f6044\") " pod="openshift-console/console-5477f8b68d-pfmr4"
Jul 06 22:26:47.931063 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:26:47.931043    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10caf825-68fd-4303-9542-c6bc820f6044-trusted-ca-bundle\") pod \"console-5477f8b68d-pfmr4\" (UID: \"10caf825-68fd-4303-9542-c6bc820f6044\") " pod="openshift-console/console-5477f8b68d-pfmr4"
Jul 06 22:26:48.031910 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:26:48.031884    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10caf825-68fd-4303-9542-c6bc820f6044-trusted-ca-bundle\") pod \"console-5477f8b68d-pfmr4\" (UID: \"10caf825-68fd-4303-9542-c6bc820f6044\") " pod="openshift-console/console-5477f8b68d-pfmr4"
Jul 06 22:26:48.032028 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:26:48.031916    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pp585\" (UniqueName: \"kubernetes.io/projected/10caf825-68fd-4303-9542-c6bc820f6044-kube-api-access-pp585\") pod \"console-5477f8b68d-pfmr4\" (UID: \"10caf825-68fd-4303-9542-c6bc820f6044\") " pod="openshift-console/console-5477f8b68d-pfmr4"
Jul 06 22:26:48.032028 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:26:48.031964    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/10caf825-68fd-4303-9542-c6bc820f6044-service-ca\") pod \"console-5477f8b68d-pfmr4\" (UID: \"10caf825-68fd-4303-9542-c6bc820f6044\") " pod="openshift-console/console-5477f8b68d-pfmr4"
Jul 06 22:26:48.032028 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:26:48.032011    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/10caf825-68fd-4303-9542-c6bc820f6044-console-config\") pod \"console-5477f8b68d-pfmr4\" (UID: \"10caf825-68fd-4303-9542-c6bc820f6044\") " pod="openshift-console/console-5477f8b68d-pfmr4"
Jul 06 22:26:48.032236 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:26:48.032044    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/10caf825-68fd-4303-9542-c6bc820f6044-console-oauth-config\") pod \"console-5477f8b68d-pfmr4\" (UID: \"10caf825-68fd-4303-9542-c6bc820f6044\") " pod="openshift-console/console-5477f8b68d-pfmr4"
Jul 06 22:26:48.032236 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:26:48.032121    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/10caf825-68fd-4303-9542-c6bc820f6044-oauth-serving-cert\") pod \"console-5477f8b68d-pfmr4\" (UID: \"10caf825-68fd-4303-9542-c6bc820f6044\") " pod="openshift-console/console-5477f8b68d-pfmr4"
Jul 06 22:26:48.032236 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:26:48.032150    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/10caf825-68fd-4303-9542-c6bc820f6044-console-serving-cert\") pod \"console-5477f8b68d-pfmr4\" (UID: \"10caf825-68fd-4303-9542-c6bc820f6044\") " pod="openshift-console/console-5477f8b68d-pfmr4"
Jul 06 22:26:48.032804 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:26:48.032773    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/10caf825-68fd-4303-9542-c6bc820f6044-service-ca\") pod \"console-5477f8b68d-pfmr4\" (UID: \"10caf825-68fd-4303-9542-c6bc820f6044\") " pod="openshift-console/console-5477f8b68d-pfmr4"
Jul 06 22:26:48.032919 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:26:48.032842    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/10caf825-68fd-4303-9542-c6bc820f6044-oauth-serving-cert\") pod \"console-5477f8b68d-pfmr4\" (UID: \"10caf825-68fd-4303-9542-c6bc820f6044\") " pod="openshift-console/console-5477f8b68d-pfmr4"
Jul 06 22:26:48.032919 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:26:48.032869    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/10caf825-68fd-4303-9542-c6bc820f6044-console-config\") pod \"console-5477f8b68d-pfmr4\" (UID: \"10caf825-68fd-4303-9542-c6bc820f6044\") " pod="openshift-console/console-5477f8b68d-pfmr4"
Jul 06 22:26:48.032919 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:26:48.032851    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10caf825-68fd-4303-9542-c6bc820f6044-trusted-ca-bundle\") pod \"console-5477f8b68d-pfmr4\" (UID: \"10caf825-68fd-4303-9542-c6bc820f6044\") " pod="openshift-console/console-5477f8b68d-pfmr4"
Jul 06 22:26:48.034712 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:26:48.034682    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/10caf825-68fd-4303-9542-c6bc820f6044-console-serving-cert\") pod \"console-5477f8b68d-pfmr4\" (UID: \"10caf825-68fd-4303-9542-c6bc820f6044\") " pod="openshift-console/console-5477f8b68d-pfmr4"
Jul 06 22:26:48.034832 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:26:48.034755    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/10caf825-68fd-4303-9542-c6bc820f6044-console-oauth-config\") pod \"console-5477f8b68d-pfmr4\" (UID: \"10caf825-68fd-4303-9542-c6bc820f6044\") " pod="openshift-console/console-5477f8b68d-pfmr4"
Jul 06 22:26:48.041727 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:26:48.041705    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pp585\" (UniqueName: \"kubernetes.io/projected/10caf825-68fd-4303-9542-c6bc820f6044-kube-api-access-pp585\") pod \"console-5477f8b68d-pfmr4\" (UID: \"10caf825-68fd-4303-9542-c6bc820f6044\") " pod="openshift-console/console-5477f8b68d-pfmr4"
Jul 06 22:26:48.210626 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:26:48.210565    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5477f8b68d-pfmr4"
Jul 06 22:26:48.352294 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:26:48.352270    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5477f8b68d-pfmr4"]
Jul 06 22:26:48.354058 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:26:48.354029    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10caf825_68fd_4303_9542_c6bc820f6044.slice/crio-de4d13005ea328cb21471cf6d915bcd1024124f54947294c8945224573fa720e WatchSource:0}: Error finding container de4d13005ea328cb21471cf6d915bcd1024124f54947294c8945224573fa720e: Status 404 returned error can't find the container with id de4d13005ea328cb21471cf6d915bcd1024124f54947294c8945224573fa720e
Jul 06 22:26:48.673519 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:26:48.673490    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5477f8b68d-pfmr4" event={"ID":"10caf825-68fd-4303-9542-c6bc820f6044","Type":"ContainerStarted","Data":"72508185a627a0d65ced0a85959886d7e1d3e1951700ec3a6557c77835f42359"}
Jul 06 22:26:48.673717 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:26:48.673528    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5477f8b68d-pfmr4" event={"ID":"10caf825-68fd-4303-9542-c6bc820f6044","Type":"ContainerStarted","Data":"de4d13005ea328cb21471cf6d915bcd1024124f54947294c8945224573fa720e"}
Jul 06 22:26:48.692838 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:26:48.692790    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5477f8b68d-pfmr4" podStartSLOduration=1.692771773 podStartE2EDuration="1.692771773s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:26:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:26:48.691660758 +0000 UTC m=+409.479683692" watchObservedRunningTime="2026-07-06 22:26:48.692771773 +0000 UTC m=+409.480794706"
Jul 06 22:26:58.210715 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:26:58.210679    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5477f8b68d-pfmr4"
Jul 06 22:26:58.211152 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:26:58.210753    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5477f8b68d-pfmr4"
Jul 06 22:26:58.215660 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:26:58.215637    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5477f8b68d-pfmr4"
Jul 06 22:26:58.723568 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:26:58.723544    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5477f8b68d-pfmr4"
Jul 06 22:26:58.788047 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:26:58.788016    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f55fb8956-88zgj"]
Jul 06 22:27:23.810144 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:27:23.810003    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7f55fb8956-88zgj" podUID="aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c" containerName="console" containerID="cri-o://d2cc23804f63a5ae0d1fae2634719a4d55a67280fc6d718828dceefba7f75c3c" gracePeriod=15
Jul 06 22:27:24.058302 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:27:24.058278    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f55fb8956-88zgj"
Jul 06 22:27:24.220280 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:27:24.220213    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c-console-serving-cert\") pod \"aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c\" (UID: \"aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c\") "
Jul 06 22:27:24.220436 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:27:24.220295    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gvspn\" (UniqueName: \"kubernetes.io/projected/aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c-kube-api-access-gvspn\") pod \"aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c\" (UID: \"aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c\") "
Jul 06 22:27:24.220436 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:27:24.220315    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c-console-oauth-config\") pod \"aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c\" (UID: \"aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c\") "
Jul 06 22:27:24.220436 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:27:24.220345    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c-oauth-serving-cert\") pod \"aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c\" (UID: \"aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c\") "
Jul 06 22:27:24.220436 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:27:24.220361    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c-service-ca\") pod \"aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c\" (UID: \"aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c\") "
Jul 06 22:27:24.220436 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:27:24.220393    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c-trusted-ca-bundle\") pod \"aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c\" (UID: \"aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c\") "
Jul 06 22:27:24.220436 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:27:24.220417    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c-console-config\") pod \"aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c\" (UID: \"aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c\") "
Jul 06 22:27:24.220928 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:27:24.220803    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c-service-ca" (OuterVolumeSpecName: "service-ca") pod "aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c" (UID: "aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 22:27:24.221023 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:27:24.220917    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c" (UID: "aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 22:27:24.221023 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:27:24.220943    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c" (UID: "aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 22:27:24.221023 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:27:24.220977    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c-console-config" (OuterVolumeSpecName: "console-config") pod "aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c" (UID: "aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 22:27:24.222504 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:27:24.222478    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c" (UID: "aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 22:27:24.222608 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:27:24.222533    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c" (UID: "aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 22:27:24.222608 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:27:24.222580    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c-kube-api-access-gvspn" (OuterVolumeSpecName: "kube-api-access-gvspn") pod "aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c" (UID: "aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c"). InnerVolumeSpecName "kube-api-access-gvspn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 22:27:24.321755 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:27:24.321730    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gvspn\" (UniqueName: \"kubernetes.io/projected/aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c-kube-api-access-gvspn\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\""
Jul 06 22:27:24.321755 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:27:24.321753    2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c-console-oauth-config\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\""
Jul 06 22:27:24.321878 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:27:24.321762    2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c-oauth-serving-cert\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\""
Jul 06 22:27:24.321878 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:27:24.321771    2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c-service-ca\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\""
Jul 06 22:27:24.321878 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:27:24.321780    2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c-trusted-ca-bundle\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\""
Jul 06 22:27:24.321878 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:27:24.321788    2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c-console-config\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\""
Jul 06 22:27:24.321878 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:27:24.321796    2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c-console-serving-cert\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\""
Jul 06 22:27:24.836479 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:27:24.836445    2556 generic.go:356] "Generic (PLEG): container finished" podID="aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c" containerID="d2cc23804f63a5ae0d1fae2634719a4d55a67280fc6d718828dceefba7f75c3c" exitCode=0
Jul 06 22:27:24.836850 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:27:24.836492    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f55fb8956-88zgj"
Jul 06 22:27:24.836850 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:27:24.836502    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f55fb8956-88zgj" event={"ID":"aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c","Type":"ContainerDied","Data":"d2cc23804f63a5ae0d1fae2634719a4d55a67280fc6d718828dceefba7f75c3c"}
Jul 06 22:27:24.836850 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:27:24.836542    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f55fb8956-88zgj" event={"ID":"aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c","Type":"ContainerDied","Data":"5b36fcaec491d6e3ff3d8bf2d086d93e3445a341906bebd3d341db60006cf5bc"}
Jul 06 22:27:24.836850 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:27:24.836564    2556 scope.go:117] "RemoveContainer" containerID="d2cc23804f63a5ae0d1fae2634719a4d55a67280fc6d718828dceefba7f75c3c"
Jul 06 22:27:24.845936 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:27:24.845914    2556 scope.go:117] "RemoveContainer" containerID="d2cc23804f63a5ae0d1fae2634719a4d55a67280fc6d718828dceefba7f75c3c"
Jul 06 22:27:24.846230 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:27:24.846210    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2cc23804f63a5ae0d1fae2634719a4d55a67280fc6d718828dceefba7f75c3c\": container with ID starting with d2cc23804f63a5ae0d1fae2634719a4d55a67280fc6d718828dceefba7f75c3c not found: ID does not exist" containerID="d2cc23804f63a5ae0d1fae2634719a4d55a67280fc6d718828dceefba7f75c3c"
Jul 06 22:27:24.846307 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:27:24.846238    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2cc23804f63a5ae0d1fae2634719a4d55a67280fc6d718828dceefba7f75c3c"} err="failed to get container status \"d2cc23804f63a5ae0d1fae2634719a4d55a67280fc6d718828dceefba7f75c3c\": rpc error: code = NotFound desc = could not find container \"d2cc23804f63a5ae0d1fae2634719a4d55a67280fc6d718828dceefba7f75c3c\": container with ID starting with d2cc23804f63a5ae0d1fae2634719a4d55a67280fc6d718828dceefba7f75c3c not found: ID does not exist"
Jul 06 22:27:24.861766 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:27:24.861742    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f55fb8956-88zgj"]
Jul 06 22:27:24.864806 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:27:24.864785    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7f55fb8956-88zgj"]
Jul 06 22:27:25.653541 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:27:25.653509    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c" path="/var/lib/kubelet/pods/aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c/volumes"
Jul 06 22:27:50.115478 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:27:50.115447    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:27:50.115843 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:27:50.115816    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c" containerName="console"
Jul 06 22:27:50.115843 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:27:50.115827    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c" containerName="console"
Jul 06 22:27:50.115918 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:27:50.115893    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa34675c-bc12-4fd0-b0c8-b5634e9e6c6c" containerName="console"
Jul 06 22:27:50.120467 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:27:50.120449    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-mw659"
Jul 06 22:27:50.124661 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:27:50.124638    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 06 22:27:50.124837 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:27:50.124818    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 06 22:27:50.124928 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:27:50.124892    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 06 22:27:50.125219 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:27:50.125197    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-fcb48\""
Jul 06 22:27:50.130195 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:27:50.130168    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:27:50.171610 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:27:50.171583    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:27:50.237776 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:27:50.237754    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-559c4\" (UniqueName: \"kubernetes.io/projected/ff160115-403c-45dc-8e54-a4d1ba2a7984-kube-api-access-559c4\") pod \"limitador-limitador-54d6d988d5-mw659\" (UID: \"ff160115-403c-45dc-8e54-a4d1ba2a7984\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mw659"
Jul 06 22:27:50.237881 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:27:50.237858    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ff160115-403c-45dc-8e54-a4d1ba2a7984-config-file\") pod \"limitador-limitador-54d6d988d5-mw659\" (UID: \"ff160115-403c-45dc-8e54-a4d1ba2a7984\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mw659"
Jul 06 22:27:50.339178 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:27:50.339146    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ff160115-403c-45dc-8e54-a4d1ba2a7984-config-file\") pod \"limitador-limitador-54d6d988d5-mw659\" (UID: \"ff160115-403c-45dc-8e54-a4d1ba2a7984\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mw659"
Jul 06 22:27:50.339178 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:27:50.339181    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-559c4\" (UniqueName: \"kubernetes.io/projected/ff160115-403c-45dc-8e54-a4d1ba2a7984-kube-api-access-559c4\") pod \"limitador-limitador-54d6d988d5-mw659\" (UID: \"ff160115-403c-45dc-8e54-a4d1ba2a7984\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mw659"
Jul 06 22:27:50.339761 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:27:50.339743    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ff160115-403c-45dc-8e54-a4d1ba2a7984-config-file\") pod \"limitador-limitador-54d6d988d5-mw659\" (UID: \"ff160115-403c-45dc-8e54-a4d1ba2a7984\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mw659"
Jul 06 22:27:50.349494 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:27:50.349475    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-559c4\" (UniqueName: \"kubernetes.io/projected/ff160115-403c-45dc-8e54-a4d1ba2a7984-kube-api-access-559c4\") pod \"limitador-limitador-54d6d988d5-mw659\" (UID: \"ff160115-403c-45dc-8e54-a4d1ba2a7984\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mw659"
Jul 06 22:27:50.431594 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:27:50.431535    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-mw659"
Jul 06 22:27:50.588129 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:27:50.588081    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:27:50.590508 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:27:50.590479    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff160115_403c_45dc_8e54_a4d1ba2a7984.slice/crio-4090edbc9c485f6d3cdfe269d48917c6e0db03294967394733dd50eeb7512d21 WatchSource:0}: Error finding container 4090edbc9c485f6d3cdfe269d48917c6e0db03294967394733dd50eeb7512d21: Status 404 returned error can't find the container with id 4090edbc9c485f6d3cdfe269d48917c6e0db03294967394733dd50eeb7512d21
Jul 06 22:27:50.957687 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:27:50.957656    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-mw659" event={"ID":"ff160115-403c-45dc-8e54-a4d1ba2a7984","Type":"ContainerStarted","Data":"4090edbc9c485f6d3cdfe269d48917c6e0db03294967394733dd50eeb7512d21"}
Jul 06 22:27:53.973621 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:27:53.973585    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-mw659" event={"ID":"ff160115-403c-45dc-8e54-a4d1ba2a7984","Type":"ContainerStarted","Data":"c3659bcc527c013eea1947f1bc3a0746557b8ef470bb46557a8731a9fd9ffb14"}
Jul 06 22:27:53.974082 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:27:53.973697    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-mw659"
Jul 06 22:27:53.994893 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:27:53.994842    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-mw659" podStartSLOduration=1.5008299859999998 podStartE2EDuration="3.994827502s" totalImagesPullingTime="2.493997516s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:27:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:27:53.994334243 +0000 UTC m=+474.782357190" watchObservedRunningTime="2026-07-06 22:27:53.994827502 +0000 UTC m=+474.782850475"
Jul 06 22:28:04.980152 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:28:04.980124    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-mw659"
Jul 06 22:29:10.772194 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:29:10.772118    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:29:28.634335 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:29:28.634294    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:29:32.294733 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:29:32.294695    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:29:40.610733 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:29:40.610698    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:29:51.819151 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:29:51.819121    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:29:57.329531 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:29:57.329490    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-gnz7f"]
Jul 06 22:29:57.333210 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:29:57.333188    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gnz7f"
Jul 06 22:29:57.338678 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:29:57.338650    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 06 22:29:57.338821 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:29:57.338650    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 06 22:29:57.339628 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:29:57.339608    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 06 22:29:57.339748 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:29:57.339719    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-j9vrr\""
Jul 06 22:29:57.350389 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:29:57.350364    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-gnz7f"]
Jul 06 22:29:57.353325 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:29:57.353299    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95a0263a-fd3a-4002-ac64-b145b88aa094-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gnz7f\" (UID: \"95a0263a-fd3a-4002-ac64-b145b88aa094\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gnz7f"
Jul 06 22:29:57.353450 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:29:57.353332    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95a0263a-fd3a-4002-ac64-b145b88aa094-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gnz7f\" (UID: \"95a0263a-fd3a-4002-ac64-b145b88aa094\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gnz7f"
Jul 06 22:29:57.353450 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:29:57.353355    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95a0263a-fd3a-4002-ac64-b145b88aa094-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gnz7f\" (UID: \"95a0263a-fd3a-4002-ac64-b145b88aa094\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gnz7f"
Jul 06 22:29:57.353574 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:29:57.353476    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rp7dh\" (UniqueName: \"kubernetes.io/projected/95a0263a-fd3a-4002-ac64-b145b88aa094-kube-api-access-rp7dh\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gnz7f\" (UID: \"95a0263a-fd3a-4002-ac64-b145b88aa094\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gnz7f"
Jul 06 22:29:57.353574 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:29:57.353519    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95a0263a-fd3a-4002-ac64-b145b88aa094-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gnz7f\" (UID: \"95a0263a-fd3a-4002-ac64-b145b88aa094\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gnz7f"
Jul 06 22:29:57.353679 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:29:57.353588    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95a0263a-fd3a-4002-ac64-b145b88aa094-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gnz7f\" (UID: \"95a0263a-fd3a-4002-ac64-b145b88aa094\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gnz7f"
Jul 06 22:29:57.454232 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:29:57.454201    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rp7dh\" (UniqueName: \"kubernetes.io/projected/95a0263a-fd3a-4002-ac64-b145b88aa094-kube-api-access-rp7dh\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gnz7f\" (UID: \"95a0263a-fd3a-4002-ac64-b145b88aa094\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gnz7f"
Jul 06 22:29:57.454419 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:29:57.454242    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95a0263a-fd3a-4002-ac64-b145b88aa094-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gnz7f\" (UID: \"95a0263a-fd3a-4002-ac64-b145b88aa094\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gnz7f"
Jul 06 22:29:57.454419 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:29:57.454277    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95a0263a-fd3a-4002-ac64-b145b88aa094-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gnz7f\" (UID: \"95a0263a-fd3a-4002-ac64-b145b88aa094\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gnz7f"
Jul 06 22:29:57.454419 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:29:57.454293    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95a0263a-fd3a-4002-ac64-b145b88aa094-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gnz7f\" (UID: \"95a0263a-fd3a-4002-ac64-b145b88aa094\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gnz7f"
Jul 06 22:29:57.454419 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:29:57.454313    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95a0263a-fd3a-4002-ac64-b145b88aa094-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gnz7f\" (UID: \"95a0263a-fd3a-4002-ac64-b145b88aa094\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gnz7f"
Jul 06 22:29:57.454419 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:29:57.454331    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95a0263a-fd3a-4002-ac64-b145b88aa094-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gnz7f\" (UID: \"95a0263a-fd3a-4002-ac64-b145b88aa094\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gnz7f"
Jul 06 22:29:57.454739 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:29:57.454719    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95a0263a-fd3a-4002-ac64-b145b88aa094-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gnz7f\" (UID: \"95a0263a-fd3a-4002-ac64-b145b88aa094\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gnz7f"
Jul 06 22:29:57.454798 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:29:57.454734    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95a0263a-fd3a-4002-ac64-b145b88aa094-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gnz7f\" (UID: \"95a0263a-fd3a-4002-ac64-b145b88aa094\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gnz7f"
Jul 06 22:29:57.454798 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:29:57.454791    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95a0263a-fd3a-4002-ac64-b145b88aa094-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gnz7f\" (UID: \"95a0263a-fd3a-4002-ac64-b145b88aa094\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gnz7f"
Jul 06 22:29:57.456514 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:29:57.456495    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95a0263a-fd3a-4002-ac64-b145b88aa094-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gnz7f\" (UID: \"95a0263a-fd3a-4002-ac64-b145b88aa094\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gnz7f"
Jul 06 22:29:57.456683 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:29:57.456664    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95a0263a-fd3a-4002-ac64-b145b88aa094-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gnz7f\" (UID: \"95a0263a-fd3a-4002-ac64-b145b88aa094\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gnz7f"
Jul 06 22:29:57.463820 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:29:57.463797    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rp7dh\" (UniqueName: \"kubernetes.io/projected/95a0263a-fd3a-4002-ac64-b145b88aa094-kube-api-access-rp7dh\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gnz7f\" (UID: \"95a0263a-fd3a-4002-ac64-b145b88aa094\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gnz7f"
Jul 06 22:29:57.645373 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:29:57.645288    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gnz7f"
Jul 06 22:29:57.781601 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:29:57.781578    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-gnz7f"]
Jul 06 22:29:57.783454 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:29:57.783430    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95a0263a_fd3a_4002_ac64_b145b88aa094.slice/crio-c9cbc760a341f749b90da4233877bc67d2c9996b17280d9bd7d479ba245af679 WatchSource:0}: Error finding container c9cbc760a341f749b90da4233877bc67d2c9996b17280d9bd7d479ba245af679: Status 404 returned error can't find the container with id c9cbc760a341f749b90da4233877bc67d2c9996b17280d9bd7d479ba245af679
Jul 06 22:29:58.573220 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:29:58.573178    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gnz7f" event={"ID":"95a0263a-fd3a-4002-ac64-b145b88aa094","Type":"ContainerStarted","Data":"c9cbc760a341f749b90da4233877bc67d2c9996b17280d9bd7d479ba245af679"}
Jul 06 22:29:59.518783 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:29:59.518749    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:29:59.580819 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:29:59.580792    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gnz7f" event={"ID":"95a0263a-fd3a-4002-ac64-b145b88aa094","Type":"ContainerStarted","Data":"d6d7fa182e4332cfdb153c942e31bfdf6780c86cfe43a942ce71cc48822a1715"}
Jul 06 22:29:59.602472 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:29:59.602444    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mxl25_49cd65b9-2343-4e21-8907-73358ec673ee/ovn-acl-logging/0.log"
Jul 06 22:29:59.603074 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:29:59.603022    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gnz7f" podStartSLOduration=1.610821786 podStartE2EDuration="2.603003227s" totalImagesPullingTime="992.181441ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:29:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:29:59.600699651 +0000 UTC m=+600.388722585" watchObservedRunningTime="2026-07-06 22:29:59.603003227 +0000 UTC m=+600.391026161"
Jul 06 22:29:59.608201 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:29:59.608185    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mxl25_49cd65b9-2343-4e21-8907-73358ec673ee/ovn-acl-logging/0.log"
Jul 06 22:30:07.646169 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:30:07.646133    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gnz7f"
Jul 06 22:30:07.648672 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:30:07.646198    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gnz7f"
Jul 06 22:30:07.659379 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:30:07.659354    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gnz7f"
Jul 06 22:30:08.632983 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:30:08.632953    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gnz7f"
Jul 06 22:30:10.315835 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:30:10.315801    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:31:46.012250 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:31:46.012217    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:31:56.791472 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:31:56.791390    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:32:08.407646 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:32:08.407603    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:32:16.795793 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:32:16.795761    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:32:27.099753 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:32:27.099710    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:32:54.403417 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:32:54.403384    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:33:06.025932 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:33:06.025890    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:33:41.094801 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:33:41.094770    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:33:50.892307 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:33:50.892269    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:33:59.899655 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:33:59.899624    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:34:09.003713 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:34:09.003680    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:34:18.500654 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:34:18.500603    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:34:27.706404 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:34:27.706368    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:34:37.987388 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:34:37.987353    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:34:47.697456 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:34:47.697418    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:34:59.641439 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:34:59.641370    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mxl25_49cd65b9-2343-4e21-8907-73358ec673ee/ovn-acl-logging/0.log"
Jul 06 22:34:59.643889 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:34:59.643867    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mxl25_49cd65b9-2343-4e21-8907-73358ec673ee/ovn-acl-logging/0.log"
Jul 06 22:35:10.308960 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:35:10.308925    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:35:19.798109 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:35:19.798075    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:35:43.402089 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:35:43.402052    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:35:53.509904 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:35:53.509871    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:36:08.634602 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:36:08.634570    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:36:18.009980 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:36:18.009945    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:36:29.890957 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:36:29.890881    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:36:39.099114 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:36:39.099061    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:36:48.697582 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:36:48.697552    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:38:37.201493 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:38:37.201459    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:38:48.196658 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:38:48.196623    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:38:58.797184 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:38:58.797144    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:39:07.896178 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:39:07.896141    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:39:17.411133 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:39:17.411081    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:39:26.413119 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:39:26.413022    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:39:37.097211 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:39:37.097173    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:39:47.999940 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:39:47.999903    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:39:56.634925 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:39:56.634888    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:39:59.671526 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:39:59.671496    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mxl25_49cd65b9-2343-4e21-8907-73358ec673ee/ovn-acl-logging/0.log"
Jul 06 22:39:59.672064 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:39:59.672046    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mxl25_49cd65b9-2343-4e21-8907-73358ec673ee/ovn-acl-logging/0.log"
Jul 06 22:40:08.205659 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:40:08.205619    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:40:19.699223 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:40:19.699190    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:40:26.501276 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:40:26.501240    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:40:45.006037 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:40:45.006002    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:40:54.593942 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:40:54.593860    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:41:06.597430 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:41:06.597397    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:41:14.506233 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:41:14.506200    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:41:23.897475 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:41:23.897442    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:41:42.901795 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:41:42.901766    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:41:52.194931 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:41:52.194896    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:42:01.395179 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:42:01.395147    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:42:08.703040 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:42:08.703003    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:42:20.198600 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:42:20.198564    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:42:29.599992 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:42:29.599917    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:42:41.419797 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:42:41.419762    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:42:53.322032 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:42:53.322000    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:43:08.199526 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:43:08.199492    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:43:16.706164 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:43:16.706122    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:43:28.490587 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:43:28.490553    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:43:45.998443 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:43:45.998408    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:43:58.494765 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:43:58.494687    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:44:11.501889 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:44:11.501847    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:44:24.599119 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:44:24.599059    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:44:33.396471 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:44:33.396440    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:44:42.797287 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:44:42.797253    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:44:59.700394 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:44:59.700367    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mxl25_49cd65b9-2343-4e21-8907-73358ec673ee/ovn-acl-logging/0.log"
Jul 06 22:44:59.701549 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:44:59.701523    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mxl25_49cd65b9-2343-4e21-8907-73358ec673ee/ovn-acl-logging/0.log"
Jul 06 22:45:00.911335 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:45:00.911301    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:45:11.496317 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:45:11.496282    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:45:21.200641 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:45:21.200609    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:45:31.595676 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:45:31.595640    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:46:52.098258 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:46:52.098159    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:47:00.989576 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:47:00.989540    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:47:15.898428 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:47:15.898397    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:47:23.787274 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:47:23.787237    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:47:57.796544 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:47:57.796505    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:48:21.694049 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:48:21.694003    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:48:35.595795 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:48:35.595755    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:48:49.391447 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:48:49.391415    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:49:28.787381 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:49:28.787340    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:49:59.731839 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:49:59.731809    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mxl25_49cd65b9-2343-4e21-8907-73358ec673ee/ovn-acl-logging/0.log"
Jul 06 22:49:59.734997 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:49:59.734978    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mxl25_49cd65b9-2343-4e21-8907-73358ec673ee/ovn-acl-logging/0.log"
Jul 06 22:50:00.401626 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:50:00.401587    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:50:14.496402 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:50:14.496367    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:51:02.892188 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:51:02.892154    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:51:13.117341 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:51:13.117307    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:51:23.505161 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:51:23.505058    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:51:44.055466 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:51:44.055430    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-e401d1/test-model-e401d1-kserve-fb9c56859-7p4t9"]
Jul 06 22:51:44.058834 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:51:44.058818    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-e401d1/test-model-e401d1-kserve-fb9c56859-7p4t9"
Jul 06 22:51:44.061174 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:51:44.061156    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-e401d1\"/\"openshift-service-ca.crt\""
Jul 06 22:51:44.061399 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:51:44.061379    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-e401d1\"/\"kube-root-ca.crt\""
Jul 06 22:51:44.061994 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:51:44.061977    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-e401d1\"/\"default-dockercfg-gzwl2\""
Jul 06 22:51:44.062078 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:51:44.062013    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-e401d1\"/\"test-model-e401d1-kserve-self-signed-certs\""
Jul 06 22:51:44.067879 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:51:44.067856    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-e401d1/test-model-e401d1-kserve-fb9c56859-7p4t9"]
Jul 06 22:51:44.244859 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:51:44.244828    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a09c922-2b07-4394-89ad-775ea024c05e-tls-certs\") pod \"test-model-e401d1-kserve-fb9c56859-7p4t9\" (UID: \"5a09c922-2b07-4394-89ad-775ea024c05e\") " pod="ai-tenant-e2e-inf-b-e401d1/test-model-e401d1-kserve-fb9c56859-7p4t9"
Jul 06 22:51:44.244859 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:51:44.244861    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a09c922-2b07-4394-89ad-775ea024c05e-dshm\") pod \"test-model-e401d1-kserve-fb9c56859-7p4t9\" (UID: \"5a09c922-2b07-4394-89ad-775ea024c05e\") " pod="ai-tenant-e2e-inf-b-e401d1/test-model-e401d1-kserve-fb9c56859-7p4t9"
Jul 06 22:51:44.245077 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:51:44.244879    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a09c922-2b07-4394-89ad-775ea024c05e-model-cache\") pod \"test-model-e401d1-kserve-fb9c56859-7p4t9\" (UID: \"5a09c922-2b07-4394-89ad-775ea024c05e\") " pod="ai-tenant-e2e-inf-b-e401d1/test-model-e401d1-kserve-fb9c56859-7p4t9"
Jul 06 22:51:44.245077 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:51:44.244903    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5rkl\" (UniqueName: \"kubernetes.io/projected/5a09c922-2b07-4394-89ad-775ea024c05e-kube-api-access-d5rkl\") pod \"test-model-e401d1-kserve-fb9c56859-7p4t9\" (UID: \"5a09c922-2b07-4394-89ad-775ea024c05e\") " pod="ai-tenant-e2e-inf-b-e401d1/test-model-e401d1-kserve-fb9c56859-7p4t9"
Jul 06 22:51:44.245077 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:51:44.244995    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a09c922-2b07-4394-89ad-775ea024c05e-tmp-dir\") pod \"test-model-e401d1-kserve-fb9c56859-7p4t9\" (UID: \"5a09c922-2b07-4394-89ad-775ea024c05e\") " pod="ai-tenant-e2e-inf-b-e401d1/test-model-e401d1-kserve-fb9c56859-7p4t9"
Jul 06 22:51:44.245077 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:51:44.245012    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a09c922-2b07-4394-89ad-775ea024c05e-home\") pod \"test-model-e401d1-kserve-fb9c56859-7p4t9\" (UID: \"5a09c922-2b07-4394-89ad-775ea024c05e\") " pod="ai-tenant-e2e-inf-b-e401d1/test-model-e401d1-kserve-fb9c56859-7p4t9"
Jul 06 22:51:44.346351 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:51:44.346263    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a09c922-2b07-4394-89ad-775ea024c05e-tls-certs\") pod \"test-model-e401d1-kserve-fb9c56859-7p4t9\" (UID: \"5a09c922-2b07-4394-89ad-775ea024c05e\") " pod="ai-tenant-e2e-inf-b-e401d1/test-model-e401d1-kserve-fb9c56859-7p4t9"
Jul 06 22:51:44.346351 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:51:44.346302    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a09c922-2b07-4394-89ad-775ea024c05e-dshm\") pod \"test-model-e401d1-kserve-fb9c56859-7p4t9\" (UID: \"5a09c922-2b07-4394-89ad-775ea024c05e\") " pod="ai-tenant-e2e-inf-b-e401d1/test-model-e401d1-kserve-fb9c56859-7p4t9"
Jul 06 22:51:44.346351 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:51:44.346317    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a09c922-2b07-4394-89ad-775ea024c05e-model-cache\") pod \"test-model-e401d1-kserve-fb9c56859-7p4t9\" (UID: \"5a09c922-2b07-4394-89ad-775ea024c05e\") " pod="ai-tenant-e2e-inf-b-e401d1/test-model-e401d1-kserve-fb9c56859-7p4t9"
Jul 06 22:51:44.346351 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:51:44.346345    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5rkl\" (UniqueName: \"kubernetes.io/projected/5a09c922-2b07-4394-89ad-775ea024c05e-kube-api-access-d5rkl\") pod \"test-model-e401d1-kserve-fb9c56859-7p4t9\" (UID: \"5a09c922-2b07-4394-89ad-775ea024c05e\") " pod="ai-tenant-e2e-inf-b-e401d1/test-model-e401d1-kserve-fb9c56859-7p4t9"
Jul 06 22:51:44.346665 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:51:44.346396    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a09c922-2b07-4394-89ad-775ea024c05e-tmp-dir\") pod \"test-model-e401d1-kserve-fb9c56859-7p4t9\" (UID: \"5a09c922-2b07-4394-89ad-775ea024c05e\") " pod="ai-tenant-e2e-inf-b-e401d1/test-model-e401d1-kserve-fb9c56859-7p4t9"
Jul 06 22:51:44.346665 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:51:44.346420    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a09c922-2b07-4394-89ad-775ea024c05e-home\") pod \"test-model-e401d1-kserve-fb9c56859-7p4t9\" (UID: \"5a09c922-2b07-4394-89ad-775ea024c05e\") " pod="ai-tenant-e2e-inf-b-e401d1/test-model-e401d1-kserve-fb9c56859-7p4t9"
Jul 06 22:51:44.346793 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:51:44.346719    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a09c922-2b07-4394-89ad-775ea024c05e-model-cache\") pod \"test-model-e401d1-kserve-fb9c56859-7p4t9\" (UID: \"5a09c922-2b07-4394-89ad-775ea024c05e\") " pod="ai-tenant-e2e-inf-b-e401d1/test-model-e401d1-kserve-fb9c56859-7p4t9"
Jul 06 22:51:44.346793 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:51:44.346768    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a09c922-2b07-4394-89ad-775ea024c05e-tmp-dir\") pod \"test-model-e401d1-kserve-fb9c56859-7p4t9\" (UID: \"5a09c922-2b07-4394-89ad-775ea024c05e\") " pod="ai-tenant-e2e-inf-b-e401d1/test-model-e401d1-kserve-fb9c56859-7p4t9"
Jul 06 22:51:44.346915 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:51:44.346790    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a09c922-2b07-4394-89ad-775ea024c05e-home\") pod \"test-model-e401d1-kserve-fb9c56859-7p4t9\" (UID: \"5a09c922-2b07-4394-89ad-775ea024c05e\") " pod="ai-tenant-e2e-inf-b-e401d1/test-model-e401d1-kserve-fb9c56859-7p4t9"
Jul 06 22:51:44.348775 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:51:44.348756    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a09c922-2b07-4394-89ad-775ea024c05e-dshm\") pod \"test-model-e401d1-kserve-fb9c56859-7p4t9\" (UID: \"5a09c922-2b07-4394-89ad-775ea024c05e\") " pod="ai-tenant-e2e-inf-b-e401d1/test-model-e401d1-kserve-fb9c56859-7p4t9"
Jul 06 22:51:44.348964 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:51:44.348949    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a09c922-2b07-4394-89ad-775ea024c05e-tls-certs\") pod \"test-model-e401d1-kserve-fb9c56859-7p4t9\" (UID: \"5a09c922-2b07-4394-89ad-775ea024c05e\") " pod="ai-tenant-e2e-inf-b-e401d1/test-model-e401d1-kserve-fb9c56859-7p4t9"
Jul 06 22:51:44.357160 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:51:44.357135    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5rkl\" (UniqueName: \"kubernetes.io/projected/5a09c922-2b07-4394-89ad-775ea024c05e-kube-api-access-d5rkl\") pod \"test-model-e401d1-kserve-fb9c56859-7p4t9\" (UID: \"5a09c922-2b07-4394-89ad-775ea024c05e\") " pod="ai-tenant-e2e-inf-b-e401d1/test-model-e401d1-kserve-fb9c56859-7p4t9"
Jul 06 22:51:44.368932 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:51:44.368907    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-e401d1/test-model-e401d1-kserve-fb9c56859-7p4t9"
Jul 06 22:51:44.504060 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:51:44.504036    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-e401d1/test-model-e401d1-kserve-fb9c56859-7p4t9"]
Jul 06 22:51:44.506218 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:51:44.506184    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5a09c922_2b07_4394_89ad_775ea024c05e.slice/crio-c946ef7001c0f61d0d9783a8160846bfb78b3c6695581fac0f44dff2bbcd3c20 WatchSource:0}: Error finding container c946ef7001c0f61d0d9783a8160846bfb78b3c6695581fac0f44dff2bbcd3c20: Status 404 returned error can't find the container with id c946ef7001c0f61d0d9783a8160846bfb78b3c6695581fac0f44dff2bbcd3c20
Jul 06 22:51:44.703263 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:51:44.703176    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-e401d1/test-model-e401d1-kserve-fb9c56859-7p4t9" event={"ID":"5a09c922-2b07-4394-89ad-775ea024c05e","Type":"ContainerStarted","Data":"fa13c60cf7281ea40fc353d0aa767648b225feead0a67b980d191042bd9d194f"}
Jul 06 22:51:44.703263 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:51:44.703215    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-e401d1/test-model-e401d1-kserve-fb9c56859-7p4t9" event={"ID":"5a09c922-2b07-4394-89ad-775ea024c05e","Type":"ContainerStarted","Data":"c946ef7001c0f61d0d9783a8160846bfb78b3c6695581fac0f44dff2bbcd3c20"}
Jul 06 22:51:44.723572 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:51:44.723525    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-e401d1/test-model-e401d1-kserve-fb9c56859-7p4t9" podStartSLOduration=0.723509868 podStartE2EDuration="723.509868ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:51:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:51:44.722817958 +0000 UTC m=+1905.510840896" watchObservedRunningTime="2026-07-06 22:51:44.723509868 +0000 UTC m=+1905.511532801"
Jul 06 22:51:48.211245 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:51:48.211207    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:51:54.369958 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:51:54.369918    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-e401d1/test-model-e401d1-kserve-fb9c56859-7p4t9"
Jul 06 22:51:54.370381 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:51:54.370002    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-e401d1/test-model-e401d1-kserve-fb9c56859-7p4t9"
Jul 06 22:51:54.382573 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:51:54.382553    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-e401d1/test-model-e401d1-kserve-fb9c56859-7p4t9"
Jul 06 22:51:54.762193 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:51:54.762118    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-e401d1/test-model-e401d1-kserve-fb9c56859-7p4t9"
Jul 06 22:52:22.448673 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:52:22.448637    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-e401d1/test-model-e401d1-kserve-fb9c56859-7p4t9"]
Jul 06 22:52:26.311517 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:52:26.311483    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:52:37.469562 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:52:37.469522    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-e401d1/test-model-e401d1-kserve-fb9c56859-7p4t9" podUID="5a09c922-2b07-4394-89ad-775ea024c05e" containerName="main" containerID="cri-o://fa13c60cf7281ea40fc353d0aa767648b225feead0a67b980d191042bd9d194f" gracePeriod=45
Jul 06 22:52:37.719678 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:52:37.719626    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-e401d1/test-model-e401d1-kserve-fb9c56859-7p4t9"
Jul 06 22:52:37.738599 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:52:37.738577    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d5rkl\" (UniqueName: \"kubernetes.io/projected/5a09c922-2b07-4394-89ad-775ea024c05e-kube-api-access-d5rkl\") pod \"5a09c922-2b07-4394-89ad-775ea024c05e\" (UID: \"5a09c922-2b07-4394-89ad-775ea024c05e\") "
Jul 06 22:52:37.738682 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:52:37.738640    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a09c922-2b07-4394-89ad-775ea024c05e-tls-certs\") pod \"5a09c922-2b07-4394-89ad-775ea024c05e\" (UID: \"5a09c922-2b07-4394-89ad-775ea024c05e\") "
Jul 06 22:52:37.738773 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:52:37.738755    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a09c922-2b07-4394-89ad-775ea024c05e-model-cache\") pod \"5a09c922-2b07-4394-89ad-775ea024c05e\" (UID: \"5a09c922-2b07-4394-89ad-775ea024c05e\") "
Jul 06 22:52:37.738831 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:52:37.738818    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a09c922-2b07-4394-89ad-775ea024c05e-dshm\") pod \"5a09c922-2b07-4394-89ad-775ea024c05e\" (UID: \"5a09c922-2b07-4394-89ad-775ea024c05e\") "
Jul 06 22:52:37.738884 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:52:37.738872    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a09c922-2b07-4394-89ad-775ea024c05e-tmp-dir\") pod \"5a09c922-2b07-4394-89ad-775ea024c05e\" (UID: \"5a09c922-2b07-4394-89ad-775ea024c05e\") "
Jul 06 22:52:37.738934 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:52:37.738904    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a09c922-2b07-4394-89ad-775ea024c05e-home\") pod \"5a09c922-2b07-4394-89ad-775ea024c05e\" (UID: \"5a09c922-2b07-4394-89ad-775ea024c05e\") "
Jul 06 22:52:37.739068 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:52:37.739034    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a09c922-2b07-4394-89ad-775ea024c05e-model-cache" (OuterVolumeSpecName: "model-cache") pod "5a09c922-2b07-4394-89ad-775ea024c05e" (UID: "5a09c922-2b07-4394-89ad-775ea024c05e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 22:52:37.739233 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:52:37.739191    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a09c922-2b07-4394-89ad-775ea024c05e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5a09c922-2b07-4394-89ad-775ea024c05e" (UID: "5a09c922-2b07-4394-89ad-775ea024c05e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 22:52:37.739300 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:52:37.739254    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a09c922-2b07-4394-89ad-775ea024c05e-home" (OuterVolumeSpecName: "home") pod "5a09c922-2b07-4394-89ad-775ea024c05e" (UID: "5a09c922-2b07-4394-89ad-775ea024c05e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 22:52:37.739354 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:52:37.739306    2556 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a09c922-2b07-4394-89ad-775ea024c05e-model-cache\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\""
Jul 06 22:52:37.739354 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:52:37.739329    2556 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a09c922-2b07-4394-89ad-775ea024c05e-tmp-dir\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\""
Jul 06 22:52:37.741491 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:52:37.741453    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a09c922-2b07-4394-89ad-775ea024c05e-kube-api-access-d5rkl" (OuterVolumeSpecName: "kube-api-access-d5rkl") pod "5a09c922-2b07-4394-89ad-775ea024c05e" (UID: "5a09c922-2b07-4394-89ad-775ea024c05e"). InnerVolumeSpecName "kube-api-access-d5rkl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 22:52:37.741491 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:52:37.741476    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a09c922-2b07-4394-89ad-775ea024c05e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5a09c922-2b07-4394-89ad-775ea024c05e" (UID: "5a09c922-2b07-4394-89ad-775ea024c05e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 22:52:37.741744 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:52:37.741707    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a09c922-2b07-4394-89ad-775ea024c05e-dshm" (OuterVolumeSpecName: "dshm") pod "5a09c922-2b07-4394-89ad-775ea024c05e" (UID: "5a09c922-2b07-4394-89ad-775ea024c05e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 22:52:37.840113 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:52:37.840072    2556 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a09c922-2b07-4394-89ad-775ea024c05e-dshm\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\""
Jul 06 22:52:37.840113 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:52:37.840094    2556 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a09c922-2b07-4394-89ad-775ea024c05e-home\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\""
Jul 06 22:52:37.840243 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:52:37.840123    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d5rkl\" (UniqueName: \"kubernetes.io/projected/5a09c922-2b07-4394-89ad-775ea024c05e-kube-api-access-d5rkl\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\""
Jul 06 22:52:37.840243 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:52:37.840133    2556 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a09c922-2b07-4394-89ad-775ea024c05e-tls-certs\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\""
Jul 06 22:52:37.956887 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:52:37.956850    2556 generic.go:356] "Generic (PLEG): container finished" podID="5a09c922-2b07-4394-89ad-775ea024c05e" containerID="fa13c60cf7281ea40fc353d0aa767648b225feead0a67b980d191042bd9d194f" exitCode=0
Jul 06 22:52:37.957016 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:52:37.956887    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-e401d1/test-model-e401d1-kserve-fb9c56859-7p4t9" event={"ID":"5a09c922-2b07-4394-89ad-775ea024c05e","Type":"ContainerDied","Data":"fa13c60cf7281ea40fc353d0aa767648b225feead0a67b980d191042bd9d194f"}
Jul 06 22:52:37.957016 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:52:37.956931    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-e401d1/test-model-e401d1-kserve-fb9c56859-7p4t9" event={"ID":"5a09c922-2b07-4394-89ad-775ea024c05e","Type":"ContainerDied","Data":"c946ef7001c0f61d0d9783a8160846bfb78b3c6695581fac0f44dff2bbcd3c20"}
Jul 06 22:52:37.957016 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:52:37.956954    2556 scope.go:117] "RemoveContainer" containerID="fa13c60cf7281ea40fc353d0aa767648b225feead0a67b980d191042bd9d194f"
Jul 06 22:52:37.957016 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:52:37.956892    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-e401d1/test-model-e401d1-kserve-fb9c56859-7p4t9"
Jul 06 22:52:37.969071 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:52:37.969053    2556 scope.go:117] "RemoveContainer" containerID="fa13c60cf7281ea40fc353d0aa767648b225feead0a67b980d191042bd9d194f"
Jul 06 22:52:37.969364 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:52:37.969343    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa13c60cf7281ea40fc353d0aa767648b225feead0a67b980d191042bd9d194f\": container with ID starting with fa13c60cf7281ea40fc353d0aa767648b225feead0a67b980d191042bd9d194f not found: ID does not exist" containerID="fa13c60cf7281ea40fc353d0aa767648b225feead0a67b980d191042bd9d194f"
Jul 06 22:52:37.969409 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:52:37.969373    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa13c60cf7281ea40fc353d0aa767648b225feead0a67b980d191042bd9d194f"} err="failed to get container status \"fa13c60cf7281ea40fc353d0aa767648b225feead0a67b980d191042bd9d194f\": rpc error: code = NotFound desc = could not find container \"fa13c60cf7281ea40fc353d0aa767648b225feead0a67b980d191042bd9d194f\": container with ID starting with fa13c60cf7281ea40fc353d0aa767648b225feead0a67b980d191042bd9d194f not found: ID does not exist"
Jul 06 22:52:37.995955 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:52:37.995869    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-e401d1/test-model-e401d1-kserve-fb9c56859-7p4t9"]
Jul 06 22:52:37.998260 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:52:37.998235    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-e401d1/test-model-e401d1-kserve-fb9c56859-7p4t9"]
Jul 06 22:52:39.652859 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:52:39.652825    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a09c922-2b07-4394-89ad-775ea024c05e" path="/var/lib/kubelet/pods/5a09c922-2b07-4394-89ad-775ea024c05e/volumes"
Jul 06 22:53:09.696233 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:53:09.696198    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:53:24.599320 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:53:24.599286    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:53:38.804367 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:53:38.804329    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:53:48.506818 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:53:48.506775    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:54:01.703599 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:54:01.703557    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:54:13.608467 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:54:13.608432    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:54:45.310210 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:54:45.310138    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:54:59.760629 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:54:59.760603    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mxl25_49cd65b9-2343-4e21-8907-73358ec673ee/ovn-acl-logging/0.log"
Jul 06 22:54:59.764656 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:54:59.764627    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mxl25_49cd65b9-2343-4e21-8907-73358ec673ee/ovn-acl-logging/0.log"
Jul 06 22:55:09.212627 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:55:09.212595    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-6c153e/auth-test-model-6c153e-kserve-5f7f5f8c95-dp8sc"]
Jul 06 22:55:09.213086 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:55:09.212975    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a09c922-2b07-4394-89ad-775ea024c05e" containerName="main"
Jul 06 22:55:09.213086 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:55:09.212986    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a09c922-2b07-4394-89ad-775ea024c05e" containerName="main"
Jul 06 22:55:09.213086 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:55:09.213055    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a09c922-2b07-4394-89ad-775ea024c05e" containerName="main"
Jul 06 22:55:09.216048 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:55:09.216034    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6c153e/auth-test-model-6c153e-kserve-5f7f5f8c95-dp8sc"
Jul 06 22:55:09.219295 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:55:09.219276    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-6c153e\"/\"auth-test-model-6c153e-kserve-self-signed-certs\""
Jul 06 22:55:09.219427 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:55:09.219297    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-6c153e\"/\"kube-root-ca.crt\""
Jul 06 22:55:09.219558 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:55:09.219539    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-6c153e\"/\"default-dockercfg-nsqkg\""
Jul 06 22:55:09.219676 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:55:09.219600    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-6c153e\"/\"openshift-service-ca.crt\""
Jul 06 22:55:09.224352 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:55:09.224330    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-6c153e/auth-test-model-6c153e-kserve-5f7f5f8c95-dp8sc"]
Jul 06 22:55:09.306525 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:55:09.306461    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd6328c4-67f5-4090-aa9a-eb24a1f7e30f-dshm\") pod \"auth-test-model-6c153e-kserve-5f7f5f8c95-dp8sc\" (UID: \"cd6328c4-67f5-4090-aa9a-eb24a1f7e30f\") " pod="ai-tenant-e2e-shared-b-6c153e/auth-test-model-6c153e-kserve-5f7f5f8c95-dp8sc"
Jul 06 22:55:09.306669 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:55:09.306532    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd6328c4-67f5-4090-aa9a-eb24a1f7e30f-tls-certs\") pod \"auth-test-model-6c153e-kserve-5f7f5f8c95-dp8sc\" (UID: \"cd6328c4-67f5-4090-aa9a-eb24a1f7e30f\") " pod="ai-tenant-e2e-shared-b-6c153e/auth-test-model-6c153e-kserve-5f7f5f8c95-dp8sc"
Jul 06 22:55:09.306669 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:55:09.306603    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd6328c4-67f5-4090-aa9a-eb24a1f7e30f-tmp-dir\") pod \"auth-test-model-6c153e-kserve-5f7f5f8c95-dp8sc\" (UID: \"cd6328c4-67f5-4090-aa9a-eb24a1f7e30f\") " pod="ai-tenant-e2e-shared-b-6c153e/auth-test-model-6c153e-kserve-5f7f5f8c95-dp8sc"
Jul 06 22:55:09.306753 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:55:09.306701    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd6328c4-67f5-4090-aa9a-eb24a1f7e30f-home\") pod \"auth-test-model-6c153e-kserve-5f7f5f8c95-dp8sc\" (UID: \"cd6328c4-67f5-4090-aa9a-eb24a1f7e30f\") " pod="ai-tenant-e2e-shared-b-6c153e/auth-test-model-6c153e-kserve-5f7f5f8c95-dp8sc"
Jul 06 22:55:09.306753 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:55:09.306731    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzdr4\" (UniqueName: \"kubernetes.io/projected/cd6328c4-67f5-4090-aa9a-eb24a1f7e30f-kube-api-access-wzdr4\") pod \"auth-test-model-6c153e-kserve-5f7f5f8c95-dp8sc\" (UID: \"cd6328c4-67f5-4090-aa9a-eb24a1f7e30f\") " pod="ai-tenant-e2e-shared-b-6c153e/auth-test-model-6c153e-kserve-5f7f5f8c95-dp8sc"
Jul 06 22:55:09.307022 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:55:09.306846    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd6328c4-67f5-4090-aa9a-eb24a1f7e30f-model-cache\") pod \"auth-test-model-6c153e-kserve-5f7f5f8c95-dp8sc\" (UID: \"cd6328c4-67f5-4090-aa9a-eb24a1f7e30f\") " pod="ai-tenant-e2e-shared-b-6c153e/auth-test-model-6c153e-kserve-5f7f5f8c95-dp8sc"
Jul 06 22:55:09.407646 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:55:09.407613    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd6328c4-67f5-4090-aa9a-eb24a1f7e30f-model-cache\") pod \"auth-test-model-6c153e-kserve-5f7f5f8c95-dp8sc\" (UID: \"cd6328c4-67f5-4090-aa9a-eb24a1f7e30f\") " pod="ai-tenant-e2e-shared-b-6c153e/auth-test-model-6c153e-kserve-5f7f5f8c95-dp8sc"
Jul 06 22:55:09.407784 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:55:09.407666    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd6328c4-67f5-4090-aa9a-eb24a1f7e30f-dshm\") pod \"auth-test-model-6c153e-kserve-5f7f5f8c95-dp8sc\" (UID: \"cd6328c4-67f5-4090-aa9a-eb24a1f7e30f\") " pod="ai-tenant-e2e-shared-b-6c153e/auth-test-model-6c153e-kserve-5f7f5f8c95-dp8sc"
Jul 06 22:55:09.407784 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:55:09.407693    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd6328c4-67f5-4090-aa9a-eb24a1f7e30f-tls-certs\") pod \"auth-test-model-6c153e-kserve-5f7f5f8c95-dp8sc\" (UID: \"cd6328c4-67f5-4090-aa9a-eb24a1f7e30f\") " pod="ai-tenant-e2e-shared-b-6c153e/auth-test-model-6c153e-kserve-5f7f5f8c95-dp8sc"
Jul 06 22:55:09.407784 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:55:09.407721    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd6328c4-67f5-4090-aa9a-eb24a1f7e30f-tmp-dir\") pod \"auth-test-model-6c153e-kserve-5f7f5f8c95-dp8sc\" (UID: \"cd6328c4-67f5-4090-aa9a-eb24a1f7e30f\") " pod="ai-tenant-e2e-shared-b-6c153e/auth-test-model-6c153e-kserve-5f7f5f8c95-dp8sc"
Jul 06 22:55:09.407950 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:55:09.407784    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd6328c4-67f5-4090-aa9a-eb24a1f7e30f-home\") pod \"auth-test-model-6c153e-kserve-5f7f5f8c95-dp8sc\" (UID: \"cd6328c4-67f5-4090-aa9a-eb24a1f7e30f\") " pod="ai-tenant-e2e-shared-b-6c153e/auth-test-model-6c153e-kserve-5f7f5f8c95-dp8sc"
Jul 06 22:55:09.407950 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:55:09.407811    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzdr4\" (UniqueName: \"kubernetes.io/projected/cd6328c4-67f5-4090-aa9a-eb24a1f7e30f-kube-api-access-wzdr4\") pod \"auth-test-model-6c153e-kserve-5f7f5f8c95-dp8sc\" (UID: \"cd6328c4-67f5-4090-aa9a-eb24a1f7e30f\") " pod="ai-tenant-e2e-shared-b-6c153e/auth-test-model-6c153e-kserve-5f7f5f8c95-dp8sc"
Jul 06 22:55:09.408087 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:55:09.408056    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd6328c4-67f5-4090-aa9a-eb24a1f7e30f-model-cache\") pod \"auth-test-model-6c153e-kserve-5f7f5f8c95-dp8sc\" (UID: \"cd6328c4-67f5-4090-aa9a-eb24a1f7e30f\") " pod="ai-tenant-e2e-shared-b-6c153e/auth-test-model-6c153e-kserve-5f7f5f8c95-dp8sc"
Jul 06 22:55:09.408224 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:55:09.408138    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd6328c4-67f5-4090-aa9a-eb24a1f7e30f-tmp-dir\") pod \"auth-test-model-6c153e-kserve-5f7f5f8c95-dp8sc\" (UID: \"cd6328c4-67f5-4090-aa9a-eb24a1f7e30f\") " pod="ai-tenant-e2e-shared-b-6c153e/auth-test-model-6c153e-kserve-5f7f5f8c95-dp8sc"
Jul 06 22:55:09.408288 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:55:09.408267    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd6328c4-67f5-4090-aa9a-eb24a1f7e30f-home\") pod \"auth-test-model-6c153e-kserve-5f7f5f8c95-dp8sc\" (UID: \"cd6328c4-67f5-4090-aa9a-eb24a1f7e30f\") " pod="ai-tenant-e2e-shared-b-6c153e/auth-test-model-6c153e-kserve-5f7f5f8c95-dp8sc"
Jul 06 22:55:09.409985 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:55:09.409963    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd6328c4-67f5-4090-aa9a-eb24a1f7e30f-dshm\") pod \"auth-test-model-6c153e-kserve-5f7f5f8c95-dp8sc\" (UID: \"cd6328c4-67f5-4090-aa9a-eb24a1f7e30f\") " pod="ai-tenant-e2e-shared-b-6c153e/auth-test-model-6c153e-kserve-5f7f5f8c95-dp8sc"
Jul 06 22:55:09.410279 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:55:09.410260    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd6328c4-67f5-4090-aa9a-eb24a1f7e30f-tls-certs\") pod \"auth-test-model-6c153e-kserve-5f7f5f8c95-dp8sc\" (UID: \"cd6328c4-67f5-4090-aa9a-eb24a1f7e30f\") " pod="ai-tenant-e2e-shared-b-6c153e/auth-test-model-6c153e-kserve-5f7f5f8c95-dp8sc"
Jul 06 22:55:09.417142 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:55:09.417086    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzdr4\" (UniqueName: \"kubernetes.io/projected/cd6328c4-67f5-4090-aa9a-eb24a1f7e30f-kube-api-access-wzdr4\") pod \"auth-test-model-6c153e-kserve-5f7f5f8c95-dp8sc\" (UID: \"cd6328c4-67f5-4090-aa9a-eb24a1f7e30f\") " pod="ai-tenant-e2e-shared-b-6c153e/auth-test-model-6c153e-kserve-5f7f5f8c95-dp8sc"
Jul 06 22:55:09.526751 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:55:09.526732    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6c153e/auth-test-model-6c153e-kserve-5f7f5f8c95-dp8sc"
Jul 06 22:55:09.659581 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:55:09.659542    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-6c153e/auth-test-model-6c153e-kserve-5f7f5f8c95-dp8sc"]
Jul 06 22:55:09.662539 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:55:09.662518    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcd6328c4_67f5_4090_aa9a_eb24a1f7e30f.slice/crio-7e0790a81d6cd95f5d1560157533fd890ed0199c7fd7d74fb5b416a393341e17 WatchSource:0}: Error finding container 7e0790a81d6cd95f5d1560157533fd890ed0199c7fd7d74fb5b416a393341e17: Status 404 returned error can't find the container with id 7e0790a81d6cd95f5d1560157533fd890ed0199c7fd7d74fb5b416a393341e17
Jul 06 22:55:09.684143 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:55:09.684116    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6c153e/auth-test-model-6c153e-kserve-5f7f5f8c95-dp8sc" event={"ID":"cd6328c4-67f5-4090-aa9a-eb24a1f7e30f","Type":"ContainerStarted","Data":"7e0790a81d6cd95f5d1560157533fd890ed0199c7fd7d74fb5b416a393341e17"}
Jul 06 22:55:10.689931 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:55:10.689896    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6c153e/auth-test-model-6c153e-kserve-5f7f5f8c95-dp8sc" event={"ID":"cd6328c4-67f5-4090-aa9a-eb24a1f7e30f","Type":"ContainerStarted","Data":"957a77e49dff64875854148cf5cc159ef4b976a8d991c919e3b41626fab1a472"}
Jul 06 22:55:10.709634 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:55:10.709585    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-6c153e/auth-test-model-6c153e-kserve-5f7f5f8c95-dp8sc" podStartSLOduration=1.709567472 podStartE2EDuration="1.709567472s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:55:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:55:10.70908962 +0000 UTC m=+2111.497112544" watchObservedRunningTime="2026-07-06 22:55:10.709567472 +0000 UTC m=+2111.497590405"
Jul 06 22:55:12.891964 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:55:12.891933    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:55:19.527638 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:55:19.527608    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-6c153e/auth-test-model-6c153e-kserve-5f7f5f8c95-dp8sc"
Jul 06 22:55:19.527638 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:55:19.527647    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-6c153e/auth-test-model-6c153e-kserve-5f7f5f8c95-dp8sc"
Jul 06 22:55:19.539914 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:55:19.539889    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-6c153e/auth-test-model-6c153e-kserve-5f7f5f8c95-dp8sc"
Jul 06 22:55:19.739195 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:55:19.739172    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-6c153e/auth-test-model-6c153e-kserve-5f7f5f8c95-dp8sc"
Jul 06 22:55:25.711125 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:55:25.711081    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:55:42.290450 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:55:42.290414    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:55:55.798648 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:55:55.798568    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:56:12.692821 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:56:12.692785    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:56:30.988131 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:56:30.988079    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:56:49.299572 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:56:49.299535    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:57:06.390167 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:57:06.390131    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:57:16.842114 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:57:16.842062    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-6c153e/auth-test-model-6c153e-kserve-5f7f5f8c95-dp8sc"]
Jul 06 22:57:20.194929 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:57:20.194900    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:57:26.425866 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:57:26.425834    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-2ef6a3/sub-test-model-2ef6a3-kserve-5ff8546469-zrt7t"]
Jul 06 22:57:26.429339 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:57:26.429322    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2ef6a3/sub-test-model-2ef6a3-kserve-5ff8546469-zrt7t"
Jul 06 22:57:26.432800 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:57:26.432776    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-2ef6a3\"/\"default-dockercfg-d8nv5\""
Jul 06 22:57:26.432940 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:57:26.432799    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-2ef6a3\"/\"sub-test-model-2ef6a3-kserve-self-signed-certs\""
Jul 06 22:57:26.432940 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:57:26.432847    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-2ef6a3\"/\"kube-root-ca.crt\""
Jul 06 22:57:26.432940 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:57:26.432798    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-2ef6a3\"/\"openshift-service-ca.crt\""
Jul 06 22:57:26.437969 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:57:26.437951    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-2ef6a3/sub-test-model-2ef6a3-kserve-5ff8546469-zrt7t"]
Jul 06 22:57:26.454482 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:57:26.454451    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1910e367-23a7-46bd-af93-e95c4df2e73f-dshm\") pod \"sub-test-model-2ef6a3-kserve-5ff8546469-zrt7t\" (UID: \"1910e367-23a7-46bd-af93-e95c4df2e73f\") " pod="ai-tenant-e2e-shared-a-2ef6a3/sub-test-model-2ef6a3-kserve-5ff8546469-zrt7t"
Jul 06 22:57:26.454596 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:57:26.454491    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzz9c\" (UniqueName: \"kubernetes.io/projected/1910e367-23a7-46bd-af93-e95c4df2e73f-kube-api-access-pzz9c\") pod \"sub-test-model-2ef6a3-kserve-5ff8546469-zrt7t\" (UID: \"1910e367-23a7-46bd-af93-e95c4df2e73f\") " pod="ai-tenant-e2e-shared-a-2ef6a3/sub-test-model-2ef6a3-kserve-5ff8546469-zrt7t"
Jul 06 22:57:26.454596 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:57:26.454562    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1910e367-23a7-46bd-af93-e95c4df2e73f-home\") pod \"sub-test-model-2ef6a3-kserve-5ff8546469-zrt7t\" (UID: \"1910e367-23a7-46bd-af93-e95c4df2e73f\") " pod="ai-tenant-e2e-shared-a-2ef6a3/sub-test-model-2ef6a3-kserve-5ff8546469-zrt7t"
Jul 06 22:57:26.454683 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:57:26.454634    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1910e367-23a7-46bd-af93-e95c4df2e73f-tls-certs\") pod \"sub-test-model-2ef6a3-kserve-5ff8546469-zrt7t\" (UID: \"1910e367-23a7-46bd-af93-e95c4df2e73f\") " pod="ai-tenant-e2e-shared-a-2ef6a3/sub-test-model-2ef6a3-kserve-5ff8546469-zrt7t"
Jul 06 22:57:26.454683 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:57:26.454664    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1910e367-23a7-46bd-af93-e95c4df2e73f-model-cache\") pod \"sub-test-model-2ef6a3-kserve-5ff8546469-zrt7t\" (UID: \"1910e367-23a7-46bd-af93-e95c4df2e73f\") " pod="ai-tenant-e2e-shared-a-2ef6a3/sub-test-model-2ef6a3-kserve-5ff8546469-zrt7t"
Jul 06 22:57:26.454782 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:57:26.454693    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1910e367-23a7-46bd-af93-e95c4df2e73f-tmp-dir\") pod \"sub-test-model-2ef6a3-kserve-5ff8546469-zrt7t\" (UID: \"1910e367-23a7-46bd-af93-e95c4df2e73f\") " pod="ai-tenant-e2e-shared-a-2ef6a3/sub-test-model-2ef6a3-kserve-5ff8546469-zrt7t"
Jul 06 22:57:26.555212 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:57:26.555182    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1910e367-23a7-46bd-af93-e95c4df2e73f-home\") pod \"sub-test-model-2ef6a3-kserve-5ff8546469-zrt7t\" (UID: \"1910e367-23a7-46bd-af93-e95c4df2e73f\") " pod="ai-tenant-e2e-shared-a-2ef6a3/sub-test-model-2ef6a3-kserve-5ff8546469-zrt7t"
Jul 06 22:57:26.555397 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:57:26.555248    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1910e367-23a7-46bd-af93-e95c4df2e73f-tls-certs\") pod \"sub-test-model-2ef6a3-kserve-5ff8546469-zrt7t\" (UID: \"1910e367-23a7-46bd-af93-e95c4df2e73f\") " pod="ai-tenant-e2e-shared-a-2ef6a3/sub-test-model-2ef6a3-kserve-5ff8546469-zrt7t"
Jul 06 22:57:26.555397 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:57:26.555272    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1910e367-23a7-46bd-af93-e95c4df2e73f-model-cache\") pod \"sub-test-model-2ef6a3-kserve-5ff8546469-zrt7t\" (UID: \"1910e367-23a7-46bd-af93-e95c4df2e73f\") " pod="ai-tenant-e2e-shared-a-2ef6a3/sub-test-model-2ef6a3-kserve-5ff8546469-zrt7t"
Jul 06 22:57:26.555397 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:57:26.555297    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1910e367-23a7-46bd-af93-e95c4df2e73f-tmp-dir\") pod \"sub-test-model-2ef6a3-kserve-5ff8546469-zrt7t\" (UID: \"1910e367-23a7-46bd-af93-e95c4df2e73f\") " pod="ai-tenant-e2e-shared-a-2ef6a3/sub-test-model-2ef6a3-kserve-5ff8546469-zrt7t"
Jul 06 22:57:26.555397 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:57:26.555327    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1910e367-23a7-46bd-af93-e95c4df2e73f-dshm\") pod \"sub-test-model-2ef6a3-kserve-5ff8546469-zrt7t\" (UID: \"1910e367-23a7-46bd-af93-e95c4df2e73f\") " pod="ai-tenant-e2e-shared-a-2ef6a3/sub-test-model-2ef6a3-kserve-5ff8546469-zrt7t"
Jul 06 22:57:26.555397 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:57:26.555353    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzz9c\" (UniqueName: \"kubernetes.io/projected/1910e367-23a7-46bd-af93-e95c4df2e73f-kube-api-access-pzz9c\") pod \"sub-test-model-2ef6a3-kserve-5ff8546469-zrt7t\" (UID: \"1910e367-23a7-46bd-af93-e95c4df2e73f\") " pod="ai-tenant-e2e-shared-a-2ef6a3/sub-test-model-2ef6a3-kserve-5ff8546469-zrt7t"
Jul 06 22:57:26.555749 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:57:26.555621    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1910e367-23a7-46bd-af93-e95c4df2e73f-home\") pod \"sub-test-model-2ef6a3-kserve-5ff8546469-zrt7t\" (UID: \"1910e367-23a7-46bd-af93-e95c4df2e73f\") " pod="ai-tenant-e2e-shared-a-2ef6a3/sub-test-model-2ef6a3-kserve-5ff8546469-zrt7t"
Jul 06 22:57:26.555749 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:57:26.555641    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1910e367-23a7-46bd-af93-e95c4df2e73f-tmp-dir\") pod \"sub-test-model-2ef6a3-kserve-5ff8546469-zrt7t\" (UID: \"1910e367-23a7-46bd-af93-e95c4df2e73f\") " pod="ai-tenant-e2e-shared-a-2ef6a3/sub-test-model-2ef6a3-kserve-5ff8546469-zrt7t"
Jul 06 22:57:26.555749 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:57:26.555704    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1910e367-23a7-46bd-af93-e95c4df2e73f-model-cache\") pod \"sub-test-model-2ef6a3-kserve-5ff8546469-zrt7t\" (UID: \"1910e367-23a7-46bd-af93-e95c4df2e73f\") " pod="ai-tenant-e2e-shared-a-2ef6a3/sub-test-model-2ef6a3-kserve-5ff8546469-zrt7t"
Jul 06 22:57:26.557565 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:57:26.557542    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1910e367-23a7-46bd-af93-e95c4df2e73f-dshm\") pod \"sub-test-model-2ef6a3-kserve-5ff8546469-zrt7t\" (UID: \"1910e367-23a7-46bd-af93-e95c4df2e73f\") " pod="ai-tenant-e2e-shared-a-2ef6a3/sub-test-model-2ef6a3-kserve-5ff8546469-zrt7t"
Jul 06 22:57:26.557915 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:57:26.557896    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1910e367-23a7-46bd-af93-e95c4df2e73f-tls-certs\") pod \"sub-test-model-2ef6a3-kserve-5ff8546469-zrt7t\" (UID: \"1910e367-23a7-46bd-af93-e95c4df2e73f\") " pod="ai-tenant-e2e-shared-a-2ef6a3/sub-test-model-2ef6a3-kserve-5ff8546469-zrt7t"
Jul 06 22:57:26.564648 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:57:26.564625    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzz9c\" (UniqueName: \"kubernetes.io/projected/1910e367-23a7-46bd-af93-e95c4df2e73f-kube-api-access-pzz9c\") pod \"sub-test-model-2ef6a3-kserve-5ff8546469-zrt7t\" (UID: \"1910e367-23a7-46bd-af93-e95c4df2e73f\") " pod="ai-tenant-e2e-shared-a-2ef6a3/sub-test-model-2ef6a3-kserve-5ff8546469-zrt7t"
Jul 06 22:57:26.739747 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:57:26.739671    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2ef6a3/sub-test-model-2ef6a3-kserve-5ff8546469-zrt7t"
Jul 06 22:57:26.877411 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:57:26.877388    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-2ef6a3/sub-test-model-2ef6a3-kserve-5ff8546469-zrt7t"]
Jul 06 22:57:26.879568 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:57:26.879545    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1910e367_23a7_46bd_af93_e95c4df2e73f.slice/crio-6238e6a3942de6fac9da6da82b47af800ab0be7be70a581a133e3c1054f9f9da WatchSource:0}: Error finding container 6238e6a3942de6fac9da6da82b47af800ab0be7be70a581a133e3c1054f9f9da: Status 404 returned error can't find the container with id 6238e6a3942de6fac9da6da82b47af800ab0be7be70a581a133e3c1054f9f9da
Jul 06 22:57:27.326537 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:57:27.326504    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2ef6a3/sub-test-model-2ef6a3-kserve-5ff8546469-zrt7t" event={"ID":"1910e367-23a7-46bd-af93-e95c4df2e73f","Type":"ContainerStarted","Data":"b55c4685dc9dffaff6ab8b7a14c833b3bd4801c6ca3ae575ac4afefafc3e1962"}
Jul 06 22:57:27.326537 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:57:27.326543    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2ef6a3/sub-test-model-2ef6a3-kserve-5ff8546469-zrt7t" event={"ID":"1910e367-23a7-46bd-af93-e95c4df2e73f","Type":"ContainerStarted","Data":"6238e6a3942de6fac9da6da82b47af800ab0be7be70a581a133e3c1054f9f9da"}
Jul 06 22:57:27.347537 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:57:27.347489    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-2ef6a3/sub-test-model-2ef6a3-kserve-5ff8546469-zrt7t" podStartSLOduration=1.347476699 podStartE2EDuration="1.347476699s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:57:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:57:27.346854499 +0000 UTC m=+2248.134877433" watchObservedRunningTime="2026-07-06 22:57:27.347476699 +0000 UTC m=+2248.135499632"
Jul 06 22:57:31.862169 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:57:31.862116    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-6c153e/auth-test-model-6c153e-kserve-5f7f5f8c95-dp8sc" podUID="cd6328c4-67f5-4090-aa9a-eb24a1f7e30f" containerName="main" containerID="cri-o://957a77e49dff64875854148cf5cc159ef4b976a8d991c919e3b41626fab1a472" gracePeriod=45
Jul 06 22:57:32.123416 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:57:32.123361    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6c153e/auth-test-model-6c153e-kserve-5f7f5f8c95-dp8sc"
Jul 06 22:57:32.208262 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:57:32.208227    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd6328c4-67f5-4090-aa9a-eb24a1f7e30f-dshm\") pod \"cd6328c4-67f5-4090-aa9a-eb24a1f7e30f\" (UID: \"cd6328c4-67f5-4090-aa9a-eb24a1f7e30f\") "
Jul 06 22:57:32.208445 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:57:32.208274    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd6328c4-67f5-4090-aa9a-eb24a1f7e30f-home\") pod \"cd6328c4-67f5-4090-aa9a-eb24a1f7e30f\" (UID: \"cd6328c4-67f5-4090-aa9a-eb24a1f7e30f\") "
Jul 06 22:57:32.208445 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:57:32.208310    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wzdr4\" (UniqueName: \"kubernetes.io/projected/cd6328c4-67f5-4090-aa9a-eb24a1f7e30f-kube-api-access-wzdr4\") pod \"cd6328c4-67f5-4090-aa9a-eb24a1f7e30f\" (UID: \"cd6328c4-67f5-4090-aa9a-eb24a1f7e30f\") "
Jul 06 22:57:32.208445 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:57:32.208339    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd6328c4-67f5-4090-aa9a-eb24a1f7e30f-tls-certs\") pod \"cd6328c4-67f5-4090-aa9a-eb24a1f7e30f\" (UID: \"cd6328c4-67f5-4090-aa9a-eb24a1f7e30f\") "
Jul 06 22:57:32.208445 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:57:32.208372    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd6328c4-67f5-4090-aa9a-eb24a1f7e30f-tmp-dir\") pod \"cd6328c4-67f5-4090-aa9a-eb24a1f7e30f\" (UID: \"cd6328c4-67f5-4090-aa9a-eb24a1f7e30f\") "
Jul 06 22:57:32.208445 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:57:32.208423    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd6328c4-67f5-4090-aa9a-eb24a1f7e30f-model-cache\") pod \"cd6328c4-67f5-4090-aa9a-eb24a1f7e30f\" (UID: \"cd6328c4-67f5-4090-aa9a-eb24a1f7e30f\") "
Jul 06 22:57:32.208695 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:57:32.208616    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd6328c4-67f5-4090-aa9a-eb24a1f7e30f-home" (OuterVolumeSpecName: "home") pod "cd6328c4-67f5-4090-aa9a-eb24a1f7e30f" (UID: "cd6328c4-67f5-4090-aa9a-eb24a1f7e30f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 22:57:32.208763 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:57:32.208714    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd6328c4-67f5-4090-aa9a-eb24a1f7e30f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "cd6328c4-67f5-4090-aa9a-eb24a1f7e30f" (UID: "cd6328c4-67f5-4090-aa9a-eb24a1f7e30f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 22:57:32.208820 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:57:32.208759    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd6328c4-67f5-4090-aa9a-eb24a1f7e30f-model-cache" (OuterVolumeSpecName: "model-cache") pod "cd6328c4-67f5-4090-aa9a-eb24a1f7e30f" (UID: "cd6328c4-67f5-4090-aa9a-eb24a1f7e30f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 22:57:32.210548 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:57:32.210517    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd6328c4-67f5-4090-aa9a-eb24a1f7e30f-dshm" (OuterVolumeSpecName: "dshm") pod "cd6328c4-67f5-4090-aa9a-eb24a1f7e30f" (UID: "cd6328c4-67f5-4090-aa9a-eb24a1f7e30f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 22:57:32.210647 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:57:32.210556    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd6328c4-67f5-4090-aa9a-eb24a1f7e30f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "cd6328c4-67f5-4090-aa9a-eb24a1f7e30f" (UID: "cd6328c4-67f5-4090-aa9a-eb24a1f7e30f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 22:57:32.210647 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:57:32.210559    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd6328c4-67f5-4090-aa9a-eb24a1f7e30f-kube-api-access-wzdr4" (OuterVolumeSpecName: "kube-api-access-wzdr4") pod "cd6328c4-67f5-4090-aa9a-eb24a1f7e30f" (UID: "cd6328c4-67f5-4090-aa9a-eb24a1f7e30f"). InnerVolumeSpecName "kube-api-access-wzdr4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 22:57:32.309182 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:57:32.309147    2556 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd6328c4-67f5-4090-aa9a-eb24a1f7e30f-dshm\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\""
Jul 06 22:57:32.309182 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:57:32.309176    2556 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd6328c4-67f5-4090-aa9a-eb24a1f7e30f-home\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\""
Jul 06 22:57:32.309182 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:57:32.309186    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wzdr4\" (UniqueName: \"kubernetes.io/projected/cd6328c4-67f5-4090-aa9a-eb24a1f7e30f-kube-api-access-wzdr4\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\""
Jul 06 22:57:32.309406 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:57:32.309196    2556 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd6328c4-67f5-4090-aa9a-eb24a1f7e30f-tls-certs\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\""
Jul 06 22:57:32.309406 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:57:32.309205    2556 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd6328c4-67f5-4090-aa9a-eb24a1f7e30f-tmp-dir\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\""
Jul 06 22:57:32.309406 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:57:32.309212    2556 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd6328c4-67f5-4090-aa9a-eb24a1f7e30f-model-cache\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\""
Jul 06 22:57:32.350113 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:57:32.350074    2556 generic.go:356] "Generic (PLEG): container finished" podID="cd6328c4-67f5-4090-aa9a-eb24a1f7e30f" containerID="957a77e49dff64875854148cf5cc159ef4b976a8d991c919e3b41626fab1a472" exitCode=0
Jul 06 22:57:32.350259 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:57:32.350146    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6c153e/auth-test-model-6c153e-kserve-5f7f5f8c95-dp8sc"
Jul 06 22:57:32.350259 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:57:32.350165    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6c153e/auth-test-model-6c153e-kserve-5f7f5f8c95-dp8sc" event={"ID":"cd6328c4-67f5-4090-aa9a-eb24a1f7e30f","Type":"ContainerDied","Data":"957a77e49dff64875854148cf5cc159ef4b976a8d991c919e3b41626fab1a472"}
Jul 06 22:57:32.350259 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:57:32.350211    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6c153e/auth-test-model-6c153e-kserve-5f7f5f8c95-dp8sc" event={"ID":"cd6328c4-67f5-4090-aa9a-eb24a1f7e30f","Type":"ContainerDied","Data":"7e0790a81d6cd95f5d1560157533fd890ed0199c7fd7d74fb5b416a393341e17"}
Jul 06 22:57:32.350259 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:57:32.350228    2556 scope.go:117] "RemoveContainer" containerID="957a77e49dff64875854148cf5cc159ef4b976a8d991c919e3b41626fab1a472"
Jul 06 22:57:32.359179 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:57:32.359161    2556 scope.go:117] "RemoveContainer" containerID="957a77e49dff64875854148cf5cc159ef4b976a8d991c919e3b41626fab1a472"
Jul 06 22:57:32.359425 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:57:32.359406    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"957a77e49dff64875854148cf5cc159ef4b976a8d991c919e3b41626fab1a472\": container with ID starting with 957a77e49dff64875854148cf5cc159ef4b976a8d991c919e3b41626fab1a472 not found: ID does not exist" containerID="957a77e49dff64875854148cf5cc159ef4b976a8d991c919e3b41626fab1a472"
Jul 06 22:57:32.359477 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:57:32.359434    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"957a77e49dff64875854148cf5cc159ef4b976a8d991c919e3b41626fab1a472"} err="failed to get container status \"957a77e49dff64875854148cf5cc159ef4b976a8d991c919e3b41626fab1a472\": rpc error: code = NotFound desc = could not find container \"957a77e49dff64875854148cf5cc159ef4b976a8d991c919e3b41626fab1a472\": container with ID starting with 957a77e49dff64875854148cf5cc159ef4b976a8d991c919e3b41626fab1a472 not found: ID does not exist"
Jul 06 22:57:32.372685 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:57:32.372660    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-6c153e/auth-test-model-6c153e-kserve-5f7f5f8c95-dp8sc"]
Jul 06 22:57:32.377614 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:57:32.377556    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-6c153e/auth-test-model-6c153e-kserve-5f7f5f8c95-dp8sc"]
Jul 06 22:57:33.652690 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:57:33.652658    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd6328c4-67f5-4090-aa9a-eb24a1f7e30f" path="/var/lib/kubelet/pods/cd6328c4-67f5-4090-aa9a-eb24a1f7e30f/volumes"
Jul 06 22:57:36.740846 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:57:36.740805    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-2ef6a3/sub-test-model-2ef6a3-kserve-5ff8546469-zrt7t"
Jul 06 22:57:36.740846 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:57:36.740858    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-2ef6a3/sub-test-model-2ef6a3-kserve-5ff8546469-zrt7t"
Jul 06 22:57:36.753477 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:57:36.753451    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-2ef6a3/sub-test-model-2ef6a3-kserve-5ff8546469-zrt7t"
Jul 06 22:57:37.385758 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:57:37.385734    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-2ef6a3/sub-test-model-2ef6a3-kserve-5ff8546469-zrt7t"
Jul 06 22:57:38.698614 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:57:38.698576    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:57:58.106734 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:57:58.106695    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:58:27.221444 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:58:27.221406    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:58:45.501742 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:58:45.501707    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:58:51.296240 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:58:51.296205    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-2ef6a3/sub-test-model-2ef6a3-kserve-5ff8546469-zrt7t"]
Jul 06 22:58:58.034947 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:58:58.034915    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-2ef6a3/rate-test-model-2ef6a3-kserve-dfb778847-fjxth"]
Jul 06 22:58:58.035463 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:58:58.035312    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd6328c4-67f5-4090-aa9a-eb24a1f7e30f" containerName="main"
Jul 06 22:58:58.035463 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:58:58.035324    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd6328c4-67f5-4090-aa9a-eb24a1f7e30f" containerName="main"
Jul 06 22:58:58.035463 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:58:58.035405    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd6328c4-67f5-4090-aa9a-eb24a1f7e30f" containerName="main"
Jul 06 22:58:58.038425 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:58:58.038408    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2ef6a3/rate-test-model-2ef6a3-kserve-dfb778847-fjxth"
Jul 06 22:58:58.040667 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:58:58.040645    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-2ef6a3\"/\"rate-test-model-2ef6a3-kserve-self-signed-certs\""
Jul 06 22:58:58.047853 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:58:58.047831    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-2ef6a3/rate-test-model-2ef6a3-kserve-dfb778847-fjxth"]
Jul 06 22:58:58.100706 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:58:58.100674    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b956a9c-7e5c-4068-ae90-e6e28475072a-tmp-dir\") pod \"rate-test-model-2ef6a3-kserve-dfb778847-fjxth\" (UID: \"6b956a9c-7e5c-4068-ae90-e6e28475072a\") " pod="ai-tenant-e2e-shared-a-2ef6a3/rate-test-model-2ef6a3-kserve-dfb778847-fjxth"
Jul 06 22:58:58.100862 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:58:58.100714    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b956a9c-7e5c-4068-ae90-e6e28475072a-model-cache\") pod \"rate-test-model-2ef6a3-kserve-dfb778847-fjxth\" (UID: \"6b956a9c-7e5c-4068-ae90-e6e28475072a\") " pod="ai-tenant-e2e-shared-a-2ef6a3/rate-test-model-2ef6a3-kserve-dfb778847-fjxth"
Jul 06 22:58:58.100862 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:58:58.100735    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b956a9c-7e5c-4068-ae90-e6e28475072a-home\") pod \"rate-test-model-2ef6a3-kserve-dfb778847-fjxth\" (UID: \"6b956a9c-7e5c-4068-ae90-e6e28475072a\") " pod="ai-tenant-e2e-shared-a-2ef6a3/rate-test-model-2ef6a3-kserve-dfb778847-fjxth"
Jul 06 22:58:58.100862 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:58:58.100842    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b956a9c-7e5c-4068-ae90-e6e28475072a-tls-certs\") pod \"rate-test-model-2ef6a3-kserve-dfb778847-fjxth\" (UID: \"6b956a9c-7e5c-4068-ae90-e6e28475072a\") " pod="ai-tenant-e2e-shared-a-2ef6a3/rate-test-model-2ef6a3-kserve-dfb778847-fjxth"
Jul 06 22:58:58.101033 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:58:58.100902    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b956a9c-7e5c-4068-ae90-e6e28475072a-dshm\") pod \"rate-test-model-2ef6a3-kserve-dfb778847-fjxth\" (UID: \"6b956a9c-7e5c-4068-ae90-e6e28475072a\") " pod="ai-tenant-e2e-shared-a-2ef6a3/rate-test-model-2ef6a3-kserve-dfb778847-fjxth"
Jul 06 22:58:58.101033 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:58:58.100996    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48576\" (UniqueName: \"kubernetes.io/projected/6b956a9c-7e5c-4068-ae90-e6e28475072a-kube-api-access-48576\") pod \"rate-test-model-2ef6a3-kserve-dfb778847-fjxth\" (UID: \"6b956a9c-7e5c-4068-ae90-e6e28475072a\") " pod="ai-tenant-e2e-shared-a-2ef6a3/rate-test-model-2ef6a3-kserve-dfb778847-fjxth"
Jul 06 22:58:58.201749 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:58:58.201714    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b956a9c-7e5c-4068-ae90-e6e28475072a-dshm\") pod \"rate-test-model-2ef6a3-kserve-dfb778847-fjxth\" (UID: \"6b956a9c-7e5c-4068-ae90-e6e28475072a\") " pod="ai-tenant-e2e-shared-a-2ef6a3/rate-test-model-2ef6a3-kserve-dfb778847-fjxth"
Jul 06 22:58:58.201930 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:58:58.201779    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48576\" (UniqueName: \"kubernetes.io/projected/6b956a9c-7e5c-4068-ae90-e6e28475072a-kube-api-access-48576\") pod \"rate-test-model-2ef6a3-kserve-dfb778847-fjxth\" (UID: \"6b956a9c-7e5c-4068-ae90-e6e28475072a\") " pod="ai-tenant-e2e-shared-a-2ef6a3/rate-test-model-2ef6a3-kserve-dfb778847-fjxth"
Jul 06 22:58:58.201930 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:58:58.201810    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b956a9c-7e5c-4068-ae90-e6e28475072a-tmp-dir\") pod \"rate-test-model-2ef6a3-kserve-dfb778847-fjxth\" (UID: \"6b956a9c-7e5c-4068-ae90-e6e28475072a\") " pod="ai-tenant-e2e-shared-a-2ef6a3/rate-test-model-2ef6a3-kserve-dfb778847-fjxth"
Jul 06 22:58:58.201930 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:58:58.201906    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b956a9c-7e5c-4068-ae90-e6e28475072a-model-cache\") pod \"rate-test-model-2ef6a3-kserve-dfb778847-fjxth\" (UID: \"6b956a9c-7e5c-4068-ae90-e6e28475072a\") " pod="ai-tenant-e2e-shared-a-2ef6a3/rate-test-model-2ef6a3-kserve-dfb778847-fjxth"
Jul 06 22:58:58.202110 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:58:58.201951    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b956a9c-7e5c-4068-ae90-e6e28475072a-home\") pod \"rate-test-model-2ef6a3-kserve-dfb778847-fjxth\" (UID: \"6b956a9c-7e5c-4068-ae90-e6e28475072a\") " pod="ai-tenant-e2e-shared-a-2ef6a3/rate-test-model-2ef6a3-kserve-dfb778847-fjxth"
Jul 06 22:58:58.202110 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:58:58.202000    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b956a9c-7e5c-4068-ae90-e6e28475072a-tls-certs\") pod \"rate-test-model-2ef6a3-kserve-dfb778847-fjxth\" (UID: \"6b956a9c-7e5c-4068-ae90-e6e28475072a\") " pod="ai-tenant-e2e-shared-a-2ef6a3/rate-test-model-2ef6a3-kserve-dfb778847-fjxth"
Jul 06 22:58:58.202232 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:58:58.202213    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b956a9c-7e5c-4068-ae90-e6e28475072a-tmp-dir\") pod \"rate-test-model-2ef6a3-kserve-dfb778847-fjxth\" (UID: \"6b956a9c-7e5c-4068-ae90-e6e28475072a\") " pod="ai-tenant-e2e-shared-a-2ef6a3/rate-test-model-2ef6a3-kserve-dfb778847-fjxth"
Jul 06 22:58:58.202308 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:58:58.202289    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b956a9c-7e5c-4068-ae90-e6e28475072a-model-cache\") pod \"rate-test-model-2ef6a3-kserve-dfb778847-fjxth\" (UID: \"6b956a9c-7e5c-4068-ae90-e6e28475072a\") " pod="ai-tenant-e2e-shared-a-2ef6a3/rate-test-model-2ef6a3-kserve-dfb778847-fjxth"
Jul 06 22:58:58.202346 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:58:58.202317    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b956a9c-7e5c-4068-ae90-e6e28475072a-home\") pod \"rate-test-model-2ef6a3-kserve-dfb778847-fjxth\" (UID: \"6b956a9c-7e5c-4068-ae90-e6e28475072a\") " pod="ai-tenant-e2e-shared-a-2ef6a3/rate-test-model-2ef6a3-kserve-dfb778847-fjxth"
Jul 06 22:58:58.203988 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:58:58.203965    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b956a9c-7e5c-4068-ae90-e6e28475072a-dshm\") pod \"rate-test-model-2ef6a3-kserve-dfb778847-fjxth\" (UID: \"6b956a9c-7e5c-4068-ae90-e6e28475072a\") " pod="ai-tenant-e2e-shared-a-2ef6a3/rate-test-model-2ef6a3-kserve-dfb778847-fjxth"
Jul 06 22:58:58.204360 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:58:58.204344    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b956a9c-7e5c-4068-ae90-e6e28475072a-tls-certs\") pod \"rate-test-model-2ef6a3-kserve-dfb778847-fjxth\" (UID: \"6b956a9c-7e5c-4068-ae90-e6e28475072a\") " pod="ai-tenant-e2e-shared-a-2ef6a3/rate-test-model-2ef6a3-kserve-dfb778847-fjxth"
Jul 06 22:58:58.211340 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:58:58.211319    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-48576\" (UniqueName: \"kubernetes.io/projected/6b956a9c-7e5c-4068-ae90-e6e28475072a-kube-api-access-48576\") pod \"rate-test-model-2ef6a3-kserve-dfb778847-fjxth\" (UID: \"6b956a9c-7e5c-4068-ae90-e6e28475072a\") " pod="ai-tenant-e2e-shared-a-2ef6a3/rate-test-model-2ef6a3-kserve-dfb778847-fjxth"
Jul 06 22:58:58.348338 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:58:58.348249    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2ef6a3/rate-test-model-2ef6a3-kserve-dfb778847-fjxth"
Jul 06 22:58:58.479973 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:58:58.479944    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-2ef6a3/rate-test-model-2ef6a3-kserve-dfb778847-fjxth"]
Jul 06 22:58:58.482091 ip-10-0-141-52 kubenswrapper[2556]: W0706 22:58:58.482064    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6b956a9c_7e5c_4068_ae90_e6e28475072a.slice/crio-d892711ca7987ee58bf6bb6e34532e76fbbc1ac3507624d4845287dff72062fe WatchSource:0}: Error finding container d892711ca7987ee58bf6bb6e34532e76fbbc1ac3507624d4845287dff72062fe: Status 404 returned error can't find the container with id d892711ca7987ee58bf6bb6e34532e76fbbc1ac3507624d4845287dff72062fe
Jul 06 22:58:58.758797 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:58:58.758716    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2ef6a3/rate-test-model-2ef6a3-kserve-dfb778847-fjxth" event={"ID":"6b956a9c-7e5c-4068-ae90-e6e28475072a","Type":"ContainerStarted","Data":"edba25a6922e2705971cda92d2430bd83a404d90a2eb0b48d2cbcaaf7d342faa"}
Jul 06 22:58:58.758797 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:58:58.758758    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2ef6a3/rate-test-model-2ef6a3-kserve-dfb778847-fjxth" event={"ID":"6b956a9c-7e5c-4068-ae90-e6e28475072a","Type":"ContainerStarted","Data":"d892711ca7987ee58bf6bb6e34532e76fbbc1ac3507624d4845287dff72062fe"}
Jul 06 22:58:58.777183 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:58:58.777139    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-2ef6a3/rate-test-model-2ef6a3-kserve-dfb778847-fjxth" podStartSLOduration=0.777124632 podStartE2EDuration="777.124632ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:58:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:58:58.775712204 +0000 UTC m=+2339.563735136" watchObservedRunningTime="2026-07-06 22:58:58.777124632 +0000 UTC m=+2339.565147559"
Jul 06 22:59:02.699759 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:59:02.699724    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:59:06.316685 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:59:06.316639    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-2ef6a3/sub-test-model-2ef6a3-kserve-5ff8546469-zrt7t" podUID="1910e367-23a7-46bd-af93-e95c4df2e73f" containerName="main" containerID="cri-o://b55c4685dc9dffaff6ab8b7a14c833b3bd4801c6ca3ae575ac4afefafc3e1962" gracePeriod=45
Jul 06 22:59:06.574911 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:59:06.574850    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2ef6a3/sub-test-model-2ef6a3-kserve-5ff8546469-zrt7t"
Jul 06 22:59:06.682457 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:59:06.682426    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1910e367-23a7-46bd-af93-e95c4df2e73f-tls-certs\") pod \"1910e367-23a7-46bd-af93-e95c4df2e73f\" (UID: \"1910e367-23a7-46bd-af93-e95c4df2e73f\") "
Jul 06 22:59:06.682635 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:59:06.682460    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1910e367-23a7-46bd-af93-e95c4df2e73f-dshm\") pod \"1910e367-23a7-46bd-af93-e95c4df2e73f\" (UID: \"1910e367-23a7-46bd-af93-e95c4df2e73f\") "
Jul 06 22:59:06.682635 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:59:06.682483    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1910e367-23a7-46bd-af93-e95c4df2e73f-model-cache\") pod \"1910e367-23a7-46bd-af93-e95c4df2e73f\" (UID: \"1910e367-23a7-46bd-af93-e95c4df2e73f\") "
Jul 06 22:59:06.682635 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:59:06.682615    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1910e367-23a7-46bd-af93-e95c4df2e73f-tmp-dir\") pod \"1910e367-23a7-46bd-af93-e95c4df2e73f\" (UID: \"1910e367-23a7-46bd-af93-e95c4df2e73f\") "
Jul 06 22:59:06.682814 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:59:06.682668    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pzz9c\" (UniqueName: \"kubernetes.io/projected/1910e367-23a7-46bd-af93-e95c4df2e73f-kube-api-access-pzz9c\") pod \"1910e367-23a7-46bd-af93-e95c4df2e73f\" (UID: \"1910e367-23a7-46bd-af93-e95c4df2e73f\") "
Jul 06 22:59:06.682814 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:59:06.682714    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1910e367-23a7-46bd-af93-e95c4df2e73f-home\") pod \"1910e367-23a7-46bd-af93-e95c4df2e73f\" (UID: \"1910e367-23a7-46bd-af93-e95c4df2e73f\") "
Jul 06 22:59:06.682814 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:59:06.682720    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1910e367-23a7-46bd-af93-e95c4df2e73f-model-cache" (OuterVolumeSpecName: "model-cache") pod "1910e367-23a7-46bd-af93-e95c4df2e73f" (UID: "1910e367-23a7-46bd-af93-e95c4df2e73f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 22:59:06.682959 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:59:06.682871    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1910e367-23a7-46bd-af93-e95c4df2e73f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1910e367-23a7-46bd-af93-e95c4df2e73f" (UID: "1910e367-23a7-46bd-af93-e95c4df2e73f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 22:59:06.683009 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:59:06.682952    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1910e367-23a7-46bd-af93-e95c4df2e73f-home" (OuterVolumeSpecName: "home") pod "1910e367-23a7-46bd-af93-e95c4df2e73f" (UID: "1910e367-23a7-46bd-af93-e95c4df2e73f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 22:59:06.683136 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:59:06.683089    2556 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1910e367-23a7-46bd-af93-e95c4df2e73f-model-cache\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\""
Jul 06 22:59:06.683136 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:59:06.683128    2556 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1910e367-23a7-46bd-af93-e95c4df2e73f-tmp-dir\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\""
Jul 06 22:59:06.683136 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:59:06.683140    2556 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1910e367-23a7-46bd-af93-e95c4df2e73f-home\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\""
Jul 06 22:59:06.684865 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:59:06.684841    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1910e367-23a7-46bd-af93-e95c4df2e73f-kube-api-access-pzz9c" (OuterVolumeSpecName: "kube-api-access-pzz9c") pod "1910e367-23a7-46bd-af93-e95c4df2e73f" (UID: "1910e367-23a7-46bd-af93-e95c4df2e73f"). InnerVolumeSpecName "kube-api-access-pzz9c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 22:59:06.685070 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:59:06.685040    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1910e367-23a7-46bd-af93-e95c4df2e73f-dshm" (OuterVolumeSpecName: "dshm") pod "1910e367-23a7-46bd-af93-e95c4df2e73f" (UID: "1910e367-23a7-46bd-af93-e95c4df2e73f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 22:59:06.685170 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:59:06.685088    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1910e367-23a7-46bd-af93-e95c4df2e73f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1910e367-23a7-46bd-af93-e95c4df2e73f" (UID: "1910e367-23a7-46bd-af93-e95c4df2e73f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 22:59:06.784394 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:59:06.784357    2556 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1910e367-23a7-46bd-af93-e95c4df2e73f-tls-certs\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\""
Jul 06 22:59:06.784394 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:59:06.784389    2556 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1910e367-23a7-46bd-af93-e95c4df2e73f-dshm\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\""
Jul 06 22:59:06.784394 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:59:06.784399    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pzz9c\" (UniqueName: \"kubernetes.io/projected/1910e367-23a7-46bd-af93-e95c4df2e73f-kube-api-access-pzz9c\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\""
Jul 06 22:59:06.800845 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:59:06.800814    2556 generic.go:356] "Generic (PLEG): container finished" podID="1910e367-23a7-46bd-af93-e95c4df2e73f" containerID="b55c4685dc9dffaff6ab8b7a14c833b3bd4801c6ca3ae575ac4afefafc3e1962" exitCode=0
Jul 06 22:59:06.800998 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:59:06.800857    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2ef6a3/sub-test-model-2ef6a3-kserve-5ff8546469-zrt7t"
Jul 06 22:59:06.800998 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:59:06.800864    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2ef6a3/sub-test-model-2ef6a3-kserve-5ff8546469-zrt7t" event={"ID":"1910e367-23a7-46bd-af93-e95c4df2e73f","Type":"ContainerDied","Data":"b55c4685dc9dffaff6ab8b7a14c833b3bd4801c6ca3ae575ac4afefafc3e1962"}
Jul 06 22:59:06.800998 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:59:06.800892    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2ef6a3/sub-test-model-2ef6a3-kserve-5ff8546469-zrt7t" event={"ID":"1910e367-23a7-46bd-af93-e95c4df2e73f","Type":"ContainerDied","Data":"6238e6a3942de6fac9da6da82b47af800ab0be7be70a581a133e3c1054f9f9da"}
Jul 06 22:59:06.800998 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:59:06.800908    2556 scope.go:117] "RemoveContainer" containerID="b55c4685dc9dffaff6ab8b7a14c833b3bd4801c6ca3ae575ac4afefafc3e1962"
Jul 06 22:59:06.809815 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:59:06.809798    2556 scope.go:117] "RemoveContainer" containerID="b55c4685dc9dffaff6ab8b7a14c833b3bd4801c6ca3ae575ac4afefafc3e1962"
Jul 06 22:59:06.810079 ip-10-0-141-52 kubenswrapper[2556]: E0706 22:59:06.810054    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b55c4685dc9dffaff6ab8b7a14c833b3bd4801c6ca3ae575ac4afefafc3e1962\": container with ID starting with b55c4685dc9dffaff6ab8b7a14c833b3bd4801c6ca3ae575ac4afefafc3e1962 not found: ID does not exist" containerID="b55c4685dc9dffaff6ab8b7a14c833b3bd4801c6ca3ae575ac4afefafc3e1962"
Jul 06 22:59:06.810167 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:59:06.810084    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b55c4685dc9dffaff6ab8b7a14c833b3bd4801c6ca3ae575ac4afefafc3e1962"} err="failed to get container status \"b55c4685dc9dffaff6ab8b7a14c833b3bd4801c6ca3ae575ac4afefafc3e1962\": rpc error: code = NotFound desc = could not find container \"b55c4685dc9dffaff6ab8b7a14c833b3bd4801c6ca3ae575ac4afefafc3e1962\": container with ID starting with b55c4685dc9dffaff6ab8b7a14c833b3bd4801c6ca3ae575ac4afefafc3e1962 not found: ID does not exist"
Jul 06 22:59:06.823076 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:59:06.823051    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-2ef6a3/sub-test-model-2ef6a3-kserve-5ff8546469-zrt7t"]
Jul 06 22:59:06.830137 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:59:06.830058    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-2ef6a3/sub-test-model-2ef6a3-kserve-5ff8546469-zrt7t"]
Jul 06 22:59:07.653235 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:59:07.653200    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1910e367-23a7-46bd-af93-e95c4df2e73f" path="/var/lib/kubelet/pods/1910e367-23a7-46bd-af93-e95c4df2e73f/volumes"
Jul 06 22:59:08.348592 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:59:08.348553    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-2ef6a3/rate-test-model-2ef6a3-kserve-dfb778847-fjxth"
Jul 06 22:59:08.348772 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:59:08.348606    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-2ef6a3/rate-test-model-2ef6a3-kserve-dfb778847-fjxth"
Jul 06 22:59:08.361113 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:59:08.361083    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-2ef6a3/rate-test-model-2ef6a3-kserve-dfb778847-fjxth"
Jul 06 22:59:08.822555 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:59:08.822526    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-2ef6a3/rate-test-model-2ef6a3-kserve-dfb778847-fjxth"
Jul 06 22:59:29.307797 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:59:29.307761    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:59:46.194059 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:59:46.194017    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 22:59:59.790156 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:59:59.790130    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mxl25_49cd65b9-2343-4e21-8907-73358ec673ee/ovn-acl-logging/0.log"
Jul 06 22:59:59.795053 ip-10-0-141-52 kubenswrapper[2556]: I0706 22:59:59.795029    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mxl25_49cd65b9-2343-4e21-8907-73358ec673ee/ovn-acl-logging/0.log"
Jul 06 23:00:00.138148 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:00:00.138051    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-6c153e-29722980-vkmz6"]
Jul 06 23:00:00.138448 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:00:00.138436    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1910e367-23a7-46bd-af93-e95c4df2e73f" containerName="main"
Jul 06 23:00:00.138495 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:00:00.138449    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="1910e367-23a7-46bd-af93-e95c4df2e73f" containerName="main"
Jul 06 23:00:00.138533 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:00:00.138506    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="1910e367-23a7-46bd-af93-e95c4df2e73f" containerName="main"
Jul 06 23:00:00.142666 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:00:00.142650    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-6c153e-29722980-vkmz6"
Jul 06 23:00:00.146049 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:00:00.146018    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-98x7w\""
Jul 06 23:00:00.151457 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:00:00.151428    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-6c153e-29722980-vkmz6"]
Jul 06 23:00:00.274016 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:00:00.273983    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzztx\" (UniqueName: \"kubernetes.io/projected/1ed3ba88-1533-4a6e-9580-9487274d3948-kube-api-access-nzztx\") pod \"maas-api-key-cleanup-e2e-shared-b-6c153e-29722980-vkmz6\" (UID: \"1ed3ba88-1533-4a6e-9580-9487274d3948\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-6c153e-29722980-vkmz6"
Jul 06 23:00:00.375091 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:00:00.375052    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzztx\" (UniqueName: \"kubernetes.io/projected/1ed3ba88-1533-4a6e-9580-9487274d3948-kube-api-access-nzztx\") pod \"maas-api-key-cleanup-e2e-shared-b-6c153e-29722980-vkmz6\" (UID: \"1ed3ba88-1533-4a6e-9580-9487274d3948\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-6c153e-29722980-vkmz6"
Jul 06 23:00:00.384866 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:00:00.384833    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzztx\" (UniqueName: \"kubernetes.io/projected/1ed3ba88-1533-4a6e-9580-9487274d3948-kube-api-access-nzztx\") pod \"maas-api-key-cleanup-e2e-shared-b-6c153e-29722980-vkmz6\" (UID: \"1ed3ba88-1533-4a6e-9580-9487274d3948\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-6c153e-29722980-vkmz6"
Jul 06 23:00:00.454653 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:00:00.454571    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-6c153e-29722980-vkmz6"
Jul 06 23:00:00.594219 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:00:00.594186    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-6c153e-29722980-vkmz6"]
Jul 06 23:00:00.595710 ip-10-0-141-52 kubenswrapper[2556]: W0706 23:00:00.595678    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ed3ba88_1533_4a6e_9580_9487274d3948.slice/crio-05a57597c1cc70de03705cdd925b4e957c27f8cb1225bbdc3296fa95298f98f9 WatchSource:0}: Error finding container 05a57597c1cc70de03705cdd925b4e957c27f8cb1225bbdc3296fa95298f98f9: Status 404 returned error can't find the container with id 05a57597c1cc70de03705cdd925b4e957c27f8cb1225bbdc3296fa95298f98f9
Jul 06 23:00:00.597663 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:00:00.597646    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 23:00:01.060333 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:00:01.060301    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-6c153e-29722980-vkmz6" event={"ID":"1ed3ba88-1533-4a6e-9580-9487274d3948","Type":"ContainerStarted","Data":"05a57597c1cc70de03705cdd925b4e957c27f8cb1225bbdc3296fa95298f98f9"}
Jul 06 23:00:01.791600 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:00:01.791570    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 23:00:08.409248 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:00:08.409209    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-2ef6a3/rate-test-model-2ef6a3-kserve-dfb778847-fjxth"]
Jul 06 23:00:10.105019 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:00:10.104928    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-6c153e-29722980-vkmz6" event={"ID":"1ed3ba88-1533-4a6e-9580-9487274d3948","Type":"ContainerStarted","Data":"5c3bd518c97f687bf69c9cb498d90af9680882601323682d3135523c66e3826c"}
Jul 06 23:00:10.124480 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:00:10.124434    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-6c153e-29722980-vkmz6" podStartSLOduration=1.151601118 podStartE2EDuration="10.124419325s" totalImagesPullingTime="8.972818207s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:00:10.123151789 +0000 UTC m=+2410.911174723" watchObservedRunningTime="2026-07-06 23:00:10.124419325 +0000 UTC m=+2410.912442258"
Jul 06 23:00:11.110927 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:00:11.110896    2556 generic.go:356] "Generic (PLEG): container finished" podID="1ed3ba88-1533-4a6e-9580-9487274d3948" containerID="5c3bd518c97f687bf69c9cb498d90af9680882601323682d3135523c66e3826c" exitCode=0
Jul 06 23:00:11.111373 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:00:11.110982    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-6c153e-29722980-vkmz6" event={"ID":"1ed3ba88-1533-4a6e-9580-9487274d3948","Type":"ContainerDied","Data":"5c3bd518c97f687bf69c9cb498d90af9680882601323682d3135523c66e3826c"}
Jul 06 23:00:12.245889 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:00:12.245866    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-6c153e-29722980-vkmz6"
Jul 06 23:00:12.394957 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:00:12.394872    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nzztx\" (UniqueName: \"kubernetes.io/projected/1ed3ba88-1533-4a6e-9580-9487274d3948-kube-api-access-nzztx\") pod \"1ed3ba88-1533-4a6e-9580-9487274d3948\" (UID: \"1ed3ba88-1533-4a6e-9580-9487274d3948\") "
Jul 06 23:00:12.397091 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:00:12.397058    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ed3ba88-1533-4a6e-9580-9487274d3948-kube-api-access-nzztx" (OuterVolumeSpecName: "kube-api-access-nzztx") pod "1ed3ba88-1533-4a6e-9580-9487274d3948" (UID: "1ed3ba88-1533-4a6e-9580-9487274d3948"). InnerVolumeSpecName "kube-api-access-nzztx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 23:00:12.496431 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:00:12.496396    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nzztx\" (UniqueName: \"kubernetes.io/projected/1ed3ba88-1533-4a6e-9580-9487274d3948-kube-api-access-nzztx\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\""
Jul 06 23:00:13.122334 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:00:13.122304    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-6c153e-29722980-vkmz6"
Jul 06 23:00:13.122498 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:00:13.122344    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-6c153e-29722980-vkmz6" event={"ID":"1ed3ba88-1533-4a6e-9580-9487274d3948","Type":"ContainerDied","Data":"05a57597c1cc70de03705cdd925b4e957c27f8cb1225bbdc3296fa95298f98f9"}
Jul 06 23:00:13.122498 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:00:13.122386    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="05a57597c1cc70de03705cdd925b4e957c27f8cb1225bbdc3296fa95298f98f9"
Jul 06 23:00:14.990195 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:00:14.990162    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 23:00:23.434398 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:00:23.434312    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-2ef6a3/rate-test-model-2ef6a3-kserve-dfb778847-fjxth" podUID="6b956a9c-7e5c-4068-ae90-e6e28475072a" containerName="main" containerID="cri-o://edba25a6922e2705971cda92d2430bd83a404d90a2eb0b48d2cbcaaf7d342faa" gracePeriod=45
Jul 06 23:00:23.677555 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:00:23.677532    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2ef6a3/rate-test-model-2ef6a3-kserve-dfb778847-fjxth"
Jul 06 23:00:23.693613 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:00:23.693549    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b956a9c-7e5c-4068-ae90-e6e28475072a-tmp-dir\") pod \"6b956a9c-7e5c-4068-ae90-e6e28475072a\" (UID: \"6b956a9c-7e5c-4068-ae90-e6e28475072a\") "
Jul 06 23:00:23.693735 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:00:23.693615    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b956a9c-7e5c-4068-ae90-e6e28475072a-model-cache\") pod \"6b956a9c-7e5c-4068-ae90-e6e28475072a\" (UID: \"6b956a9c-7e5c-4068-ae90-e6e28475072a\") "
Jul 06 23:00:23.693735 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:00:23.693674    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-48576\" (UniqueName: \"kubernetes.io/projected/6b956a9c-7e5c-4068-ae90-e6e28475072a-kube-api-access-48576\") pod \"6b956a9c-7e5c-4068-ae90-e6e28475072a\" (UID: \"6b956a9c-7e5c-4068-ae90-e6e28475072a\") "
Jul 06 23:00:23.693735 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:00:23.693712    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b956a9c-7e5c-4068-ae90-e6e28475072a-home\") pod \"6b956a9c-7e5c-4068-ae90-e6e28475072a\" (UID: \"6b956a9c-7e5c-4068-ae90-e6e28475072a\") "
Jul 06 23:00:23.693886 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:00:23.693736    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b956a9c-7e5c-4068-ae90-e6e28475072a-dshm\") pod \"6b956a9c-7e5c-4068-ae90-e6e28475072a\" (UID: \"6b956a9c-7e5c-4068-ae90-e6e28475072a\") "
Jul 06 23:00:23.693886 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:00:23.693754    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b956a9c-7e5c-4068-ae90-e6e28475072a-tls-certs\") pod \"6b956a9c-7e5c-4068-ae90-e6e28475072a\" (UID: \"6b956a9c-7e5c-4068-ae90-e6e28475072a\") "
Jul 06 23:00:23.693886 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:00:23.693772    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b956a9c-7e5c-4068-ae90-e6e28475072a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6b956a9c-7e5c-4068-ae90-e6e28475072a" (UID: "6b956a9c-7e5c-4068-ae90-e6e28475072a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 23:00:23.694039 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:00:23.693886    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b956a9c-7e5c-4068-ae90-e6e28475072a-model-cache" (OuterVolumeSpecName: "model-cache") pod "6b956a9c-7e5c-4068-ae90-e6e28475072a" (UID: "6b956a9c-7e5c-4068-ae90-e6e28475072a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 23:00:23.694039 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:00:23.693976    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b956a9c-7e5c-4068-ae90-e6e28475072a-home" (OuterVolumeSpecName: "home") pod "6b956a9c-7e5c-4068-ae90-e6e28475072a" (UID: "6b956a9c-7e5c-4068-ae90-e6e28475072a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 23:00:23.694644 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:00:23.694323    2556 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b956a9c-7e5c-4068-ae90-e6e28475072a-model-cache\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\""
Jul 06 23:00:23.694644 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:00:23.694349    2556 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b956a9c-7e5c-4068-ae90-e6e28475072a-home\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\""
Jul 06 23:00:23.694644 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:00:23.694361    2556 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b956a9c-7e5c-4068-ae90-e6e28475072a-tmp-dir\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\""
Jul 06 23:00:23.696414 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:00:23.696386    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b956a9c-7e5c-4068-ae90-e6e28475072a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6b956a9c-7e5c-4068-ae90-e6e28475072a" (UID: "6b956a9c-7e5c-4068-ae90-e6e28475072a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 23:00:23.696787 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:00:23.696760    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b956a9c-7e5c-4068-ae90-e6e28475072a-dshm" (OuterVolumeSpecName: "dshm") pod "6b956a9c-7e5c-4068-ae90-e6e28475072a" (UID: "6b956a9c-7e5c-4068-ae90-e6e28475072a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 23:00:23.697124 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:00:23.697070    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b956a9c-7e5c-4068-ae90-e6e28475072a-kube-api-access-48576" (OuterVolumeSpecName: "kube-api-access-48576") pod "6b956a9c-7e5c-4068-ae90-e6e28475072a" (UID: "6b956a9c-7e5c-4068-ae90-e6e28475072a"). InnerVolumeSpecName "kube-api-access-48576". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 23:00:23.794821 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:00:23.794787    2556 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b956a9c-7e5c-4068-ae90-e6e28475072a-tls-certs\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\""
Jul 06 23:00:23.794821 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:00:23.794812    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-48576\" (UniqueName: \"kubernetes.io/projected/6b956a9c-7e5c-4068-ae90-e6e28475072a-kube-api-access-48576\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\""
Jul 06 23:00:23.794821 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:00:23.794822    2556 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b956a9c-7e5c-4068-ae90-e6e28475072a-dshm\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\""
Jul 06 23:00:24.178174 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:00:24.178139    2556 generic.go:356] "Generic (PLEG): container finished" podID="6b956a9c-7e5c-4068-ae90-e6e28475072a" containerID="edba25a6922e2705971cda92d2430bd83a404d90a2eb0b48d2cbcaaf7d342faa" exitCode=0
Jul 06 23:00:24.178379 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:00:24.178181    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2ef6a3/rate-test-model-2ef6a3-kserve-dfb778847-fjxth"
Jul 06 23:00:24.178379 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:00:24.178197    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2ef6a3/rate-test-model-2ef6a3-kserve-dfb778847-fjxth" event={"ID":"6b956a9c-7e5c-4068-ae90-e6e28475072a","Type":"ContainerDied","Data":"edba25a6922e2705971cda92d2430bd83a404d90a2eb0b48d2cbcaaf7d342faa"}
Jul 06 23:00:24.178379 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:00:24.178236    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2ef6a3/rate-test-model-2ef6a3-kserve-dfb778847-fjxth" event={"ID":"6b956a9c-7e5c-4068-ae90-e6e28475072a","Type":"ContainerDied","Data":"d892711ca7987ee58bf6bb6e34532e76fbbc1ac3507624d4845287dff72062fe"}
Jul 06 23:00:24.178379 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:00:24.178260    2556 scope.go:117] "RemoveContainer" containerID="edba25a6922e2705971cda92d2430bd83a404d90a2eb0b48d2cbcaaf7d342faa"
Jul 06 23:00:24.186833 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:00:24.186814    2556 scope.go:117] "RemoveContainer" containerID="edba25a6922e2705971cda92d2430bd83a404d90a2eb0b48d2cbcaaf7d342faa"
Jul 06 23:00:24.187089 ip-10-0-141-52 kubenswrapper[2556]: E0706 23:00:24.187065    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"edba25a6922e2705971cda92d2430bd83a404d90a2eb0b48d2cbcaaf7d342faa\": container with ID starting with edba25a6922e2705971cda92d2430bd83a404d90a2eb0b48d2cbcaaf7d342faa not found: ID does not exist" containerID="edba25a6922e2705971cda92d2430bd83a404d90a2eb0b48d2cbcaaf7d342faa"
Jul 06 23:00:24.187177 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:00:24.187114    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"edba25a6922e2705971cda92d2430bd83a404d90a2eb0b48d2cbcaaf7d342faa"} err="failed to get container status \"edba25a6922e2705971cda92d2430bd83a404d90a2eb0b48d2cbcaaf7d342faa\": rpc error: code = NotFound desc = could not find container \"edba25a6922e2705971cda92d2430bd83a404d90a2eb0b48d2cbcaaf7d342faa\": container with ID starting with edba25a6922e2705971cda92d2430bd83a404d90a2eb0b48d2cbcaaf7d342faa not found: ID does not exist"
Jul 06 23:00:24.200477 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:00:24.200452    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-2ef6a3/rate-test-model-2ef6a3-kserve-dfb778847-fjxth"]
Jul 06 23:00:24.205728 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:00:24.205707    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-2ef6a3/rate-test-model-2ef6a3-kserve-dfb778847-fjxth"]
Jul 06 23:00:25.652743 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:00:25.652702    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b956a9c-7e5c-4068-ae90-e6e28475072a" path="/var/lib/kubelet/pods/6b956a9c-7e5c-4068-ae90-e6e28475072a/volumes"
Jul 06 23:00:54.467450 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:00:54.467416    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-6c153e-29722980-vkmz6"]
Jul 06 23:00:54.470588 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:00:54.470564    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-6c153e-29722980-vkmz6"]
Jul 06 23:00:55.653521 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:00:55.653482    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ed3ba88-1533-4a6e-9580-9487274d3948" path="/var/lib/kubelet/pods/1ed3ba88-1533-4a6e-9580-9487274d3948/volumes"
Jul 06 23:00:56.403354 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:00:56.403321    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mw659"]
Jul 06 23:01:07.219680 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:07.219653    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c6597d756-4794n_79ee8235-108b-437a-a86a-d42c4fb5d3e0/copy-manifests/0.log"
Jul 06 23:01:07.228146 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:07.228124    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c6597d756-4794n_79ee8235-108b-437a-a86a-d42c4fb5d3e0/manager/0.log"
Jul 06 23:01:09.799313 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:09.799279    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-mw659_ff160115-403c-45dc-8e54-a4d1ba2a7984/limitador/0.log"
Jul 06 23:01:10.288345 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:10.288319    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678hrvw2_cc5b9738-bcee-430e-85f7-a93bb0e97426/istio-proxy/0.log"
Jul 06 23:01:10.420590 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:10.420558    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-7s5dw_12d8be81-9a96-4462-845c-f4539e4e574c/discovery/0.log"
Jul 06 23:01:11.185207 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:11.185176    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-57c9599b87-5gwnz_6d3dbf73-97c0-4313-938f-10000be128f8/router/0.log"
Jul 06 23:01:12.004827 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:12.004800    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-gnz7f_95a0263a-fd3a-4002-ac64-b145b88aa094/main/0.log"
Jul 06 23:01:19.310335 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:19.310306    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-626fl_7ae74a76-a46c-483e-8f38-a4bc4b9f0b03/global-pull-secret-syncer/0.log"
Jul 06 23:01:19.544747 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:19.544713    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-prtqv_bb153ded-966e-45d9-a254-2c3b68f5196d/konnectivity-agent/0.log"
Jul 06 23:01:19.600128 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:19.600025    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-52.ec2.internal_4e0af277c0cb33613563e1e2b5c15bcc/haproxy/0.log"
Jul 06 23:01:25.342088 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:25.342052    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-mw659_ff160115-403c-45dc-8e54-a4d1ba2a7984/limitador/0.log"
Jul 06 23:01:27.233851 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:27.233825    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_03da331d-6638-46c7-82b1-34df8ebc085b/alertmanager/0.log"
Jul 06 23:01:27.263624 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:27.263606    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_03da331d-6638-46c7-82b1-34df8ebc085b/config-reloader/0.log"
Jul 06 23:01:27.295319 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:27.295298    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_03da331d-6638-46c7-82b1-34df8ebc085b/kube-rbac-proxy-web/0.log"
Jul 06 23:01:27.323058 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:27.323034    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_03da331d-6638-46c7-82b1-34df8ebc085b/kube-rbac-proxy/0.log"
Jul 06 23:01:27.358855 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:27.358821    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_03da331d-6638-46c7-82b1-34df8ebc085b/kube-rbac-proxy-metric/0.log"
Jul 06 23:01:27.386241 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:27.386213    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_03da331d-6638-46c7-82b1-34df8ebc085b/prom-label-proxy/0.log"
Jul 06 23:01:27.413316 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:27.413297    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_03da331d-6638-46c7-82b1-34df8ebc085b/init-config-reloader/0.log"
Jul 06 23:01:27.455597 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:27.455571    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-6pj82_74fd4789-fb73-431e-98a6-d4785a776a04/cluster-monitoring-operator/0.log"
Jul 06 23:01:27.581070 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:27.581047    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-574f878cfc-gt2fx_4ed30170-54eb-482a-8a74-7eb82a044d08/metrics-server/0.log"
Jul 06 23:01:27.619207 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:27.619190    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-2gkx6_cd760c0a-43cf-4a91-9004-46309e9fa553/monitoring-plugin/0.log"
Jul 06 23:01:27.868143 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:27.868038    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t92w6_50d6e796-47fe-446b-841e-2af7e38bf5ad/node-exporter/0.log"
Jul 06 23:01:27.895079 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:27.895056    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t92w6_50d6e796-47fe-446b-841e-2af7e38bf5ad/kube-rbac-proxy/0.log"
Jul 06 23:01:27.926845 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:27.926825    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t92w6_50d6e796-47fe-446b-841e-2af7e38bf5ad/init-textfile/0.log"
Jul 06 23:01:28.290422 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:28.290396    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-mgt48_8255ff86-cf58-4957-a4f1-d994d79137a7/prometheus-operator/0.log"
Jul 06 23:01:28.317517 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:28.317488    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-mgt48_8255ff86-cf58-4957-a4f1-d994d79137a7/kube-rbac-proxy/0.log"
Jul 06 23:01:28.349722 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:28.349697    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-95fln_fd85eeec-c642-44d8-a0aa-dc207c328d21/prometheus-operator-admission-webhook/0.log"
Jul 06 23:01:28.381933 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:28.381906    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-55cb77ff94-sd8kq_7ed6a64a-3a0b-4933-b99b-90d8a0c3e1fe/telemeter-client/0.log"
Jul 06 23:01:28.409431 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:28.409409    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-55cb77ff94-sd8kq_7ed6a64a-3a0b-4933-b99b-90d8a0c3e1fe/reload/0.log"
Jul 06 23:01:28.441563 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:28.441541    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-55cb77ff94-sd8kq_7ed6a64a-3a0b-4933-b99b-90d8a0c3e1fe/kube-rbac-proxy/0.log"
Jul 06 23:01:28.474612 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:28.474589    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67b94b7755-9bmsj_71ff7249-17a8-4172-a5ee-4ff3c599bae6/thanos-query/0.log"
Jul 06 23:01:28.504601 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:28.504574    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67b94b7755-9bmsj_71ff7249-17a8-4172-a5ee-4ff3c599bae6/kube-rbac-proxy-web/0.log"
Jul 06 23:01:28.532055 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:28.532027    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67b94b7755-9bmsj_71ff7249-17a8-4172-a5ee-4ff3c599bae6/kube-rbac-proxy/0.log"
Jul 06 23:01:28.564297 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:28.564223    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67b94b7755-9bmsj_71ff7249-17a8-4172-a5ee-4ff3c599bae6/prom-label-proxy/0.log"
Jul 06 23:01:28.596646 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:28.596619    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67b94b7755-9bmsj_71ff7249-17a8-4172-a5ee-4ff3c599bae6/kube-rbac-proxy-rules/0.log"
Jul 06 23:01:28.623492 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:28.623467    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67b94b7755-9bmsj_71ff7249-17a8-4172-a5ee-4ff3c599bae6/kube-rbac-proxy-metrics/0.log"
Jul 06 23:01:29.323182 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:29.323150    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-59pq4/perf-node-gather-daemonset-8nxvr"]
Jul 06 23:01:29.323731 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:29.323709    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ed3ba88-1533-4a6e-9580-9487274d3948" containerName="cleanup"
Jul 06 23:01:29.323731 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:29.323732    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ed3ba88-1533-4a6e-9580-9487274d3948" containerName="cleanup"
Jul 06 23:01:29.323855 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:29.323748    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b956a9c-7e5c-4068-ae90-e6e28475072a" containerName="main"
Jul 06 23:01:29.323855 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:29.323758    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b956a9c-7e5c-4068-ae90-e6e28475072a" containerName="main"
Jul 06 23:01:29.323855 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:29.323846    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b956a9c-7e5c-4068-ae90-e6e28475072a" containerName="main"
Jul 06 23:01:29.323855 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:29.323854    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ed3ba88-1533-4a6e-9580-9487274d3948" containerName="cleanup"
Jul 06 23:01:29.327074 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:29.327054    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-59pq4/perf-node-gather-daemonset-8nxvr"
Jul 06 23:01:29.329751 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:29.329733    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-59pq4\"/\"openshift-service-ca.crt\""
Jul 06 23:01:29.330017 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:29.330000    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-59pq4\"/\"kube-root-ca.crt\""
Jul 06 23:01:29.330550 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:29.330536    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-59pq4\"/\"default-dockercfg-zdbs2\""
Jul 06 23:01:29.336365 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:29.336345    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-59pq4/perf-node-gather-daemonset-8nxvr"]
Jul 06 23:01:29.503696 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:29.503663    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbsqb\" (UniqueName: \"kubernetes.io/projected/15d06fb1-c48e-40fe-8a4c-a79b3d257410-kube-api-access-hbsqb\") pod \"perf-node-gather-daemonset-8nxvr\" (UID: \"15d06fb1-c48e-40fe-8a4c-a79b3d257410\") " pod="openshift-must-gather-59pq4/perf-node-gather-daemonset-8nxvr"
Jul 06 23:01:29.503866 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:29.503704    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/15d06fb1-c48e-40fe-8a4c-a79b3d257410-podres\") pod \"perf-node-gather-daemonset-8nxvr\" (UID: \"15d06fb1-c48e-40fe-8a4c-a79b3d257410\") " pod="openshift-must-gather-59pq4/perf-node-gather-daemonset-8nxvr"
Jul 06 23:01:29.503866 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:29.503744    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/15d06fb1-c48e-40fe-8a4c-a79b3d257410-sys\") pod \"perf-node-gather-daemonset-8nxvr\" (UID: \"15d06fb1-c48e-40fe-8a4c-a79b3d257410\") " pod="openshift-must-gather-59pq4/perf-node-gather-daemonset-8nxvr"
Jul 06 23:01:29.503866 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:29.503766    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/15d06fb1-c48e-40fe-8a4c-a79b3d257410-proc\") pod \"perf-node-gather-daemonset-8nxvr\" (UID: \"15d06fb1-c48e-40fe-8a4c-a79b3d257410\") " pod="openshift-must-gather-59pq4/perf-node-gather-daemonset-8nxvr"
Jul 06 23:01:29.503866 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:29.503806    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/15d06fb1-c48e-40fe-8a4c-a79b3d257410-lib-modules\") pod \"perf-node-gather-daemonset-8nxvr\" (UID: \"15d06fb1-c48e-40fe-8a4c-a79b3d257410\") " pod="openshift-must-gather-59pq4/perf-node-gather-daemonset-8nxvr"
Jul 06 23:01:29.605321 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:29.605237    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/15d06fb1-c48e-40fe-8a4c-a79b3d257410-sys\") pod \"perf-node-gather-daemonset-8nxvr\" (UID: \"15d06fb1-c48e-40fe-8a4c-a79b3d257410\") " pod="openshift-must-gather-59pq4/perf-node-gather-daemonset-8nxvr"
Jul 06 23:01:29.605321 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:29.605267    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/15d06fb1-c48e-40fe-8a4c-a79b3d257410-proc\") pod \"perf-node-gather-daemonset-8nxvr\" (UID: \"15d06fb1-c48e-40fe-8a4c-a79b3d257410\") " pod="openshift-must-gather-59pq4/perf-node-gather-daemonset-8nxvr"
Jul 06 23:01:29.605321 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:29.605305    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/15d06fb1-c48e-40fe-8a4c-a79b3d257410-lib-modules\") pod \"perf-node-gather-daemonset-8nxvr\" (UID: \"15d06fb1-c48e-40fe-8a4c-a79b3d257410\") " pod="openshift-must-gather-59pq4/perf-node-gather-daemonset-8nxvr"
Jul 06 23:01:29.605543 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:29.605352    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbsqb\" (UniqueName: \"kubernetes.io/projected/15d06fb1-c48e-40fe-8a4c-a79b3d257410-kube-api-access-hbsqb\") pod \"perf-node-gather-daemonset-8nxvr\" (UID: \"15d06fb1-c48e-40fe-8a4c-a79b3d257410\") " pod="openshift-must-gather-59pq4/perf-node-gather-daemonset-8nxvr"
Jul 06 23:01:29.605543 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:29.605369    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/15d06fb1-c48e-40fe-8a4c-a79b3d257410-sys\") pod \"perf-node-gather-daemonset-8nxvr\" (UID: \"15d06fb1-c48e-40fe-8a4c-a79b3d257410\") " pod="openshift-must-gather-59pq4/perf-node-gather-daemonset-8nxvr"
Jul 06 23:01:29.605543 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:29.605382    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/15d06fb1-c48e-40fe-8a4c-a79b3d257410-proc\") pod \"perf-node-gather-daemonset-8nxvr\" (UID: \"15d06fb1-c48e-40fe-8a4c-a79b3d257410\") " pod="openshift-must-gather-59pq4/perf-node-gather-daemonset-8nxvr"
Jul 06 23:01:29.605543 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:29.605388    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/15d06fb1-c48e-40fe-8a4c-a79b3d257410-podres\") pod \"perf-node-gather-daemonset-8nxvr\" (UID: \"15d06fb1-c48e-40fe-8a4c-a79b3d257410\") " pod="openshift-must-gather-59pq4/perf-node-gather-daemonset-8nxvr"
Jul 06 23:01:29.605543 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:29.605480    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/15d06fb1-c48e-40fe-8a4c-a79b3d257410-podres\") pod \"perf-node-gather-daemonset-8nxvr\" (UID: \"15d06fb1-c48e-40fe-8a4c-a79b3d257410\") " pod="openshift-must-gather-59pq4/perf-node-gather-daemonset-8nxvr"
Jul 06 23:01:29.605543 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:29.605497    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/15d06fb1-c48e-40fe-8a4c-a79b3d257410-lib-modules\") pod \"perf-node-gather-daemonset-8nxvr\" (UID: \"15d06fb1-c48e-40fe-8a4c-a79b3d257410\") " pod="openshift-must-gather-59pq4/perf-node-gather-daemonset-8nxvr"
Jul 06 23:01:29.614355 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:29.614329    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbsqb\" (UniqueName: \"kubernetes.io/projected/15d06fb1-c48e-40fe-8a4c-a79b3d257410-kube-api-access-hbsqb\") pod \"perf-node-gather-daemonset-8nxvr\" (UID: \"15d06fb1-c48e-40fe-8a4c-a79b3d257410\") " pod="openshift-must-gather-59pq4/perf-node-gather-daemonset-8nxvr"
Jul 06 23:01:29.638402 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:29.638361    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-59pq4/perf-node-gather-daemonset-8nxvr"
Jul 06 23:01:29.776634 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:29.776609    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-59pq4/perf-node-gather-daemonset-8nxvr"]
Jul 06 23:01:29.778238 ip-10-0-141-52 kubenswrapper[2556]: W0706 23:01:29.778214    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod15d06fb1_c48e_40fe_8a4c_a79b3d257410.slice/crio-01bc37f8767b350d4264a59b1360a3f7bdca78b5c8dc1bcc7f7ff882e57b8be8 WatchSource:0}: Error finding container 01bc37f8767b350d4264a59b1360a3f7bdca78b5c8dc1bcc7f7ff882e57b8be8: Status 404 returned error can't find the container with id 01bc37f8767b350d4264a59b1360a3f7bdca78b5c8dc1bcc7f7ff882e57b8be8
Jul 06 23:01:29.835308 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:29.835288    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-klb8g_611ceaf8-f1df-4077-9881-4f7291342c79/networking-console-plugin/0.log"
Jul 06 23:01:30.494211 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:30.494179    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-59pq4/perf-node-gather-daemonset-8nxvr" event={"ID":"15d06fb1-c48e-40fe-8a4c-a79b3d257410","Type":"ContainerStarted","Data":"2d3ad5a087ba7507dc0cc328afd71cf0ddea01b87d16e3edf5a9f12f60604e1d"}
Jul 06 23:01:30.494626 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:30.494227    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-59pq4/perf-node-gather-daemonset-8nxvr" event={"ID":"15d06fb1-c48e-40fe-8a4c-a79b3d257410","Type":"ContainerStarted","Data":"01bc37f8767b350d4264a59b1360a3f7bdca78b5c8dc1bcc7f7ff882e57b8be8"}
Jul 06 23:01:30.494626 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:30.494308    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-59pq4/perf-node-gather-daemonset-8nxvr"
Jul 06 23:01:30.514073 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:30.514025    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-59pq4/perf-node-gather-daemonset-8nxvr" podStartSLOduration=1.5140110020000002 podStartE2EDuration="1.514011002s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:01:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:01:30.512785132 +0000 UTC m=+2491.300808067" watchObservedRunningTime="2026-07-06 23:01:30.514011002 +0000 UTC m=+2491.302033935"
Jul 06 23:01:30.967577 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:30.967550    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5477f8b68d-pfmr4_10caf825-68fd-4303-9542-c6bc820f6044/console/0.log"
Jul 06 23:01:31.007464 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:31.007434    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-s29sb_cc894bc2-0569-476b-9806-277a81ba1da6/download-server/0.log"
Jul 06 23:01:31.607403 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:31.607373    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-dw9bg_20e777ec-fc6d-4976-9fb2-2fcf68fd492d/volume-data-source-validator/0.log"
Jul 06 23:01:32.735318 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:32.735295    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-grc74_d5aca2ef-cead-468c-ae99-bb4988f0b2aa/dns/0.log"
Jul 06 23:01:32.779842 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:32.779814    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-grc74_d5aca2ef-cead-468c-ae99-bb4988f0b2aa/kube-rbac-proxy/0.log"
Jul 06 23:01:33.001177 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:33.001072    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9gpdr_8f22a5f0-92b2-4853-9cce-38758ed34f72/dns-node-resolver/0.log"
Jul 06 23:01:33.651131 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:33.651085    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5cdbd5f6f7-klz5q_fafe1b2c-711e-4f13-9ec8-31882c89af4e/registry/0.log"
Jul 06 23:01:33.695780 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:33.695742    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-t4r7v_53db0d7a-f95e-4101-9677-2e12ea5f8b26/node-ca/0.log"
Jul 06 23:01:34.840134 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:34.840093    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678hrvw2_cc5b9738-bcee-430e-85f7-a93bb0e97426/istio-proxy/0.log"
Jul 06 23:01:34.951460 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:34.951430    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-7s5dw_12d8be81-9a96-4462-845c-f4539e4e574c/discovery/0.log"
Jul 06 23:01:35.304797 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:35.304766    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-57c9599b87-5gwnz_6d3dbf73-97c0-4313-938f-10000be128f8/router/0.log"
Jul 06 23:01:36.064620 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:36.064588    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2vdl9_d02ab32f-a098-478f-a12a-f5bfc6096e27/serve-healthcheck-canary/0.log"
Jul 06 23:01:36.508182 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:36.508115    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-59pq4/perf-node-gather-daemonset-8nxvr"
Jul 06 23:01:36.634489 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:36.634456    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-px5rm_6f201e5f-d7c9-456c-b7b4-05c2542e5933/insights-operator/0.log"
Jul 06 23:01:36.635692 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:36.635673    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-px5rm_6f201e5f-d7c9-456c-b7b4-05c2542e5933/insights-operator/1.log"
Jul 06 23:01:36.830997 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:36.830963    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kwlvj_3d153f53-015d-4cae-a617-0f5e4d745e80/kube-rbac-proxy/0.log"
Jul 06 23:01:36.858701 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:36.858681    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kwlvj_3d153f53-015d-4cae-a617-0f5e4d745e80/exporter/0.log"
Jul 06 23:01:36.887725 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:36.887696    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kwlvj_3d153f53-015d-4cae-a617-0f5e4d745e80/extractor/0.log"
Jul 06 23:01:39.881520 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:39.881468    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678hrvw2_cc5b9738-bcee-430e-85f7-a93bb0e97426/istio-proxy/0.log"
Jul 06 23:01:39.997285 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:39.997253    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-7s5dw_12d8be81-9a96-4462-845c-f4539e4e574c/discovery/0.log"
Jul 06 23:01:40.155954 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:40.155882    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c6597d756-4794n_79ee8235-108b-437a-a86a-d42c4fb5d3e0/manager/0.log"
Jul 06 23:01:40.187774 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:40.187744    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c6597d756-4794n_79ee8235-108b-437a-a86a-d42c4fb5d3e0/copy-manifests/0.log"
Jul 06 23:01:40.226608 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:40.226582    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-57c9599b87-5gwnz_6d3dbf73-97c0-4313-938f-10000be128f8/router/0.log"
Jul 06 23:01:41.548521 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:41.548496    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678hrvw2_cc5b9738-bcee-430e-85f7-a93bb0e97426/istio-proxy/0.log"
Jul 06 23:01:41.663488 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:41.663458    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-7s5dw_12d8be81-9a96-4462-845c-f4539e4e574c/discovery/0.log"
Jul 06 23:01:41.882133 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:41.882032    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-57c9599b87-5gwnz_6d3dbf73-97c0-4313-938f-10000be128f8/router/0.log"
Jul 06 23:01:41.927355 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:41.927333    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-67b4867ff6-8w27h_c62cb91f-1180-4181-8bb7-949a202d5cf8/manager/0.log"
Jul 06 23:01:42.000756 ip-10-0-141-52 kubenswrapper[2556]: I0706 23:01:42.000730    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-pghz8_775c591b-fa6d-4afd-8ce1-8cc4ebbd1f4a/openshift-lws-operator/0.log"