Jul 16 21:07:29.999800 ip-10-0-133-58 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 16 21:07:29.999812 ip-10-0-133-58 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 16 21:07:29.999821 ip-10-0-133-58 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 16 21:07:30.000128 ip-10-0-133-58 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 16 21:07:40.100447 ip-10-0-133-58 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 16 21:07:40.100464 ip-10-0-133-58 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 05fa876929e74a918db648917f663b56 --
Jul 16 21:09:41.273435 ip-10-0-133-58 systemd[1]: Starting Kubernetes Kubelet...
Jul 16 21:09:41.661912 ip-10-0-133-58 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 16 21:09:41.661912 ip-10-0-133-58 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 16 21:09:41.661912 ip-10-0-133-58 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 16 21:09:41.661912 ip-10-0-133-58 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 16 21:09:41.662545 ip-10-0-133-58 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 16 21:09:41.664445 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.664353    2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 16 21:09:41.670305 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670289    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 21:09:41.670305 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670307    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 21:09:41.670385 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670311    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 21:09:41.670385 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670315    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 21:09:41.670385 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670319    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 21:09:41.670385 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670322    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 21:09:41.670385 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670325    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 21:09:41.670385 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670329    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 21:09:41.670385 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670332    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 21:09:41.670385 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670335    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 21:09:41.670385 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670338    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 21:09:41.670385 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670341    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 21:09:41.670385 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670344    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 21:09:41.670385 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670346    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 21:09:41.670385 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670349    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 21:09:41.670385 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670352    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 21:09:41.670385 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670354    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 21:09:41.670385 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670358    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 21:09:41.670385 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670362    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 21:09:41.670385 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670365    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 21:09:41.670385 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670368    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 21:09:41.670385 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670370    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 21:09:41.670885 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670373    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 21:09:41.670885 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670376    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 21:09:41.670885 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670379    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 21:09:41.670885 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670381    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 21:09:41.670885 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670384    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 21:09:41.670885 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670387    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 21:09:41.670885 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670390    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 21:09:41.670885 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670393    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 21:09:41.670885 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670396    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 21:09:41.670885 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670399    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 21:09:41.670885 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670402    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 21:09:41.670885 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670405    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 21:09:41.670885 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670407    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 21:09:41.670885 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670410    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 21:09:41.670885 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670413    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 21:09:41.670885 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670415    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 21:09:41.670885 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670418    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 21:09:41.670885 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670421    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 21:09:41.670885 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670424    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 21:09:41.670885 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670426    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 21:09:41.671441 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670429    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 21:09:41.671441 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670431    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 21:09:41.671441 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670434    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 21:09:41.671441 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670437    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 21:09:41.671441 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670439    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 21:09:41.671441 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670442    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 21:09:41.671441 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670444    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 21:09:41.671441 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670450    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 21:09:41.671441 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670455    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 21:09:41.671441 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670459    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 21:09:41.671441 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670462    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 21:09:41.671441 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670466    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 21:09:41.671441 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670471    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 21:09:41.671441 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670474    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 21:09:41.671441 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670477    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 21:09:41.671441 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670480    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 21:09:41.671441 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670483    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 21:09:41.671441 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670485    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 21:09:41.671906 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670488    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 21:09:41.671906 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670491    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 21:09:41.671906 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670494    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 21:09:41.671906 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670496    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 21:09:41.671906 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670499    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 21:09:41.671906 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670501    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 21:09:41.671906 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670504    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 21:09:41.671906 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670507    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 21:09:41.671906 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670509    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 21:09:41.671906 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670512    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 21:09:41.671906 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670515    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 21:09:41.671906 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670523    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 21:09:41.671906 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670526    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 21:09:41.671906 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670529    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 21:09:41.671906 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670532    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 21:09:41.671906 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670534    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 21:09:41.671906 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670537    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 21:09:41.671906 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670540    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 21:09:41.671906 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670542    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 21:09:41.671906 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670545    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 21:09:41.672434 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670548    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 21:09:41.672434 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670550    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 21:09:41.672434 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670553    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 21:09:41.672434 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670556    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 21:09:41.672434 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670559    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 21:09:41.672434 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670562    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 21:09:41.672434 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670564    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 21:09:41.672434 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670569    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 21:09:41.672434 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670572    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 21:09:41.672434 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670575    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 21:09:41.672434 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670578    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 21:09:41.672434 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670581    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 21:09:41.672434 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670584    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 21:09:41.672434 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670587    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 21:09:41.672434 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670589    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 21:09:41.672434 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670592    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 21:09:41.672434 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670595    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 21:09:41.672434 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670598    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 21:09:41.672434 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.670600    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 21:09:41.672897 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671406    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 21:09:41.672897 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671414    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 21:09:41.672897 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671418    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 21:09:41.672897 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671422    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 21:09:41.672897 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671425    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 21:09:41.672897 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671429    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 21:09:41.672897 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671433    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 21:09:41.672897 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671437    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 21:09:41.672897 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671441    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 21:09:41.672897 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671444    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 21:09:41.672897 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671447    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 21:09:41.672897 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671450    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 21:09:41.672897 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671453    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 21:09:41.672897 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671456    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 21:09:41.672897 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671459    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 21:09:41.672897 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671462    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 21:09:41.672897 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671465    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 21:09:41.672897 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671468    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 21:09:41.672897 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671471    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 21:09:41.673398 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671474    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 21:09:41.673398 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671477    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 21:09:41.673398 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671480    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 21:09:41.673398 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671483    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 21:09:41.673398 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671486    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 21:09:41.673398 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671489    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 21:09:41.673398 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671492    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 21:09:41.673398 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671494    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 21:09:41.673398 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671497    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 21:09:41.673398 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671500    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 21:09:41.673398 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671502    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 21:09:41.673398 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671505    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 21:09:41.673398 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671508    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 21:09:41.673398 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671511    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 21:09:41.673398 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671513    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 21:09:41.673398 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671516    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 21:09:41.673398 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671519    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 21:09:41.673398 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671522    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 21:09:41.673398 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671524    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 21:09:41.673398 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671528    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 21:09:41.673922 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671530    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 21:09:41.673922 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671533    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 21:09:41.673922 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671536    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 21:09:41.673922 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671538    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 21:09:41.673922 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671541    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 21:09:41.673922 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671544    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 21:09:41.673922 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671546    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 21:09:41.673922 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671549    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 21:09:41.673922 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671552    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 21:09:41.673922 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671555    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 21:09:41.673922 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671559    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 21:09:41.673922 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671561    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 21:09:41.673922 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671565    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 21:09:41.673922 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671568    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 21:09:41.673922 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671571    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 21:09:41.673922 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671574    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 21:09:41.673922 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671576    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 21:09:41.673922 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671579    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 21:09:41.673922 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671582    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 21:09:41.673922 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671584    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 21:09:41.674456 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671587    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 21:09:41.674456 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671589    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 21:09:41.674456 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671592    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 21:09:41.674456 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671595    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 21:09:41.674456 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671598    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 21:09:41.674456 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671601    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 21:09:41.674456 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671603    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 21:09:41.674456 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671606    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 21:09:41.674456 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671609    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 21:09:41.674456 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671611    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 21:09:41.674456 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671614    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 21:09:41.674456 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671617    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 21:09:41.674456 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671624    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 21:09:41.674456 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671627    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 21:09:41.674456 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671629    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 21:09:41.674456 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671632    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 21:09:41.674456 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671636    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 21:09:41.674456 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671640    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 21:09:41.674456 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671643    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 21:09:41.674456 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671647    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 21:09:41.674991 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671651    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 21:09:41.674991 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671654    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 21:09:41.674991 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671656    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 21:09:41.674991 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671659    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 21:09:41.674991 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671663    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 21:09:41.674991 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671666    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 21:09:41.674991 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671668    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 21:09:41.674991 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671671    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 21:09:41.674991 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671674    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 21:09:41.674991 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671677    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 21:09:41.674991 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671679    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 21:09:41.674991 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671683    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 21:09:41.674991 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671687    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 21:09:41.674991 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671690    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 21:09:41.674991 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671693    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 21:09:41.674991 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671696    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 21:09:41.674991 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671699    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 21:09:41.674991 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671702    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 21:09:41.674991 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671705    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 21:09:41.674991 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.671708    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 21:09:41.675524 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672130    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 21:09:41.675524 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672135    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 21:09:41.675524 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672139    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 21:09:41.675524 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672142    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 21:09:41.675524 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672152    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 21:09:41.675524 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672156    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 21:09:41.675524 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672159    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 21:09:41.675524 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672162    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 21:09:41.675524 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672165    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 21:09:41.675524 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672168    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 21:09:41.675524 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672187    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 21:09:41.675524 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672190    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 21:09:41.675524 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672193    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 21:09:41.675524 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672196    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 21:09:41.675524 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672199    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 21:09:41.675524 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672202    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 21:09:41.675524 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672205    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 21:09:41.675524 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672208    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 21:09:41.675524 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672211    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 21:09:41.675524 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672214    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 21:09:41.676043 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672217    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 21:09:41.676043 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672220    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 21:09:41.676043 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672223    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 21:09:41.676043 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672226    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 21:09:41.676043 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672229    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 21:09:41.676043 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672231    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 21:09:41.676043 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672234    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 21:09:41.676043 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672237    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 21:09:41.676043 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672239    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 21:09:41.676043 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672242    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 21:09:41.676043 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672245    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 21:09:41.676043 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672248    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 21:09:41.676043 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672250    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 21:09:41.676043 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672253    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 21:09:41.676043 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672256    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 21:09:41.676043 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672259    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 21:09:41.676043 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672261    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 21:09:41.676043 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672270    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 21:09:41.676043 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672273    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 21:09:41.676043 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672276    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 21:09:41.676615 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672279    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 21:09:41.676615 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672282    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 21:09:41.676615 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672287    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 21:09:41.676615 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672291    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 21:09:41.676615 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672295    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 21:09:41.676615 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672298    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 21:09:41.676615 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672301    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 21:09:41.676615 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672304    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 21:09:41.676615 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672307    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 21:09:41.676615 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672311    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 21:09:41.676615 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672313    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 21:09:41.676615 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672316    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 21:09:41.676615 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672319    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 21:09:41.676615 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672321    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 21:09:41.676615 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672324    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 21:09:41.676615 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672327    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 21:09:41.676615 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672329    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 21:09:41.676615 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672332    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 21:09:41.676615 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672335    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 21:09:41.676615 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672337    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 21:09:41.677115 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672340    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 21:09:41.677115 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672343    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 21:09:41.677115 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672345    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 21:09:41.677115 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672348    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 21:09:41.677115 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672351    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 21:09:41.677115 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672354    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 21:09:41.677115 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672357    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 21:09:41.677115 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672359    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 21:09:41.677115 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672362    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 21:09:41.677115 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672364    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 21:09:41.677115 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672373    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 21:09:41.677115 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672376    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 21:09:41.677115 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672381    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 21:09:41.677115 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672384    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 21:09:41.677115 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672388    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 21:09:41.677115 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672391    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 21:09:41.677115 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672394    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 21:09:41.677115 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672397    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 21:09:41.677115 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672399    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 21:09:41.677653 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672402    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 21:09:41.677653 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672405    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 21:09:41.677653 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672407    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 21:09:41.677653 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672410    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 21:09:41.677653 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672413    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 21:09:41.677653 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672415    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 21:09:41.677653 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672418    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 21:09:41.677653 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672420    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 21:09:41.677653 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672424    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 21:09:41.677653 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672428    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 21:09:41.677653 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672431    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 21:09:41.677653 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672434    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 21:09:41.677653 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672438    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 21:09:41.677653 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672441    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 21:09:41.677653 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672444    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 21:09:41.677653 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672447    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 21:09:41.677653 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672452    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 21:09:41.677653 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672455    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 21:09:41.677653 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672458    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 21:09:41.678175 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.672461    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 21:09:41.678175 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672539    2579 flags.go:64] FLAG: --address="0.0.0.0"
Jul 16 21:09:41.678175 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672546    2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 16 21:09:41.678175 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672554    2579 flags.go:64] FLAG: --anonymous-auth="true"
Jul 16 21:09:41.678175 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672559    2579 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 16 21:09:41.678175 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672576    2579 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 16 21:09:41.678175 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672580    2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 16 21:09:41.678175 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672585    2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 16 21:09:41.678175 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672589    2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 16 21:09:41.678175 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672593    2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 16 21:09:41.678175 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672596    2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 16 21:09:41.678175 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672600    2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 16 21:09:41.678175 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672603    2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 16 21:09:41.678175 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672606    2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 16 21:09:41.678175 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672612    2579 flags.go:64] FLAG: --cgroup-root=""
Jul 16 21:09:41.678175 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672615    2579 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 16 21:09:41.678175 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672618    2579 flags.go:64] FLAG: --client-ca-file=""
Jul 16 21:09:41.678175 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672621    2579 flags.go:64] FLAG: --cloud-provider="external"
Jul 16 21:09:41.678175 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672624    2579 flags.go:64] FLAG: --cluster-dns="[]"
Jul 16 21:09:41.678175 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672629    2579 flags.go:64] FLAG: --cluster-domain=""
Jul 16 21:09:41.678175 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672632    2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 16 21:09:41.678175 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672635    2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 16 21:09:41.678175 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672638    2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 16 21:09:41.678175 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672642    2579 flags.go:64] FLAG: --container-log-max-files="5"
Jul 16 21:09:41.678787 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672646    2579 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 16 21:09:41.678787 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672649    2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 16 21:09:41.678787 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672653    2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 16 21:09:41.678787 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672656    2579 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 16 21:09:41.678787 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672660    2579 flags.go:64] FLAG: --contention-profiling="false"
Jul 16 21:09:41.678787 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672664    2579 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 16 21:09:41.678787 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672667    2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 16 21:09:41.678787 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672671    2579 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 16 21:09:41.678787 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672674    2579 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 16 21:09:41.678787 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672678    2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 16 21:09:41.678787 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672681    2579 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 16 21:09:41.678787 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672684    2579 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 16 21:09:41.678787 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672687    2579 flags.go:64] FLAG: --enable-load-reader="false"
Jul 16 21:09:41.678787 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672691    2579 flags.go:64] FLAG: --enable-server="true"
Jul 16 21:09:41.678787 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672704    2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 16 21:09:41.678787 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672714    2579 flags.go:64] FLAG: --event-burst="100"
Jul 16 21:09:41.678787 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672717    2579 flags.go:64] FLAG: --event-qps="50"
Jul 16 21:09:41.678787 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672721    2579 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 16 21:09:41.678787 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672724    2579 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 16 21:09:41.678787 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672727    2579 flags.go:64] FLAG: --eviction-hard=""
Jul 16 21:09:41.678787 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672732    2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 16 21:09:41.678787 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672735    2579 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 16 21:09:41.678787 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672744    2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 16 21:09:41.678787 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672747    2579 flags.go:64] FLAG: --eviction-soft=""
Jul 16 21:09:41.678787 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672750    2579 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 16 21:09:41.679435 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672753    2579 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 16 21:09:41.679435 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672757    2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 16 21:09:41.679435 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672760    2579 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 16 21:09:41.679435 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672763    2579 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 16 21:09:41.679435 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672766    2579 flags.go:64] FLAG: --fail-swap-on="true"
Jul 16 21:09:41.679435 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672769    2579 flags.go:64] FLAG: --feature-gates=""
Jul 16 21:09:41.679435 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672773    2579 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 16 21:09:41.679435 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672777    2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 16 21:09:41.679435 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672780    2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 16 21:09:41.679435 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672783    2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 16 21:09:41.679435 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672787    2579 flags.go:64] FLAG: --healthz-port="10248"
Jul 16 21:09:41.679435 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672790    2579 flags.go:64] FLAG: --help="false"
Jul 16 21:09:41.679435 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672794    2579 flags.go:64] FLAG: --hostname-override="ip-10-0-133-58.ec2.internal"
Jul 16 21:09:41.679435 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672797    2579 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 16 21:09:41.679435 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672801    2579 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 16 21:09:41.679435 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672804    2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 16 21:09:41.679435 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672807    2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 16 21:09:41.679435 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672811    2579 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 16 21:09:41.679435 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672814    2579 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 16 21:09:41.679435 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672817    2579 flags.go:64] FLAG: --image-service-endpoint=""
Jul 16 21:09:41.679435 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672820    2579 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 16 21:09:41.679435 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672823    2579 flags.go:64] FLAG: --kube-api-burst="100"
Jul 16 21:09:41.679435 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672833    2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 16 21:09:41.680089 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672836    2579 flags.go:64] FLAG: --kube-api-qps="50"
Jul 16 21:09:41.680089 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672839    2579 flags.go:64] FLAG: --kube-reserved=""
Jul 16 21:09:41.680089 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672842    2579 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 16 21:09:41.680089 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672845    2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 16 21:09:41.680089 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672849    2579 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 16 21:09:41.680089 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672852    2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 16 21:09:41.680089 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672856    2579 flags.go:64] FLAG: --lock-file=""
Jul 16 21:09:41.680089 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672859    2579 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 16 21:09:41.680089 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672862    2579 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 16 21:09:41.680089 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672865    2579 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 16 21:09:41.680089 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672871    2579 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 16 21:09:41.680089 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672874    2579 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 16 21:09:41.680089 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672877    2579 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 16 21:09:41.680089 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672880    2579 flags.go:64] FLAG: --logging-format="text"
Jul 16 21:09:41.680089 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672883    2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 16 21:09:41.680089 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672886    2579 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 16 21:09:41.680089 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672889    2579 flags.go:64] FLAG: --manifest-url=""
Jul 16 21:09:41.680089 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672892    2579 flags.go:64] FLAG: --manifest-url-header=""
Jul 16 21:09:41.680089 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672897    2579 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 16 21:09:41.680089 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672900    2579 flags.go:64] FLAG: --max-open-files="1000000"
Jul 16 21:09:41.680089 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672905    2579 flags.go:64] FLAG: --max-pods="110"
Jul 16 21:09:41.680089 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672910    2579 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 16 21:09:41.680089 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672913    2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 16 21:09:41.680089 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672916    2579 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 16 21:09:41.680089 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672920    2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 16 21:09:41.680750 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672923    2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 16 21:09:41.680750 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672927    2579 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 16 21:09:41.680750 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672930    2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 16 21:09:41.680750 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672938    2579 flags.go:64] FLAG: --node-status-max-images="50"
Jul 16 21:09:41.680750 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672941    2579 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 16 21:09:41.680750 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672944    2579 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 16 21:09:41.680750 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672948    2579 flags.go:64] FLAG: --pod-cidr=""
Jul 16 21:09:41.680750 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672958    2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 16 21:09:41.680750 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672965    2579 flags.go:64] FLAG: --pod-manifest-path=""
Jul 16 21:09:41.680750 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672968    2579 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 16 21:09:41.680750 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672972    2579 flags.go:64] FLAG: --pods-per-core="0"
Jul 16 21:09:41.680750 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672975    2579 flags.go:64] FLAG: --port="10250"
Jul 16 21:09:41.680750 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672978    2579 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 16 21:09:41.680750 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672983    2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0bebf573694f03966"
Jul 16 21:09:41.680750 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672986    2579 flags.go:64] FLAG: --qos-reserved=""
Jul 16 21:09:41.680750 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672989    2579 flags.go:64] FLAG: --read-only-port="10255"
Jul 16 21:09:41.680750 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672992    2579 flags.go:64] FLAG: --register-node="true"
Jul 16 21:09:41.680750 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672995    2579 flags.go:64] FLAG: --register-with-taints=""
Jul 16 21:09:41.680750 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.672999    2579 flags.go:64] FLAG: --registry-burst="10"
Jul 16 21:09:41.680750 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.673002    2579 flags.go:64] FLAG: --registry-qps="5"
Jul 16 21:09:41.680750 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.673005    2579 flags.go:64] FLAG: --reserved-cpus=""
Jul 16 21:09:41.680750 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.673008    2579 flags.go:64] FLAG: --reserved-memory=""
Jul 16 21:09:41.680750 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.673012    2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 16 21:09:41.680750 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.673016    2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 16 21:09:41.680750 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.673019    2579 flags.go:64] FLAG: --rotate-certificates="false"
Jul 16 21:09:41.681454 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.673022    2579 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 16 21:09:41.681454 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.673025    2579 flags.go:64] FLAG: --runonce="false"
Jul 16 21:09:41.681454 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.673028    2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 16 21:09:41.681454 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.673031    2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 16 21:09:41.681454 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.673035    2579 flags.go:64] FLAG: --seccomp-default="false"
Jul 16 21:09:41.681454 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.673038    2579 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 16 21:09:41.681454 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.673041    2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 16 21:09:41.681454 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.673044    2579 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 16 21:09:41.681454 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.673047    2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 16 21:09:41.681454 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.673050    2579 flags.go:64] FLAG: --storage-driver-password="root"
Jul 16 21:09:41.681454 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.673053    2579 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 16 21:09:41.681454 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.673056    2579 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 16 21:09:41.681454 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.673059    2579 flags.go:64] FLAG: --storage-driver-user="root"
Jul 16 21:09:41.681454 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.673062    2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 16 21:09:41.681454 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.673065    2579 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 16 21:09:41.681454 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.673069    2579 flags.go:64] FLAG: --system-cgroups=""
Jul 16 21:09:41.681454 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.673073    2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 16 21:09:41.681454 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.673078    2579 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 16 21:09:41.681454 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.673081    2579 flags.go:64] FLAG: --tls-cert-file=""
Jul 16 21:09:41.681454 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.673084    2579 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 16 21:09:41.681454 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.673093    2579 flags.go:64] FLAG: --tls-min-version=""
Jul 16 21:09:41.681454 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.673096    2579 flags.go:64] FLAG: --tls-private-key-file=""
Jul 16 21:09:41.681454 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.673098    2579 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 16 21:09:41.681454 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.673101    2579 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 16 21:09:41.681454 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.673105    2579 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 16 21:09:41.682086 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.673108    2579 flags.go:64] FLAG: --v="2"
Jul 16 21:09:41.682086 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.673112    2579 flags.go:64] FLAG: --version="false"
Jul 16 21:09:41.682086 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.673121    2579 flags.go:64] FLAG: --vmodule=""
Jul 16 21:09:41.682086 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.673125    2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 16 21:09:41.682086 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.673128    2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 16 21:09:41.682086 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673269    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 21:09:41.682086 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673273    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 21:09:41.682086 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673278    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 21:09:41.682086 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673282    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 21:09:41.682086 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673286    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 21:09:41.682086 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673289    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 21:09:41.682086 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673292    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 21:09:41.682086 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673296    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 21:09:41.682086 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673298    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 21:09:41.682086 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673301    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 21:09:41.682086 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673304    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 21:09:41.682086 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673307    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 21:09:41.682086 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673310    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 21:09:41.682086 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673314    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 21:09:41.682086 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673318    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 21:09:41.682612 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673321    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 21:09:41.682612 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673325    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 21:09:41.682612 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673328    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 21:09:41.682612 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673331    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 21:09:41.682612 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673335    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 21:09:41.682612 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673338    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 21:09:41.682612 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673340    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 21:09:41.682612 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673345    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 21:09:41.682612 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673347    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 21:09:41.682612 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673350    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 21:09:41.682612 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673352    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 21:09:41.682612 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673355    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 21:09:41.682612 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673358    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 21:09:41.682612 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673361    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 21:09:41.682612 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673364    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 21:09:41.682612 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673366    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 21:09:41.682612 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673369    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 21:09:41.682612 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673372    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 21:09:41.682612 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673375    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 21:09:41.682612 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673378    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 21:09:41.683126 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673381    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 21:09:41.683126 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673384    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 21:09:41.683126 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673386    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 21:09:41.683126 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673390    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 21:09:41.683126 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673394    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 21:09:41.683126 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673397    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 21:09:41.683126 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673400    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 21:09:41.683126 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673403    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 21:09:41.683126 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673406    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 21:09:41.683126 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673410    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 21:09:41.683126 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673413    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 21:09:41.683126 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673416    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 21:09:41.683126 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673418    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 21:09:41.683126 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673421    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 21:09:41.683126 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673424    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 21:09:41.683126 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673426    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 21:09:41.683126 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673430    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 21:09:41.683126 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673433    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 21:09:41.683126 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673435    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 21:09:41.683745 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673439    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 21:09:41.683745 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673442    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 21:09:41.683745 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673445    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 21:09:41.683745 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673448    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 21:09:41.683745 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673450    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 21:09:41.683745 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673453    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 21:09:41.683745 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673455    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 21:09:41.683745 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673458    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 21:09:41.683745 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673461    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 21:09:41.683745 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673464    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 21:09:41.683745 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673466    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 21:09:41.683745 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673469    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 21:09:41.683745 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673472    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 21:09:41.683745 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673474    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 21:09:41.683745 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673477    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 21:09:41.683745 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673480    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 21:09:41.683745 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673483    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 21:09:41.683745 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673486    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 21:09:41.683745 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673488    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 21:09:41.683745 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673491    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 21:09:41.684314 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673494    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 21:09:41.684314 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673496    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 21:09:41.684314 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673499    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 21:09:41.684314 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673501    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 21:09:41.684314 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673504    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 21:09:41.684314 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673507    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 21:09:41.684314 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673509    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 21:09:41.684314 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673512    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 21:09:41.684314 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673515    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 21:09:41.684314 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673517    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 21:09:41.684314 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673520    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 21:09:41.684314 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673523    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 21:09:41.684314 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673526    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 21:09:41.684314 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673529    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 21:09:41.684314 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673532    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 21:09:41.684314 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673535    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 21:09:41.684314 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673538    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 21:09:41.684314 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673540    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 21:09:41.684314 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673543    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 21:09:41.684314 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673545    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 21:09:41.684844 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673548    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 21:09:41.684844 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673551    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 21:09:41.684844 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673553    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 21:09:41.684844 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673557    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 21:09:41.684844 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.673560    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 21:09:41.684844 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.674480    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 16 21:09:41.684844 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.682274    2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 16 21:09:41.684844 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.682289    2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 16 21:09:41.684844 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.682308    2579 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 16 21:09:41.684844 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.682314    2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 16 21:09:41.684844 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682382    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 21:09:41.684844 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682387    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 21:09:41.684844 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682391    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 21:09:41.684844 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682395    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 21:09:41.684844 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682398    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 21:09:41.685252 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682401    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 21:09:41.685252 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682404    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 21:09:41.685252 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682415    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 21:09:41.685252 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682418    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 21:09:41.685252 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682421    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 21:09:41.685252 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682424    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 21:09:41.685252 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682427    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 21:09:41.685252 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682439    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 21:09:41.685252 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682442    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 21:09:41.685252 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682444    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 21:09:41.685252 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682447    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 21:09:41.685252 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682450    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 21:09:41.685252 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682453    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 21:09:41.685252 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682456    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 21:09:41.685252 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682458    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 21:09:41.685252 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682465    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 21:09:41.685252 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682468    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 21:09:41.685252 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682470    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 21:09:41.685252 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682473    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 21:09:41.685252 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682476    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 21:09:41.685762 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682479    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 21:09:41.685762 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682481    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 21:09:41.685762 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682484    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 21:09:41.685762 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682487    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 21:09:41.685762 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682491    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 21:09:41.685762 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682494    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 21:09:41.685762 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682497    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 21:09:41.685762 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682500    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 21:09:41.685762 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682503    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 21:09:41.685762 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682505    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 21:09:41.685762 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682508    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 21:09:41.685762 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682511    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 21:09:41.685762 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682514    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 21:09:41.685762 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682516    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 21:09:41.685762 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682519    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 21:09:41.685762 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682522    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 21:09:41.685762 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682524    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 21:09:41.685762 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682527    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 21:09:41.685762 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682530    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 21:09:41.685762 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682532    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 21:09:41.686309 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682543    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 21:09:41.686309 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682548    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 21:09:41.686309 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682551    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 21:09:41.686309 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682554    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 21:09:41.686309 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682557    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 21:09:41.686309 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682560    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 21:09:41.686309 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682563    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 21:09:41.686309 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682568    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 21:09:41.686309 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682571    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 21:09:41.686309 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682575    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 21:09:41.686309 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682577    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 21:09:41.686309 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682580    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 21:09:41.686309 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682583    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 21:09:41.686309 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682586    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 21:09:41.686309 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682589    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 21:09:41.686309 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682592    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 21:09:41.686309 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682595    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 21:09:41.686309 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682598    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 21:09:41.686309 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682601    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 21:09:41.686805 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682604    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 21:09:41.686805 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682606    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 21:09:41.686805 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682609    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 21:09:41.686805 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682611    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 21:09:41.686805 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682614    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 21:09:41.686805 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682617    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 21:09:41.686805 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682620    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 21:09:41.686805 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682623    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 21:09:41.686805 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682626    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 21:09:41.686805 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682629    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 21:09:41.686805 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682632    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 21:09:41.686805 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682635    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 21:09:41.686805 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682637    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 21:09:41.686805 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682640    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 21:09:41.686805 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682649    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 21:09:41.686805 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682652    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 21:09:41.686805 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682655    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 21:09:41.686805 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682658    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 21:09:41.686805 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682661    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 21:09:41.686805 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682663    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 21:09:41.687482 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682667    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 21:09:41.687482 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682671    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 21:09:41.687482 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682674    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 21:09:41.687482 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682677    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 21:09:41.687482 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682679    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 21:09:41.687482 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682682    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 21:09:41.687482 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682685    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 21:09:41.687482 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682687    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 21:09:41.687482 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682690    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 21:09:41.687482 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682693    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 21:09:41.687482 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682696    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 21:09:41.687482 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682699    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 21:09:41.687482 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682701    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 21:09:41.687482 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682704    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 21:09:41.687482 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682707    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 21:09:41.687885 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.682712    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 16 21:09:41.687885 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682870    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 21:09:41.687885 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682876    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 21:09:41.687885 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682879    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 21:09:41.687885 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682882    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 21:09:41.687885 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682884    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 21:09:41.687885 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682887    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 21:09:41.687885 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682890    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 21:09:41.687885 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682893    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 21:09:41.687885 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682895    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 21:09:41.687885 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682898    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 21:09:41.687885 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682900    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 21:09:41.687885 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682910    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 21:09:41.687885 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682912    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 21:09:41.687885 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682915    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 21:09:41.688303 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682918    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 21:09:41.688303 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682920    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 21:09:41.688303 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682923    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 21:09:41.688303 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682925    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 21:09:41.688303 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682930    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 21:09:41.688303 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682934    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 21:09:41.688303 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682937    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 21:09:41.688303 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682940    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 21:09:41.688303 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682944    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 21:09:41.688303 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682947    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 21:09:41.688303 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682950    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 21:09:41.688303 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682953    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 21:09:41.688303 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682955    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 21:09:41.688303 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682958    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 21:09:41.688303 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682961    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 21:09:41.688303 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682964    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 21:09:41.688303 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682967    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 21:09:41.688303 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682969    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 21:09:41.688303 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682972    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 21:09:41.688820 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682975    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 21:09:41.688820 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682977    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 21:09:41.688820 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682980    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 21:09:41.688820 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682983    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 21:09:41.688820 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682986    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 21:09:41.688820 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682988    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 21:09:41.688820 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682991    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 21:09:41.688820 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682994    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 21:09:41.688820 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682996    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 21:09:41.688820 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.682999    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 21:09:41.688820 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.683002    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 21:09:41.688820 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.683011    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 21:09:41.688820 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.683014    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 21:09:41.688820 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.683016    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 21:09:41.688820 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.683019    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 21:09:41.688820 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.683022    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 21:09:41.688820 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.683025    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 21:09:41.688820 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.683027    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 21:09:41.688820 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.683030    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 21:09:41.688820 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.683032    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 21:09:41.689360 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.683035    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 21:09:41.689360 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.683038    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 21:09:41.689360 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.683041    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 21:09:41.689360 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.683044    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 21:09:41.689360 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.683046    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 21:09:41.689360 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.683049    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 21:09:41.689360 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.683052    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 21:09:41.689360 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.683055    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 21:09:41.689360 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.683057    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 21:09:41.689360 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.683060    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 21:09:41.689360 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.683063    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 21:09:41.689360 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.683065    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 21:09:41.689360 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.683068    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 21:09:41.689360 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.683070    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 21:09:41.689360 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.683073    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 21:09:41.689360 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.683076    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 21:09:41.689360 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.683078    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 21:09:41.689360 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.683081    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 21:09:41.689360 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.683084    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 21:09:41.689360 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.683087    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 21:09:41.689873 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.683090    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 21:09:41.689873 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.683092    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 21:09:41.689873 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.683095    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 21:09:41.689873 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.683097    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 21:09:41.689873 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.683108    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 21:09:41.689873 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.683112    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 21:09:41.689873 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.683115    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 21:09:41.689873 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.683118    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 21:09:41.689873 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.683120    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 21:09:41.689873 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.683123    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 21:09:41.689873 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.683126    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 21:09:41.689873 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.683129    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 21:09:41.689873 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.683131    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 21:09:41.689873 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.683134    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 21:09:41.689873 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.683137    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 21:09:41.689873 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.683140    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 21:09:41.689873 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.683143    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 21:09:41.689873 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.683146    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 21:09:41.689873 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.683150    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 21:09:41.690395 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.683153    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 21:09:41.690395 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.683155    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 21:09:41.690395 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.683158    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 21:09:41.690395 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.683161    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 21:09:41.690395 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.683164    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 21:09:41.690395 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.683166    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 21:09:41.690395 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:41.683169    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 21:09:41.690395 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.683191    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 16 21:09:41.690395 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.683343    2579 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 16 21:09:41.690395 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.685969    2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 16 21:09:41.690395 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.687623    2579 server.go:1019] "Starting client certificate rotation"
Jul 16 21:09:41.690395 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.687738    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 16 21:09:41.690395 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.687817    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 16 21:09:41.690756 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.690394    2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 16 21:09:41.692019 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.691989    2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 16 21:09:41.704161 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.704137    2579 log.go:25] "Validated CRI v1 runtime API"
Jul 16 21:09:41.707414 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.707395    2579 log.go:25] "Validated CRI v1 image API"
Jul 16 21:09:41.708289 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.708271    2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 16 21:09:41.710848 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.710828    2579 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 8cddd130-8fd9-4dd9-9ac1-84b17eb74651:/dev/nvme0n1p3 8f207315-ab75-446e-a9b7-a3774514b10f:/dev/nvme0n1p4]
Jul 16 21:09:41.710923 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.710847    2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 16 21:09:41.717307 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.717187    2579 manager.go:216] Machine: {Timestamp:2026-07-16 21:09:41.715695471 +0000 UTC m=+0.329875802 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100914 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2069f6e704dabb11c3ffa28ca474fc SystemUUID:ec2069f6-e704-dabb-11c3-ffa28ca474fc BootID:05fa8769-29e7-4a91-8db6-48917f663b56 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b0:07:ae:c9:7b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b0:07:ae:c9:7b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:66:dc:f3:6f:6a:04 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 16 21:09:41.717307 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.717302    2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 16 21:09:41.717438 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.717419    2579 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 16 21:09:41.720821 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.720794    2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 16 21:09:41.720967 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.720824    2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-58.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 16 21:09:41.721676 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.721663    2579 topology_manager.go:138] "Creating topology manager with none policy"
Jul 16 21:09:41.721711 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.721679    2579 container_manager_linux.go:309] "Creating device plugin manager"
Jul 16 21:09:41.721711 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.721687    2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 16 21:09:41.722535 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.722523    2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 16 21:09:41.724559 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.724547    2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 16 21:09:41.726213 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.726197    2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 16 21:09:41.728983 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.728970    2579 state_mem.go:36] "Initialized new in-memory state store"
Jul 16 21:09:41.729120 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.729111    2579 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 16 21:09:41.729151 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.729141    2579 kubelet.go:486] "Attempting to sync node with API server"
Jul 16 21:09:41.729204 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.729155    2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 16 21:09:41.729204 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.729194    2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 16 21:09:41.729273 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.729208    2579 kubelet.go:398] "Adding apiserver pod source"
Jul 16 21:09:41.729273 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.729226    2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 16 21:09:41.729610 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.729597    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 16 21:09:41.729679 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.729617    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 16 21:09:41.731962 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.731945    2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 16 21:09:41.733782 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.733765    2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 16 21:09:41.733835 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.733797    2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 16 21:09:41.735410 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.735396    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 16 21:09:41.735452 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.735417    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 16 21:09:41.735452 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.735424    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 16 21:09:41.735452 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.735430    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 16 21:09:41.735452 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.735439    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 16 21:09:41.735452 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.735446    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 16 21:09:41.735609 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.735455    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 16 21:09:41.735609 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.735460    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 16 21:09:41.735609 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.735469    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 16 21:09:41.735609 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.735474    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 16 21:09:41.735609 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.735483    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 16 21:09:41.735609 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.735489    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 16 21:09:41.736195 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.736184    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 16 21:09:41.736256 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.736212    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 16 21:09:41.738577 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.738553    2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-58.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 16 21:09:41.739383 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:41.739358    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-58.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 16 21:09:41.739678 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:41.739383    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 16 21:09:41.741278 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.741134    2579 server.go:1268] "Started kubelet"
Jul 16 21:09:41.741278 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.741188    2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 16 21:09:41.741447 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.741225    2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 16 21:09:41.741447 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.741328    2579 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 16 21:09:41.742310 ip-10-0-133-58 systemd[1]: Started Kubernetes Kubelet.
Jul 16 21:09:41.743075 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.743056    2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 16 21:09:41.744290 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.744272    2579 server.go:310] "Adding debug handlers to kubelet server"
Jul 16 21:09:41.747859 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:41.747836    2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 16 21:09:41.749021 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:41.748204    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-58.ec2.internal.18c2e15aa0139705  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-58.ec2.internal,UID:ip-10-0-133-58.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-58.ec2.internal,},FirstTimestamp:2026-07-16 21:09:41.741082373 +0000 UTC m=+0.355262684,LastTimestamp:2026-07-16 21:09:41.741082373 +0000 UTC m=+0.355262684,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-58.ec2.internal,}"
Jul 16 21:09:41.753757 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.753739    2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 16 21:09:41.753832 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.753755    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 16 21:09:41.753897 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:41.753847    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-58.ec2.internal\" not found"
Jul 16 21:09:41.754756 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.754550    2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 16 21:09:41.754756 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.754630    2579 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 16 21:09:41.754756 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.754647    2579 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 16 21:09:41.754924 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.754770    2579 reconstruct.go:97] "Volume reconstruction finished"
Jul 16 21:09:41.754924 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.754782    2579 reconciler.go:29] "Reconciler: start to sync state"
Jul 16 21:09:41.755074 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.755055    2579 factory.go:55] Registering systemd factory
Jul 16 21:09:41.755147 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.755077    2579 factory.go:223] Registration of the systemd container factory successfully
Jul 16 21:09:41.755342 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.755324    2579 factory.go:153] Registering CRI-O factory
Jul 16 21:09:41.755342 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.755343    2579 factory.go:223] Registration of the crio container factory successfully
Jul 16 21:09:41.755448 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.755387    2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 16 21:09:41.755448 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.755406    2579 factory.go:103] Registering Raw factory
Jul 16 21:09:41.755448 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.755419    2579 manager.go:1196] Started watching for new ooms in manager
Jul 16 21:09:41.755803 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.755788    2579 manager.go:349] Starting recovery of all containers
Jul 16 21:09:41.765348 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.765330    2579 manager.go:354] Recovery completed
Jul 16 21:09:41.765868 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:41.765840    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 16 21:09:41.765954 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:41.765911    2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-58.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 16 21:09:41.770069 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.770056    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 21:09:41.771934 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.771908    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-58.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 21:09:41.771984 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.771954    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-58.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 21:09:41.771984 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.771967    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-58.ec2.internal" event="NodeHasSufficientPID"
Jul 16 21:09:41.773508 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.773486    2579 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 16 21:09:41.773508 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.773508    2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 16 21:09:41.773656 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.773527    2579 state_mem.go:36] "Initialized new in-memory state store"
Jul 16 21:09:41.773656 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.773589    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 21:09:41.774582 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.774561    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-58.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 21:09:41.774666 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.774597    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-58.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 21:09:41.774666 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.774632    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-58.ec2.internal" event="NodeHasSufficientPID"
Jul 16 21:09:41.775100 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.775083    2579 policy_none.go:49] "None policy: Start"
Jul 16 21:09:41.775156 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.775121    2579 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 16 21:09:41.775156 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.775136    2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 16 21:09:41.776565 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.776550    2579 policy_none.go:47] "Start"
Jul 16 21:09:41.787596 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:41.787531    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-58.ec2.internal.18c2e15aa1ea638c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-58.ec2.internal,UID:ip-10-0-133-58.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-58.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-58.ec2.internal,},FirstTimestamp:2026-07-16 21:09:41.771936652 +0000 UTC m=+0.386116967,LastTimestamp:2026-07-16 21:09:41.771936652 +0000 UTC m=+0.386116967,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-58.ec2.internal,}"
Jul 16 21:09:41.790747 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:41.790686    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-58.ec2.internal.18c2e15aa1eabec8  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-58.ec2.internal,UID:ip-10-0-133-58.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-133-58.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-133-58.ec2.internal,},FirstTimestamp:2026-07-16 21:09:41.771960008 +0000 UTC m=+0.386140318,LastTimestamp:2026-07-16 21:09:41.771960008 +0000 UTC m=+0.386140318,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-58.ec2.internal,}"
Jul 16 21:09:41.799264 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:41.799071    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-58.ec2.internal.18c2e15aa1eaea22  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-58.ec2.internal,UID:ip-10-0-133-58.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-133-58.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-133-58.ec2.internal,},FirstTimestamp:2026-07-16 21:09:41.771971106 +0000 UTC m=+0.386151416,LastTimestamp:2026-07-16 21:09:41.771971106 +0000 UTC m=+0.386151416,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-58.ec2.internal,}"
Jul 16 21:09:41.805791 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:41.805724    2579 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-133-58.ec2.internal.18c2e15aa1ea638c\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-58.ec2.internal.18c2e15aa1ea638c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-58.ec2.internal,UID:ip-10-0-133-58.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-58.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-58.ec2.internal,},FirstTimestamp:2026-07-16 21:09:41.771936652 +0000 UTC m=+0.386116967,LastTimestamp:2026-07-16 21:09:41.774583238 +0000 UTC m=+0.388763559,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-58.ec2.internal,}"
Jul 16 21:09:41.814829 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:41.814767    2579 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-133-58.ec2.internal.18c2e15aa1eabec8\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-58.ec2.internal.18c2e15aa1eabec8  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-58.ec2.internal,UID:ip-10-0-133-58.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-133-58.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-133-58.ec2.internal,},FirstTimestamp:2026-07-16 21:09:41.771960008 +0000 UTC m=+0.386140318,LastTimestamp:2026-07-16 21:09:41.774626039 +0000 UTC m=+0.388806349,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-58.ec2.internal,}"
Jul 16 21:09:41.816733 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.816717    2579 manager.go:337] "Starting Device Plugin manager"
Jul 16 21:09:41.816816 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:41.816764    2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 16 21:09:41.816816 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.816780    2579 server.go:87] "Starting device plugin registration server"
Jul 16 21:09:41.817042 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.817029    2579 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 16 21:09:41.817105 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.817044    2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 16 21:09:41.817193 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.817173    2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 16 21:09:41.817296 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.817271    2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 16 21:09:41.817296 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.817287    2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 16 21:09:41.817772 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:41.817750    2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 16 21:09:41.817852 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:41.817802    2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-58.ec2.internal\" not found"
Jul 16 21:09:41.829418 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:41.829355    2579 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-133-58.ec2.internal.18c2e15aa1eaea22\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-58.ec2.internal.18c2e15aa1eaea22  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-58.ec2.internal,UID:ip-10-0-133-58.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-133-58.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-133-58.ec2.internal,},FirstTimestamp:2026-07-16 21:09:41.771971106 +0000 UTC m=+0.386151416,LastTimestamp:2026-07-16 21:09:41.774637146 +0000 UTC m=+0.388817456,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-58.ec2.internal,}"
Jul 16 21:09:41.839035 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:41.838965    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-58.ec2.internal.18c2e15aa4b843b0  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-58.ec2.internal,UID:ip-10-0-133-58.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-133-58.ec2.internal,},FirstTimestamp:2026-07-16 21:09:41.818983344 +0000 UTC m=+0.433163644,LastTimestamp:2026-07-16 21:09:41.818983344 +0000 UTC m=+0.433163644,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-58.ec2.internal,}"
Jul 16 21:09:41.905676 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.905621    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9f9cp"
Jul 16 21:09:41.913147 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.913128    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9f9cp"
Jul 16 21:09:41.918221 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.918198    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 21:09:41.919161 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.919144    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-58.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 21:09:41.919254 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.919176    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-58.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 21:09:41.919254 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.919186    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-58.ec2.internal" event="NodeHasSufficientPID"
Jul 16 21:09:41.919254 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.919224    2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-58.ec2.internal"
Jul 16 21:09:41.940697 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.940678    2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-58.ec2.internal"
Jul 16 21:09:41.940775 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:41.940705    2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-58.ec2.internal\": node \"ip-10-0-133-58.ec2.internal\" not found"
Jul 16 21:09:41.960163 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:41.960145    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-58.ec2.internal\" not found"
Jul 16 21:09:41.963937 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.963917    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 16 21:09:41.965110 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.965075    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 16 21:09:41.965110 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.965112    2579 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 16 21:09:41.965247 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.965132    2579 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 16 21:09:41.965247 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:41.965163    2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 16 21:09:41.967673 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:41.967653    2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 21:09:42.061049 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:42.061015    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-58.ec2.internal\" not found"
Jul 16 21:09:42.065453 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:42.065427    2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-58.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-58.ec2.internal"]
Jul 16 21:09:42.065514 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:42.065503    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 21:09:42.066524 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:42.066502    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-58.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 21:09:42.066628 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:42.066533    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-58.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 21:09:42.066628 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:42.066548    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-58.ec2.internal" event="NodeHasSufficientPID"
Jul 16 21:09:42.068313 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:42.068299    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 21:09:42.068443 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:42.068429    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-58.ec2.internal"
Jul 16 21:09:42.068480 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:42.068462    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 21:09:42.069052 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:42.069035    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-58.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 21:09:42.069176 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:42.069060    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-58.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 21:09:42.069176 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:42.069075    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-58.ec2.internal" event="NodeHasSufficientPID"
Jul 16 21:09:42.069176 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:42.069096    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-58.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 21:09:42.069176 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:42.069130    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-58.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 21:09:42.069176 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:42.069141    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-58.ec2.internal" event="NodeHasSufficientPID"
Jul 16 21:09:42.070834 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:42.070816    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-58.ec2.internal"
Jul 16 21:09:42.070926 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:42.070848    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 21:09:42.071604 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:42.071590    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-58.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 21:09:42.071684 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:42.071619    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-58.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 21:09:42.071684 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:42.071634    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-58.ec2.internal" event="NodeHasSufficientPID"
Jul 16 21:09:42.094932 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:42.094912    2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-58.ec2.internal\" not found" node="ip-10-0-133-58.ec2.internal"
Jul 16 21:09:42.099939 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:42.099918    2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-58.ec2.internal\" not found" node="ip-10-0-133-58.ec2.internal"
Jul 16 21:09:42.157282 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:42.157203    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8191b9618bfa53be6f3908cc4952d20e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-58.ec2.internal\" (UID: \"8191b9618bfa53be6f3908cc4952d20e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-58.ec2.internal"
Jul 16 21:09:42.157282 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:42.157234    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8191b9618bfa53be6f3908cc4952d20e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-58.ec2.internal\" (UID: \"8191b9618bfa53be6f3908cc4952d20e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-58.ec2.internal"
Jul 16 21:09:42.157282 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:42.157253    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/505a84a2e65f988310008bbe35d60123-config\") pod \"kube-apiserver-proxy-ip-10-0-133-58.ec2.internal\" (UID: \"505a84a2e65f988310008bbe35d60123\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-58.ec2.internal"
Jul 16 21:09:42.161563 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:42.161542    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-58.ec2.internal\" not found"
Jul 16 21:09:42.257836 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:42.257794    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8191b9618bfa53be6f3908cc4952d20e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-58.ec2.internal\" (UID: \"8191b9618bfa53be6f3908cc4952d20e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-58.ec2.internal"
Jul 16 21:09:42.257836 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:42.257846    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8191b9618bfa53be6f3908cc4952d20e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-58.ec2.internal\" (UID: \"8191b9618bfa53be6f3908cc4952d20e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-58.ec2.internal"
Jul 16 21:09:42.258044 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:42.257864    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/505a84a2e65f988310008bbe35d60123-config\") pod \"kube-apiserver-proxy-ip-10-0-133-58.ec2.internal\" (UID: \"505a84a2e65f988310008bbe35d60123\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-58.ec2.internal"
Jul 16 21:09:42.258044 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:42.257912    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/505a84a2e65f988310008bbe35d60123-config\") pod \"kube-apiserver-proxy-ip-10-0-133-58.ec2.internal\" (UID: \"505a84a2e65f988310008bbe35d60123\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-58.ec2.internal"
Jul 16 21:09:42.258044 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:42.257917    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8191b9618bfa53be6f3908cc4952d20e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-58.ec2.internal\" (UID: \"8191b9618bfa53be6f3908cc4952d20e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-58.ec2.internal"
Jul 16 21:09:42.258044 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:42.257917    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8191b9618bfa53be6f3908cc4952d20e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-58.ec2.internal\" (UID: \"8191b9618bfa53be6f3908cc4952d20e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-58.ec2.internal"
Jul 16 21:09:42.262244 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:42.262225    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-58.ec2.internal\" not found"
Jul 16 21:09:42.363333 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:42.363298    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-58.ec2.internal\" not found"
Jul 16 21:09:42.399210 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:42.399178    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-58.ec2.internal"
Jul 16 21:09:42.405183 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:42.405155    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-58.ec2.internal"
Jul 16 21:09:42.463578 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:42.463539    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-58.ec2.internal\" not found"
Jul 16 21:09:42.564313 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:42.564278    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-58.ec2.internal\" not found"
Jul 16 21:09:42.665412 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:42.665355    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-58.ec2.internal\" not found"
Jul 16 21:09:42.686728 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:42.686704    2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 16 21:09:42.686885 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:42.686869    2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 16 21:09:42.766541 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:42.766502    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-58.ec2.internal\" not found"
Jul 16 21:09:42.866964 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:42.866932    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-58.ec2.internal\" not found"
Jul 16 21:09:42.901151 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:42.901035    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 21:09:42.901897 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:42.901873    2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 21:09:42.902878 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:42.902855    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-58.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 21:09:42.902953 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:42.902896    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-58.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 21:09:42.902953 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:42.902909    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-58.ec2.internal" event="NodeHasSufficientPID"
Jul 16 21:09:42.910041 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:42.910021    2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 21:09:42.918993 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:42.918931    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-15 21:04:42 +0000 UTC" deadline="2028-04-16 05:02:58.220386868 +0000 UTC"
Jul 16 21:09:42.918993 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:42.918956    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15343h53m15.301434079s"
Jul 16 21:09:42.967046 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:42.967023    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-58.ec2.internal\" not found"
Jul 16 21:09:42.981636 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:42.981598    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8191b9618bfa53be6f3908cc4952d20e.slice/crio-4db8892078982f06c52e131e69d4a7b55c614f886d6b7898a008d2568e99efa4 WatchSource:0}: Error finding container 4db8892078982f06c52e131e69d4a7b55c614f886d6b7898a008d2568e99efa4: Status 404 returned error can't find the container with id 4db8892078982f06c52e131e69d4a7b55c614f886d6b7898a008d2568e99efa4
Jul 16 21:09:42.986833 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:42.986820    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 21:09:43.067377 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:43.067342    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-58.ec2.internal\" not found"
Jul 16 21:09:43.165257 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.165229    2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 21:09:43.254887 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.254782    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-58.ec2.internal"
Jul 16 21:09:43.272721 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.272684    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 16 21:09:43.273657 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.273642    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-58.ec2.internal"
Jul 16 21:09:43.284853 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.284833    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 16 21:09:43.544370 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:43.544344    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod505a84a2e65f988310008bbe35d60123.slice/crio-29b0c76a2d2d3ddfb3ca50940d3a7f8cbcc8ea3a1168ebde1c4f12f49a078a1b WatchSource:0}: Error finding container 29b0c76a2d2d3ddfb3ca50940d3a7f8cbcc8ea3a1168ebde1c4f12f49a078a1b: Status 404 returned error can't find the container with id 29b0c76a2d2d3ddfb3ca50940d3a7f8cbcc8ea3a1168ebde1c4f12f49a078a1b
Jul 16 21:09:43.732687 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.732654    2579 apiserver.go:52] "Watching apiserver"
Jul 16 21:09:43.742857 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.742836    2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 16 21:09:43.744090 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.744067    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-dd8jk","kube-system/global-pull-secret-syncer-6z877","kube-system/konnectivity-agent-llmw2","kube-system/kube-apiserver-proxy-ip-10-0-133-58.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68m9d","openshift-cluster-node-tuning-operator/tuned-lqhw4","openshift-dns/node-resolver-znkwj","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-58.ec2.internal","openshift-multus/multus-s2phn","openshift-image-registry/node-ca-lft7l","openshift-multus/multus-additional-cni-plugins-w9rrt","openshift-multus/network-metrics-daemon-v5bvd","openshift-network-diagnostics/network-check-target-9mdcw","openshift-network-operator/iptables-alerter-hkbpk"]
Jul 16 21:09:43.745938 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.745925    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lft7l"
Jul 16 21:09:43.747957 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.747938    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9mdcw"
Jul 16 21:09:43.748045 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:43.748001    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9mdcw" podUID="e9422503-3736-42d5-85de-6160c39f65bf"
Jul 16 21:09:43.749335 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.749317    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-llmw2"
Jul 16 21:09:43.749985 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.749970    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-rkl7z\""
Jul 16 21:09:43.750490 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.750470    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 16 21:09:43.750558 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.750545    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 16 21:09:43.750642 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.750626    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hkbpk"
Jul 16 21:09:43.751039 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.751025    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 16 21:09:43.751810 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.751793    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68m9d"
Jul 16 21:09:43.753197 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.753163    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lqhw4"
Jul 16 21:09:43.753315 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.753290    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-kfslq\""
Jul 16 21:09:43.753424 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.753395    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 16 21:09:43.753424 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.753299    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 16 21:09:43.753538 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.753444    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 16 21:09:43.754723 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.754708    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 16 21:09:43.754892 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.754876    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-s2phn"
Jul 16 21:09:43.756732 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.756712    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-znkwj"
Jul 16 21:09:43.758054 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.758038    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6z877"
Jul 16 21:09:43.758145 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:43.758091    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6z877" podUID="97f73b7d-47ea-4d24-a45e-fab8a2f5cda2"
Jul 16 21:09:43.759602 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.759580    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk"
Jul 16 21:09:43.761232 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.761208    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-jkc6t\""
Jul 16 21:09:43.762665 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.761539    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-rz57f\""
Jul 16 21:09:43.762665 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.761637    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 16 21:09:43.762665 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.761723    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 16 21:09:43.762665 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.761733    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-4b7t8\""
Jul 16 21:09:43.762665 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.761838    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-pfzrv\""
Jul 16 21:09:43.762665 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.761921    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 16 21:09:43.762665 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.762032    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 16 21:09:43.762665 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.762081    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 16 21:09:43.762665 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.762484    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-w9rrt"
Jul 16 21:09:43.763055 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.762934    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 16 21:09:43.763308 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.763290    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 16 21:09:43.763502 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.763480    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 16 21:09:43.763650 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.763629    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 16 21:09:43.763726 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.763668    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-2lpnb\""
Jul 16 21:09:43.763788 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.763767    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 16 21:09:43.763849 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.763825    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 16 21:09:43.763973 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.763923    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 16 21:09:43.764062 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.764044    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 16 21:09:43.764611 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.764593    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v5bvd"
Jul 16 21:09:43.764703 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:43.764678    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v5bvd" podUID="abc6bb6b-5fd0-4978-9416-d0582775a520"
Jul 16 21:09:43.765512 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.765481    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hswhk\""
Jul 16 21:09:43.765609 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.765535    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 16 21:09:43.765609 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.765562    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 16 21:09:43.765825 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.765811    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 16 21:09:43.765915 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.765898    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 16 21:09:43.766562 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.766543    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/31d88740-4569-46ac-8cf7-1ba83a71f020-host-slash\") pod \"iptables-alerter-hkbpk\" (UID: \"31d88740-4569-46ac-8cf7-1ba83a71f020\") " pod="openshift-network-operator/iptables-alerter-hkbpk"
Jul 16 21:09:43.766631 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.766576    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/101708f5-f1af-4179-91e1-f57c3494b6a7-etc-modprobe-d\") pod \"tuned-lqhw4\" (UID: \"101708f5-f1af-4179-91e1-f57c3494b6a7\") " pod="openshift-cluster-node-tuning-operator/tuned-lqhw4"
Jul 16 21:09:43.766631 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.766601    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/101708f5-f1af-4179-91e1-f57c3494b6a7-etc-sysctl-d\") pod \"tuned-lqhw4\" (UID: \"101708f5-f1af-4179-91e1-f57c3494b6a7\") " pod="openshift-cluster-node-tuning-operator/tuned-lqhw4"
Jul 16 21:09:43.766631 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.766626    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e787d2eb-af32-410d-96c2-d02ba94e62cd-cni-binary-copy\") pod \"multus-s2phn\" (UID: \"e787d2eb-af32-410d-96c2-d02ba94e62cd\") " pod="openshift-multus/multus-s2phn"
Jul 16 21:09:43.766804 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.766641    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e787d2eb-af32-410d-96c2-d02ba94e62cd-multus-socket-dir-parent\") pod \"multus-s2phn\" (UID: \"e787d2eb-af32-410d-96c2-d02ba94e62cd\") " pod="openshift-multus/multus-s2phn"
Jul 16 21:09:43.766804 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.766685    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e787d2eb-af32-410d-96c2-d02ba94e62cd-host-run-k8s-cni-cncf-io\") pod \"multus-s2phn\" (UID: \"e787d2eb-af32-410d-96c2-d02ba94e62cd\") " pod="openshift-multus/multus-s2phn"
Jul 16 21:09:43.766804 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.766713    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e787d2eb-af32-410d-96c2-d02ba94e62cd-multus-daemon-config\") pod \"multus-s2phn\" (UID: \"e787d2eb-af32-410d-96c2-d02ba94e62cd\") " pod="openshift-multus/multus-s2phn"
Jul 16 21:09:43.766804 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.766731    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmh2k\" (UniqueName: \"kubernetes.io/projected/26fd5f6a-a629-43f1-8370-9e9f5974390a-kube-api-access-zmh2k\") pod \"aws-ebs-csi-driver-node-68m9d\" (UID: \"26fd5f6a-a629-43f1-8370-9e9f5974390a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68m9d"
Jul 16 21:09:43.766804 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.766747    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v84kv\" (UniqueName: \"kubernetes.io/projected/31d88740-4569-46ac-8cf7-1ba83a71f020-kube-api-access-v84kv\") pod \"iptables-alerter-hkbpk\" (UID: \"31d88740-4569-46ac-8cf7-1ba83a71f020\") " pod="openshift-network-operator/iptables-alerter-hkbpk"
Jul 16 21:09:43.766804 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.766791    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/101708f5-f1af-4179-91e1-f57c3494b6a7-etc-systemd\") pod \"tuned-lqhw4\" (UID: \"101708f5-f1af-4179-91e1-f57c3494b6a7\") " pod="openshift-cluster-node-tuning-operator/tuned-lqhw4"
Jul 16 21:09:43.767089 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.766817    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/101708f5-f1af-4179-91e1-f57c3494b6a7-sys\") pod \"tuned-lqhw4\" (UID: \"101708f5-f1af-4179-91e1-f57c3494b6a7\") " pod="openshift-cluster-node-tuning-operator/tuned-lqhw4"
Jul 16 21:09:43.767089 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.766845    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e787d2eb-af32-410d-96c2-d02ba94e62cd-os-release\") pod \"multus-s2phn\" (UID: \"e787d2eb-af32-410d-96c2-d02ba94e62cd\") " pod="openshift-multus/multus-s2phn"
Jul 16 21:09:43.767089 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.766864    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e787d2eb-af32-410d-96c2-d02ba94e62cd-host-var-lib-kubelet\") pod \"multus-s2phn\" (UID: \"e787d2eb-af32-410d-96c2-d02ba94e62cd\") " pod="openshift-multus/multus-s2phn"
Jul 16 21:09:43.767089 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.766879    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/355ad64f-aa0d-4876-a4a2-faec378a30bf-host\") pod \"node-ca-lft7l\" (UID: \"355ad64f-aa0d-4876-a4a2-faec378a30bf\") " pod="openshift-image-registry/node-ca-lft7l"
Jul 16 21:09:43.767089 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.766901    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/355ad64f-aa0d-4876-a4a2-faec378a30bf-serviceca\") pod \"node-ca-lft7l\" (UID: \"355ad64f-aa0d-4876-a4a2-faec378a30bf\") " pod="openshift-image-registry/node-ca-lft7l"
Jul 16 21:09:43.767089 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.766925    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/26fd5f6a-a629-43f1-8370-9e9f5974390a-socket-dir\") pod \"aws-ebs-csi-driver-node-68m9d\" (UID: \"26fd5f6a-a629-43f1-8370-9e9f5974390a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68m9d"
Jul 16 21:09:43.767089 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.766955    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/26fd5f6a-a629-43f1-8370-9e9f5974390a-registration-dir\") pod \"aws-ebs-csi-driver-node-68m9d\" (UID: \"26fd5f6a-a629-43f1-8370-9e9f5974390a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68m9d"
Jul 16 21:09:43.767089 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.766974    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/92e2f3e9-e610-4859-b11b-105f3e28d548-agent-certs\") pod \"konnectivity-agent-llmw2\" (UID: \"92e2f3e9-e610-4859-b11b-105f3e28d548\") " pod="kube-system/konnectivity-agent-llmw2"
Jul 16 21:09:43.767089 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.766999    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/31d88740-4569-46ac-8cf7-1ba83a71f020-iptables-alerter-script\") pod \"iptables-alerter-hkbpk\" (UID: \"31d88740-4569-46ac-8cf7-1ba83a71f020\") " pod="openshift-network-operator/iptables-alerter-hkbpk"
Jul 16 21:09:43.767089 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.767022    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e787d2eb-af32-410d-96c2-d02ba94e62cd-host-var-lib-cni-bin\") pod \"multus-s2phn\" (UID: \"e787d2eb-af32-410d-96c2-d02ba94e62cd\") " pod="openshift-multus/multus-s2phn"
Jul 16 21:09:43.767089 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.767043    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e787d2eb-af32-410d-96c2-d02ba94e62cd-host-var-lib-cni-multus\") pod \"multus-s2phn\" (UID: \"e787d2eb-af32-410d-96c2-d02ba94e62cd\") " pod="openshift-multus/multus-s2phn"
Jul 16 21:09:43.767089 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.767061    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e787d2eb-af32-410d-96c2-d02ba94e62cd-etc-kubernetes\") pod \"multus-s2phn\" (UID: \"e787d2eb-af32-410d-96c2-d02ba94e62cd\") " pod="openshift-multus/multus-s2phn"
Jul 16 21:09:43.767089 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.767077    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q854g\" (UniqueName: \"kubernetes.io/projected/355ad64f-aa0d-4876-a4a2-faec378a30bf-kube-api-access-q854g\") pod \"node-ca-lft7l\" (UID: \"355ad64f-aa0d-4876-a4a2-faec378a30bf\") " pod="openshift-image-registry/node-ca-lft7l"
Jul 16 21:09:43.767089 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.767096    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/26fd5f6a-a629-43f1-8370-9e9f5974390a-sys-fs\") pod \"aws-ebs-csi-driver-node-68m9d\" (UID: \"26fd5f6a-a629-43f1-8370-9e9f5974390a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68m9d"
Jul 16 21:09:43.767816 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.767118    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/101708f5-f1af-4179-91e1-f57c3494b6a7-etc-kubernetes\") pod \"tuned-lqhw4\" (UID: \"101708f5-f1af-4179-91e1-f57c3494b6a7\") " pod="openshift-cluster-node-tuning-operator/tuned-lqhw4"
Jul 16 21:09:43.767816 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.767157    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e787d2eb-af32-410d-96c2-d02ba94e62cd-system-cni-dir\") pod \"multus-s2phn\" (UID: \"e787d2eb-af32-410d-96c2-d02ba94e62cd\") " pod="openshift-multus/multus-s2phn"
Jul 16 21:09:43.767816 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.767171    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/26fd5f6a-a629-43f1-8370-9e9f5974390a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-68m9d\" (UID: \"26fd5f6a-a629-43f1-8370-9e9f5974390a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68m9d"
Jul 16 21:09:43.767816 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.767186    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/26fd5f6a-a629-43f1-8370-9e9f5974390a-device-dir\") pod \"aws-ebs-csi-driver-node-68m9d\" (UID: \"26fd5f6a-a629-43f1-8370-9e9f5974390a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68m9d"
Jul 16 21:09:43.767816 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.767210    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/101708f5-f1af-4179-91e1-f57c3494b6a7-etc-tuned\") pod \"tuned-lqhw4\" (UID: \"101708f5-f1af-4179-91e1-f57c3494b6a7\") " pod="openshift-cluster-node-tuning-operator/tuned-lqhw4"
Jul 16 21:09:43.767816 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.767239    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/101708f5-f1af-4179-91e1-f57c3494b6a7-tmp\") pod \"tuned-lqhw4\" (UID: \"101708f5-f1af-4179-91e1-f57c3494b6a7\") " pod="openshift-cluster-node-tuning-operator/tuned-lqhw4"
Jul 16 21:09:43.767816 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.767301    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e787d2eb-af32-410d-96c2-d02ba94e62cd-multus-conf-dir\") pod \"multus-s2phn\" (UID: \"e787d2eb-af32-410d-96c2-d02ba94e62cd\") " pod="openshift-multus/multus-s2phn"
Jul 16 21:09:43.767816 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.767340    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/92e2f3e9-e610-4859-b11b-105f3e28d548-konnectivity-ca\") pod \"konnectivity-agent-llmw2\" (UID: \"92e2f3e9-e610-4859-b11b-105f3e28d548\") " pod="kube-system/konnectivity-agent-llmw2"
Jul 16 21:09:43.767816 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.767369    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/101708f5-f1af-4179-91e1-f57c3494b6a7-var-lib-kubelet\") pod \"tuned-lqhw4\" (UID: \"101708f5-f1af-4179-91e1-f57c3494b6a7\") " pod="openshift-cluster-node-tuning-operator/tuned-lqhw4"
Jul 16 21:09:43.767816 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.767394    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/101708f5-f1af-4179-91e1-f57c3494b6a7-host\") pod \"tuned-lqhw4\" (UID: \"101708f5-f1af-4179-91e1-f57c3494b6a7\") " pod="openshift-cluster-node-tuning-operator/tuned-lqhw4"
Jul 16 21:09:43.767816 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.767412    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e787d2eb-af32-410d-96c2-d02ba94e62cd-cnibin\") pod \"multus-s2phn\" (UID: \"e787d2eb-af32-410d-96c2-d02ba94e62cd\") " pod="openshift-multus/multus-s2phn"
Jul 16 21:09:43.767816 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.767427    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e787d2eb-af32-410d-96c2-d02ba94e62cd-host-run-netns\") pod \"multus-s2phn\" (UID: \"e787d2eb-af32-410d-96c2-d02ba94e62cd\") " pod="openshift-multus/multus-s2phn"
Jul 16 21:09:43.767816 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.767440    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/101708f5-f1af-4179-91e1-f57c3494b6a7-etc-sysconfig\") pod \"tuned-lqhw4\" (UID: \"101708f5-f1af-4179-91e1-f57c3494b6a7\") " pod="openshift-cluster-node-tuning-operator/tuned-lqhw4"
Jul 16 21:09:43.767816 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.767453    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/101708f5-f1af-4179-91e1-f57c3494b6a7-run\") pod \"tuned-lqhw4\" (UID: \"101708f5-f1af-4179-91e1-f57c3494b6a7\") " pod="openshift-cluster-node-tuning-operator/tuned-lqhw4"
Jul 16 21:09:43.767816 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.767482    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/101708f5-f1af-4179-91e1-f57c3494b6a7-lib-modules\") pod \"tuned-lqhw4\" (UID: \"101708f5-f1af-4179-91e1-f57c3494b6a7\") " pod="openshift-cluster-node-tuning-operator/tuned-lqhw4"
Jul 16 21:09:43.767816 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.767502    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkzlg\" (UniqueName: \"kubernetes.io/projected/101708f5-f1af-4179-91e1-f57c3494b6a7-kube-api-access-vkzlg\") pod \"tuned-lqhw4\" (UID: \"101708f5-f1af-4179-91e1-f57c3494b6a7\") " pod="openshift-cluster-node-tuning-operator/tuned-lqhw4"
Jul 16 21:09:43.767816 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.767519    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/26fd5f6a-a629-43f1-8370-9e9f5974390a-etc-selinux\") pod \"aws-ebs-csi-driver-node-68m9d\" (UID: \"26fd5f6a-a629-43f1-8370-9e9f5974390a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68m9d"
Jul 16 21:09:43.768752 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.767534    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jr8lm\" (UniqueName: \"kubernetes.io/projected/e9422503-3736-42d5-85de-6160c39f65bf-kube-api-access-jr8lm\") pod \"network-check-target-9mdcw\" (UID: \"e9422503-3736-42d5-85de-6160c39f65bf\") " pod="openshift-network-diagnostics/network-check-target-9mdcw"
Jul 16 21:09:43.768752 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.767552    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/101708f5-f1af-4179-91e1-f57c3494b6a7-etc-sysctl-conf\") pod \"tuned-lqhw4\" (UID: \"101708f5-f1af-4179-91e1-f57c3494b6a7\") " pod="openshift-cluster-node-tuning-operator/tuned-lqhw4"
Jul 16 21:09:43.768752 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.767577    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e787d2eb-af32-410d-96c2-d02ba94e62cd-multus-cni-dir\") pod \"multus-s2phn\" (UID: \"e787d2eb-af32-410d-96c2-d02ba94e62cd\") " pod="openshift-multus/multus-s2phn"
Jul 16 21:09:43.768752 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.767596    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e787d2eb-af32-410d-96c2-d02ba94e62cd-hostroot\") pod \"multus-s2phn\" (UID: \"e787d2eb-af32-410d-96c2-d02ba94e62cd\") " pod="openshift-multus/multus-s2phn"
Jul 16 21:09:43.768752 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.767610    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e787d2eb-af32-410d-96c2-d02ba94e62cd-host-run-multus-certs\") pod \"multus-s2phn\" (UID: \"e787d2eb-af32-410d-96c2-d02ba94e62cd\") " pod="openshift-multus/multus-s2phn"
Jul 16 21:09:43.768752 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.767637    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhjwp\" (UniqueName: \"kubernetes.io/projected/e787d2eb-af32-410d-96c2-d02ba94e62cd-kube-api-access-lhjwp\") pod \"multus-s2phn\" (UID: \"e787d2eb-af32-410d-96c2-d02ba94e62cd\") " pod="openshift-multus/multus-s2phn"
Jul 16 21:09:43.769902 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.769881    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 16 21:09:43.770664 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.770642    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 16 21:09:43.770664 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.770657    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 16 21:09:43.770812 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.770657    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 16 21:09:43.777469 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.777436    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-v8bvx\""
Jul 16 21:09:43.777673 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.777656    2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 21:09:43.781610 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.781590    2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 16 21:09:43.855741 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.855710    2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 16 21:09:43.868160 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.868135    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e787d2eb-af32-410d-96c2-d02ba94e62cd-multus-conf-dir\") pod \"multus-s2phn\" (UID: \"e787d2eb-af32-410d-96c2-d02ba94e62cd\") " pod="openshift-multus/multus-s2phn"
Jul 16 21:09:43.868309 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.868166    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/92e2f3e9-e610-4859-b11b-105f3e28d548-konnectivity-ca\") pod \"konnectivity-agent-llmw2\" (UID: \"92e2f3e9-e610-4859-b11b-105f3e28d548\") " pod="kube-system/konnectivity-agent-llmw2"
Jul 16 21:09:43.868309 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.868193    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/101708f5-f1af-4179-91e1-f57c3494b6a7-var-lib-kubelet\") pod \"tuned-lqhw4\" (UID: \"101708f5-f1af-4179-91e1-f57c3494b6a7\") " pod="openshift-cluster-node-tuning-operator/tuned-lqhw4"
Jul 16 21:09:43.868309 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.868224    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/67996421-567c-4901-b037-a8863575763b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w9rrt\" (UID: \"67996421-567c-4901-b037-a8863575763b\") " pod="openshift-multus/multus-additional-cni-plugins-w9rrt"
Jul 16 21:09:43.868309 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.868290    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/abc6bb6b-5fd0-4978-9416-d0582775a520-metrics-certs\") pod \"network-metrics-daemon-v5bvd\" (UID: \"abc6bb6b-5fd0-4978-9416-d0582775a520\") " pod="openshift-multus/network-metrics-daemon-v5bvd"
Jul 16 21:09:43.868309 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.868290    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e787d2eb-af32-410d-96c2-d02ba94e62cd-multus-conf-dir\") pod \"multus-s2phn\" (UID: \"e787d2eb-af32-410d-96c2-d02ba94e62cd\") " pod="openshift-multus/multus-s2phn"
Jul 16 21:09:43.868691 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.868315    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/101708f5-f1af-4179-91e1-f57c3494b6a7-var-lib-kubelet\") pod \"tuned-lqhw4\" (UID: \"101708f5-f1af-4179-91e1-f57c3494b6a7\") " pod="openshift-cluster-node-tuning-operator/tuned-lqhw4"
Jul 16 21:09:43.868691 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.868333    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/101708f5-f1af-4179-91e1-f57c3494b6a7-etc-sysconfig\") pod \"tuned-lqhw4\" (UID: \"101708f5-f1af-4179-91e1-f57c3494b6a7\") " pod="openshift-cluster-node-tuning-operator/tuned-lqhw4"
Jul 16 21:09:43.868691 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.868359    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkzlg\" (UniqueName: \"kubernetes.io/projected/101708f5-f1af-4179-91e1-f57c3494b6a7-kube-api-access-vkzlg\") pod \"tuned-lqhw4\" (UID: \"101708f5-f1af-4179-91e1-f57c3494b6a7\") " pod="openshift-cluster-node-tuning-operator/tuned-lqhw4"
Jul 16 21:09:43.868691 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.868379    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/67996421-567c-4901-b037-a8863575763b-cnibin\") pod \"multus-additional-cni-plugins-w9rrt\" (UID: \"67996421-567c-4901-b037-a8863575763b\") " pod="openshift-multus/multus-additional-cni-plugins-w9rrt"
Jul 16 21:09:43.868691 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.868401    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/67996421-567c-4901-b037-a8863575763b-cni-binary-copy\") pod \"multus-additional-cni-plugins-w9rrt\" (UID: \"67996421-567c-4901-b037-a8863575763b\") " pod="openshift-multus/multus-additional-cni-plugins-w9rrt"
Jul 16 21:09:43.868691 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.868428    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/67996421-567c-4901-b037-a8863575763b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w9rrt\" (UID: \"67996421-567c-4901-b037-a8863575763b\") " pod="openshift-multus/multus-additional-cni-plugins-w9rrt"
Jul 16 21:09:43.868691 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.868433    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/101708f5-f1af-4179-91e1-f57c3494b6a7-etc-sysconfig\") pod \"tuned-lqhw4\" (UID: \"101708f5-f1af-4179-91e1-f57c3494b6a7\") " pod="openshift-cluster-node-tuning-operator/tuned-lqhw4"
Jul 16 21:09:43.868691 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.868450    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e52ac48f-692d-4893-a046-71dea5a7b5aa-tmp-dir\") pod \"node-resolver-znkwj\" (UID: \"e52ac48f-692d-4893-a046-71dea5a7b5aa\") " pod="openshift-dns/node-resolver-znkwj"
Jul 16 21:09:43.868691 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.868476    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1b4a76d0-f222-48bd-ac11-fd187bada4ec-host-slash\") pod \"ovnkube-node-dd8jk\" (UID: \"1b4a76d0-f222-48bd-ac11-fd187bada4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk"
Jul 16 21:09:43.868691 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.868511    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1b4a76d0-f222-48bd-ac11-fd187bada4ec-log-socket\") pod \"ovnkube-node-dd8jk\" (UID: \"1b4a76d0-f222-48bd-ac11-fd187bada4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk"
Jul 16 21:09:43.868691 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.868544    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/101708f5-f1af-4179-91e1-f57c3494b6a7-etc-sysctl-conf\") pod \"tuned-lqhw4\" (UID: \"101708f5-f1af-4179-91e1-f57c3494b6a7\") " pod="openshift-cluster-node-tuning-operator/tuned-lqhw4"
Jul 16 21:09:43.868691 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.868600    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/67996421-567c-4901-b037-a8863575763b-os-release\") pod \"multus-additional-cni-plugins-w9rrt\" (UID: \"67996421-567c-4901-b037-a8863575763b\") " pod="openshift-multus/multus-additional-cni-plugins-w9rrt"
Jul 16 21:09:43.868691 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.868628    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1b4a76d0-f222-48bd-ac11-fd187bada4ec-run-ovn\") pod \"ovnkube-node-dd8jk\" (UID: \"1b4a76d0-f222-48bd-ac11-fd187bada4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk"
Jul 16 21:09:43.868691 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.868655    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e787d2eb-af32-410d-96c2-d02ba94e62cd-hostroot\") pod \"multus-s2phn\" (UID: \"e787d2eb-af32-410d-96c2-d02ba94e62cd\") " pod="openshift-multus/multus-s2phn"
Jul 16 21:09:43.868691 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.868682    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/101708f5-f1af-4179-91e1-f57c3494b6a7-etc-sysctl-d\") pod \"tuned-lqhw4\" (UID: \"101708f5-f1af-4179-91e1-f57c3494b6a7\") " pod="openshift-cluster-node-tuning-operator/tuned-lqhw4"
Jul 16 21:09:43.869498 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.868707    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/101708f5-f1af-4179-91e1-f57c3494b6a7-etc-sysctl-conf\") pod \"tuned-lqhw4\" (UID: \"101708f5-f1af-4179-91e1-f57c3494b6a7\") " pod="openshift-cluster-node-tuning-operator/tuned-lqhw4"
Jul 16 21:09:43.869498 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.868709    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/67996421-567c-4901-b037-a8863575763b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w9rrt\" (UID: \"67996421-567c-4901-b037-a8863575763b\") " pod="openshift-multus/multus-additional-cni-plugins-w9rrt"
Jul 16 21:09:43.869498 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.868709    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e787d2eb-af32-410d-96c2-d02ba94e62cd-hostroot\") pod \"multus-s2phn\" (UID: \"e787d2eb-af32-410d-96c2-d02ba94e62cd\") " pod="openshift-multus/multus-s2phn"
Jul 16 21:09:43.869498 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.868743    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e52ac48f-692d-4893-a046-71dea5a7b5aa-hosts-file\") pod \"node-resolver-znkwj\" (UID: \"e52ac48f-692d-4893-a046-71dea5a7b5aa\") " pod="openshift-dns/node-resolver-znkwj"
Jul 16 21:09:43.869498 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.868764    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1b4a76d0-f222-48bd-ac11-fd187bada4ec-etc-openvswitch\") pod \"ovnkube-node-dd8jk\" (UID: \"1b4a76d0-f222-48bd-ac11-fd187bada4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk"
Jul 16 21:09:43.869498 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.868783    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1b4a76d0-f222-48bd-ac11-fd187bada4ec-node-log\") pod \"ovnkube-node-dd8jk\" (UID: \"1b4a76d0-f222-48bd-ac11-fd187bada4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk"
Jul 16 21:09:43.869498 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.868832    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/92e2f3e9-e610-4859-b11b-105f3e28d548-konnectivity-ca\") pod \"konnectivity-agent-llmw2\" (UID: \"92e2f3e9-e610-4859-b11b-105f3e28d548\") " pod="kube-system/konnectivity-agent-llmw2"
Jul 16 21:09:43.869498 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.868853    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/101708f5-f1af-4179-91e1-f57c3494b6a7-etc-sysctl-d\") pod \"tuned-lqhw4\" (UID: \"101708f5-f1af-4179-91e1-f57c3494b6a7\") " pod="openshift-cluster-node-tuning-operator/tuned-lqhw4"
Jul 16 21:09:43.869498 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.868907    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e787d2eb-af32-410d-96c2-d02ba94e62cd-host-run-k8s-cni-cncf-io\") pod \"multus-s2phn\" (UID: \"e787d2eb-af32-410d-96c2-d02ba94e62cd\") " pod="openshift-multus/multus-s2phn"
Jul 16 21:09:43.869498 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.868941    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e787d2eb-af32-410d-96c2-d02ba94e62cd-host-run-k8s-cni-cncf-io\") pod \"multus-s2phn\" (UID: \"e787d2eb-af32-410d-96c2-d02ba94e62cd\") " pod="openshift-multus/multus-s2phn"
Jul 16 21:09:43.869498 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.868958    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmh2k\" (UniqueName: \"kubernetes.io/projected/26fd5f6a-a629-43f1-8370-9e9f5974390a-kube-api-access-zmh2k\") pod \"aws-ebs-csi-driver-node-68m9d\" (UID: \"26fd5f6a-a629-43f1-8370-9e9f5974390a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68m9d"
Jul 16 21:09:43.869498 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.868983    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/101708f5-f1af-4179-91e1-f57c3494b6a7-etc-systemd\") pod \"tuned-lqhw4\" (UID: \"101708f5-f1af-4179-91e1-f57c3494b6a7\") " pod="openshift-cluster-node-tuning-operator/tuned-lqhw4"
Jul 16 21:09:43.869498 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.869009    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4v4wt\" (UniqueName: \"kubernetes.io/projected/abc6bb6b-5fd0-4978-9416-d0582775a520-kube-api-access-4v4wt\") pod \"network-metrics-daemon-v5bvd\" (UID: \"abc6bb6b-5fd0-4978-9416-d0582775a520\") " pod="openshift-multus/network-metrics-daemon-v5bvd"
Jul 16 21:09:43.869498 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.869046    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/97f73b7d-47ea-4d24-a45e-fab8a2f5cda2-kubelet-config\") pod \"global-pull-secret-syncer-6z877\" (UID: \"97f73b7d-47ea-4d24-a45e-fab8a2f5cda2\") " pod="kube-system/global-pull-secret-syncer-6z877"
Jul 16 21:09:43.869498 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.869093    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1b4a76d0-f222-48bd-ac11-fd187bada4ec-host-run-ovn-kubernetes\") pod \"ovnkube-node-dd8jk\" (UID: \"1b4a76d0-f222-48bd-ac11-fd187bada4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk"
Jul 16 21:09:43.869498 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.869126    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/101708f5-f1af-4179-91e1-f57c3494b6a7-etc-systemd\") pod \"tuned-lqhw4\" (UID: \"101708f5-f1af-4179-91e1-f57c3494b6a7\") " pod="openshift-cluster-node-tuning-operator/tuned-lqhw4"
Jul 16 21:09:43.869498 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.869131    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1b4a76d0-f222-48bd-ac11-fd187bada4ec-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dd8jk\" (UID: \"1b4a76d0-f222-48bd-ac11-fd187bada4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk"
Jul 16 21:09:43.870365 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.869184    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1b4a76d0-f222-48bd-ac11-fd187bada4ec-env-overrides\") pod \"ovnkube-node-dd8jk\" (UID: \"1b4a76d0-f222-48bd-ac11-fd187bada4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk"
Jul 16 21:09:43.870365 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.869210    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e787d2eb-af32-410d-96c2-d02ba94e62cd-os-release\") pod \"multus-s2phn\" (UID: \"e787d2eb-af32-410d-96c2-d02ba94e62cd\") " pod="openshift-multus/multus-s2phn"
Jul 16 21:09:43.870365 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.869252    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e787d2eb-af32-410d-96c2-d02ba94e62cd-host-var-lib-kubelet\") pod \"multus-s2phn\" (UID: \"e787d2eb-af32-410d-96c2-d02ba94e62cd\") " pod="openshift-multus/multus-s2phn"
Jul 16 21:09:43.870365 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.869277    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/355ad64f-aa0d-4876-a4a2-faec378a30bf-host\") pod \"node-ca-lft7l\" (UID: \"355ad64f-aa0d-4876-a4a2-faec378a30bf\") " pod="openshift-image-registry/node-ca-lft7l"
Jul 16 21:09:43.870365 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.869301    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/26fd5f6a-a629-43f1-8370-9e9f5974390a-socket-dir\") pod \"aws-ebs-csi-driver-node-68m9d\" (UID: \"26fd5f6a-a629-43f1-8370-9e9f5974390a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68m9d"
Jul 16 21:09:43.870365 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.869342    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e787d2eb-af32-410d-96c2-d02ba94e62cd-host-var-lib-kubelet\") pod \"multus-s2phn\" (UID: \"e787d2eb-af32-410d-96c2-d02ba94e62cd\") " pod="openshift-multus/multus-s2phn"
Jul 16 21:09:43.870365 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.869344    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/26fd5f6a-a629-43f1-8370-9e9f5974390a-registration-dir\") pod \"aws-ebs-csi-driver-node-68m9d\" (UID: \"26fd5f6a-a629-43f1-8370-9e9f5974390a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68m9d"
Jul 16 21:09:43.870365 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.869377    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e787d2eb-af32-410d-96c2-d02ba94e62cd-os-release\") pod \"multus-s2phn\" (UID: \"e787d2eb-af32-410d-96c2-d02ba94e62cd\") " pod="openshift-multus/multus-s2phn"
Jul 16 21:09:43.870365 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.869376    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/355ad64f-aa0d-4876-a4a2-faec378a30bf-host\") pod \"node-ca-lft7l\" (UID: \"355ad64f-aa0d-4876-a4a2-faec378a30bf\") " pod="openshift-image-registry/node-ca-lft7l"
Jul 16 21:09:43.870365 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.869381    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/97f73b7d-47ea-4d24-a45e-fab8a2f5cda2-original-pull-secret\") pod \"global-pull-secret-syncer-6z877\" (UID: \"97f73b7d-47ea-4d24-a45e-fab8a2f5cda2\") " pod="kube-system/global-pull-secret-syncer-6z877"
Jul 16 21:09:43.870365 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.869428    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/26fd5f6a-a629-43f1-8370-9e9f5974390a-registration-dir\") pod \"aws-ebs-csi-driver-node-68m9d\" (UID: \"26fd5f6a-a629-43f1-8370-9e9f5974390a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68m9d"
Jul 16 21:09:43.870365 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.869436    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1b4a76d0-f222-48bd-ac11-fd187bada4ec-systemd-units\") pod \"ovnkube-node-dd8jk\" (UID: \"1b4a76d0-f222-48bd-ac11-fd187bada4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk"
Jul 16 21:09:43.870365 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.869467    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/26fd5f6a-a629-43f1-8370-9e9f5974390a-socket-dir\") pod \"aws-ebs-csi-driver-node-68m9d\" (UID: \"26fd5f6a-a629-43f1-8370-9e9f5974390a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68m9d"
Jul 16 21:09:43.870365 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.869486    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1b4a76d0-f222-48bd-ac11-fd187bada4ec-host-cni-netd\") pod \"ovnkube-node-dd8jk\" (UID: \"1b4a76d0-f222-48bd-ac11-fd187bada4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk"
Jul 16 21:09:43.870365 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.869516    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e787d2eb-af32-410d-96c2-d02ba94e62cd-host-var-lib-cni-bin\") pod \"multus-s2phn\" (UID: \"e787d2eb-af32-410d-96c2-d02ba94e62cd\") " pod="openshift-multus/multus-s2phn"
Jul 16 21:09:43.870365 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.869542    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e787d2eb-af32-410d-96c2-d02ba94e62cd-host-var-lib-cni-multus\") pod \"multus-s2phn\" (UID: \"e787d2eb-af32-410d-96c2-d02ba94e62cd\") " pod="openshift-multus/multus-s2phn"
Jul 16 21:09:43.870365 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.869568    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e787d2eb-af32-410d-96c2-d02ba94e62cd-host-var-lib-cni-bin\") pod \"multus-s2phn\" (UID: \"e787d2eb-af32-410d-96c2-d02ba94e62cd\") " pod="openshift-multus/multus-s2phn"
Jul 16 21:09:43.871270 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.869568    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/26fd5f6a-a629-43f1-8370-9e9f5974390a-sys-fs\") pod \"aws-ebs-csi-driver-node-68m9d\" (UID: \"26fd5f6a-a629-43f1-8370-9e9f5974390a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68m9d"
Jul 16 21:09:43.871270 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.869608    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1b4a76d0-f222-48bd-ac11-fd187bada4ec-ovnkube-script-lib\") pod \"ovnkube-node-dd8jk\" (UID: \"1b4a76d0-f222-48bd-ac11-fd187bada4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk"
Jul 16 21:09:43.871270 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.869615    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/26fd5f6a-a629-43f1-8370-9e9f5974390a-sys-fs\") pod \"aws-ebs-csi-driver-node-68m9d\" (UID: \"26fd5f6a-a629-43f1-8370-9e9f5974390a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68m9d"
Jul 16 21:09:43.871270 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.869652    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e787d2eb-af32-410d-96c2-d02ba94e62cd-system-cni-dir\") pod \"multus-s2phn\" (UID: \"e787d2eb-af32-410d-96c2-d02ba94e62cd\") " pod="openshift-multus/multus-s2phn"
Jul 16 21:09:43.871270 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.869671    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e787d2eb-af32-410d-96c2-d02ba94e62cd-host-var-lib-cni-multus\") pod \"multus-s2phn\" (UID: \"e787d2eb-af32-410d-96c2-d02ba94e62cd\") " pod="openshift-multus/multus-s2phn"
Jul 16 21:09:43.871270 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.869678    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/26fd5f6a-a629-43f1-8370-9e9f5974390a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-68m9d\" (UID: \"26fd5f6a-a629-43f1-8370-9e9f5974390a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68m9d"
Jul 16 21:09:43.871270 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.869704    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/26fd5f6a-a629-43f1-8370-9e9f5974390a-device-dir\") pod \"aws-ebs-csi-driver-node-68m9d\" (UID: \"26fd5f6a-a629-43f1-8370-9e9f5974390a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68m9d"
Jul 16 21:09:43.871270 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.869723    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e787d2eb-af32-410d-96c2-d02ba94e62cd-system-cni-dir\") pod \"multus-s2phn\" (UID: \"e787d2eb-af32-410d-96c2-d02ba94e62cd\") " pod="openshift-multus/multus-s2phn"
Jul 16 21:09:43.871270 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.869747    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/26fd5f6a-a629-43f1-8370-9e9f5974390a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-68m9d\" (UID: \"26fd5f6a-a629-43f1-8370-9e9f5974390a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68m9d"
Jul 16 21:09:43.871270 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.869762    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/67996421-567c-4901-b037-a8863575763b-system-cni-dir\") pod \"multus-additional-cni-plugins-w9rrt\" (UID: \"67996421-567c-4901-b037-a8863575763b\") " pod="openshift-multus/multus-additional-cni-plugins-w9rrt"
Jul 16 21:09:43.871270 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.869802    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/26fd5f6a-a629-43f1-8370-9e9f5974390a-device-dir\") pod \"aws-ebs-csi-driver-node-68m9d\" (UID: \"26fd5f6a-a629-43f1-8370-9e9f5974390a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68m9d"
Jul 16 21:09:43.871270 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.869809    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djhmt\" (UniqueName: \"kubernetes.io/projected/e52ac48f-692d-4893-a046-71dea5a7b5aa-kube-api-access-djhmt\") pod \"node-resolver-znkwj\" (UID: \"e52ac48f-692d-4893-a046-71dea5a7b5aa\") " pod="openshift-dns/node-resolver-znkwj"
Jul 16 21:09:43.871270 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.869852    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/101708f5-f1af-4179-91e1-f57c3494b6a7-host\") pod \"tuned-lqhw4\" (UID: \"101708f5-f1af-4179-91e1-f57c3494b6a7\") " pod="openshift-cluster-node-tuning-operator/tuned-lqhw4"
Jul 16 21:09:43.871270 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.869874    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1b4a76d0-f222-48bd-ac11-fd187bada4ec-host-kubelet\") pod \"ovnkube-node-dd8jk\" (UID: \"1b4a76d0-f222-48bd-ac11-fd187bada4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk"
Jul 16 21:09:43.871270 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.869900    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1b4a76d0-f222-48bd-ac11-fd187bada4ec-host-run-netns\") pod \"ovnkube-node-dd8jk\" (UID: \"1b4a76d0-f222-48bd-ac11-fd187bada4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk"
Jul 16 21:09:43.871270 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.869925    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1b4a76d0-f222-48bd-ac11-fd187bada4ec-host-cni-bin\") pod \"ovnkube-node-dd8jk\" (UID: \"1b4a76d0-f222-48bd-ac11-fd187bada4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk"
Jul 16 21:09:43.871270 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.869935    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/101708f5-f1af-4179-91e1-f57c3494b6a7-host\") pod \"tuned-lqhw4\" (UID: \"101708f5-f1af-4179-91e1-f57c3494b6a7\") " pod="openshift-cluster-node-tuning-operator/tuned-lqhw4"
Jul 16 21:09:43.872071 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.869957    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1b4a76d0-f222-48bd-ac11-fd187bada4ec-ovn-node-metrics-cert\") pod \"ovnkube-node-dd8jk\" (UID: \"1b4a76d0-f222-48bd-ac11-fd187bada4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk"
Jul 16 21:09:43.872071 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.869989    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e787d2eb-af32-410d-96c2-d02ba94e62cd-cnibin\") pod \"multus-s2phn\" (UID: \"e787d2eb-af32-410d-96c2-d02ba94e62cd\") " pod="openshift-multus/multus-s2phn"
Jul 16 21:09:43.872071 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.870020    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e787d2eb-af32-410d-96c2-d02ba94e62cd-host-run-netns\") pod \"multus-s2phn\" (UID: \"e787d2eb-af32-410d-96c2-d02ba94e62cd\") " pod="openshift-multus/multus-s2phn"
Jul 16 21:09:43.872071 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.870042    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/101708f5-f1af-4179-91e1-f57c3494b6a7-run\") pod \"tuned-lqhw4\" (UID: \"101708f5-f1af-4179-91e1-f57c3494b6a7\") " pod="openshift-cluster-node-tuning-operator/tuned-lqhw4"
Jul 16 21:09:43.872071 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.870062    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/101708f5-f1af-4179-91e1-f57c3494b6a7-lib-modules\") pod \"tuned-lqhw4\" (UID: \"101708f5-f1af-4179-91e1-f57c3494b6a7\") " pod="openshift-cluster-node-tuning-operator/tuned-lqhw4"
Jul 16 21:09:43.872071 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.870085    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e787d2eb-af32-410d-96c2-d02ba94e62cd-cnibin\") pod \"multus-s2phn\" (UID: \"e787d2eb-af32-410d-96c2-d02ba94e62cd\") " pod="openshift-multus/multus-s2phn"
Jul 16 21:09:43.872071 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.870096    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tcrr\" (UniqueName: \"kubernetes.io/projected/67996421-567c-4901-b037-a8863575763b-kube-api-access-9tcrr\") pod \"multus-additional-cni-plugins-w9rrt\" (UID: \"67996421-567c-4901-b037-a8863575763b\") " pod="openshift-multus/multus-additional-cni-plugins-w9rrt"
Jul 16 21:09:43.872071 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.870157    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1b4a76d0-f222-48bd-ac11-fd187bada4ec-run-openvswitch\") pod \"ovnkube-node-dd8jk\" (UID: \"1b4a76d0-f222-48bd-ac11-fd187bada4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk"
Jul 16 21:09:43.872071 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.870171    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e787d2eb-af32-410d-96c2-d02ba94e62cd-host-run-netns\") pod \"multus-s2phn\" (UID: \"e787d2eb-af32-410d-96c2-d02ba94e62cd\") " pod="openshift-multus/multus-s2phn"
Jul 16 21:09:43.872071 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.870219    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/101708f5-f1af-4179-91e1-f57c3494b6a7-lib-modules\") pod \"tuned-lqhw4\" (UID: \"101708f5-f1af-4179-91e1-f57c3494b6a7\") " pod="openshift-cluster-node-tuning-operator/tuned-lqhw4"
Jul 16 21:09:43.872071 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.870227    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/101708f5-f1af-4179-91e1-f57c3494b6a7-run\") pod \"tuned-lqhw4\" (UID: \"101708f5-f1af-4179-91e1-f57c3494b6a7\") " pod="openshift-cluster-node-tuning-operator/tuned-lqhw4"
Jul 16 21:09:43.872071 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.870208    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-682qk\" (UniqueName: \"kubernetes.io/projected/1b4a76d0-f222-48bd-ac11-fd187bada4ec-kube-api-access-682qk\") pod \"ovnkube-node-dd8jk\" (UID: \"1b4a76d0-f222-48bd-ac11-fd187bada4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk"
Jul 16 21:09:43.872071 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.870267    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/26fd5f6a-a629-43f1-8370-9e9f5974390a-etc-selinux\") pod \"aws-ebs-csi-driver-node-68m9d\" (UID: \"26fd5f6a-a629-43f1-8370-9e9f5974390a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68m9d"
Jul 16 21:09:43.872071 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.870303    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jr8lm\" (UniqueName: \"kubernetes.io/projected/e9422503-3736-42d5-85de-6160c39f65bf-kube-api-access-jr8lm\") pod \"network-check-target-9mdcw\" (UID: \"e9422503-3736-42d5-85de-6160c39f65bf\") " pod="openshift-network-diagnostics/network-check-target-9mdcw"
Jul 16 21:09:43.872071 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.870373    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/26fd5f6a-a629-43f1-8370-9e9f5974390a-etc-selinux\") pod \"aws-ebs-csi-driver-node-68m9d\" (UID: \"26fd5f6a-a629-43f1-8370-9e9f5974390a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68m9d"
Jul 16 21:09:43.872071 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.870395    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/97f73b7d-47ea-4d24-a45e-fab8a2f5cda2-dbus\") pod \"global-pull-secret-syncer-6z877\" (UID: \"97f73b7d-47ea-4d24-a45e-fab8a2f5cda2\") " pod="kube-system/global-pull-secret-syncer-6z877"
Jul 16 21:09:43.872071 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.870412    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1b4a76d0-f222-48bd-ac11-fd187bada4ec-var-lib-openvswitch\") pod \"ovnkube-node-dd8jk\" (UID: \"1b4a76d0-f222-48bd-ac11-fd187bada4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk"
Jul 16 21:09:43.872874 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.870430    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e787d2eb-af32-410d-96c2-d02ba94e62cd-multus-cni-dir\") pod \"multus-s2phn\" (UID: \"e787d2eb-af32-410d-96c2-d02ba94e62cd\") " pod="openshift-multus/multus-s2phn"
Jul 16 21:09:43.872874 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.870447    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e787d2eb-af32-410d-96c2-d02ba94e62cd-host-run-multus-certs\") pod \"multus-s2phn\" (UID: \"e787d2eb-af32-410d-96c2-d02ba94e62cd\") " pod="openshift-multus/multus-s2phn"
Jul 16 21:09:43.872874 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.870462    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhjwp\" (UniqueName: \"kubernetes.io/projected/e787d2eb-af32-410d-96c2-d02ba94e62cd-kube-api-access-lhjwp\") pod \"multus-s2phn\" (UID: \"e787d2eb-af32-410d-96c2-d02ba94e62cd\") " pod="openshift-multus/multus-s2phn"
Jul 16 21:09:43.872874 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.870485    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/31d88740-4569-46ac-8cf7-1ba83a71f020-host-slash\") pod \"iptables-alerter-hkbpk\" (UID: \"31d88740-4569-46ac-8cf7-1ba83a71f020\") " pod="openshift-network-operator/iptables-alerter-hkbpk"
Jul 16 21:09:43.872874 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.870512    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e787d2eb-af32-410d-96c2-d02ba94e62cd-host-run-multus-certs\") pod \"multus-s2phn\" (UID: \"e787d2eb-af32-410d-96c2-d02ba94e62cd\") " pod="openshift-multus/multus-s2phn"
Jul 16 21:09:43.872874 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.870598    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/101708f5-f1af-4179-91e1-f57c3494b6a7-etc-modprobe-d\") pod \"tuned-lqhw4\" (UID: \"101708f5-f1af-4179-91e1-f57c3494b6a7\") " pod="openshift-cluster-node-tuning-operator/tuned-lqhw4"
Jul 16 21:09:43.872874 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.870611    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e787d2eb-af32-410d-96c2-d02ba94e62cd-multus-cni-dir\") pod \"multus-s2phn\" (UID: \"e787d2eb-af32-410d-96c2-d02ba94e62cd\") " pod="openshift-multus/multus-s2phn"
Jul 16 21:09:43.872874 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.870601    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/31d88740-4569-46ac-8cf7-1ba83a71f020-host-slash\") pod \"iptables-alerter-hkbpk\" (UID: \"31d88740-4569-46ac-8cf7-1ba83a71f020\") " pod="openshift-network-operator/iptables-alerter-hkbpk"
Jul 16 21:09:43.872874 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.870632    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e787d2eb-af32-410d-96c2-d02ba94e62cd-cni-binary-copy\") pod \"multus-s2phn\" (UID: \"e787d2eb-af32-410d-96c2-d02ba94e62cd\") " pod="openshift-multus/multus-s2phn"
Jul 16 21:09:43.872874 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.870658    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e787d2eb-af32-410d-96c2-d02ba94e62cd-multus-socket-dir-parent\") pod \"multus-s2phn\" (UID: \"e787d2eb-af32-410d-96c2-d02ba94e62cd\") " pod="openshift-multus/multus-s2phn"
Jul 16 21:09:43.872874 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.870692    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e787d2eb-af32-410d-96c2-d02ba94e62cd-multus-daemon-config\") pod \"multus-s2phn\" (UID: \"e787d2eb-af32-410d-96c2-d02ba94e62cd\") " pod="openshift-multus/multus-s2phn"
Jul 16 21:09:43.872874 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.870724    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v84kv\" (UniqueName: \"kubernetes.io/projected/31d88740-4569-46ac-8cf7-1ba83a71f020-kube-api-access-v84kv\") pod \"iptables-alerter-hkbpk\" (UID: \"31d88740-4569-46ac-8cf7-1ba83a71f020\") " pod="openshift-network-operator/iptables-alerter-hkbpk"
Jul 16 21:09:43.872874 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.870749    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/101708f5-f1af-4179-91e1-f57c3494b6a7-sys\") pod \"tuned-lqhw4\" (UID: \"101708f5-f1af-4179-91e1-f57c3494b6a7\") " pod="openshift-cluster-node-tuning-operator/tuned-lqhw4"
Jul 16 21:09:43.872874 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.870768    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e787d2eb-af32-410d-96c2-d02ba94e62cd-multus-socket-dir-parent\") pod \"multus-s2phn\" (UID: \"e787d2eb-af32-410d-96c2-d02ba94e62cd\") " pod="openshift-multus/multus-s2phn"
Jul 16 21:09:43.872874 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.870697    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/101708f5-f1af-4179-91e1-f57c3494b6a7-etc-modprobe-d\") pod \"tuned-lqhw4\" (UID: \"101708f5-f1af-4179-91e1-f57c3494b6a7\") " pod="openshift-cluster-node-tuning-operator/tuned-lqhw4"
Jul 16 21:09:43.872874 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.870888    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/101708f5-f1af-4179-91e1-f57c3494b6a7-sys\") pod \"tuned-lqhw4\" (UID: \"101708f5-f1af-4179-91e1-f57c3494b6a7\") " pod="openshift-cluster-node-tuning-operator/tuned-lqhw4"
Jul 16 21:09:43.872874 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.870772    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/101708f5-f1af-4179-91e1-f57c3494b6a7-tmp\") pod \"tuned-lqhw4\" (UID: \"101708f5-f1af-4179-91e1-f57c3494b6a7\") " pod="openshift-cluster-node-tuning-operator/tuned-lqhw4"
Jul 16 21:09:43.872874 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.870928    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1b4a76d0-f222-48bd-ac11-fd187bada4ec-ovnkube-config\") pod \"ovnkube-node-dd8jk\" (UID: \"1b4a76d0-f222-48bd-ac11-fd187bada4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk"
Jul 16 21:09:43.873788 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.871026    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/355ad64f-aa0d-4876-a4a2-faec378a30bf-serviceca\") pod \"node-ca-lft7l\" (UID: \"355ad64f-aa0d-4876-a4a2-faec378a30bf\") " pod="openshift-image-registry/node-ca-lft7l"
Jul 16 21:09:43.873788 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.871052    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/92e2f3e9-e610-4859-b11b-105f3e28d548-agent-certs\") pod \"konnectivity-agent-llmw2\" (UID: \"92e2f3e9-e610-4859-b11b-105f3e28d548\") " pod="kube-system/konnectivity-agent-llmw2"
Jul 16 21:09:43.873788 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.871112    2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 16 21:09:43.873788 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.871129    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/31d88740-4569-46ac-8cf7-1ba83a71f020-iptables-alerter-script\") pod \"iptables-alerter-hkbpk\" (UID: \"31d88740-4569-46ac-8cf7-1ba83a71f020\") " pod="openshift-network-operator/iptables-alerter-hkbpk"
Jul 16 21:09:43.873788 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.871196    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/101708f5-f1af-4179-91e1-f57c3494b6a7-etc-kubernetes\") pod \"tuned-lqhw4\" (UID: \"101708f5-f1af-4179-91e1-f57c3494b6a7\") " pod="openshift-cluster-node-tuning-operator/tuned-lqhw4"
Jul 16 21:09:43.873788 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.871246    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e787d2eb-af32-410d-96c2-d02ba94e62cd-etc-kubernetes\") pod \"multus-s2phn\" (UID: \"e787d2eb-af32-410d-96c2-d02ba94e62cd\") " pod="openshift-multus/multus-s2phn"
Jul 16 21:09:43.873788 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.871267    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q854g\" (UniqueName: \"kubernetes.io/projected/355ad64f-aa0d-4876-a4a2-faec378a30bf-kube-api-access-q854g\") pod \"node-ca-lft7l\" (UID: \"355ad64f-aa0d-4876-a4a2-faec378a30bf\") " pod="openshift-image-registry/node-ca-lft7l"
Jul 16 21:09:43.873788 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.871308    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/101708f5-f1af-4179-91e1-f57c3494b6a7-etc-tuned\") pod \"tuned-lqhw4\" (UID: \"101708f5-f1af-4179-91e1-f57c3494b6a7\") " pod="openshift-cluster-node-tuning-operator/tuned-lqhw4"
Jul 16 21:09:43.873788 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.871364    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e787d2eb-af32-410d-96c2-d02ba94e62cd-multus-daemon-config\") pod \"multus-s2phn\" (UID: \"e787d2eb-af32-410d-96c2-d02ba94e62cd\") " pod="openshift-multus/multus-s2phn"
Jul 16 21:09:43.873788 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.871407    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e787d2eb-af32-410d-96c2-d02ba94e62cd-cni-binary-copy\") pod \"multus-s2phn\" (UID: \"e787d2eb-af32-410d-96c2-d02ba94e62cd\") " pod="openshift-multus/multus-s2phn"
Jul 16 21:09:43.873788 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.871462    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/101708f5-f1af-4179-91e1-f57c3494b6a7-etc-kubernetes\") pod \"tuned-lqhw4\" (UID: \"101708f5-f1af-4179-91e1-f57c3494b6a7\") " pod="openshift-cluster-node-tuning-operator/tuned-lqhw4"
Jul 16 21:09:43.873788 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.871475    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1b4a76d0-f222-48bd-ac11-fd187bada4ec-run-systemd\") pod \"ovnkube-node-dd8jk\" (UID: \"1b4a76d0-f222-48bd-ac11-fd187bada4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk"
Jul 16 21:09:43.873788 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.871493    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e787d2eb-af32-410d-96c2-d02ba94e62cd-etc-kubernetes\") pod \"multus-s2phn\" (UID: \"e787d2eb-af32-410d-96c2-d02ba94e62cd\") " pod="openshift-multus/multus-s2phn"
Jul 16 21:09:43.873788 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.871517    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/355ad64f-aa0d-4876-a4a2-faec378a30bf-serviceca\") pod \"node-ca-lft7l\" (UID: \"355ad64f-aa0d-4876-a4a2-faec378a30bf\") " pod="openshift-image-registry/node-ca-lft7l"
Jul 16 21:09:43.873788 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.871991    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/31d88740-4569-46ac-8cf7-1ba83a71f020-iptables-alerter-script\") pod \"iptables-alerter-hkbpk\" (UID: \"31d88740-4569-46ac-8cf7-1ba83a71f020\") " pod="openshift-network-operator/iptables-alerter-hkbpk"
Jul 16 21:09:43.875125 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.875101    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/101708f5-f1af-4179-91e1-f57c3494b6a7-tmp\") pod \"tuned-lqhw4\" (UID: \"101708f5-f1af-4179-91e1-f57c3494b6a7\") " pod="openshift-cluster-node-tuning-operator/tuned-lqhw4"
Jul 16 21:09:43.875249 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.875224    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/101708f5-f1af-4179-91e1-f57c3494b6a7-etc-tuned\") pod \"tuned-lqhw4\" (UID: \"101708f5-f1af-4179-91e1-f57c3494b6a7\") " pod="openshift-cluster-node-tuning-operator/tuned-lqhw4"
Jul 16 21:09:43.875364 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.875347    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/92e2f3e9-e610-4859-b11b-105f3e28d548-agent-certs\") pod \"konnectivity-agent-llmw2\" (UID: \"92e2f3e9-e610-4859-b11b-105f3e28d548\") " pod="kube-system/konnectivity-agent-llmw2"
Jul 16 21:09:43.885064 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.885037    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkzlg\" (UniqueName: \"kubernetes.io/projected/101708f5-f1af-4179-91e1-f57c3494b6a7-kube-api-access-vkzlg\") pod \"tuned-lqhw4\" (UID: \"101708f5-f1af-4179-91e1-f57c3494b6a7\") " pod="openshift-cluster-node-tuning-operator/tuned-lqhw4"
Jul 16 21:09:43.885855 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:43.885806    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 21:09:43.885855 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:43.885830    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 21:09:43.885855 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:43.885846    2579 projected.go:196] Error preparing data for projected volume kube-api-access-jr8lm for pod openshift-network-diagnostics/network-check-target-9mdcw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 21:09:43.886120 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:43.885927    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e9422503-3736-42d5-85de-6160c39f65bf-kube-api-access-jr8lm podName:e9422503-3736-42d5-85de-6160c39f65bf nodeName:}" failed. No retries permitted until 2026-07-16 21:09:44.385897464 +0000 UTC m=+3.000077779 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jr8lm" (UniqueName: "kubernetes.io/projected/e9422503-3736-42d5-85de-6160c39f65bf-kube-api-access-jr8lm") pod "network-check-target-9mdcw" (UID: "e9422503-3736-42d5-85de-6160c39f65bf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 21:09:43.886741 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.886717    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhjwp\" (UniqueName: \"kubernetes.io/projected/e787d2eb-af32-410d-96c2-d02ba94e62cd-kube-api-access-lhjwp\") pod \"multus-s2phn\" (UID: \"e787d2eb-af32-410d-96c2-d02ba94e62cd\") " pod="openshift-multus/multus-s2phn"
Jul 16 21:09:43.887956 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.887936    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q854g\" (UniqueName: \"kubernetes.io/projected/355ad64f-aa0d-4876-a4a2-faec378a30bf-kube-api-access-q854g\") pod \"node-ca-lft7l\" (UID: \"355ad64f-aa0d-4876-a4a2-faec378a30bf\") " pod="openshift-image-registry/node-ca-lft7l"
Jul 16 21:09:43.889884 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.889861    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmh2k\" (UniqueName: \"kubernetes.io/projected/26fd5f6a-a629-43f1-8370-9e9f5974390a-kube-api-access-zmh2k\") pod \"aws-ebs-csi-driver-node-68m9d\" (UID: \"26fd5f6a-a629-43f1-8370-9e9f5974390a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68m9d"
Jul 16 21:09:43.890312 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.890289    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v84kv\" (UniqueName: \"kubernetes.io/projected/31d88740-4569-46ac-8cf7-1ba83a71f020-kube-api-access-v84kv\") pod \"iptables-alerter-hkbpk\" (UID: \"31d88740-4569-46ac-8cf7-1ba83a71f020\") " pod="openshift-network-operator/iptables-alerter-hkbpk"
Jul 16 21:09:43.904064 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.904043    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-bd7sk"
Jul 16 21:09:43.916381 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.916355    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-bd7sk"
Jul 16 21:09:43.969509 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.969439    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-58.ec2.internal" event={"ID":"505a84a2e65f988310008bbe35d60123","Type":"ContainerStarted","Data":"29b0c76a2d2d3ddfb3ca50940d3a7f8cbcc8ea3a1168ebde1c4f12f49a078a1b"}
Jul 16 21:09:43.970458 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.970438    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-58.ec2.internal" event={"ID":"8191b9618bfa53be6f3908cc4952d20e","Type":"ContainerStarted","Data":"4db8892078982f06c52e131e69d4a7b55c614f886d6b7898a008d2568e99efa4"}
Jul 16 21:09:43.971742 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.971725    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1b4a76d0-f222-48bd-ac11-fd187bada4ec-host-kubelet\") pod \"ovnkube-node-dd8jk\" (UID: \"1b4a76d0-f222-48bd-ac11-fd187bada4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk"
Jul 16 21:09:43.971800 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.971751    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1b4a76d0-f222-48bd-ac11-fd187bada4ec-host-run-netns\") pod \"ovnkube-node-dd8jk\" (UID: \"1b4a76d0-f222-48bd-ac11-fd187bada4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk"
Jul 16 21:09:43.971800 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.971767    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1b4a76d0-f222-48bd-ac11-fd187bada4ec-host-cni-bin\") pod \"ovnkube-node-dd8jk\" (UID: \"1b4a76d0-f222-48bd-ac11-fd187bada4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk"
Jul 16 21:09:43.971800 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.971787    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1b4a76d0-f222-48bd-ac11-fd187bada4ec-ovn-node-metrics-cert\") pod \"ovnkube-node-dd8jk\" (UID: \"1b4a76d0-f222-48bd-ac11-fd187bada4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk"
Jul 16 21:09:43.971945 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.971816    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tcrr\" (UniqueName: \"kubernetes.io/projected/67996421-567c-4901-b037-a8863575763b-kube-api-access-9tcrr\") pod \"multus-additional-cni-plugins-w9rrt\" (UID: \"67996421-567c-4901-b037-a8863575763b\") " pod="openshift-multus/multus-additional-cni-plugins-w9rrt"
Jul 16 21:09:43.971945 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.971831    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1b4a76d0-f222-48bd-ac11-fd187bada4ec-host-run-netns\") pod \"ovnkube-node-dd8jk\" (UID: \"1b4a76d0-f222-48bd-ac11-fd187bada4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk"
Jul 16 21:09:43.971945 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.971839    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1b4a76d0-f222-48bd-ac11-fd187bada4ec-host-cni-bin\") pod \"ovnkube-node-dd8jk\" (UID: \"1b4a76d0-f222-48bd-ac11-fd187bada4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk"
Jul 16 21:09:43.971945 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.971842    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1b4a76d0-f222-48bd-ac11-fd187bada4ec-run-openvswitch\") pod \"ovnkube-node-dd8jk\" (UID: \"1b4a76d0-f222-48bd-ac11-fd187bada4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk"
Jul 16 21:09:43.971945 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.971856    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1b4a76d0-f222-48bd-ac11-fd187bada4ec-host-kubelet\") pod \"ovnkube-node-dd8jk\" (UID: \"1b4a76d0-f222-48bd-ac11-fd187bada4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk"
Jul 16 21:09:43.971945 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.971875    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-682qk\" (UniqueName: \"kubernetes.io/projected/1b4a76d0-f222-48bd-ac11-fd187bada4ec-kube-api-access-682qk\") pod \"ovnkube-node-dd8jk\" (UID: \"1b4a76d0-f222-48bd-ac11-fd187bada4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk"
Jul 16 21:09:43.971945 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.971910    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/97f73b7d-47ea-4d24-a45e-fab8a2f5cda2-dbus\") pod \"global-pull-secret-syncer-6z877\" (UID: \"97f73b7d-47ea-4d24-a45e-fab8a2f5cda2\") " pod="kube-system/global-pull-secret-syncer-6z877"
Jul 16 21:09:43.971945 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.971930    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1b4a76d0-f222-48bd-ac11-fd187bada4ec-var-lib-openvswitch\") pod \"ovnkube-node-dd8jk\" (UID: \"1b4a76d0-f222-48bd-ac11-fd187bada4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk"
Jul 16 21:09:43.972360 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.971948    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1b4a76d0-f222-48bd-ac11-fd187bada4ec-run-openvswitch\") pod \"ovnkube-node-dd8jk\" (UID: \"1b4a76d0-f222-48bd-ac11-fd187bada4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk"
Jul 16 21:09:43.972360 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.971987    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1b4a76d0-f222-48bd-ac11-fd187bada4ec-var-lib-openvswitch\") pod \"ovnkube-node-dd8jk\" (UID: \"1b4a76d0-f222-48bd-ac11-fd187bada4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk"
Jul 16 21:09:43.972360 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.971954    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1b4a76d0-f222-48bd-ac11-fd187bada4ec-ovnkube-config\") pod \"ovnkube-node-dd8jk\" (UID: \"1b4a76d0-f222-48bd-ac11-fd187bada4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk"
Jul 16 21:09:43.972360 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.972004    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/97f73b7d-47ea-4d24-a45e-fab8a2f5cda2-dbus\") pod \"global-pull-secret-syncer-6z877\" (UID: \"97f73b7d-47ea-4d24-a45e-fab8a2f5cda2\") " pod="kube-system/global-pull-secret-syncer-6z877"
Jul 16 21:09:43.972360 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.972041    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1b4a76d0-f222-48bd-ac11-fd187bada4ec-run-systemd\") pod \"ovnkube-node-dd8jk\" (UID: \"1b4a76d0-f222-48bd-ac11-fd187bada4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk"
Jul 16 21:09:43.972360 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.972079    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/67996421-567c-4901-b037-a8863575763b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w9rrt\" (UID: \"67996421-567c-4901-b037-a8863575763b\") " pod="openshift-multus/multus-additional-cni-plugins-w9rrt"
Jul 16 21:09:43.972360 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.972122    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1b4a76d0-f222-48bd-ac11-fd187bada4ec-run-systemd\") pod \"ovnkube-node-dd8jk\" (UID: \"1b4a76d0-f222-48bd-ac11-fd187bada4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk"
Jul 16 21:09:43.972360 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.972124    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/abc6bb6b-5fd0-4978-9416-d0582775a520-metrics-certs\") pod \"network-metrics-daemon-v5bvd\" (UID: \"abc6bb6b-5fd0-4978-9416-d0582775a520\") " pod="openshift-multus/network-metrics-daemon-v5bvd"
Jul 16 21:09:43.972360 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.972165    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/67996421-567c-4901-b037-a8863575763b-cnibin\") pod \"multus-additional-cni-plugins-w9rrt\" (UID: \"67996421-567c-4901-b037-a8863575763b\") " pod="openshift-multus/multus-additional-cni-plugins-w9rrt"
Jul 16 21:09:43.972360 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.972190    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/67996421-567c-4901-b037-a8863575763b-cni-binary-copy\") pod \"multus-additional-cni-plugins-w9rrt\" (UID: \"67996421-567c-4901-b037-a8863575763b\") " pod="openshift-multus/multus-additional-cni-plugins-w9rrt"
Jul 16 21:09:43.972360 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:43.972210    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 21:09:43.972360 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.972228    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/67996421-567c-4901-b037-a8863575763b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w9rrt\" (UID: \"67996421-567c-4901-b037-a8863575763b\") " pod="openshift-multus/multus-additional-cni-plugins-w9rrt"
Jul 16 21:09:43.972360 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:43.972281    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abc6bb6b-5fd0-4978-9416-d0582775a520-metrics-certs podName:abc6bb6b-5fd0-4978-9416-d0582775a520 nodeName:}" failed. No retries permitted until 2026-07-16 21:09:44.472262537 +0000 UTC m=+3.086442851 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/abc6bb6b-5fd0-4978-9416-d0582775a520-metrics-certs") pod "network-metrics-daemon-v5bvd" (UID: "abc6bb6b-5fd0-4978-9416-d0582775a520") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 21:09:43.972360 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.972297    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e52ac48f-692d-4893-a046-71dea5a7b5aa-tmp-dir\") pod \"node-resolver-znkwj\" (UID: \"e52ac48f-692d-4893-a046-71dea5a7b5aa\") " pod="openshift-dns/node-resolver-znkwj"
Jul 16 21:09:43.972360 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.972321    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1b4a76d0-f222-48bd-ac11-fd187bada4ec-host-slash\") pod \"ovnkube-node-dd8jk\" (UID: \"1b4a76d0-f222-48bd-ac11-fd187bada4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk"
Jul 16 21:09:43.972360 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.972322    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/67996421-567c-4901-b037-a8863575763b-cnibin\") pod \"multus-additional-cni-plugins-w9rrt\" (UID: \"67996421-567c-4901-b037-a8863575763b\") " pod="openshift-multus/multus-additional-cni-plugins-w9rrt"
Jul 16 21:09:43.972360 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.972344    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1b4a76d0-f222-48bd-ac11-fd187bada4ec-log-socket\") pod \"ovnkube-node-dd8jk\" (UID: \"1b4a76d0-f222-48bd-ac11-fd187bada4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk"
Jul 16 21:09:43.973242 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.972388    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1b4a76d0-f222-48bd-ac11-fd187bada4ec-log-socket\") pod \"ovnkube-node-dd8jk\" (UID: \"1b4a76d0-f222-48bd-ac11-fd187bada4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk"
Jul 16 21:09:43.973242 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.972386    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/67996421-567c-4901-b037-a8863575763b-os-release\") pod \"multus-additional-cni-plugins-w9rrt\" (UID: \"67996421-567c-4901-b037-a8863575763b\") " pod="openshift-multus/multus-additional-cni-plugins-w9rrt"
Jul 16 21:09:43.973242 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.972408    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/67996421-567c-4901-b037-a8863575763b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w9rrt\" (UID: \"67996421-567c-4901-b037-a8863575763b\") " pod="openshift-multus/multus-additional-cni-plugins-w9rrt"
Jul 16 21:09:43.973242 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.972430    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1b4a76d0-f222-48bd-ac11-fd187bada4ec-run-ovn\") pod \"ovnkube-node-dd8jk\" (UID: \"1b4a76d0-f222-48bd-ac11-fd187bada4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk"
Jul 16 21:09:43.973242 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.972447    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/67996421-567c-4901-b037-a8863575763b-os-release\") pod \"multus-additional-cni-plugins-w9rrt\" (UID: \"67996421-567c-4901-b037-a8863575763b\") " pod="openshift-multus/multus-additional-cni-plugins-w9rrt"
Jul 16 21:09:43.973242 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.972492    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1b4a76d0-f222-48bd-ac11-fd187bada4ec-run-ovn\") pod \"ovnkube-node-dd8jk\" (UID: \"1b4a76d0-f222-48bd-ac11-fd187bada4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk"
Jul 16 21:09:43.973242 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.972497    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/67996421-567c-4901-b037-a8863575763b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w9rrt\" (UID: \"67996421-567c-4901-b037-a8863575763b\") " pod="openshift-multus/multus-additional-cni-plugins-w9rrt"
Jul 16 21:09:43.973242 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.972527    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e52ac48f-692d-4893-a046-71dea5a7b5aa-hosts-file\") pod \"node-resolver-znkwj\" (UID: \"e52ac48f-692d-4893-a046-71dea5a7b5aa\") " pod="openshift-dns/node-resolver-znkwj"
Jul 16 21:09:43.973242 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.972536    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1b4a76d0-f222-48bd-ac11-fd187bada4ec-host-slash\") pod \"ovnkube-node-dd8jk\" (UID: \"1b4a76d0-f222-48bd-ac11-fd187bada4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk"
Jul 16 21:09:43.973242 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.972553    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1b4a76d0-f222-48bd-ac11-fd187bada4ec-etc-openvswitch\") pod \"ovnkube-node-dd8jk\" (UID: \"1b4a76d0-f222-48bd-ac11-fd187bada4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk"
Jul 16 21:09:43.973242 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.972578    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1b4a76d0-f222-48bd-ac11-fd187bada4ec-node-log\") pod \"ovnkube-node-dd8jk\" (UID: \"1b4a76d0-f222-48bd-ac11-fd187bada4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk"
Jul 16 21:09:43.973242 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.972608    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4v4wt\" (UniqueName: \"kubernetes.io/projected/abc6bb6b-5fd0-4978-9416-d0582775a520-kube-api-access-4v4wt\") pod \"network-metrics-daemon-v5bvd\" (UID: \"abc6bb6b-5fd0-4978-9416-d0582775a520\") " pod="openshift-multus/network-metrics-daemon-v5bvd"
Jul 16 21:09:43.973242 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.972635    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/97f73b7d-47ea-4d24-a45e-fab8a2f5cda2-kubelet-config\") pod \"global-pull-secret-syncer-6z877\" (UID: \"97f73b7d-47ea-4d24-a45e-fab8a2f5cda2\") " pod="kube-system/global-pull-secret-syncer-6z877"
Jul 16 21:09:43.973242 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.972651    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e52ac48f-692d-4893-a046-71dea5a7b5aa-hosts-file\") pod \"node-resolver-znkwj\" (UID: \"e52ac48f-692d-4893-a046-71dea5a7b5aa\") " pod="openshift-dns/node-resolver-znkwj"
Jul 16 21:09:43.973242 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.972666    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1b4a76d0-f222-48bd-ac11-fd187bada4ec-host-run-ovn-kubernetes\") pod \"ovnkube-node-dd8jk\" (UID: \"1b4a76d0-f222-48bd-ac11-fd187bada4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk"
Jul 16 21:09:43.973242 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.972696    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1b4a76d0-f222-48bd-ac11-fd187bada4ec-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dd8jk\" (UID: \"1b4a76d0-f222-48bd-ac11-fd187bada4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk"
Jul 16 21:09:43.973242 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.972702    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1b4a76d0-f222-48bd-ac11-fd187bada4ec-ovnkube-config\") pod \"ovnkube-node-dd8jk\" (UID: \"1b4a76d0-f222-48bd-ac11-fd187bada4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk"
Jul 16 21:09:43.973832 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.972723    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1b4a76d0-f222-48bd-ac11-fd187bada4ec-env-overrides\") pod \"ovnkube-node-dd8jk\" (UID: \"1b4a76d0-f222-48bd-ac11-fd187bada4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk"
Jul 16 21:09:43.973832 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.972755    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/97f73b7d-47ea-4d24-a45e-fab8a2f5cda2-original-pull-secret\") pod \"global-pull-secret-syncer-6z877\" (UID: \"97f73b7d-47ea-4d24-a45e-fab8a2f5cda2\") " pod="kube-system/global-pull-secret-syncer-6z877"
Jul 16 21:09:43.973832 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.972782    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1b4a76d0-f222-48bd-ac11-fd187bada4ec-systemd-units\") pod \"ovnkube-node-dd8jk\" (UID: \"1b4a76d0-f222-48bd-ac11-fd187bada4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk"
Jul 16 21:09:43.973832 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.972784    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/67996421-567c-4901-b037-a8863575763b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w9rrt\" (UID: \"67996421-567c-4901-b037-a8863575763b\") " pod="openshift-multus/multus-additional-cni-plugins-w9rrt"
Jul 16 21:09:43.973832 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.972808    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1b4a76d0-f222-48bd-ac11-fd187bada4ec-host-cni-netd\") pod \"ovnkube-node-dd8jk\" (UID: \"1b4a76d0-f222-48bd-ac11-fd187bada4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk"
Jul 16 21:09:43.973832 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.972818    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e52ac48f-692d-4893-a046-71dea5a7b5aa-tmp-dir\") pod \"node-resolver-znkwj\" (UID: \"e52ac48f-692d-4893-a046-71dea5a7b5aa\") " pod="openshift-dns/node-resolver-znkwj"
Jul 16 21:09:43.973832 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.972824    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/67996421-567c-4901-b037-a8863575763b-cni-binary-copy\") pod \"multus-additional-cni-plugins-w9rrt\" (UID: \"67996421-567c-4901-b037-a8863575763b\") " pod="openshift-multus/multus-additional-cni-plugins-w9rrt"
Jul 16 21:09:43.973832 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.972838    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1b4a76d0-f222-48bd-ac11-fd187bada4ec-ovnkube-script-lib\") pod \"ovnkube-node-dd8jk\" (UID: \"1b4a76d0-f222-48bd-ac11-fd187bada4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk"
Jul 16 21:09:43.973832 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.972859    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1b4a76d0-f222-48bd-ac11-fd187bada4ec-etc-openvswitch\") pod \"ovnkube-node-dd8jk\" (UID: \"1b4a76d0-f222-48bd-ac11-fd187bada4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk"
Jul 16 21:09:43.973832 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.972886    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1b4a76d0-f222-48bd-ac11-fd187bada4ec-node-log\") pod \"ovnkube-node-dd8jk\" (UID: \"1b4a76d0-f222-48bd-ac11-fd187bada4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk"
Jul 16 21:09:43.973832 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.972888    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/67996421-567c-4901-b037-a8863575763b-system-cni-dir\") pod \"multus-additional-cni-plugins-w9rrt\" (UID: \"67996421-567c-4901-b037-a8863575763b\") " pod="openshift-multus/multus-additional-cni-plugins-w9rrt"
Jul 16 21:09:43.973832 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.972911    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1b4a76d0-f222-48bd-ac11-fd187bada4ec-systemd-units\") pod \"ovnkube-node-dd8jk\" (UID: \"1b4a76d0-f222-48bd-ac11-fd187bada4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk"
Jul 16 21:09:43.973832 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.972924    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djhmt\" (UniqueName: \"kubernetes.io/projected/e52ac48f-692d-4893-a046-71dea5a7b5aa-kube-api-access-djhmt\") pod \"node-resolver-znkwj\" (UID: \"e52ac48f-692d-4893-a046-71dea5a7b5aa\") " pod="openshift-dns/node-resolver-znkwj"
Jul 16 21:09:43.973832 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.972930    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1b4a76d0-f222-48bd-ac11-fd187bada4ec-host-run-ovn-kubernetes\") pod \"ovnkube-node-dd8jk\" (UID: \"1b4a76d0-f222-48bd-ac11-fd187bada4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk"
Jul 16 21:09:43.973832 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.972934    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/97f73b7d-47ea-4d24-a45e-fab8a2f5cda2-kubelet-config\") pod \"global-pull-secret-syncer-6z877\" (UID: \"97f73b7d-47ea-4d24-a45e-fab8a2f5cda2\") " pod="kube-system/global-pull-secret-syncer-6z877"
Jul 16 21:09:43.973832 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.972962    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1b4a76d0-f222-48bd-ac11-fd187bada4ec-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dd8jk\" (UID: \"1b4a76d0-f222-48bd-ac11-fd187bada4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk"
Jul 16 21:09:43.973832 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.972997    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/67996421-567c-4901-b037-a8863575763b-system-cni-dir\") pod \"multus-additional-cni-plugins-w9rrt\" (UID: \"67996421-567c-4901-b037-a8863575763b\") " pod="openshift-multus/multus-additional-cni-plugins-w9rrt"
Jul 16 21:09:43.974393 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:43.973004    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 21:09:43.974393 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.973003    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1b4a76d0-f222-48bd-ac11-fd187bada4ec-host-cni-netd\") pod \"ovnkube-node-dd8jk\" (UID: \"1b4a76d0-f222-48bd-ac11-fd187bada4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk"
Jul 16 21:09:43.974393 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:43.973064    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97f73b7d-47ea-4d24-a45e-fab8a2f5cda2-original-pull-secret podName:97f73b7d-47ea-4d24-a45e-fab8a2f5cda2 nodeName:}" failed. No retries permitted until 2026-07-16 21:09:44.473046132 +0000 UTC m=+3.087226435 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/97f73b7d-47ea-4d24-a45e-fab8a2f5cda2-original-pull-secret") pod "global-pull-secret-syncer-6z877" (UID: "97f73b7d-47ea-4d24-a45e-fab8a2f5cda2") : object "kube-system"/"original-pull-secret" not registered
Jul 16 21:09:43.974393 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.973110    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/67996421-567c-4901-b037-a8863575763b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w9rrt\" (UID: \"67996421-567c-4901-b037-a8863575763b\") " pod="openshift-multus/multus-additional-cni-plugins-w9rrt"
Jul 16 21:09:43.974393 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.973332    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1b4a76d0-f222-48bd-ac11-fd187bada4ec-env-overrides\") pod \"ovnkube-node-dd8jk\" (UID: \"1b4a76d0-f222-48bd-ac11-fd187bada4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk"
Jul 16 21:09:43.974393 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.973440    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1b4a76d0-f222-48bd-ac11-fd187bada4ec-ovnkube-script-lib\") pod \"ovnkube-node-dd8jk\" (UID: \"1b4a76d0-f222-48bd-ac11-fd187bada4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk"
Jul 16 21:09:43.974393 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.974276    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1b4a76d0-f222-48bd-ac11-fd187bada4ec-ovn-node-metrics-cert\") pod \"ovnkube-node-dd8jk\" (UID: \"1b4a76d0-f222-48bd-ac11-fd187bada4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk"
Jul 16 21:09:43.982862 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.982839    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4v4wt\" (UniqueName: \"kubernetes.io/projected/abc6bb6b-5fd0-4978-9416-d0582775a520-kube-api-access-4v4wt\") pod \"network-metrics-daemon-v5bvd\" (UID: \"abc6bb6b-5fd0-4978-9416-d0582775a520\") " pod="openshift-multus/network-metrics-daemon-v5bvd"
Jul 16 21:09:43.982975 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.982958    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-682qk\" (UniqueName: \"kubernetes.io/projected/1b4a76d0-f222-48bd-ac11-fd187bada4ec-kube-api-access-682qk\") pod \"ovnkube-node-dd8jk\" (UID: \"1b4a76d0-f222-48bd-ac11-fd187bada4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk"
Jul 16 21:09:43.983138 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.983106    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djhmt\" (UniqueName: \"kubernetes.io/projected/e52ac48f-692d-4893-a046-71dea5a7b5aa-kube-api-access-djhmt\") pod \"node-resolver-znkwj\" (UID: \"e52ac48f-692d-4893-a046-71dea5a7b5aa\") " pod="openshift-dns/node-resolver-znkwj"
Jul 16 21:09:43.983220 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:43.983200    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tcrr\" (UniqueName: \"kubernetes.io/projected/67996421-567c-4901-b037-a8863575763b-kube-api-access-9tcrr\") pod \"multus-additional-cni-plugins-w9rrt\" (UID: \"67996421-567c-4901-b037-a8863575763b\") " pod="openshift-multus/multus-additional-cni-plugins-w9rrt"
Jul 16 21:09:44.057276 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:44.057198    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lft7l"
Jul 16 21:09:44.065550 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:44.065517    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-llmw2"
Jul 16 21:09:44.068152 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:44.068125    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod355ad64f_aa0d_4876_a4a2_faec378a30bf.slice/crio-6b8cf8b6667db3884a1a1845b4340f3c7bf4354830cd362788f458972e6d0356 WatchSource:0}: Error finding container 6b8cf8b6667db3884a1a1845b4340f3c7bf4354830cd362788f458972e6d0356: Status 404 returned error can't find the container with id 6b8cf8b6667db3884a1a1845b4340f3c7bf4354830cd362788f458972e6d0356
Jul 16 21:09:44.075024 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:44.074988    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92e2f3e9_e610_4859_b11b_105f3e28d548.slice/crio-14e3862484dd1f397c11b151f56cbf7ab7322110bb8cf9b14981d612e5172ee7 WatchSource:0}: Error finding container 14e3862484dd1f397c11b151f56cbf7ab7322110bb8cf9b14981d612e5172ee7: Status 404 returned error can't find the container with id 14e3862484dd1f397c11b151f56cbf7ab7322110bb8cf9b14981d612e5172ee7
Jul 16 21:09:44.075808 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:44.075788    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hkbpk"
Jul 16 21:09:44.082218 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:44.082197    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68m9d"
Jul 16 21:09:44.086593 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:44.086570    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31d88740_4569_46ac_8cf7_1ba83a71f020.slice/crio-a4c608bb4bae76c3fd11f6ff178a9c7f65c961e89aa784d23c2b80488dc3586a WatchSource:0}: Error finding container a4c608bb4bae76c3fd11f6ff178a9c7f65c961e89aa784d23c2b80488dc3586a: Status 404 returned error can't find the container with id a4c608bb4bae76c3fd11f6ff178a9c7f65c961e89aa784d23c2b80488dc3586a
Jul 16 21:09:44.090222 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:44.090198    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lqhw4"
Jul 16 21:09:44.093921 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:44.093895    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26fd5f6a_a629_43f1_8370_9e9f5974390a.slice/crio-d20ff59407c6faadeeecd150173a56a7be5966e48038151163cdf6791f3be188 WatchSource:0}: Error finding container d20ff59407c6faadeeecd150173a56a7be5966e48038151163cdf6791f3be188: Status 404 returned error can't find the container with id d20ff59407c6faadeeecd150173a56a7be5966e48038151163cdf6791f3be188
Jul 16 21:09:44.098601 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:44.098578    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-s2phn"
Jul 16 21:09:44.098834 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:44.098801    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod101708f5_f1af_4179_91e1_f57c3494b6a7.slice/crio-190a3aa61be0a016b227d49afd873cd25de47e364f8ae589e5304410d89979af WatchSource:0}: Error finding container 190a3aa61be0a016b227d49afd873cd25de47e364f8ae589e5304410d89979af: Status 404 returned error can't find the container with id 190a3aa61be0a016b227d49afd873cd25de47e364f8ae589e5304410d89979af
Jul 16 21:09:44.105766 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:44.105740    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-znkwj"
Jul 16 21:09:44.107855 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:44.107832    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode787d2eb_af32_410d_96c2_d02ba94e62cd.slice/crio-c526a67ee08ec068269b9c544fdeaef5488622d709b665df77e473dddb964231 WatchSource:0}: Error finding container c526a67ee08ec068269b9c544fdeaef5488622d709b665df77e473dddb964231: Status 404 returned error can't find the container with id c526a67ee08ec068269b9c544fdeaef5488622d709b665df77e473dddb964231
Jul 16 21:09:44.113173 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:44.113150    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk"
Jul 16 21:09:44.115451 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:44.115421    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode52ac48f_692d_4893_a046_71dea5a7b5aa.slice/crio-f822e0c35e2c1c27e33f58c71841e0efae1d6d80ed3c3520b71c4767d2829097 WatchSource:0}: Error finding container f822e0c35e2c1c27e33f58c71841e0efae1d6d80ed3c3520b71c4767d2829097: Status 404 returned error can't find the container with id f822e0c35e2c1c27e33f58c71841e0efae1d6d80ed3c3520b71c4767d2829097
Jul 16 21:09:44.118277 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:44.118161    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-w9rrt"
Jul 16 21:09:44.129494 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:09:44.129471    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67996421_567c_4901_b037_a8863575763b.slice/crio-0045d992c3135b949761c2749c2dec849254f8f6a0c57ecf5e097467d23b78fa WatchSource:0}: Error finding container 0045d992c3135b949761c2749c2dec849254f8f6a0c57ecf5e097467d23b78fa: Status 404 returned error can't find the container with id 0045d992c3135b949761c2749c2dec849254f8f6a0c57ecf5e097467d23b78fa
Jul 16 21:09:44.476070 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:44.475978    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/abc6bb6b-5fd0-4978-9416-d0582775a520-metrics-certs\") pod \"network-metrics-daemon-v5bvd\" (UID: \"abc6bb6b-5fd0-4978-9416-d0582775a520\") " pod="openshift-multus/network-metrics-daemon-v5bvd"
Jul 16 21:09:44.476070 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:44.476058    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/97f73b7d-47ea-4d24-a45e-fab8a2f5cda2-original-pull-secret\") pod \"global-pull-secret-syncer-6z877\" (UID: \"97f73b7d-47ea-4d24-a45e-fab8a2f5cda2\") " pod="kube-system/global-pull-secret-syncer-6z877"
Jul 16 21:09:44.476333 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:44.476223    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 21:09:44.476333 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:44.476255    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jr8lm\" (UniqueName: \"kubernetes.io/projected/e9422503-3736-42d5-85de-6160c39f65bf-kube-api-access-jr8lm\") pod \"network-check-target-9mdcw\" (UID: \"e9422503-3736-42d5-85de-6160c39f65bf\") " pod="openshift-network-diagnostics/network-check-target-9mdcw"
Jul 16 21:09:44.476333 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:44.476295    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abc6bb6b-5fd0-4978-9416-d0582775a520-metrics-certs podName:abc6bb6b-5fd0-4978-9416-d0582775a520 nodeName:}" failed. No retries permitted until 2026-07-16 21:09:45.476274987 +0000 UTC m=+4.090455287 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/abc6bb6b-5fd0-4978-9416-d0582775a520-metrics-certs") pod "network-metrics-daemon-v5bvd" (UID: "abc6bb6b-5fd0-4978-9416-d0582775a520") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 21:09:44.476501 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:44.476381    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 21:09:44.476501 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:44.476393    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 21:09:44.476501 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:44.476417    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 21:09:44.476501 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:44.476431    2579 projected.go:196] Error preparing data for projected volume kube-api-access-jr8lm for pod openshift-network-diagnostics/network-check-target-9mdcw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 21:09:44.476501 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:44.476446    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97f73b7d-47ea-4d24-a45e-fab8a2f5cda2-original-pull-secret podName:97f73b7d-47ea-4d24-a45e-fab8a2f5cda2 nodeName:}" failed. No retries permitted until 2026-07-16 21:09:45.476429403 +0000 UTC m=+4.090609704 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/97f73b7d-47ea-4d24-a45e-fab8a2f5cda2-original-pull-secret") pod "global-pull-secret-syncer-6z877" (UID: "97f73b7d-47ea-4d24-a45e-fab8a2f5cda2") : object "kube-system"/"original-pull-secret" not registered
Jul 16 21:09:44.476501 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:44.476480    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e9422503-3736-42d5-85de-6160c39f65bf-kube-api-access-jr8lm podName:e9422503-3736-42d5-85de-6160c39f65bf nodeName:}" failed. No retries permitted until 2026-07-16 21:09:45.476464503 +0000 UTC m=+4.090644814 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jr8lm" (UniqueName: "kubernetes.io/projected/e9422503-3736-42d5-85de-6160c39f65bf-kube-api-access-jr8lm") pod "network-check-target-9mdcw" (UID: "e9422503-3736-42d5-85de-6160c39f65bf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 21:09:44.920234 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:44.920034    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 21:04:44 +0000 UTC" deadline="2027-12-15 18:19:32.917089055 +0000 UTC"
Jul 16 21:09:44.920234 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:44.920123    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12405h9m47.996984603s"
Jul 16 21:09:44.966577 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:44.965835    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v5bvd"
Jul 16 21:09:44.966577 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:44.965983    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v5bvd" podUID="abc6bb6b-5fd0-4978-9416-d0582775a520"
Jul 16 21:09:44.966577 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:44.966428    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6z877"
Jul 16 21:09:44.966577 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:44.966525    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6z877" podUID="97f73b7d-47ea-4d24-a45e-fab8a2f5cda2"
Jul 16 21:09:44.977220 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:44.977133    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w9rrt" event={"ID":"67996421-567c-4901-b037-a8863575763b","Type":"ContainerStarted","Data":"0045d992c3135b949761c2749c2dec849254f8f6a0c57ecf5e097467d23b78fa"}
Jul 16 21:09:44.979402 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:44.979318    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lqhw4" event={"ID":"101708f5-f1af-4179-91e1-f57c3494b6a7","Type":"ContainerStarted","Data":"190a3aa61be0a016b227d49afd873cd25de47e364f8ae589e5304410d89979af"}
Jul 16 21:09:44.981754 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:44.981720    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hkbpk" event={"ID":"31d88740-4569-46ac-8cf7-1ba83a71f020","Type":"ContainerStarted","Data":"a4c608bb4bae76c3fd11f6ff178a9c7f65c961e89aa784d23c2b80488dc3586a"}
Jul 16 21:09:44.983619 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:44.983590    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lft7l" event={"ID":"355ad64f-aa0d-4876-a4a2-faec378a30bf","Type":"ContainerStarted","Data":"6b8cf8b6667db3884a1a1845b4340f3c7bf4354830cd362788f458972e6d0356"}
Jul 16 21:09:44.987422 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:44.987330    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk" event={"ID":"1b4a76d0-f222-48bd-ac11-fd187bada4ec","Type":"ContainerStarted","Data":"6da7d0273b2138c4b58394476030262c5f5e50ee83e5d297a2c7a4398d2bbd66"}
Jul 16 21:09:44.990137 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:44.990098    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-znkwj" event={"ID":"e52ac48f-692d-4893-a046-71dea5a7b5aa","Type":"ContainerStarted","Data":"f822e0c35e2c1c27e33f58c71841e0efae1d6d80ed3c3520b71c4767d2829097"}
Jul 16 21:09:44.992297 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:44.992275    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-s2phn" event={"ID":"e787d2eb-af32-410d-96c2-d02ba94e62cd","Type":"ContainerStarted","Data":"c526a67ee08ec068269b9c544fdeaef5488622d709b665df77e473dddb964231"}
Jul 16 21:09:44.995825 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:44.995798    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68m9d" event={"ID":"26fd5f6a-a629-43f1-8370-9e9f5974390a","Type":"ContainerStarted","Data":"d20ff59407c6faadeeecd150173a56a7be5966e48038151163cdf6791f3be188"}
Jul 16 21:09:44.998062 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:44.998037    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-llmw2" event={"ID":"92e2f3e9-e610-4859-b11b-105f3e28d548","Type":"ContainerStarted","Data":"14e3862484dd1f397c11b151f56cbf7ab7322110bb8cf9b14981d612e5172ee7"}
Jul 16 21:09:45.485967 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:45.485920    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/abc6bb6b-5fd0-4978-9416-d0582775a520-metrics-certs\") pod \"network-metrics-daemon-v5bvd\" (UID: \"abc6bb6b-5fd0-4978-9416-d0582775a520\") " pod="openshift-multus/network-metrics-daemon-v5bvd"
Jul 16 21:09:45.486158 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:45.485995    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/97f73b7d-47ea-4d24-a45e-fab8a2f5cda2-original-pull-secret\") pod \"global-pull-secret-syncer-6z877\" (UID: \"97f73b7d-47ea-4d24-a45e-fab8a2f5cda2\") " pod="kube-system/global-pull-secret-syncer-6z877"
Jul 16 21:09:45.486158 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:45.486040    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jr8lm\" (UniqueName: \"kubernetes.io/projected/e9422503-3736-42d5-85de-6160c39f65bf-kube-api-access-jr8lm\") pod \"network-check-target-9mdcw\" (UID: \"e9422503-3736-42d5-85de-6160c39f65bf\") " pod="openshift-network-diagnostics/network-check-target-9mdcw"
Jul 16 21:09:45.486310 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:45.486222    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 21:09:45.486310 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:45.486245    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 21:09:45.486310 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:45.486259    2579 projected.go:196] Error preparing data for projected volume kube-api-access-jr8lm for pod openshift-network-diagnostics/network-check-target-9mdcw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 21:09:45.486479 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:45.486323    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e9422503-3736-42d5-85de-6160c39f65bf-kube-api-access-jr8lm podName:e9422503-3736-42d5-85de-6160c39f65bf nodeName:}" failed. No retries permitted until 2026-07-16 21:09:47.486303807 +0000 UTC m=+6.100484108 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jr8lm" (UniqueName: "kubernetes.io/projected/e9422503-3736-42d5-85de-6160c39f65bf-kube-api-access-jr8lm") pod "network-check-target-9mdcw" (UID: "e9422503-3736-42d5-85de-6160c39f65bf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 21:09:45.486773 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:45.486752    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 21:09:45.486832 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:45.486815    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abc6bb6b-5fd0-4978-9416-d0582775a520-metrics-certs podName:abc6bb6b-5fd0-4978-9416-d0582775a520 nodeName:}" failed. No retries permitted until 2026-07-16 21:09:47.486798727 +0000 UTC m=+6.100979024 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/abc6bb6b-5fd0-4978-9416-d0582775a520-metrics-certs") pod "network-metrics-daemon-v5bvd" (UID: "abc6bb6b-5fd0-4978-9416-d0582775a520") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 21:09:45.486907 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:45.486878    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 21:09:45.486961 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:45.486921    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97f73b7d-47ea-4d24-a45e-fab8a2f5cda2-original-pull-secret podName:97f73b7d-47ea-4d24-a45e-fab8a2f5cda2 nodeName:}" failed. No retries permitted until 2026-07-16 21:09:47.486907896 +0000 UTC m=+6.101088207 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/97f73b7d-47ea-4d24-a45e-fab8a2f5cda2-original-pull-secret") pod "global-pull-secret-syncer-6z877" (UID: "97f73b7d-47ea-4d24-a45e-fab8a2f5cda2") : object "kube-system"/"original-pull-secret" not registered
Jul 16 21:09:45.921237 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:45.921188    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 21:04:44 +0000 UTC" deadline="2028-01-25 13:55:22.917507064 +0000 UTC"
Jul 16 21:09:45.921237 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:45.921235    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13384h45m36.996277697s"
Jul 16 21:09:45.966045 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:45.966014    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9mdcw"
Jul 16 21:09:45.966207 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:45.966181    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9mdcw" podUID="e9422503-3736-42d5-85de-6160c39f65bf"
Jul 16 21:09:46.966396 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:46.966020    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6z877"
Jul 16 21:09:46.966396 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:46.966087    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v5bvd"
Jul 16 21:09:46.970247 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:46.968664    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6z877" podUID="97f73b7d-47ea-4d24-a45e-fab8a2f5cda2"
Jul 16 21:09:46.970247 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:46.969292    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v5bvd" podUID="abc6bb6b-5fd0-4978-9416-d0582775a520"
Jul 16 21:09:47.030097 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:47.029147    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-58.ec2.internal" event={"ID":"505a84a2e65f988310008bbe35d60123","Type":"ContainerStarted","Data":"4bbbc9fa3b2c17cd2287c68aa62126da5ab5efa00388883b4340b6e3577fb28a"}
Jul 16 21:09:47.057601 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:47.057347    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-58.ec2.internal" podStartSLOduration=4.057323261 podStartE2EDuration="4.057323261s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:09:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:09:47.057212381 +0000 UTC m=+5.671392729" watchObservedRunningTime="2026-07-16 21:09:47.057323261 +0000 UTC m=+5.671503582"
Jul 16 21:09:47.504145 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:47.504108    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/97f73b7d-47ea-4d24-a45e-fab8a2f5cda2-original-pull-secret\") pod \"global-pull-secret-syncer-6z877\" (UID: \"97f73b7d-47ea-4d24-a45e-fab8a2f5cda2\") " pod="kube-system/global-pull-secret-syncer-6z877"
Jul 16 21:09:47.504350 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:47.504187    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jr8lm\" (UniqueName: \"kubernetes.io/projected/e9422503-3736-42d5-85de-6160c39f65bf-kube-api-access-jr8lm\") pod \"network-check-target-9mdcw\" (UID: \"e9422503-3736-42d5-85de-6160c39f65bf\") " pod="openshift-network-diagnostics/network-check-target-9mdcw"
Jul 16 21:09:47.504350 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:47.504231    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/abc6bb6b-5fd0-4978-9416-d0582775a520-metrics-certs\") pod \"network-metrics-daemon-v5bvd\" (UID: \"abc6bb6b-5fd0-4978-9416-d0582775a520\") " pod="openshift-multus/network-metrics-daemon-v5bvd"
Jul 16 21:09:47.504464 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:47.504349    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 21:09:47.504464 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:47.504360    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 21:09:47.504464 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:47.504419    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97f73b7d-47ea-4d24-a45e-fab8a2f5cda2-original-pull-secret podName:97f73b7d-47ea-4d24-a45e-fab8a2f5cda2 nodeName:}" failed. No retries permitted until 2026-07-16 21:09:51.504395151 +0000 UTC m=+10.118575470 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/97f73b7d-47ea-4d24-a45e-fab8a2f5cda2-original-pull-secret") pod "global-pull-secret-syncer-6z877" (UID: "97f73b7d-47ea-4d24-a45e-fab8a2f5cda2") : object "kube-system"/"original-pull-secret" not registered
Jul 16 21:09:47.504626 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:47.504466    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 21:09:47.504626 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:47.504474    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abc6bb6b-5fd0-4978-9416-d0582775a520-metrics-certs podName:abc6bb6b-5fd0-4978-9416-d0582775a520 nodeName:}" failed. No retries permitted until 2026-07-16 21:09:51.504430114 +0000 UTC m=+10.118610415 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/abc6bb6b-5fd0-4978-9416-d0582775a520-metrics-certs") pod "network-metrics-daemon-v5bvd" (UID: "abc6bb6b-5fd0-4978-9416-d0582775a520") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 21:09:47.504626 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:47.504481    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 21:09:47.504626 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:47.504493    2579 projected.go:196] Error preparing data for projected volume kube-api-access-jr8lm for pod openshift-network-diagnostics/network-check-target-9mdcw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 21:09:47.504626 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:47.504535    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e9422503-3736-42d5-85de-6160c39f65bf-kube-api-access-jr8lm podName:e9422503-3736-42d5-85de-6160c39f65bf nodeName:}" failed. No retries permitted until 2026-07-16 21:09:51.50451928 +0000 UTC m=+10.118699583 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jr8lm" (UniqueName: "kubernetes.io/projected/e9422503-3736-42d5-85de-6160c39f65bf-kube-api-access-jr8lm") pod "network-check-target-9mdcw" (UID: "e9422503-3736-42d5-85de-6160c39f65bf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 21:09:47.967142 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:47.967086    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9mdcw"
Jul 16 21:09:47.967643 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:47.967337    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9mdcw" podUID="e9422503-3736-42d5-85de-6160c39f65bf"
Jul 16 21:09:48.040321 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:48.040266    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-58.ec2.internal" event={"ID":"8191b9618bfa53be6f3908cc4952d20e","Type":"ContainerStarted","Data":"2497c84ebb18134e99ab5ba01e940fca9d3ab190538d87ad35c6ca819c8080c4"}
Jul 16 21:09:48.966210 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:48.966176    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6z877"
Jul 16 21:09:48.966404 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:48.966326    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6z877" podUID="97f73b7d-47ea-4d24-a45e-fab8a2f5cda2"
Jul 16 21:09:48.966472 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:48.966395    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v5bvd"
Jul 16 21:09:48.966570 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:48.966540    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v5bvd" podUID="abc6bb6b-5fd0-4978-9416-d0582775a520"
Jul 16 21:09:49.044006 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:49.043920    2579 generic.go:356] "Generic (PLEG): container finished" podID="8191b9618bfa53be6f3908cc4952d20e" containerID="2497c84ebb18134e99ab5ba01e940fca9d3ab190538d87ad35c6ca819c8080c4" exitCode=0
Jul 16 21:09:49.044006 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:49.043974    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-58.ec2.internal" event={"ID":"8191b9618bfa53be6f3908cc4952d20e","Type":"ContainerDied","Data":"2497c84ebb18134e99ab5ba01e940fca9d3ab190538d87ad35c6ca819c8080c4"}
Jul 16 21:09:49.965404 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:49.965326    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9mdcw"
Jul 16 21:09:49.965577 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:49.965463    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9mdcw" podUID="e9422503-3736-42d5-85de-6160c39f65bf"
Jul 16 21:09:50.966391 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:50.966248    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6z877"
Jul 16 21:09:50.966391 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:50.966284    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v5bvd"
Jul 16 21:09:50.966923 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:50.966447    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v5bvd" podUID="abc6bb6b-5fd0-4978-9416-d0582775a520"
Jul 16 21:09:50.966923 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:50.966806    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6z877" podUID="97f73b7d-47ea-4d24-a45e-fab8a2f5cda2"
Jul 16 21:09:51.537417 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:51.537378    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/97f73b7d-47ea-4d24-a45e-fab8a2f5cda2-original-pull-secret\") pod \"global-pull-secret-syncer-6z877\" (UID: \"97f73b7d-47ea-4d24-a45e-fab8a2f5cda2\") " pod="kube-system/global-pull-secret-syncer-6z877"
Jul 16 21:09:51.537594 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:51.537449    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jr8lm\" (UniqueName: \"kubernetes.io/projected/e9422503-3736-42d5-85de-6160c39f65bf-kube-api-access-jr8lm\") pod \"network-check-target-9mdcw\" (UID: \"e9422503-3736-42d5-85de-6160c39f65bf\") " pod="openshift-network-diagnostics/network-check-target-9mdcw"
Jul 16 21:09:51.537594 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:51.537484    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/abc6bb6b-5fd0-4978-9416-d0582775a520-metrics-certs\") pod \"network-metrics-daemon-v5bvd\" (UID: \"abc6bb6b-5fd0-4978-9416-d0582775a520\") " pod="openshift-multus/network-metrics-daemon-v5bvd"
Jul 16 21:09:51.537594 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:51.537537    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 21:09:51.537763 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:51.537609    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97f73b7d-47ea-4d24-a45e-fab8a2f5cda2-original-pull-secret podName:97f73b7d-47ea-4d24-a45e-fab8a2f5cda2 nodeName:}" failed. No retries permitted until 2026-07-16 21:09:59.537590282 +0000 UTC m=+18.151770583 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/97f73b7d-47ea-4d24-a45e-fab8a2f5cda2-original-pull-secret") pod "global-pull-secret-syncer-6z877" (UID: "97f73b7d-47ea-4d24-a45e-fab8a2f5cda2") : object "kube-system"/"original-pull-secret" not registered
Jul 16 21:09:51.537763 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:51.537614    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 21:09:51.537763 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:51.537636    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 21:09:51.537763 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:51.537650    2579 projected.go:196] Error preparing data for projected volume kube-api-access-jr8lm for pod openshift-network-diagnostics/network-check-target-9mdcw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 21:09:51.537763 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:51.537692    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e9422503-3736-42d5-85de-6160c39f65bf-kube-api-access-jr8lm podName:e9422503-3736-42d5-85de-6160c39f65bf nodeName:}" failed. No retries permitted until 2026-07-16 21:09:59.537677758 +0000 UTC m=+18.151858053 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jr8lm" (UniqueName: "kubernetes.io/projected/e9422503-3736-42d5-85de-6160c39f65bf-kube-api-access-jr8lm") pod "network-check-target-9mdcw" (UID: "e9422503-3736-42d5-85de-6160c39f65bf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 21:09:51.537763 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:51.537615    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 21:09:51.537763 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:51.537727    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abc6bb6b-5fd0-4978-9416-d0582775a520-metrics-certs podName:abc6bb6b-5fd0-4978-9416-d0582775a520 nodeName:}" failed. No retries permitted until 2026-07-16 21:09:59.537719799 +0000 UTC m=+18.151900093 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/abc6bb6b-5fd0-4978-9416-d0582775a520-metrics-certs") pod "network-metrics-daemon-v5bvd" (UID: "abc6bb6b-5fd0-4978-9416-d0582775a520") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 21:09:51.966416 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:51.966338    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9mdcw"
Jul 16 21:09:51.966862 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:51.966451    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9mdcw" podUID="e9422503-3736-42d5-85de-6160c39f65bf"
Jul 16 21:09:52.966040 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:52.965842    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6z877"
Jul 16 21:09:52.966040 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:52.965899    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v5bvd"
Jul 16 21:09:52.966040 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:52.965983    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6z877" podUID="97f73b7d-47ea-4d24-a45e-fab8a2f5cda2"
Jul 16 21:09:52.966337 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:52.966087    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v5bvd" podUID="abc6bb6b-5fd0-4978-9416-d0582775a520"
Jul 16 21:09:53.966503 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:53.966458    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9mdcw"
Jul 16 21:09:53.966958 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:53.966610    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9mdcw" podUID="e9422503-3736-42d5-85de-6160c39f65bf"
Jul 16 21:09:54.965580 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:54.965549    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v5bvd"
Jul 16 21:09:54.965742 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:54.965690    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v5bvd" podUID="abc6bb6b-5fd0-4978-9416-d0582775a520"
Jul 16 21:09:54.965813 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:54.965745    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6z877"
Jul 16 21:09:54.965854 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:54.965841    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6z877" podUID="97f73b7d-47ea-4d24-a45e-fab8a2f5cda2"
Jul 16 21:09:55.965609 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:55.965568    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9mdcw"
Jul 16 21:09:55.966086 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:55.965746    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9mdcw" podUID="e9422503-3736-42d5-85de-6160c39f65bf"
Jul 16 21:09:56.966008 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:56.965968    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v5bvd"
Jul 16 21:09:56.966498 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:56.966121    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v5bvd" podUID="abc6bb6b-5fd0-4978-9416-d0582775a520"
Jul 16 21:09:56.966498 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:56.966129    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6z877"
Jul 16 21:09:56.966498 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:56.966258    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6z877" podUID="97f73b7d-47ea-4d24-a45e-fab8a2f5cda2"
Jul 16 21:09:57.965834 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:57.965802    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9mdcw"
Jul 16 21:09:57.966004 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:57.965948    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9mdcw" podUID="e9422503-3736-42d5-85de-6160c39f65bf"
Jul 16 21:09:58.966174 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:58.966138    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6z877"
Jul 16 21:09:58.966676 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:58.966138    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v5bvd"
Jul 16 21:09:58.966676 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:58.966265    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6z877" podUID="97f73b7d-47ea-4d24-a45e-fab8a2f5cda2"
Jul 16 21:09:58.966676 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:58.966382    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v5bvd" podUID="abc6bb6b-5fd0-4978-9416-d0582775a520"
Jul 16 21:09:59.599938 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:59.599906    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/97f73b7d-47ea-4d24-a45e-fab8a2f5cda2-original-pull-secret\") pod \"global-pull-secret-syncer-6z877\" (UID: \"97f73b7d-47ea-4d24-a45e-fab8a2f5cda2\") " pod="kube-system/global-pull-secret-syncer-6z877"
Jul 16 21:09:59.600135 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:59.599957    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jr8lm\" (UniqueName: \"kubernetes.io/projected/e9422503-3736-42d5-85de-6160c39f65bf-kube-api-access-jr8lm\") pod \"network-check-target-9mdcw\" (UID: \"e9422503-3736-42d5-85de-6160c39f65bf\") " pod="openshift-network-diagnostics/network-check-target-9mdcw"
Jul 16 21:09:59.600135 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:59.599993    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/abc6bb6b-5fd0-4978-9416-d0582775a520-metrics-certs\") pod \"network-metrics-daemon-v5bvd\" (UID: \"abc6bb6b-5fd0-4978-9416-d0582775a520\") " pod="openshift-multus/network-metrics-daemon-v5bvd"
Jul 16 21:09:59.600135 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:59.600042    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 21:09:59.600135 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:59.600109    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 21:09:59.600135 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:59.600124    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97f73b7d-47ea-4d24-a45e-fab8a2f5cda2-original-pull-secret podName:97f73b7d-47ea-4d24-a45e-fab8a2f5cda2 nodeName:}" failed. No retries permitted until 2026-07-16 21:10:15.600110572 +0000 UTC m=+34.214290882 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/97f73b7d-47ea-4d24-a45e-fab8a2f5cda2-original-pull-secret") pod "global-pull-secret-syncer-6z877" (UID: "97f73b7d-47ea-4d24-a45e-fab8a2f5cda2") : object "kube-system"/"original-pull-secret" not registered
Jul 16 21:09:59.600327 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:59.600137    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 21:09:59.600327 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:59.600156    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 21:09:59.600327 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:59.600158    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abc6bb6b-5fd0-4978-9416-d0582775a520-metrics-certs podName:abc6bb6b-5fd0-4978-9416-d0582775a520 nodeName:}" failed. No retries permitted until 2026-07-16 21:10:15.600142732 +0000 UTC m=+34.214323031 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/abc6bb6b-5fd0-4978-9416-d0582775a520-metrics-certs") pod "network-metrics-daemon-v5bvd" (UID: "abc6bb6b-5fd0-4978-9416-d0582775a520") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 21:09:59.600327 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:59.600166    2579 projected.go:196] Error preparing data for projected volume kube-api-access-jr8lm for pod openshift-network-diagnostics/network-check-target-9mdcw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 21:09:59.600327 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:59.600206    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e9422503-3736-42d5-85de-6160c39f65bf-kube-api-access-jr8lm podName:e9422503-3736-42d5-85de-6160c39f65bf nodeName:}" failed. No retries permitted until 2026-07-16 21:10:15.600194945 +0000 UTC m=+34.214375255 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jr8lm" (UniqueName: "kubernetes.io/projected/e9422503-3736-42d5-85de-6160c39f65bf-kube-api-access-jr8lm") pod "network-check-target-9mdcw" (UID: "e9422503-3736-42d5-85de-6160c39f65bf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 21:09:59.966398 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:09:59.966322    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9mdcw"
Jul 16 21:09:59.966783 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:09:59.966445    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9mdcw" podUID="e9422503-3736-42d5-85de-6160c39f65bf"
Jul 16 21:10:00.965482 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:00.965448    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v5bvd"
Jul 16 21:10:00.965646 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:00.965578    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v5bvd" podUID="abc6bb6b-5fd0-4978-9416-d0582775a520"
Jul 16 21:10:00.965646 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:00.965629    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6z877"
Jul 16 21:10:00.965766 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:00.965735    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6z877" podUID="97f73b7d-47ea-4d24-a45e-fab8a2f5cda2"
Jul 16 21:10:01.966040 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:01.966010    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9mdcw"
Jul 16 21:10:01.966550 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:01.966128    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9mdcw" podUID="e9422503-3736-42d5-85de-6160c39f65bf"
Jul 16 21:10:02.965562 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:02.965519    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v5bvd"
Jul 16 21:10:02.965738 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:02.965573    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6z877"
Jul 16 21:10:02.965738 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:02.965671    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v5bvd" podUID="abc6bb6b-5fd0-4978-9416-d0582775a520"
Jul 16 21:10:02.965897 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:02.965801    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6z877" podUID="97f73b7d-47ea-4d24-a45e-fab8a2f5cda2"
Jul 16 21:10:03.966483 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:03.966199    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9mdcw"
Jul 16 21:10:03.967288 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:03.966562    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9mdcw" podUID="e9422503-3736-42d5-85de-6160c39f65bf"
Jul 16 21:10:04.075638 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:04.075608    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-58.ec2.internal" event={"ID":"8191b9618bfa53be6f3908cc4952d20e","Type":"ContainerStarted","Data":"6b57a429bbd9a948f68ae421fd63de8c19e0b0c83af56b5a0497373fcb49fd68"}
Jul 16 21:10:04.077233 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:04.077213    2579 generic.go:356] "Generic (PLEG): container finished" podID="67996421-567c-4901-b037-a8863575763b" containerID="c5a52803ade74e625f042f31d284c0ca103e2fedc7b624869c008bad0c6267d8" exitCode=0
Jul 16 21:10:04.077327 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:04.077276    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w9rrt" event={"ID":"67996421-567c-4901-b037-a8863575763b","Type":"ContainerDied","Data":"c5a52803ade74e625f042f31d284c0ca103e2fedc7b624869c008bad0c6267d8"}
Jul 16 21:10:04.081738 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:04.081667    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lqhw4" event={"ID":"101708f5-f1af-4179-91e1-f57c3494b6a7","Type":"ContainerStarted","Data":"12cc34a4fa35a843a49f85433a75cc8025897b0db1ec7d70b18cd95d5eee5cf6"}
Jul 16 21:10:04.083676 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:04.083650    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lft7l" event={"ID":"355ad64f-aa0d-4876-a4a2-faec378a30bf","Type":"ContainerStarted","Data":"eb8bda920276b0391e4b1d9191c2b97b3e5b98b8aa7a2327c76ea2b61264a055"}
Jul 16 21:10:04.087813 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:04.087794    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk" event={"ID":"1b4a76d0-f222-48bd-ac11-fd187bada4ec","Type":"ContainerStarted","Data":"1d830b5f5e4f56ae59c1b79c81a942ab1372610c7e48f8c474108d4ae8e5a591"}
Jul 16 21:10:04.087908 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:04.087855    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk" event={"ID":"1b4a76d0-f222-48bd-ac11-fd187bada4ec","Type":"ContainerStarted","Data":"7f47178f2c6ee99d6938cc436371f8c6221ae7e58f73745da51773537ee8a88c"}
Jul 16 21:10:04.087908 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:04.087885    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk" event={"ID":"1b4a76d0-f222-48bd-ac11-fd187bada4ec","Type":"ContainerStarted","Data":"e6fba0ffc7a07f37209f1d4502820aa410e0eccc60fd869fb604f1f693c4cc5e"}
Jul 16 21:10:04.089111 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:04.089074    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-znkwj" event={"ID":"e52ac48f-692d-4893-a046-71dea5a7b5aa","Type":"ContainerStarted","Data":"0bba2202a32ee4ba5c9cdcb1ef623d9fbc09429b4325ffd93e35c8d2e41abb51"}
Jul 16 21:10:04.090362 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:04.090343    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-s2phn" event={"ID":"e787d2eb-af32-410d-96c2-d02ba94e62cd","Type":"ContainerStarted","Data":"75608918d0bd46120c0490d926022deef2439dbbdcc916b35983ccca16b891c4"}
Jul 16 21:10:04.091879 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:04.091860    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68m9d" event={"ID":"26fd5f6a-a629-43f1-8370-9e9f5974390a","Type":"ContainerStarted","Data":"72eb2a45a4198d180fdd0807bdedb7fc83fe5b833d13498ff3876f71da6d5492"}
Jul 16 21:10:04.093339 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:04.093313    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-llmw2" event={"ID":"92e2f3e9-e610-4859-b11b-105f3e28d548","Type":"ContainerStarted","Data":"a1b4ce0ace5635fb9f251da7cab7e85c3dd512cb2171f8e556fd7755255a954a"}
Jul 16 21:10:04.101637 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:04.101600    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-58.ec2.internal" podStartSLOduration=21.101586653 podStartE2EDuration="21.101586653s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:09:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:10:04.10157702 +0000 UTC m=+22.715757337" watchObservedRunningTime="2026-07-16 21:10:04.101586653 +0000 UTC m=+22.715766968"
Jul 16 21:10:04.126623 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:04.126579    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-lqhw4" podStartSLOduration=2.661267026 podStartE2EDuration="22.126564301s" totalImagesPullingTime="19.465297275s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:09:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:10:04.126236679 +0000 UTC m=+22.740417016" watchObservedRunningTime="2026-07-16 21:10:04.126564301 +0000 UTC m=+22.740744617"
Jul 16 21:10:04.187213 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:04.187173    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-znkwj" podStartSLOduration=6.765697737 podStartE2EDuration="22.187157304s" totalImagesPullingTime="15.421459567s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:09:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:10:04.154644649 +0000 UTC m=+22.768824965" watchObservedRunningTime="2026-07-16 21:10:04.187157304 +0000 UTC m=+22.801337620"
Jul 16 21:10:04.217802 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:04.217757    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-lft7l" podStartSLOduration=2.724043102 podStartE2EDuration="22.217740581s" totalImagesPullingTime="19.493697479s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:09:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:10:04.187834938 +0000 UTC m=+22.802015255" watchObservedRunningTime="2026-07-16 21:10:04.217740581 +0000 UTC m=+22.831920924"
Jul 16 21:10:04.247003 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:04.246890    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-s2phn" podStartSLOduration=2.636850548 podStartE2EDuration="22.246874337s" totalImagesPullingTime="19.610023789s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:09:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:10:04.217831838 +0000 UTC m=+22.832012153" watchObservedRunningTime="2026-07-16 21:10:04.246874337 +0000 UTC m=+22.861054653"
Jul 16 21:10:04.273456 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:04.273416    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-llmw2" podStartSLOduration=2.784929248 podStartE2EDuration="22.273400639s" totalImagesPullingTime="19.488471391s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:09:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:10:04.273191349 +0000 UTC m=+22.887371665" watchObservedRunningTime="2026-07-16 21:10:04.273400639 +0000 UTC m=+22.887580955"
Jul 16 21:10:04.965743 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:04.965709    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6z877"
Jul 16 21:10:04.965957 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:04.965761    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v5bvd"
Jul 16 21:10:04.965957 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:04.965848    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6z877" podUID="97f73b7d-47ea-4d24-a45e-fab8a2f5cda2"
Jul 16 21:10:04.966079 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:04.965992    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v5bvd" podUID="abc6bb6b-5fd0-4978-9416-d0582775a520"
Jul 16 21:10:05.098508 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:05.098468    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk" event={"ID":"1b4a76d0-f222-48bd-ac11-fd187bada4ec","Type":"ContainerStarted","Data":"51188a07d649ce9339a803cb39029097ab1214ed4af217760500c24790e3e25f"}
Jul 16 21:10:05.098920 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:05.098559    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk" event={"ID":"1b4a76d0-f222-48bd-ac11-fd187bada4ec","Type":"ContainerStarted","Data":"be294f4b9b92cfb47ccee74e2987a9b8c10a1181397a88a4862cc1485ac4c039"}
Jul 16 21:10:05.098920 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:05.098606    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk" event={"ID":"1b4a76d0-f222-48bd-ac11-fd187bada4ec","Type":"ContainerStarted","Data":"a67024f0c83a66cd5f1225acaea88b340fdd5137198a3e6fac921d4a6b6de9f0"}
Jul 16 21:10:05.099882 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:05.099860    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hkbpk" event={"ID":"31d88740-4569-46ac-8cf7-1ba83a71f020","Type":"ContainerStarted","Data":"7d2addfa16246093c00be5f734b95c12fb45c3ea5411773c2205e2575666b724"}
Jul 16 21:10:05.561781 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:05.561751    2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 16 21:10:05.827686 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:05.827524    2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-16T21:10:05.561775475Z","UUID":"f959f7db-4f27-4875-8ab8-5fed66423442","Handler":null,"Name":"","Endpoint":""}
Jul 16 21:10:05.828990 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:05.828969    2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 16 21:10:05.829128 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:05.829009    2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 16 21:10:05.965721 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:05.965687    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9mdcw"
Jul 16 21:10:05.965904 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:05.965825    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9mdcw" podUID="e9422503-3736-42d5-85de-6160c39f65bf"
Jul 16 21:10:06.104163 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:06.104060    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68m9d" event={"ID":"26fd5f6a-a629-43f1-8370-9e9f5974390a","Type":"ContainerStarted","Data":"3cd553e921c3f9f1ad685b3c84c31708f530ab2870dd1c5af5cc700a1a8769f1"}
Jul 16 21:10:06.254986 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:06.254953    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-llmw2"
Jul 16 21:10:06.255591 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:06.255570    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-llmw2"
Jul 16 21:10:06.296252 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:06.296194    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hkbpk" podStartSLOduration=8.846253111 podStartE2EDuration="24.296173092s" totalImagesPullingTime="15.449919981s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:09:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:10:05.130177699 +0000 UTC m=+23.744358015" watchObservedRunningTime="2026-07-16 21:10:06.296173092 +0000 UTC m=+24.910353408"
Jul 16 21:10:06.965549 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:06.965520    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6z877"
Jul 16 21:10:06.965704 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:06.965520    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v5bvd"
Jul 16 21:10:06.965704 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:06.965618    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6z877" podUID="97f73b7d-47ea-4d24-a45e-fab8a2f5cda2"
Jul 16 21:10:06.965774 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:06.965729    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v5bvd" podUID="abc6bb6b-5fd0-4978-9416-d0582775a520"
Jul 16 21:10:07.109308 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:07.109279    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk" event={"ID":"1b4a76d0-f222-48bd-ac11-fd187bada4ec","Type":"ContainerStarted","Data":"5468f38287f32c837f610e6d9ff3d180edb44b7a93c69e2f14175e8d579106ba"}
Jul 16 21:10:07.111135 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:07.111110    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68m9d" event={"ID":"26fd5f6a-a629-43f1-8370-9e9f5974390a","Type":"ContainerStarted","Data":"eb1711078cd3bde7868af7ec92b420a0fb75161130ff41e9fa9e6c71232e9d3e"}
Jul 16 21:10:07.139962 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:07.139897    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68m9d" podStartSLOduration=2.656373359 podStartE2EDuration="25.139864433s" totalImagesPullingTime="22.483491074s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:09:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:10:07.139703292 +0000 UTC m=+25.753883610" watchObservedRunningTime="2026-07-16 21:10:07.139864433 +0000 UTC m=+25.754044751"
Jul 16 21:10:07.966373 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:07.966343    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9mdcw"
Jul 16 21:10:07.966538 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:07.966463    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9mdcw" podUID="e9422503-3736-42d5-85de-6160c39f65bf"
Jul 16 21:10:08.965730 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:08.965490    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6z877"
Jul 16 21:10:08.966143 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:08.965563    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v5bvd"
Jul 16 21:10:08.966143 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:08.965784    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6z877" podUID="97f73b7d-47ea-4d24-a45e-fab8a2f5cda2"
Jul 16 21:10:08.966143 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:08.965888    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v5bvd" podUID="abc6bb6b-5fd0-4978-9416-d0582775a520"
Jul 16 21:10:09.966081 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:09.966047    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9mdcw"
Jul 16 21:10:09.966508 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:09.966181    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9mdcw" podUID="e9422503-3736-42d5-85de-6160c39f65bf"
Jul 16 21:10:10.031630 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:10.031587    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-llmw2"
Jul 16 21:10:10.031795 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:10.031729    2579 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 16 21:10:10.032274 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:10.032245    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-llmw2"
Jul 16 21:10:10.965694 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:10.965519    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6z877"
Jul 16 21:10:10.965887 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:10.965519    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v5bvd"
Jul 16 21:10:10.965887 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:10.965767    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6z877" podUID="97f73b7d-47ea-4d24-a45e-fab8a2f5cda2"
Jul 16 21:10:10.965887 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:10.965873    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v5bvd" podUID="abc6bb6b-5fd0-4978-9416-d0582775a520"
Jul 16 21:10:11.121522 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:11.121486    2579 generic.go:356] "Generic (PLEG): container finished" podID="67996421-567c-4901-b037-a8863575763b" containerID="26e9358286423edc45433a3fdbc47663c84952d0a08e79e72cc92eb98107e2f7" exitCode=0
Jul 16 21:10:11.122250 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:11.121561    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w9rrt" event={"ID":"67996421-567c-4901-b037-a8863575763b","Type":"ContainerDied","Data":"26e9358286423edc45433a3fdbc47663c84952d0a08e79e72cc92eb98107e2f7"}
Jul 16 21:10:11.125175 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:11.125151    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk" event={"ID":"1b4a76d0-f222-48bd-ac11-fd187bada4ec","Type":"ContainerStarted","Data":"07dd84400bbf2c73473df76630ab04f0992ca037800b8c58cc51d5a3459f64c2"}
Jul 16 21:10:11.125425 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:11.125412    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk"
Jul 16 21:10:11.125511 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:11.125479    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk"
Jul 16 21:10:11.125560 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:11.125526    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk"
Jul 16 21:10:11.140473 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:11.140439    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk"
Jul 16 21:10:11.140615 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:11.140572    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk"
Jul 16 21:10:11.967171 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:11.967135    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9mdcw"
Jul 16 21:10:11.967321 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:11.967254    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9mdcw" podUID="e9422503-3736-42d5-85de-6160c39f65bf"
Jul 16 21:10:12.706772 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:12.706715    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk" podStartSLOduration=11.236288429 podStartE2EDuration="30.706694068s" totalImagesPullingTime="19.470405639s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:09:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:10:11.19607137 +0000 UTC m=+29.810251687" watchObservedRunningTime="2026-07-16 21:10:12.706694068 +0000 UTC m=+31.320874383"
Jul 16 21:10:12.707385 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:12.707366    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-v5bvd"]
Jul 16 21:10:12.707507 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:12.707494    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v5bvd"
Jul 16 21:10:12.707644 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:12.707622    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v5bvd" podUID="abc6bb6b-5fd0-4978-9416-d0582775a520"
Jul 16 21:10:12.710197 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:12.710174    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9mdcw"]
Jul 16 21:10:12.710296 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:12.710255    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9mdcw"
Jul 16 21:10:12.710356 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:12.710330    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9mdcw" podUID="e9422503-3736-42d5-85de-6160c39f65bf"
Jul 16 21:10:12.719832 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:12.719813    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6z877"]
Jul 16 21:10:12.719932 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:12.719901    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6z877"
Jul 16 21:10:12.719993 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:12.719977    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6z877" podUID="97f73b7d-47ea-4d24-a45e-fab8a2f5cda2"
Jul 16 21:10:13.131686 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:13.131658    2579 generic.go:356] "Generic (PLEG): container finished" podID="67996421-567c-4901-b037-a8863575763b" containerID="bf08087d2b91adc0da13902f12d3e85893ab6e7516522b809c41eb184907d2f7" exitCode=0
Jul 16 21:10:13.131802 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:13.131734    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w9rrt" event={"ID":"67996421-567c-4901-b037-a8863575763b","Type":"ContainerDied","Data":"bf08087d2b91adc0da13902f12d3e85893ab6e7516522b809c41eb184907d2f7"}
Jul 16 21:10:13.966266 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:13.966238    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6z877"
Jul 16 21:10:13.966606 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:13.966339    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6z877" podUID="97f73b7d-47ea-4d24-a45e-fab8a2f5cda2"
Jul 16 21:10:14.966284 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:14.966009    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9mdcw"
Jul 16 21:10:14.966697 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:14.966024    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v5bvd"
Jul 16 21:10:14.966697 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:14.966357    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9mdcw" podUID="e9422503-3736-42d5-85de-6160c39f65bf"
Jul 16 21:10:14.966697 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:14.966471    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v5bvd" podUID="abc6bb6b-5fd0-4978-9416-d0582775a520"
Jul 16 21:10:15.138754 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:15.138674    2579 generic.go:356] "Generic (PLEG): container finished" podID="67996421-567c-4901-b037-a8863575763b" containerID="e979176825abbaded78bee91aeee0bb33276d3d02739b01442564a02cc5cfeb0" exitCode=0
Jul 16 21:10:15.138754 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:15.138730    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w9rrt" event={"ID":"67996421-567c-4901-b037-a8863575763b","Type":"ContainerDied","Data":"e979176825abbaded78bee91aeee0bb33276d3d02739b01442564a02cc5cfeb0"}
Jul 16 21:10:15.619827 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:15.619794    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jr8lm\" (UniqueName: \"kubernetes.io/projected/e9422503-3736-42d5-85de-6160c39f65bf-kube-api-access-jr8lm\") pod \"network-check-target-9mdcw\" (UID: \"e9422503-3736-42d5-85de-6160c39f65bf\") " pod="openshift-network-diagnostics/network-check-target-9mdcw"
Jul 16 21:10:15.619973 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:15.619836    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/abc6bb6b-5fd0-4978-9416-d0582775a520-metrics-certs\") pod \"network-metrics-daemon-v5bvd\" (UID: \"abc6bb6b-5fd0-4978-9416-d0582775a520\") " pod="openshift-multus/network-metrics-daemon-v5bvd"
Jul 16 21:10:15.619973 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:15.619951    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 21:10:15.619973 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:15.619972    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 21:10:15.620150 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:15.619980    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 21:10:15.620150 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:15.620029    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abc6bb6b-5fd0-4978-9416-d0582775a520-metrics-certs podName:abc6bb6b-5fd0-4978-9416-d0582775a520 nodeName:}" failed. No retries permitted until 2026-07-16 21:10:47.620015106 +0000 UTC m=+66.234195399 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/abc6bb6b-5fd0-4978-9416-d0582775a520-metrics-certs") pod "network-metrics-daemon-v5bvd" (UID: "abc6bb6b-5fd0-4978-9416-d0582775a520") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 21:10:15.620150 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:15.620024    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/97f73b7d-47ea-4d24-a45e-fab8a2f5cda2-original-pull-secret\") pod \"global-pull-secret-syncer-6z877\" (UID: \"97f73b7d-47ea-4d24-a45e-fab8a2f5cda2\") " pod="kube-system/global-pull-secret-syncer-6z877"
Jul 16 21:10:15.620150 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:15.619982    2579 projected.go:196] Error preparing data for projected volume kube-api-access-jr8lm for pod openshift-network-diagnostics/network-check-target-9mdcw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 21:10:15.620150 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:15.620118    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e9422503-3736-42d5-85de-6160c39f65bf-kube-api-access-jr8lm podName:e9422503-3736-42d5-85de-6160c39f65bf nodeName:}" failed. No retries permitted until 2026-07-16 21:10:47.620082885 +0000 UTC m=+66.234263196 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-jr8lm" (UniqueName: "kubernetes.io/projected/e9422503-3736-42d5-85de-6160c39f65bf-kube-api-access-jr8lm") pod "network-check-target-9mdcw" (UID: "e9422503-3736-42d5-85de-6160c39f65bf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 21:10:15.620355 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:15.620174    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 21:10:15.620355 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:15.620219    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97f73b7d-47ea-4d24-a45e-fab8a2f5cda2-original-pull-secret podName:97f73b7d-47ea-4d24-a45e-fab8a2f5cda2 nodeName:}" failed. No retries permitted until 2026-07-16 21:10:47.62020579 +0000 UTC m=+66.234386098 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/97f73b7d-47ea-4d24-a45e-fab8a2f5cda2-original-pull-secret") pod "global-pull-secret-syncer-6z877" (UID: "97f73b7d-47ea-4d24-a45e-fab8a2f5cda2") : object "kube-system"/"original-pull-secret" not registered
Jul 16 21:10:15.965701 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:15.965669    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6z877"
Jul 16 21:10:15.965873 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:15.965816    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6z877" podUID="97f73b7d-47ea-4d24-a45e-fab8a2f5cda2"
Jul 16 21:10:16.014969 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.014946    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-znkwj_e52ac48f-692d-4893-a046-71dea5a7b5aa/dns-node-resolver/0.log"
Jul 16 21:10:16.184299 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.184269    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-58.ec2.internal" event="NodeReady"
Jul 16 21:10:16.184474 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.184436    2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 16 21:10:16.233822 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.233741    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-68f59f6c69-c4gqw"]
Jul 16 21:10:16.236163 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.236140    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68f59f6c69-c4gqw"
Jul 16 21:10:16.239263 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.239117    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 16 21:10:16.239263 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.239155    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 16 21:10:16.239434 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.239390    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 16 21:10:16.243028 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.243008    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-m22xl\""
Jul 16 21:10:16.256603 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.254333    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 16 21:10:16.263282 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.263261    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-68f59f6c69-c4gqw"]
Jul 16 21:10:16.263798 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.263779    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-74pf6"]
Jul 16 21:10:16.265867 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.265851    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-74pf6"
Jul 16 21:10:16.269045 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.269025    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 16 21:10:16.269146 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.269064    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 16 21:10:16.269146 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.269124    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 16 21:10:16.269284 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.269268    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 16 21:10:16.269325 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.269283    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-glgkx\""
Jul 16 21:10:16.279986 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.279970    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-67rw4"]
Jul 16 21:10:16.281755 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.281742    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-67rw4"
Jul 16 21:10:16.283334 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.283315    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-74pf6"]
Jul 16 21:10:16.287121 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.287088    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 16 21:10:16.287464 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.287446    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5s8t4\""
Jul 16 21:10:16.287754 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.287736    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 16 21:10:16.305512 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.305492    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-67rw4"]
Jul 16 21:10:16.324051 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.324023    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf-registry-tls\") pod \"image-registry-68f59f6c69-c4gqw\" (UID: \"8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf\") " pod="openshift-image-registry/image-registry-68f59f6c69-c4gqw"
Jul 16 21:10:16.324179 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.324058    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf-ca-trust-extracted\") pod \"image-registry-68f59f6c69-c4gqw\" (UID: \"8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf\") " pod="openshift-image-registry/image-registry-68f59f6c69-c4gqw"
Jul 16 21:10:16.324179 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.324149    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf-bound-sa-token\") pod \"image-registry-68f59f6c69-c4gqw\" (UID: \"8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf\") " pod="openshift-image-registry/image-registry-68f59f6c69-c4gqw"
Jul 16 21:10:16.324265 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.324190    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf-registry-certificates\") pod \"image-registry-68f59f6c69-c4gqw\" (UID: \"8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf\") " pod="openshift-image-registry/image-registry-68f59f6c69-c4gqw"
Jul 16 21:10:16.324265 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.324222    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7jls\" (UniqueName: \"kubernetes.io/projected/8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf-kube-api-access-g7jls\") pod \"image-registry-68f59f6c69-c4gqw\" (UID: \"8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf\") " pod="openshift-image-registry/image-registry-68f59f6c69-c4gqw"
Jul 16 21:10:16.324358 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.324271    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf-installation-pull-secrets\") pod \"image-registry-68f59f6c69-c4gqw\" (UID: \"8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf\") " pod="openshift-image-registry/image-registry-68f59f6c69-c4gqw"
Jul 16 21:10:16.324418 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.324353    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf-image-registry-private-configuration\") pod \"image-registry-68f59f6c69-c4gqw\" (UID: \"8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf\") " pod="openshift-image-registry/image-registry-68f59f6c69-c4gqw"
Jul 16 21:10:16.324418 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.324408    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf-trusted-ca\") pod \"image-registry-68f59f6c69-c4gqw\" (UID: \"8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf\") " pod="openshift-image-registry/image-registry-68f59f6c69-c4gqw"
Jul 16 21:10:16.369715 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.369680    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ggfl8"]
Jul 16 21:10:16.372007 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.371986    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ggfl8"
Jul 16 21:10:16.377359 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.377326    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 16 21:10:16.377359 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.377350    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-hmkvr\""
Jul 16 21:10:16.377555 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.377351    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 16 21:10:16.377555 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.377465    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 16 21:10:16.392301 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.392281    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ggfl8"]
Jul 16 21:10:16.425202 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.425179    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5009cd3f-ae88-48b9-a039-6b21b147306c-tmp-dir\") pod \"dns-default-67rw4\" (UID: \"5009cd3f-ae88-48b9-a039-6b21b147306c\") " pod="openshift-dns/dns-default-67rw4"
Jul 16 21:10:16.425202 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.425210    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/961b693a-6897-4204-a5cc-1c1c80f06693-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-74pf6\" (UID: \"961b693a-6897-4204-a5cc-1c1c80f06693\") " pod="openshift-insights/insights-runtime-extractor-74pf6"
Jul 16 21:10:16.425368 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.425232    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/961b693a-6897-4204-a5cc-1c1c80f06693-data-volume\") pod \"insights-runtime-extractor-74pf6\" (UID: \"961b693a-6897-4204-a5cc-1c1c80f06693\") " pod="openshift-insights/insights-runtime-extractor-74pf6"
Jul 16 21:10:16.425368 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.425269    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf-bound-sa-token\") pod \"image-registry-68f59f6c69-c4gqw\" (UID: \"8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf\") " pod="openshift-image-registry/image-registry-68f59f6c69-c4gqw"
Jul 16 21:10:16.425368 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.425320    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf-registry-certificates\") pod \"image-registry-68f59f6c69-c4gqw\" (UID: \"8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf\") " pod="openshift-image-registry/image-registry-68f59f6c69-c4gqw"
Jul 16 21:10:16.425368 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.425352    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7jls\" (UniqueName: \"kubernetes.io/projected/8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf-kube-api-access-g7jls\") pod \"image-registry-68f59f6c69-c4gqw\" (UID: \"8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf\") " pod="openshift-image-registry/image-registry-68f59f6c69-c4gqw"
Jul 16 21:10:16.425557 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.425376    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lqss\" (UniqueName: \"kubernetes.io/projected/961b693a-6897-4204-a5cc-1c1c80f06693-kube-api-access-2lqss\") pod \"insights-runtime-extractor-74pf6\" (UID: \"961b693a-6897-4204-a5cc-1c1c80f06693\") " pod="openshift-insights/insights-runtime-extractor-74pf6"
Jul 16 21:10:16.425557 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.425416    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9lfz\" (UniqueName: \"kubernetes.io/projected/5009cd3f-ae88-48b9-a039-6b21b147306c-kube-api-access-b9lfz\") pod \"dns-default-67rw4\" (UID: \"5009cd3f-ae88-48b9-a039-6b21b147306c\") " pod="openshift-dns/dns-default-67rw4"
Jul 16 21:10:16.425557 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.425445    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/961b693a-6897-4204-a5cc-1c1c80f06693-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-74pf6\" (UID: \"961b693a-6897-4204-a5cc-1c1c80f06693\") " pod="openshift-insights/insights-runtime-extractor-74pf6"
Jul 16 21:10:16.425557 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.425478    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/961b693a-6897-4204-a5cc-1c1c80f06693-crio-socket\") pod \"insights-runtime-extractor-74pf6\" (UID: \"961b693a-6897-4204-a5cc-1c1c80f06693\") " pod="openshift-insights/insights-runtime-extractor-74pf6"
Jul 16 21:10:16.425557 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.425507    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf-installation-pull-secrets\") pod \"image-registry-68f59f6c69-c4gqw\" (UID: \"8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf\") " pod="openshift-image-registry/image-registry-68f59f6c69-c4gqw"
Jul 16 21:10:16.425557 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.425556    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf-image-registry-private-configuration\") pod \"image-registry-68f59f6c69-c4gqw\" (UID: \"8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf\") " pod="openshift-image-registry/image-registry-68f59f6c69-c4gqw"
Jul 16 21:10:16.425824 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.425576    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf-trusted-ca\") pod \"image-registry-68f59f6c69-c4gqw\" (UID: \"8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf\") " pod="openshift-image-registry/image-registry-68f59f6c69-c4gqw"
Jul 16 21:10:16.425824 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.425599    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5009cd3f-ae88-48b9-a039-6b21b147306c-metrics-tls\") pod \"dns-default-67rw4\" (UID: \"5009cd3f-ae88-48b9-a039-6b21b147306c\") " pod="openshift-dns/dns-default-67rw4"
Jul 16 21:10:16.425824 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.425628    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf-registry-tls\") pod \"image-registry-68f59f6c69-c4gqw\" (UID: \"8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf\") " pod="openshift-image-registry/image-registry-68f59f6c69-c4gqw"
Jul 16 21:10:16.425824 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.425652    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf-ca-trust-extracted\") pod \"image-registry-68f59f6c69-c4gqw\" (UID: \"8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf\") " pod="openshift-image-registry/image-registry-68f59f6c69-c4gqw"
Jul 16 21:10:16.425824 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.425695    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5009cd3f-ae88-48b9-a039-6b21b147306c-config-volume\") pod \"dns-default-67rw4\" (UID: \"5009cd3f-ae88-48b9-a039-6b21b147306c\") " pod="openshift-dns/dns-default-67rw4"
Jul 16 21:10:16.425824 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:16.425779    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 21:10:16.425824 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:16.425792    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68f59f6c69-c4gqw: secret "image-registry-tls" not found
Jul 16 21:10:16.426156 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:16.425841    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf-registry-tls podName:8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf nodeName:}" failed. No retries permitted until 2026-07-16 21:10:16.92582339 +0000 UTC m=+35.540003693 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf-registry-tls") pod "image-registry-68f59f6c69-c4gqw" (UID: "8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf") : secret "image-registry-tls" not found
Jul 16 21:10:16.426156 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.425911    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf-registry-certificates\") pod \"image-registry-68f59f6c69-c4gqw\" (UID: \"8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf\") " pod="openshift-image-registry/image-registry-68f59f6c69-c4gqw"
Jul 16 21:10:16.426497 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.426292    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf-ca-trust-extracted\") pod \"image-registry-68f59f6c69-c4gqw\" (UID: \"8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf\") " pod="openshift-image-registry/image-registry-68f59f6c69-c4gqw"
Jul 16 21:10:16.426606 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.426500    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf-trusted-ca\") pod \"image-registry-68f59f6c69-c4gqw\" (UID: \"8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf\") " pod="openshift-image-registry/image-registry-68f59f6c69-c4gqw"
Jul 16 21:10:16.430220 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.430198    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf-image-registry-private-configuration\") pod \"image-registry-68f59f6c69-c4gqw\" (UID: \"8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf\") " pod="openshift-image-registry/image-registry-68f59f6c69-c4gqw"
Jul 16 21:10:16.430329 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.430198    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf-installation-pull-secrets\") pod \"image-registry-68f59f6c69-c4gqw\" (UID: \"8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf\") " pod="openshift-image-registry/image-registry-68f59f6c69-c4gqw"
Jul 16 21:10:16.439854 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.439821    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7jls\" (UniqueName: \"kubernetes.io/projected/8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf-kube-api-access-g7jls\") pod \"image-registry-68f59f6c69-c4gqw\" (UID: \"8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf\") " pod="openshift-image-registry/image-registry-68f59f6c69-c4gqw"
Jul 16 21:10:16.440904 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.440883    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf-bound-sa-token\") pod \"image-registry-68f59f6c69-c4gqw\" (UID: \"8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf\") " pod="openshift-image-registry/image-registry-68f59f6c69-c4gqw"
Jul 16 21:10:16.526754 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.526673    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/961b693a-6897-4204-a5cc-1c1c80f06693-data-volume\") pod \"insights-runtime-extractor-74pf6\" (UID: \"961b693a-6897-4204-a5cc-1c1c80f06693\") " pod="openshift-insights/insights-runtime-extractor-74pf6"
Jul 16 21:10:16.526754 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.526738    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lx8cg\" (UniqueName: \"kubernetes.io/projected/6ce92f9d-75e3-4c05-8ec1-5361e8ebad4c-kube-api-access-lx8cg\") pod \"ingress-canary-ggfl8\" (UID: \"6ce92f9d-75e3-4c05-8ec1-5361e8ebad4c\") " pod="openshift-ingress-canary/ingress-canary-ggfl8"
Jul 16 21:10:16.526962 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.526779    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lqss\" (UniqueName: \"kubernetes.io/projected/961b693a-6897-4204-a5cc-1c1c80f06693-kube-api-access-2lqss\") pod \"insights-runtime-extractor-74pf6\" (UID: \"961b693a-6897-4204-a5cc-1c1c80f06693\") " pod="openshift-insights/insights-runtime-extractor-74pf6"
Jul 16 21:10:16.526962 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.526820    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9lfz\" (UniqueName: \"kubernetes.io/projected/5009cd3f-ae88-48b9-a039-6b21b147306c-kube-api-access-b9lfz\") pod \"dns-default-67rw4\" (UID: \"5009cd3f-ae88-48b9-a039-6b21b147306c\") " pod="openshift-dns/dns-default-67rw4"
Jul 16 21:10:16.526962 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.526847    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/961b693a-6897-4204-a5cc-1c1c80f06693-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-74pf6\" (UID: \"961b693a-6897-4204-a5cc-1c1c80f06693\") " pod="openshift-insights/insights-runtime-extractor-74pf6"
Jul 16 21:10:16.526962 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.526880    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/961b693a-6897-4204-a5cc-1c1c80f06693-crio-socket\") pod \"insights-runtime-extractor-74pf6\" (UID: \"961b693a-6897-4204-a5cc-1c1c80f06693\") " pod="openshift-insights/insights-runtime-extractor-74pf6"
Jul 16 21:10:16.526962 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.526936    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5009cd3f-ae88-48b9-a039-6b21b147306c-metrics-tls\") pod \"dns-default-67rw4\" (UID: \"5009cd3f-ae88-48b9-a039-6b21b147306c\") " pod="openshift-dns/dns-default-67rw4"
Jul 16 21:10:16.527219 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:16.526968    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 21:10:16.527219 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:16.527032    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/961b693a-6897-4204-a5cc-1c1c80f06693-insights-runtime-extractor-tls podName:961b693a-6897-4204-a5cc-1c1c80f06693 nodeName:}" failed. No retries permitted until 2026-07-16 21:10:17.027011466 +0000 UTC m=+35.641191776 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/961b693a-6897-4204-a5cc-1c1c80f06693-insights-runtime-extractor-tls") pod "insights-runtime-extractor-74pf6" (UID: "961b693a-6897-4204-a5cc-1c1c80f06693") : secret "insights-runtime-extractor-tls" not found
Jul 16 21:10:16.527219 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.526977    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5009cd3f-ae88-48b9-a039-6b21b147306c-config-volume\") pod \"dns-default-67rw4\" (UID: \"5009cd3f-ae88-48b9-a039-6b21b147306c\") " pod="openshift-dns/dns-default-67rw4"
Jul 16 21:10:16.527219 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.527158    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5009cd3f-ae88-48b9-a039-6b21b147306c-tmp-dir\") pod \"dns-default-67rw4\" (UID: \"5009cd3f-ae88-48b9-a039-6b21b147306c\") " pod="openshift-dns/dns-default-67rw4"
Jul 16 21:10:16.527219 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.527187    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/961b693a-6897-4204-a5cc-1c1c80f06693-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-74pf6\" (UID: \"961b693a-6897-4204-a5cc-1c1c80f06693\") " pod="openshift-insights/insights-runtime-extractor-74pf6"
Jul 16 21:10:16.527219 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.527213    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6ce92f9d-75e3-4c05-8ec1-5361e8ebad4c-cert\") pod \"ingress-canary-ggfl8\" (UID: \"6ce92f9d-75e3-4c05-8ec1-5361e8ebad4c\") " pod="openshift-ingress-canary/ingress-canary-ggfl8"
Jul 16 21:10:16.527461 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:16.527237    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 21:10:16.527461 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.527255    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/961b693a-6897-4204-a5cc-1c1c80f06693-crio-socket\") pod \"insights-runtime-extractor-74pf6\" (UID: \"961b693a-6897-4204-a5cc-1c1c80f06693\") " pod="openshift-insights/insights-runtime-extractor-74pf6"
Jul 16 21:10:16.527461 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.527157    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/961b693a-6897-4204-a5cc-1c1c80f06693-data-volume\") pod \"insights-runtime-extractor-74pf6\" (UID: \"961b693a-6897-4204-a5cc-1c1c80f06693\") " pod="openshift-insights/insights-runtime-extractor-74pf6"
Jul 16 21:10:16.527461 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:16.527300    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5009cd3f-ae88-48b9-a039-6b21b147306c-metrics-tls podName:5009cd3f-ae88-48b9-a039-6b21b147306c nodeName:}" failed. No retries permitted until 2026-07-16 21:10:17.02728195 +0000 UTC m=+35.641462265 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5009cd3f-ae88-48b9-a039-6b21b147306c-metrics-tls") pod "dns-default-67rw4" (UID: "5009cd3f-ae88-48b9-a039-6b21b147306c") : secret "dns-default-metrics-tls" not found
Jul 16 21:10:16.527461 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:16.527331    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 21:10:16.527461 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:16.527402    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/961b693a-6897-4204-a5cc-1c1c80f06693-kube-rbac-proxy-cm podName:961b693a-6897-4204-a5cc-1c1c80f06693 nodeName:}" failed. No retries permitted until 2026-07-16 21:10:17.027385176 +0000 UTC m=+35.641565482 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/961b693a-6897-4204-a5cc-1c1c80f06693-kube-rbac-proxy-cm") pod "insights-runtime-extractor-74pf6" (UID: "961b693a-6897-4204-a5cc-1c1c80f06693") : configmap "kube-rbac-proxy" not found
Jul 16 21:10:16.527461 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.527444    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5009cd3f-ae88-48b9-a039-6b21b147306c-tmp-dir\") pod \"dns-default-67rw4\" (UID: \"5009cd3f-ae88-48b9-a039-6b21b147306c\") " pod="openshift-dns/dns-default-67rw4"
Jul 16 21:10:16.527704 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.527515    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5009cd3f-ae88-48b9-a039-6b21b147306c-config-volume\") pod \"dns-default-67rw4\" (UID: \"5009cd3f-ae88-48b9-a039-6b21b147306c\") " pod="openshift-dns/dns-default-67rw4"
Jul 16 21:10:16.537493 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.537471    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lqss\" (UniqueName: \"kubernetes.io/projected/961b693a-6897-4204-a5cc-1c1c80f06693-kube-api-access-2lqss\") pod \"insights-runtime-extractor-74pf6\" (UID: \"961b693a-6897-4204-a5cc-1c1c80f06693\") " pod="openshift-insights/insights-runtime-extractor-74pf6"
Jul 16 21:10:16.545027 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.545003    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9lfz\" (UniqueName: \"kubernetes.io/projected/5009cd3f-ae88-48b9-a039-6b21b147306c-kube-api-access-b9lfz\") pod \"dns-default-67rw4\" (UID: \"5009cd3f-ae88-48b9-a039-6b21b147306c\") " pod="openshift-dns/dns-default-67rw4"
Jul 16 21:10:16.627674 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.627650    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6ce92f9d-75e3-4c05-8ec1-5361e8ebad4c-cert\") pod \"ingress-canary-ggfl8\" (UID: \"6ce92f9d-75e3-4c05-8ec1-5361e8ebad4c\") " pod="openshift-ingress-canary/ingress-canary-ggfl8"
Jul 16 21:10:16.627787 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.627697    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lx8cg\" (UniqueName: \"kubernetes.io/projected/6ce92f9d-75e3-4c05-8ec1-5361e8ebad4c-kube-api-access-lx8cg\") pod \"ingress-canary-ggfl8\" (UID: \"6ce92f9d-75e3-4c05-8ec1-5361e8ebad4c\") " pod="openshift-ingress-canary/ingress-canary-ggfl8"
Jul 16 21:10:16.629784 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.629769    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6ce92f9d-75e3-4c05-8ec1-5361e8ebad4c-cert\") pod \"ingress-canary-ggfl8\" (UID: \"6ce92f9d-75e3-4c05-8ec1-5361e8ebad4c\") " pod="openshift-ingress-canary/ingress-canary-ggfl8"
Jul 16 21:10:16.640867 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.640842    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lx8cg\" (UniqueName: \"kubernetes.io/projected/6ce92f9d-75e3-4c05-8ec1-5361e8ebad4c-kube-api-access-lx8cg\") pod \"ingress-canary-ggfl8\" (UID: \"6ce92f9d-75e3-4c05-8ec1-5361e8ebad4c\") " pod="openshift-ingress-canary/ingress-canary-ggfl8"
Jul 16 21:10:16.681870 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.681840    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ggfl8"
Jul 16 21:10:16.850733 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.850706    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ggfl8"]
Jul 16 21:10:16.853132 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:10:16.853087    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ce92f9d_75e3_4c05_8ec1_5361e8ebad4c.slice/crio-f0b3c84642d5d19b431cc6dc7a5b2cabebdd8aba7c80690a9a8fb94a0f826edd WatchSource:0}: Error finding container f0b3c84642d5d19b431cc6dc7a5b2cabebdd8aba7c80690a9a8fb94a0f826edd: Status 404 returned error can't find the container with id f0b3c84642d5d19b431cc6dc7a5b2cabebdd8aba7c80690a9a8fb94a0f826edd
Jul 16 21:10:16.929770 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.929739    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf-registry-tls\") pod \"image-registry-68f59f6c69-c4gqw\" (UID: \"8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf\") " pod="openshift-image-registry/image-registry-68f59f6c69-c4gqw"
Jul 16 21:10:16.929892 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:16.929860    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 21:10:16.929892 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:16.929876    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68f59f6c69-c4gqw: secret "image-registry-tls" not found
Jul 16 21:10:16.930002 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:16.929921    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf-registry-tls podName:8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf nodeName:}" failed. No retries permitted until 2026-07-16 21:10:17.929907942 +0000 UTC m=+36.544088236 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf-registry-tls") pod "image-registry-68f59f6c69-c4gqw" (UID: "8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf") : secret "image-registry-tls" not found
Jul 16 21:10:16.966041 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.966014    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v5bvd"
Jul 16 21:10:16.966213 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.966014    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9mdcw"
Jul 16 21:10:16.970106 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.970080    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 16 21:10:16.970409 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.970392    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 16 21:10:16.970672 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.970654    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 16 21:10:16.970771 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.970732    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ljktf\""
Jul 16 21:10:16.972396 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.972378    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xwmds\""
Jul 16 21:10:16.997354 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:16.997335    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lft7l_355ad64f-aa0d-4876-a4a2-faec378a30bf/node-ca/0.log"
Jul 16 21:10:17.030618 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:17.030589    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5009cd3f-ae88-48b9-a039-6b21b147306c-metrics-tls\") pod \"dns-default-67rw4\" (UID: \"5009cd3f-ae88-48b9-a039-6b21b147306c\") " pod="openshift-dns/dns-default-67rw4"
Jul 16 21:10:17.031337 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:17.030658    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/961b693a-6897-4204-a5cc-1c1c80f06693-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-74pf6\" (UID: \"961b693a-6897-4204-a5cc-1c1c80f06693\") " pod="openshift-insights/insights-runtime-extractor-74pf6"
Jul 16 21:10:17.031337 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:17.030707    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 21:10:17.031337 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:17.030726    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/961b693a-6897-4204-a5cc-1c1c80f06693-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-74pf6\" (UID: \"961b693a-6897-4204-a5cc-1c1c80f06693\") " pod="openshift-insights/insights-runtime-extractor-74pf6"
Jul 16 21:10:17.031337 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:17.030769    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5009cd3f-ae88-48b9-a039-6b21b147306c-metrics-tls podName:5009cd3f-ae88-48b9-a039-6b21b147306c nodeName:}" failed. No retries permitted until 2026-07-16 21:10:18.030754102 +0000 UTC m=+36.644934395 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5009cd3f-ae88-48b9-a039-6b21b147306c-metrics-tls") pod "dns-default-67rw4" (UID: "5009cd3f-ae88-48b9-a039-6b21b147306c") : secret "dns-default-metrics-tls" not found
Jul 16 21:10:17.031337 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:17.030786    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 21:10:17.031337 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:17.030820    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 21:10:17.031337 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:17.030835    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/961b693a-6897-4204-a5cc-1c1c80f06693-kube-rbac-proxy-cm podName:961b693a-6897-4204-a5cc-1c1c80f06693 nodeName:}" failed. No retries permitted until 2026-07-16 21:10:18.0308202 +0000 UTC m=+36.645000501 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/961b693a-6897-4204-a5cc-1c1c80f06693-kube-rbac-proxy-cm") pod "insights-runtime-extractor-74pf6" (UID: "961b693a-6897-4204-a5cc-1c1c80f06693") : configmap "kube-rbac-proxy" not found
Jul 16 21:10:17.031337 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:17.030856    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/961b693a-6897-4204-a5cc-1c1c80f06693-insights-runtime-extractor-tls podName:961b693a-6897-4204-a5cc-1c1c80f06693 nodeName:}" failed. No retries permitted until 2026-07-16 21:10:18.030845359 +0000 UTC m=+36.645025656 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/961b693a-6897-4204-a5cc-1c1c80f06693-insights-runtime-extractor-tls") pod "insights-runtime-extractor-74pf6" (UID: "961b693a-6897-4204-a5cc-1c1c80f06693") : secret "insights-runtime-extractor-tls" not found
Jul 16 21:10:17.143784 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:17.143701    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ggfl8" event={"ID":"6ce92f9d-75e3-4c05-8ec1-5361e8ebad4c","Type":"ContainerStarted","Data":"f0b3c84642d5d19b431cc6dc7a5b2cabebdd8aba7c80690a9a8fb94a0f826edd"}
Jul 16 21:10:17.196790 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:17.196755    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-qg9gw"]
Jul 16 21:10:17.199793 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:17.199773    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-qg9gw"
Jul 16 21:10:17.206155 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:17.206131    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 16 21:10:17.206275 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:17.206194    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-hjpmp\""
Jul 16 21:10:17.206275 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:17.206250    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 16 21:10:17.207958 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:17.207942    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 16 21:10:17.212388 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:17.212372    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 16 21:10:17.230885 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:17.230862    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-qg9gw"]
Jul 16 21:10:17.333854 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:17.333819    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-km4zn\" (UniqueName: \"kubernetes.io/projected/6f373cfb-3c8e-4944-96f8-7e01ee7be36b-kube-api-access-km4zn\") pod \"service-ca-58598695f7-qg9gw\" (UID: \"6f373cfb-3c8e-4944-96f8-7e01ee7be36b\") " pod="openshift-service-ca/service-ca-58598695f7-qg9gw"
Jul 16 21:10:17.334041 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:17.333867    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6f373cfb-3c8e-4944-96f8-7e01ee7be36b-signing-key\") pod \"service-ca-58598695f7-qg9gw\" (UID: \"6f373cfb-3c8e-4944-96f8-7e01ee7be36b\") " pod="openshift-service-ca/service-ca-58598695f7-qg9gw"
Jul 16 21:10:17.334041 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:17.333888    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6f373cfb-3c8e-4944-96f8-7e01ee7be36b-signing-cabundle\") pod \"service-ca-58598695f7-qg9gw\" (UID: \"6f373cfb-3c8e-4944-96f8-7e01ee7be36b\") " pod="openshift-service-ca/service-ca-58598695f7-qg9gw"
Jul 16 21:10:17.434827 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:17.434791    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6f373cfb-3c8e-4944-96f8-7e01ee7be36b-signing-cabundle\") pod \"service-ca-58598695f7-qg9gw\" (UID: \"6f373cfb-3c8e-4944-96f8-7e01ee7be36b\") " pod="openshift-service-ca/service-ca-58598695f7-qg9gw"
Jul 16 21:10:17.434988 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:17.434972    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-km4zn\" (UniqueName: \"kubernetes.io/projected/6f373cfb-3c8e-4944-96f8-7e01ee7be36b-kube-api-access-km4zn\") pod \"service-ca-58598695f7-qg9gw\" (UID: \"6f373cfb-3c8e-4944-96f8-7e01ee7be36b\") " pod="openshift-service-ca/service-ca-58598695f7-qg9gw"
Jul 16 21:10:17.435048 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:17.435010    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6f373cfb-3c8e-4944-96f8-7e01ee7be36b-signing-key\") pod \"service-ca-58598695f7-qg9gw\" (UID: \"6f373cfb-3c8e-4944-96f8-7e01ee7be36b\") " pod="openshift-service-ca/service-ca-58598695f7-qg9gw"
Jul 16 21:10:17.435654 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:17.435633    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6f373cfb-3c8e-4944-96f8-7e01ee7be36b-signing-cabundle\") pod \"service-ca-58598695f7-qg9gw\" (UID: \"6f373cfb-3c8e-4944-96f8-7e01ee7be36b\") " pod="openshift-service-ca/service-ca-58598695f7-qg9gw"
Jul 16 21:10:17.438199 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:17.437955    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6f373cfb-3c8e-4944-96f8-7e01ee7be36b-signing-key\") pod \"service-ca-58598695f7-qg9gw\" (UID: \"6f373cfb-3c8e-4944-96f8-7e01ee7be36b\") " pod="openshift-service-ca/service-ca-58598695f7-qg9gw"
Jul 16 21:10:17.448373 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:17.448352    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-km4zn\" (UniqueName: \"kubernetes.io/projected/6f373cfb-3c8e-4944-96f8-7e01ee7be36b-kube-api-access-km4zn\") pod \"service-ca-58598695f7-qg9gw\" (UID: \"6f373cfb-3c8e-4944-96f8-7e01ee7be36b\") " pod="openshift-service-ca/service-ca-58598695f7-qg9gw"
Jul 16 21:10:17.510555 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:17.510521    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-qg9gw"
Jul 16 21:10:17.648129 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:17.648088    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-qg9gw"]
Jul 16 21:10:17.650204 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:10:17.650176    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f373cfb_3c8e_4944_96f8_7e01ee7be36b.slice/crio-503eefe410f82d716777cb99648500c1a8a62e82cb34141ea8c1f65c1417ea01 WatchSource:0}: Error finding container 503eefe410f82d716777cb99648500c1a8a62e82cb34141ea8c1f65c1417ea01: Status 404 returned error can't find the container with id 503eefe410f82d716777cb99648500c1a8a62e82cb34141ea8c1f65c1417ea01
Jul 16 21:10:17.939476 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:17.939436    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf-registry-tls\") pod \"image-registry-68f59f6c69-c4gqw\" (UID: \"8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf\") " pod="openshift-image-registry/image-registry-68f59f6c69-c4gqw"
Jul 16 21:10:17.939654 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:17.939632    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 21:10:17.939713 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:17.939660    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68f59f6c69-c4gqw: secret "image-registry-tls" not found
Jul 16 21:10:17.939776 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:17.939729    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf-registry-tls podName:8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf nodeName:}" failed. No retries permitted until 2026-07-16 21:10:19.939710139 +0000 UTC m=+38.553890435 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf-registry-tls") pod "image-registry-68f59f6c69-c4gqw" (UID: "8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf") : secret "image-registry-tls" not found
Jul 16 21:10:17.966632 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:17.966269    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6z877"
Jul 16 21:10:17.970192 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:17.970055    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 16 21:10:18.040235 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:18.040199    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/961b693a-6897-4204-a5cc-1c1c80f06693-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-74pf6\" (UID: \"961b693a-6897-4204-a5cc-1c1c80f06693\") " pod="openshift-insights/insights-runtime-extractor-74pf6"
Jul 16 21:10:18.040739 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:18.040274    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5009cd3f-ae88-48b9-a039-6b21b147306c-metrics-tls\") pod \"dns-default-67rw4\" (UID: \"5009cd3f-ae88-48b9-a039-6b21b147306c\") " pod="openshift-dns/dns-default-67rw4"
Jul 16 21:10:18.040739 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:18.040319    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/961b693a-6897-4204-a5cc-1c1c80f06693-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-74pf6\" (UID: \"961b693a-6897-4204-a5cc-1c1c80f06693\") " pod="openshift-insights/insights-runtime-extractor-74pf6"
Jul 16 21:10:18.040739 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:18.040348    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 21:10:18.040739 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:18.040416    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 21:10:18.040739 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:18.040445    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 21:10:18.040739 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:18.040448    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/961b693a-6897-4204-a5cc-1c1c80f06693-insights-runtime-extractor-tls podName:961b693a-6897-4204-a5cc-1c1c80f06693 nodeName:}" failed. No retries permitted until 2026-07-16 21:10:20.040429789 +0000 UTC m=+38.654610083 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/961b693a-6897-4204-a5cc-1c1c80f06693-insights-runtime-extractor-tls") pod "insights-runtime-extractor-74pf6" (UID: "961b693a-6897-4204-a5cc-1c1c80f06693") : secret "insights-runtime-extractor-tls" not found
Jul 16 21:10:18.040739 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:18.040535    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/961b693a-6897-4204-a5cc-1c1c80f06693-kube-rbac-proxy-cm podName:961b693a-6897-4204-a5cc-1c1c80f06693 nodeName:}" failed. No retries permitted until 2026-07-16 21:10:20.040505262 +0000 UTC m=+38.654685559 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/961b693a-6897-4204-a5cc-1c1c80f06693-kube-rbac-proxy-cm") pod "insights-runtime-extractor-74pf6" (UID: "961b693a-6897-4204-a5cc-1c1c80f06693") : configmap "kube-rbac-proxy" not found
Jul 16 21:10:18.040739 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:18.040562    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5009cd3f-ae88-48b9-a039-6b21b147306c-metrics-tls podName:5009cd3f-ae88-48b9-a039-6b21b147306c nodeName:}" failed. No retries permitted until 2026-07-16 21:10:20.040551503 +0000 UTC m=+38.654731801 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5009cd3f-ae88-48b9-a039-6b21b147306c-metrics-tls") pod "dns-default-67rw4" (UID: "5009cd3f-ae88-48b9-a039-6b21b147306c") : secret "dns-default-metrics-tls" not found
Jul 16 21:10:18.148324 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:18.148286    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-qg9gw" event={"ID":"6f373cfb-3c8e-4944-96f8-7e01ee7be36b","Type":"ContainerStarted","Data":"503eefe410f82d716777cb99648500c1a8a62e82cb34141ea8c1f65c1417ea01"}
Jul 16 21:10:19.957250 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:19.957217    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf-registry-tls\") pod \"image-registry-68f59f6c69-c4gqw\" (UID: \"8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf\") " pod="openshift-image-registry/image-registry-68f59f6c69-c4gqw"
Jul 16 21:10:19.957664 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:19.957381    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 21:10:19.957664 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:19.957402    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68f59f6c69-c4gqw: secret "image-registry-tls" not found
Jul 16 21:10:19.957664 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:19.957469    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf-registry-tls podName:8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf nodeName:}" failed. No retries permitted until 2026-07-16 21:10:23.957452421 +0000 UTC m=+42.571632715 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf-registry-tls") pod "image-registry-68f59f6c69-c4gqw" (UID: "8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf") : secret "image-registry-tls" not found
Jul 16 21:10:20.058237 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:20.058199    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5009cd3f-ae88-48b9-a039-6b21b147306c-metrics-tls\") pod \"dns-default-67rw4\" (UID: \"5009cd3f-ae88-48b9-a039-6b21b147306c\") " pod="openshift-dns/dns-default-67rw4"
Jul 16 21:10:20.058409 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:20.058253    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/961b693a-6897-4204-a5cc-1c1c80f06693-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-74pf6\" (UID: \"961b693a-6897-4204-a5cc-1c1c80f06693\") " pod="openshift-insights/insights-runtime-extractor-74pf6"
Jul 16 21:10:20.058409 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:20.058319    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/961b693a-6897-4204-a5cc-1c1c80f06693-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-74pf6\" (UID: \"961b693a-6897-4204-a5cc-1c1c80f06693\") " pod="openshift-insights/insights-runtime-extractor-74pf6"
Jul 16 21:10:20.058409 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:20.058364    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 21:10:20.058550 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:20.058413    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 21:10:20.058550 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:20.058425    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 21:10:20.058550 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:20.058440    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5009cd3f-ae88-48b9-a039-6b21b147306c-metrics-tls podName:5009cd3f-ae88-48b9-a039-6b21b147306c nodeName:}" failed. No retries permitted until 2026-07-16 21:10:24.058419513 +0000 UTC m=+42.672599828 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5009cd3f-ae88-48b9-a039-6b21b147306c-metrics-tls") pod "dns-default-67rw4" (UID: "5009cd3f-ae88-48b9-a039-6b21b147306c") : secret "dns-default-metrics-tls" not found
Jul 16 21:10:20.058550 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:20.058466    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/961b693a-6897-4204-a5cc-1c1c80f06693-insights-runtime-extractor-tls podName:961b693a-6897-4204-a5cc-1c1c80f06693 nodeName:}" failed. No retries permitted until 2026-07-16 21:10:24.058451993 +0000 UTC m=+42.672632324 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/961b693a-6897-4204-a5cc-1c1c80f06693-insights-runtime-extractor-tls") pod "insights-runtime-extractor-74pf6" (UID: "961b693a-6897-4204-a5cc-1c1c80f06693") : secret "insights-runtime-extractor-tls" not found
Jul 16 21:10:20.058550 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:20.058480    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/961b693a-6897-4204-a5cc-1c1c80f06693-kube-rbac-proxy-cm podName:961b693a-6897-4204-a5cc-1c1c80f06693 nodeName:}" failed. No retries permitted until 2026-07-16 21:10:24.058474439 +0000 UTC m=+42.672654733 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/961b693a-6897-4204-a5cc-1c1c80f06693-kube-rbac-proxy-cm") pod "insights-runtime-extractor-74pf6" (UID: "961b693a-6897-4204-a5cc-1c1c80f06693") : configmap "kube-rbac-proxy" not found
Jul 16 21:10:21.890566 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:21.890531    2579 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67996421_567c_4901_b037_a8863575763b.slice/crio-conmon-78604cbdc7bcf8c8598fcc6f1b7b4b6859ae53a0d63d9e29b353afa7684427bf.scope\": RecentStats: unable to find data in memory cache]"
Jul 16 21:10:22.162443 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:22.162411    2579 generic.go:356] "Generic (PLEG): container finished" podID="67996421-567c-4901-b037-a8863575763b" containerID="78604cbdc7bcf8c8598fcc6f1b7b4b6859ae53a0d63d9e29b353afa7684427bf" exitCode=0
Jul 16 21:10:22.162634 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:22.162490    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w9rrt" event={"ID":"67996421-567c-4901-b037-a8863575763b","Type":"ContainerDied","Data":"78604cbdc7bcf8c8598fcc6f1b7b4b6859ae53a0d63d9e29b353afa7684427bf"}
Jul 16 21:10:22.163968 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:22.163943    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ggfl8" event={"ID":"6ce92f9d-75e3-4c05-8ec1-5361e8ebad4c","Type":"ContainerStarted","Data":"28943110f29050931f2554ba694141e47318f9f7dbc06a28f8c901606d05bcd2"}
Jul 16 21:10:22.165448 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:22.165426    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-qg9gw" event={"ID":"6f373cfb-3c8e-4944-96f8-7e01ee7be36b","Type":"ContainerStarted","Data":"ed0c187a3bbb6df3b9c58b0cdde87ce10846cac47dd9d121af4a5fe957bd5660"}
Jul 16 21:10:22.219850 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:22.219799    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-qg9gw" podStartSLOduration=1.262671112 podStartE2EDuration="5.219779968s" totalImagesPullingTime="3.957108856s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:10:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:10:22.219235709 +0000 UTC m=+40.833416026" watchObservedRunningTime="2026-07-16 21:10:22.219779968 +0000 UTC m=+40.833960288"
Jul 16 21:10:23.171424 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:23.171384    2579 generic.go:356] "Generic (PLEG): container finished" podID="67996421-567c-4901-b037-a8863575763b" containerID="427196ac6f965dd1174e3e0f3ca9ac87f0d1d538e2435c9fa264cc2ce40a3c15" exitCode=0
Jul 16 21:10:23.171907 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:23.171426    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w9rrt" event={"ID":"67996421-567c-4901-b037-a8863575763b","Type":"ContainerDied","Data":"427196ac6f965dd1174e3e0f3ca9ac87f0d1d538e2435c9fa264cc2ce40a3c15"}
Jul 16 21:10:23.214857 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:23.214809    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ggfl8" podStartSLOduration=2.465981051 podStartE2EDuration="7.214790092s" totalImagesPullingTime="4.748809041s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:10:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:10:22.258112496 +0000 UTC m=+40.872292833" watchObservedRunningTime="2026-07-16 21:10:23.214790092 +0000 UTC m=+41.828970413"
Jul 16 21:10:23.991546 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:23.991511    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf-registry-tls\") pod \"image-registry-68f59f6c69-c4gqw\" (UID: \"8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf\") " pod="openshift-image-registry/image-registry-68f59f6c69-c4gqw"
Jul 16 21:10:23.991712 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:23.991646    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 21:10:23.991712 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:23.991661    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68f59f6c69-c4gqw: secret "image-registry-tls" not found
Jul 16 21:10:23.991712 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:23.991711    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf-registry-tls podName:8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf nodeName:}" failed. No retries permitted until 2026-07-16 21:10:31.991695848 +0000 UTC m=+50.605876143 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf-registry-tls") pod "image-registry-68f59f6c69-c4gqw" (UID: "8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf") : secret "image-registry-tls" not found
Jul 16 21:10:24.092705 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:24.092671    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/961b693a-6897-4204-a5cc-1c1c80f06693-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-74pf6\" (UID: \"961b693a-6897-4204-a5cc-1c1c80f06693\") " pod="openshift-insights/insights-runtime-extractor-74pf6"
Jul 16 21:10:24.092883 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:24.092726    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5009cd3f-ae88-48b9-a039-6b21b147306c-metrics-tls\") pod \"dns-default-67rw4\" (UID: \"5009cd3f-ae88-48b9-a039-6b21b147306c\") " pod="openshift-dns/dns-default-67rw4"
Jul 16 21:10:24.092883 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:24.092762    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/961b693a-6897-4204-a5cc-1c1c80f06693-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-74pf6\" (UID: \"961b693a-6897-4204-a5cc-1c1c80f06693\") " pod="openshift-insights/insights-runtime-extractor-74pf6"
Jul 16 21:10:24.092883 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:24.092845    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 21:10:24.092883 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:24.092846    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 21:10:24.093035 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:24.092887    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 21:10:24.093035 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:24.092910    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/961b693a-6897-4204-a5cc-1c1c80f06693-kube-rbac-proxy-cm podName:961b693a-6897-4204-a5cc-1c1c80f06693 nodeName:}" failed. No retries permitted until 2026-07-16 21:10:32.092892349 +0000 UTC m=+50.707072662 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/961b693a-6897-4204-a5cc-1c1c80f06693-kube-rbac-proxy-cm") pod "insights-runtime-extractor-74pf6" (UID: "961b693a-6897-4204-a5cc-1c1c80f06693") : configmap "kube-rbac-proxy" not found
Jul 16 21:10:24.093035 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:24.092926    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5009cd3f-ae88-48b9-a039-6b21b147306c-metrics-tls podName:5009cd3f-ae88-48b9-a039-6b21b147306c nodeName:}" failed. No retries permitted until 2026-07-16 21:10:32.092916 +0000 UTC m=+50.707096299 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5009cd3f-ae88-48b9-a039-6b21b147306c-metrics-tls") pod "dns-default-67rw4" (UID: "5009cd3f-ae88-48b9-a039-6b21b147306c") : secret "dns-default-metrics-tls" not found
Jul 16 21:10:24.093035 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:24.092940    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/961b693a-6897-4204-a5cc-1c1c80f06693-insights-runtime-extractor-tls podName:961b693a-6897-4204-a5cc-1c1c80f06693 nodeName:}" failed. No retries permitted until 2026-07-16 21:10:32.092933463 +0000 UTC m=+50.707113756 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/961b693a-6897-4204-a5cc-1c1c80f06693-insights-runtime-extractor-tls") pod "insights-runtime-extractor-74pf6" (UID: "961b693a-6897-4204-a5cc-1c1c80f06693") : secret "insights-runtime-extractor-tls" not found
Jul 16 21:10:24.179351 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:24.179317    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w9rrt" event={"ID":"67996421-567c-4901-b037-a8863575763b","Type":"ContainerStarted","Data":"78504f3229a4cad41e3542a08e9593050784f86aaebfe0f70fbe23e55f8df259"}
Jul 16 21:10:24.212682 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:24.212639    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-w9rrt" podStartSLOduration=7.071610386 podStartE2EDuration="42.212625398s" totalImagesPullingTime="35.141015012s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:09:42 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:10:24.21083808 +0000 UTC m=+42.825018398" watchObservedRunningTime="2026-07-16 21:10:24.212625398 +0000 UTC m=+42.826805713"
Jul 16 21:10:32.054554 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:32.054519    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf-registry-tls\") pod \"image-registry-68f59f6c69-c4gqw\" (UID: \"8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf\") " pod="openshift-image-registry/image-registry-68f59f6c69-c4gqw"
Jul 16 21:10:32.057801 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:32.057780    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf-registry-tls\") pod \"image-registry-68f59f6c69-c4gqw\" (UID: \"8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf\") " pod="openshift-image-registry/image-registry-68f59f6c69-c4gqw"
Jul 16 21:10:32.146799 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:32.146764    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68f59f6c69-c4gqw"
Jul 16 21:10:32.155044 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:32.155016    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/961b693a-6897-4204-a5cc-1c1c80f06693-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-74pf6\" (UID: \"961b693a-6897-4204-a5cc-1c1c80f06693\") " pod="openshift-insights/insights-runtime-extractor-74pf6"
Jul 16 21:10:32.155176 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:32.155068    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5009cd3f-ae88-48b9-a039-6b21b147306c-metrics-tls\") pod \"dns-default-67rw4\" (UID: \"5009cd3f-ae88-48b9-a039-6b21b147306c\") " pod="openshift-dns/dns-default-67rw4"
Jul 16 21:10:32.155176 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:32.155092    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/961b693a-6897-4204-a5cc-1c1c80f06693-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-74pf6\" (UID: \"961b693a-6897-4204-a5cc-1c1c80f06693\") " pod="openshift-insights/insights-runtime-extractor-74pf6"
Jul 16 21:10:32.155176 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:32.155164    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 21:10:32.155294 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:32.155218    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/961b693a-6897-4204-a5cc-1c1c80f06693-insights-runtime-extractor-tls podName:961b693a-6897-4204-a5cc-1c1c80f06693 nodeName:}" failed. No retries permitted until 2026-07-16 21:10:48.155203837 +0000 UTC m=+66.769384131 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/961b693a-6897-4204-a5cc-1c1c80f06693-insights-runtime-extractor-tls") pod "insights-runtime-extractor-74pf6" (UID: "961b693a-6897-4204-a5cc-1c1c80f06693") : secret "insights-runtime-extractor-tls" not found
Jul 16 21:10:32.155571 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:32.155555    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/961b693a-6897-4204-a5cc-1c1c80f06693-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-74pf6\" (UID: \"961b693a-6897-4204-a5cc-1c1c80f06693\") " pod="openshift-insights/insights-runtime-extractor-74pf6"
Jul 16 21:10:32.157416 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:32.157399    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5009cd3f-ae88-48b9-a039-6b21b147306c-metrics-tls\") pod \"dns-default-67rw4\" (UID: \"5009cd3f-ae88-48b9-a039-6b21b147306c\") " pod="openshift-dns/dns-default-67rw4"
Jul 16 21:10:32.189815 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:32.189794    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-67rw4"
Jul 16 21:10:32.310087 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:32.310015    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-68f59f6c69-c4gqw"]
Jul 16 21:10:32.314709 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:10:32.314680    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c1df253_a0ea_4d02_80b4_dad5a9f6bfdf.slice/crio-cb8c7aaf68b035e10593d72528d47668eb35c36f7629cb36ad9f9842ae2d12fb WatchSource:0}: Error finding container cb8c7aaf68b035e10593d72528d47668eb35c36f7629cb36ad9f9842ae2d12fb: Status 404 returned error can't find the container with id cb8c7aaf68b035e10593d72528d47668eb35c36f7629cb36ad9f9842ae2d12fb
Jul 16 21:10:32.355056 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:32.355028    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-67rw4"]
Jul 16 21:10:32.358728 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:10:32.358702    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5009cd3f_ae88_48b9_a039_6b21b147306c.slice/crio-bccf5c9245f6f2a3fa8c0fd01a0dee951ce30ea95431becdae6d1979d8307576 WatchSource:0}: Error finding container bccf5c9245f6f2a3fa8c0fd01a0dee951ce30ea95431becdae6d1979d8307576: Status 404 returned error can't find the container with id bccf5c9245f6f2a3fa8c0fd01a0dee951ce30ea95431becdae6d1979d8307576
Jul 16 21:10:33.202638 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:33.202604    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68f59f6c69-c4gqw" event={"ID":"8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf","Type":"ContainerStarted","Data":"84060dd743bfd9a4d7c1723072bdcf48c33b3926c0a67635b392d3288245d55e"}
Jul 16 21:10:33.203083 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:33.202651    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68f59f6c69-c4gqw" event={"ID":"8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf","Type":"ContainerStarted","Data":"cb8c7aaf68b035e10593d72528d47668eb35c36f7629cb36ad9f9842ae2d12fb"}
Jul 16 21:10:33.203083 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:33.202709    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-68f59f6c69-c4gqw"
Jul 16 21:10:33.203796 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:33.203773    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-67rw4" event={"ID":"5009cd3f-ae88-48b9-a039-6b21b147306c","Type":"ContainerStarted","Data":"bccf5c9245f6f2a3fa8c0fd01a0dee951ce30ea95431becdae6d1979d8307576"}
Jul 16 21:10:33.231250 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:33.231205    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-68f59f6c69-c4gqw" podStartSLOduration=28.231190547 podStartE2EDuration="28.231190547s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:10:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:10:33.22965011 +0000 UTC m=+51.843830447" watchObservedRunningTime="2026-07-16 21:10:33.231190547 +0000 UTC m=+51.845370862"
Jul 16 21:10:36.212214 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:36.212179    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-67rw4" event={"ID":"5009cd3f-ae88-48b9-a039-6b21b147306c","Type":"ContainerStarted","Data":"a31f6ad2aeb3b773894e01205639bdbb1af3071a3e15edc295cbe789fcf2e093"}
Jul 16 21:10:36.212656 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:36.212229    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-67rw4" event={"ID":"5009cd3f-ae88-48b9-a039-6b21b147306c","Type":"ContainerStarted","Data":"48bd7615da195707767b322c67b8895d3b2fa7ea0f22b0983c706476ede46502"}
Jul 16 21:10:36.212656 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:36.212313    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-67rw4"
Jul 16 21:10:39.352496 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:39.352437    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-67rw4" podStartSLOduration=20.525425183 podStartE2EDuration="23.352419087s" totalImagesPullingTime="2.826993904s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:10:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:10:36.24274826 +0000 UTC m=+54.856928587" watchObservedRunningTime="2026-07-16 21:10:39.352419087 +0000 UTC m=+57.966599402"
Jul 16 21:10:39.353253 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:39.353236    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-gxnhw"]
Jul 16 21:10:39.356317 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:39.356298    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-gxnhw"
Jul 16 21:10:39.359392 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:39.359374    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 16 21:10:39.360462 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:39.360444    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-hdwzm\""
Jul 16 21:10:39.360579 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:39.360554    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 16 21:10:39.382377 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:39.382322    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-gxnhw"]
Jul 16 21:10:39.383598 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:39.383573    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-68f59f6c69-c4gqw"]
Jul 16 21:10:39.410671 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:39.410648    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfscj\" (UniqueName: \"kubernetes.io/projected/f298d5ff-45b8-433f-a167-c0576efff356-kube-api-access-sfscj\") pod \"downloads-5bc67dcd46-gxnhw\" (UID: \"f298d5ff-45b8-433f-a167-c0576efff356\") " pod="openshift-console/downloads-5bc67dcd46-gxnhw"
Jul 16 21:10:39.511891 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:39.511868    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfscj\" (UniqueName: \"kubernetes.io/projected/f298d5ff-45b8-433f-a167-c0576efff356-kube-api-access-sfscj\") pod \"downloads-5bc67dcd46-gxnhw\" (UID: \"f298d5ff-45b8-433f-a167-c0576efff356\") " pod="openshift-console/downloads-5bc67dcd46-gxnhw"
Jul 16 21:10:39.541903 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:39.541871    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfscj\" (UniqueName: \"kubernetes.io/projected/f298d5ff-45b8-433f-a167-c0576efff356-kube-api-access-sfscj\") pod \"downloads-5bc67dcd46-gxnhw\" (UID: \"f298d5ff-45b8-433f-a167-c0576efff356\") " pod="openshift-console/downloads-5bc67dcd46-gxnhw"
Jul 16 21:10:39.664492 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:39.664458    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-gxnhw"
Jul 16 21:10:39.791051 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:39.791024    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-gxnhw"]
Jul 16 21:10:39.794002 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:10:39.793978    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf298d5ff_45b8_433f_a167_c0576efff356.slice/crio-92afc6091e445b6e524bf68eeea927999263f544ef50a64571a7481709639887 WatchSource:0}: Error finding container 92afc6091e445b6e524bf68eeea927999263f544ef50a64571a7481709639887: Status 404 returned error can't find the container with id 92afc6091e445b6e524bf68eeea927999263f544ef50a64571a7481709639887
Jul 16 21:10:40.223306 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:40.223269    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-gxnhw" event={"ID":"f298d5ff-45b8-433f-a167-c0576efff356","Type":"ContainerStarted","Data":"92afc6091e445b6e524bf68eeea927999263f544ef50a64571a7481709639887"}
Jul 16 21:10:43.143772 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:43.143742    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dd8jk"
Jul 16 21:10:46.027340 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:46.027307    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-qfx5x"]
Jul 16 21:10:46.030635 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:46.030616    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-qfx5x"
Jul 16 21:10:46.037562 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:46.037426    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 16 21:10:46.038821 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:46.038803    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 16 21:10:46.039917 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:46.039728    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 16 21:10:46.039917 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:46.039758    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 16 21:10:46.039917 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:46.039761    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-jfw84\""
Jul 16 21:10:46.041570 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:46.041545    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 16 21:10:46.049294 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:46.049272    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-qfx5x"]
Jul 16 21:10:46.064005 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:46.063972    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5fww\" (UniqueName: \"kubernetes.io/projected/9cd874e9-ac2e-4a23-ab69-b0be53f0588d-kube-api-access-l5fww\") pod \"prometheus-operator-5945b5cfd-qfx5x\" (UID: \"9cd874e9-ac2e-4a23-ab69-b0be53f0588d\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-qfx5x"
Jul 16 21:10:46.064127 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:46.064051    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9cd874e9-ac2e-4a23-ab69-b0be53f0588d-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-qfx5x\" (UID: \"9cd874e9-ac2e-4a23-ab69-b0be53f0588d\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-qfx5x"
Jul 16 21:10:46.064195 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:46.064148    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9cd874e9-ac2e-4a23-ab69-b0be53f0588d-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-qfx5x\" (UID: \"9cd874e9-ac2e-4a23-ab69-b0be53f0588d\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-qfx5x"
Jul 16 21:10:46.064262 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:46.064208    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9cd874e9-ac2e-4a23-ab69-b0be53f0588d-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-qfx5x\" (UID: \"9cd874e9-ac2e-4a23-ab69-b0be53f0588d\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-qfx5x"
Jul 16 21:10:46.165271 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:46.165234    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9cd874e9-ac2e-4a23-ab69-b0be53f0588d-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-qfx5x\" (UID: \"9cd874e9-ac2e-4a23-ab69-b0be53f0588d\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-qfx5x"
Jul 16 21:10:46.165435 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:46.165302    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9cd874e9-ac2e-4a23-ab69-b0be53f0588d-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-qfx5x\" (UID: \"9cd874e9-ac2e-4a23-ab69-b0be53f0588d\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-qfx5x"
Jul 16 21:10:46.165435 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:46.165367    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5fww\" (UniqueName: \"kubernetes.io/projected/9cd874e9-ac2e-4a23-ab69-b0be53f0588d-kube-api-access-l5fww\") pod \"prometheus-operator-5945b5cfd-qfx5x\" (UID: \"9cd874e9-ac2e-4a23-ab69-b0be53f0588d\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-qfx5x"
Jul 16 21:10:46.165435 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:46.165403    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9cd874e9-ac2e-4a23-ab69-b0be53f0588d-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-qfx5x\" (UID: \"9cd874e9-ac2e-4a23-ab69-b0be53f0588d\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-qfx5x"
Jul 16 21:10:46.165435 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:46.165412    2579 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 16 21:10:46.165647 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:46.165475    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cd874e9-ac2e-4a23-ab69-b0be53f0588d-prometheus-operator-tls podName:9cd874e9-ac2e-4a23-ab69-b0be53f0588d nodeName:}" failed. No retries permitted until 2026-07-16 21:10:46.665456385 +0000 UTC m=+65.279636684 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/9cd874e9-ac2e-4a23-ab69-b0be53f0588d-prometheus-operator-tls") pod "prometheus-operator-5945b5cfd-qfx5x" (UID: "9cd874e9-ac2e-4a23-ab69-b0be53f0588d") : secret "prometheus-operator-tls" not found
Jul 16 21:10:46.166195 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:46.166174    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9cd874e9-ac2e-4a23-ab69-b0be53f0588d-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-qfx5x\" (UID: \"9cd874e9-ac2e-4a23-ab69-b0be53f0588d\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-qfx5x"
Jul 16 21:10:46.168134 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:46.168113    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9cd874e9-ac2e-4a23-ab69-b0be53f0588d-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-qfx5x\" (UID: \"9cd874e9-ac2e-4a23-ab69-b0be53f0588d\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-qfx5x"
Jul 16 21:10:46.183678 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:46.183656    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5fww\" (UniqueName: \"kubernetes.io/projected/9cd874e9-ac2e-4a23-ab69-b0be53f0588d-kube-api-access-l5fww\") pod \"prometheus-operator-5945b5cfd-qfx5x\" (UID: \"9cd874e9-ac2e-4a23-ab69-b0be53f0588d\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-qfx5x"
Jul 16 21:10:46.217460 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:46.217432    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-67rw4"
Jul 16 21:10:46.669442 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:46.669408    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9cd874e9-ac2e-4a23-ab69-b0be53f0588d-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-qfx5x\" (UID: \"9cd874e9-ac2e-4a23-ab69-b0be53f0588d\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-qfx5x"
Jul 16 21:10:46.671929 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:46.671899    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9cd874e9-ac2e-4a23-ab69-b0be53f0588d-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-qfx5x\" (UID: \"9cd874e9-ac2e-4a23-ab69-b0be53f0588d\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-qfx5x"
Jul 16 21:10:46.940592 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:46.940513    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-qfx5x"
Jul 16 21:10:47.054376 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:47.054349    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f487b55f6-vlr7j"]
Jul 16 21:10:47.056714 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:47.056694    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f487b55f6-vlr7j"
Jul 16 21:10:47.061142 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:47.061119    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 16 21:10:47.061245 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:47.061156    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 16 21:10:47.062379 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:47.062361    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 16 21:10:47.062379 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:47.062372    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 16 21:10:47.062544 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:47.062476    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 16 21:10:47.062767 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:47.062745    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-9nxmq\""
Jul 16 21:10:47.079184 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:47.079157    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f487b55f6-vlr7j"]
Jul 16 21:10:47.111600 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:47.111572    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-qfx5x"]
Jul 16 21:10:47.114919 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:10:47.114891    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cd874e9_ac2e_4a23_ab69_b0be53f0588d.slice/crio-d6400add35abeeff6e7831024cb5baef28f7a9311493afe0807c0a86035bd0c8 WatchSource:0}: Error finding container d6400add35abeeff6e7831024cb5baef28f7a9311493afe0807c0a86035bd0c8: Status 404 returned error can't find the container with id d6400add35abeeff6e7831024cb5baef28f7a9311493afe0807c0a86035bd0c8
Jul 16 21:10:47.173189 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:47.173157    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/03991db4-1111-430b-a3db-2da9e5e7d23b-console-config\") pod \"console-5f487b55f6-vlr7j\" (UID: \"03991db4-1111-430b-a3db-2da9e5e7d23b\") " pod="openshift-console/console-5f487b55f6-vlr7j"
Jul 16 21:10:47.173328 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:47.173301    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/03991db4-1111-430b-a3db-2da9e5e7d23b-service-ca\") pod \"console-5f487b55f6-vlr7j\" (UID: \"03991db4-1111-430b-a3db-2da9e5e7d23b\") " pod="openshift-console/console-5f487b55f6-vlr7j"
Jul 16 21:10:47.173409 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:47.173356    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/03991db4-1111-430b-a3db-2da9e5e7d23b-console-serving-cert\") pod \"console-5f487b55f6-vlr7j\" (UID: \"03991db4-1111-430b-a3db-2da9e5e7d23b\") " pod="openshift-console/console-5f487b55f6-vlr7j"
Jul 16 21:10:47.173469 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:47.173435    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/03991db4-1111-430b-a3db-2da9e5e7d23b-console-oauth-config\") pod \"console-5f487b55f6-vlr7j\" (UID: \"03991db4-1111-430b-a3db-2da9e5e7d23b\") " pod="openshift-console/console-5f487b55f6-vlr7j"
Jul 16 21:10:47.173526 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:47.173480    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/03991db4-1111-430b-a3db-2da9e5e7d23b-oauth-serving-cert\") pod \"console-5f487b55f6-vlr7j\" (UID: \"03991db4-1111-430b-a3db-2da9e5e7d23b\") " pod="openshift-console/console-5f487b55f6-vlr7j"
Jul 16 21:10:47.173526 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:47.173505    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqvq5\" (UniqueName: \"kubernetes.io/projected/03991db4-1111-430b-a3db-2da9e5e7d23b-kube-api-access-qqvq5\") pod \"console-5f487b55f6-vlr7j\" (UID: \"03991db4-1111-430b-a3db-2da9e5e7d23b\") " pod="openshift-console/console-5f487b55f6-vlr7j"
Jul 16 21:10:47.243937 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:47.243864    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-qfx5x" event={"ID":"9cd874e9-ac2e-4a23-ab69-b0be53f0588d","Type":"ContainerStarted","Data":"d6400add35abeeff6e7831024cb5baef28f7a9311493afe0807c0a86035bd0c8"}
Jul 16 21:10:47.274431 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:47.274398    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/03991db4-1111-430b-a3db-2da9e5e7d23b-console-config\") pod \"console-5f487b55f6-vlr7j\" (UID: \"03991db4-1111-430b-a3db-2da9e5e7d23b\") " pod="openshift-console/console-5f487b55f6-vlr7j"
Jul 16 21:10:47.274595 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:47.274470    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/03991db4-1111-430b-a3db-2da9e5e7d23b-service-ca\") pod \"console-5f487b55f6-vlr7j\" (UID: \"03991db4-1111-430b-a3db-2da9e5e7d23b\") " pod="openshift-console/console-5f487b55f6-vlr7j"
Jul 16 21:10:47.274595 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:47.274505    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/03991db4-1111-430b-a3db-2da9e5e7d23b-console-serving-cert\") pod \"console-5f487b55f6-vlr7j\" (UID: \"03991db4-1111-430b-a3db-2da9e5e7d23b\") " pod="openshift-console/console-5f487b55f6-vlr7j"
Jul 16 21:10:47.274595 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:47.274538    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/03991db4-1111-430b-a3db-2da9e5e7d23b-console-oauth-config\") pod \"console-5f487b55f6-vlr7j\" (UID: \"03991db4-1111-430b-a3db-2da9e5e7d23b\") " pod="openshift-console/console-5f487b55f6-vlr7j"
Jul 16 21:10:47.274595 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:47.274565    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/03991db4-1111-430b-a3db-2da9e5e7d23b-oauth-serving-cert\") pod \"console-5f487b55f6-vlr7j\" (UID: \"03991db4-1111-430b-a3db-2da9e5e7d23b\") " pod="openshift-console/console-5f487b55f6-vlr7j"
Jul 16 21:10:47.274595 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:47.274586    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqvq5\" (UniqueName: \"kubernetes.io/projected/03991db4-1111-430b-a3db-2da9e5e7d23b-kube-api-access-qqvq5\") pod \"console-5f487b55f6-vlr7j\" (UID: \"03991db4-1111-430b-a3db-2da9e5e7d23b\") " pod="openshift-console/console-5f487b55f6-vlr7j"
Jul 16 21:10:47.275265 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:47.275238    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/03991db4-1111-430b-a3db-2da9e5e7d23b-service-ca\") pod \"console-5f487b55f6-vlr7j\" (UID: \"03991db4-1111-430b-a3db-2da9e5e7d23b\") " pod="openshift-console/console-5f487b55f6-vlr7j"
Jul 16 21:10:47.275381 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:47.275238    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/03991db4-1111-430b-a3db-2da9e5e7d23b-console-config\") pod \"console-5f487b55f6-vlr7j\" (UID: \"03991db4-1111-430b-a3db-2da9e5e7d23b\") " pod="openshift-console/console-5f487b55f6-vlr7j"
Jul 16 21:10:47.275381 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:47.275283    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/03991db4-1111-430b-a3db-2da9e5e7d23b-oauth-serving-cert\") pod \"console-5f487b55f6-vlr7j\" (UID: \"03991db4-1111-430b-a3db-2da9e5e7d23b\") " pod="openshift-console/console-5f487b55f6-vlr7j"
Jul 16 21:10:47.277272 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:47.277251    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/03991db4-1111-430b-a3db-2da9e5e7d23b-console-oauth-config\") pod \"console-5f487b55f6-vlr7j\" (UID: \"03991db4-1111-430b-a3db-2da9e5e7d23b\") " pod="openshift-console/console-5f487b55f6-vlr7j"
Jul 16 21:10:47.277533 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:47.277510    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/03991db4-1111-430b-a3db-2da9e5e7d23b-console-serving-cert\") pod \"console-5f487b55f6-vlr7j\" (UID: \"03991db4-1111-430b-a3db-2da9e5e7d23b\") " pod="openshift-console/console-5f487b55f6-vlr7j"
Jul 16 21:10:47.303617 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:47.303593    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqvq5\" (UniqueName: \"kubernetes.io/projected/03991db4-1111-430b-a3db-2da9e5e7d23b-kube-api-access-qqvq5\") pod \"console-5f487b55f6-vlr7j\" (UID: \"03991db4-1111-430b-a3db-2da9e5e7d23b\") " pod="openshift-console/console-5f487b55f6-vlr7j"
Jul 16 21:10:47.367510 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:47.367467    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f487b55f6-vlr7j"
Jul 16 21:10:47.527473 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:47.527399    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f487b55f6-vlr7j"]
Jul 16 21:10:47.530627 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:10:47.530594    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03991db4_1111_430b_a3db_2da9e5e7d23b.slice/crio-2333dd44b4790a393a12ec6f22677341ab8ed703d0e0e4aa3c4c8515579c23f1 WatchSource:0}: Error finding container 2333dd44b4790a393a12ec6f22677341ab8ed703d0e0e4aa3c4c8515579c23f1: Status 404 returned error can't find the container with id 2333dd44b4790a393a12ec6f22677341ab8ed703d0e0e4aa3c4c8515579c23f1
Jul 16 21:10:47.679473 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:47.679442    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/97f73b7d-47ea-4d24-a45e-fab8a2f5cda2-original-pull-secret\") pod \"global-pull-secret-syncer-6z877\" (UID: \"97f73b7d-47ea-4d24-a45e-fab8a2f5cda2\") " pod="kube-system/global-pull-secret-syncer-6z877"
Jul 16 21:10:47.679649 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:47.679511    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jr8lm\" (UniqueName: \"kubernetes.io/projected/e9422503-3736-42d5-85de-6160c39f65bf-kube-api-access-jr8lm\") pod \"network-check-target-9mdcw\" (UID: \"e9422503-3736-42d5-85de-6160c39f65bf\") " pod="openshift-network-diagnostics/network-check-target-9mdcw"
Jul 16 21:10:47.679649 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:47.679544    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/abc6bb6b-5fd0-4978-9416-d0582775a520-metrics-certs\") pod \"network-metrics-daemon-v5bvd\" (UID: \"abc6bb6b-5fd0-4978-9416-d0582775a520\") " pod="openshift-multus/network-metrics-daemon-v5bvd"
Jul 16 21:10:47.686465 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:47.686435    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 16 21:10:47.686594 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:47.686552    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 16 21:10:47.686594 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:47.686569    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 16 21:10:47.692822 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:47.692791    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/abc6bb6b-5fd0-4978-9416-d0582775a520-metrics-certs\") pod \"network-metrics-daemon-v5bvd\" (UID: \"abc6bb6b-5fd0-4978-9416-d0582775a520\") " pod="openshift-multus/network-metrics-daemon-v5bvd"
Jul 16 21:10:47.692822 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:47.692818    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/97f73b7d-47ea-4d24-a45e-fab8a2f5cda2-original-pull-secret\") pod \"global-pull-secret-syncer-6z877\" (UID: \"97f73b7d-47ea-4d24-a45e-fab8a2f5cda2\") " pod="kube-system/global-pull-secret-syncer-6z877"
Jul 16 21:10:47.693043 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:47.693028    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 16 21:10:47.702997 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:47.702976    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jr8lm\" (UniqueName: \"kubernetes.io/projected/e9422503-3736-42d5-85de-6160c39f65bf-kube-api-access-jr8lm\") pod \"network-check-target-9mdcw\" (UID: \"e9422503-3736-42d5-85de-6160c39f65bf\") " pod="openshift-network-diagnostics/network-check-target-9mdcw"
Jul 16 21:10:47.881733 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:47.881656    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ljktf\""
Jul 16 21:10:47.887786 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:47.887753    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xwmds\""
Jul 16 21:10:47.888708 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:47.888690    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v5bvd"
Jul 16 21:10:47.894864 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:47.894844    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9mdcw"
Jul 16 21:10:47.978747 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:47.978682    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6z877"
Jul 16 21:10:48.093744 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:48.093639    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9mdcw"]
Jul 16 21:10:48.097056 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:10:48.096991    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9422503_3736_42d5_85de_6160c39f65bf.slice/crio-cccb62bd9f64957fefff13b36cb43ad6734dafeb556970736f33351f5732a9e8 WatchSource:0}: Error finding container cccb62bd9f64957fefff13b36cb43ad6734dafeb556970736f33351f5732a9e8: Status 404 returned error can't find the container with id cccb62bd9f64957fefff13b36cb43ad6734dafeb556970736f33351f5732a9e8
Jul 16 21:10:48.116367 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:48.116345    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-v5bvd"]
Jul 16 21:10:48.122835 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:10:48.122809    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabc6bb6b_5fd0_4978_9416_d0582775a520.slice/crio-a9bb286b71acfdedb924463876552825e3fc3111ff8e3b6d4eb2fb5935384678 WatchSource:0}: Error finding container a9bb286b71acfdedb924463876552825e3fc3111ff8e3b6d4eb2fb5935384678: Status 404 returned error can't find the container with id a9bb286b71acfdedb924463876552825e3fc3111ff8e3b6d4eb2fb5935384678
Jul 16 21:10:48.143162 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:48.143091    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6z877"]
Jul 16 21:10:48.146697 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:10:48.146671    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97f73b7d_47ea_4d24_a45e_fab8a2f5cda2.slice/crio-4e4bbac408751f6909b12e6c277d6ea7ad9d1daf3a4693e2a8843f7889e8ff58 WatchSource:0}: Error finding container 4e4bbac408751f6909b12e6c277d6ea7ad9d1daf3a4693e2a8843f7889e8ff58: Status 404 returned error can't find the container with id 4e4bbac408751f6909b12e6c277d6ea7ad9d1daf3a4693e2a8843f7889e8ff58
Jul 16 21:10:48.183074 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:48.183051    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/961b693a-6897-4204-a5cc-1c1c80f06693-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-74pf6\" (UID: \"961b693a-6897-4204-a5cc-1c1c80f06693\") " pod="openshift-insights/insights-runtime-extractor-74pf6"
Jul 16 21:10:48.185265 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:48.185245    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/961b693a-6897-4204-a5cc-1c1c80f06693-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-74pf6\" (UID: \"961b693a-6897-4204-a5cc-1c1c80f06693\") " pod="openshift-insights/insights-runtime-extractor-74pf6"
Jul 16 21:10:48.248117 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:48.248065    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6z877" event={"ID":"97f73b7d-47ea-4d24-a45e-fab8a2f5cda2","Type":"ContainerStarted","Data":"4e4bbac408751f6909b12e6c277d6ea7ad9d1daf3a4693e2a8843f7889e8ff58"}
Jul 16 21:10:48.249440 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:48.249415    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-v5bvd" event={"ID":"abc6bb6b-5fd0-4978-9416-d0582775a520","Type":"ContainerStarted","Data":"a9bb286b71acfdedb924463876552825e3fc3111ff8e3b6d4eb2fb5935384678"}
Jul 16 21:10:48.250735 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:48.250690    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f487b55f6-vlr7j" event={"ID":"03991db4-1111-430b-a3db-2da9e5e7d23b","Type":"ContainerStarted","Data":"2333dd44b4790a393a12ec6f22677341ab8ed703d0e0e4aa3c4c8515579c23f1"}
Jul 16 21:10:48.251825 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:48.251801    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9mdcw" event={"ID":"e9422503-3736-42d5-85de-6160c39f65bf","Type":"ContainerStarted","Data":"cccb62bd9f64957fefff13b36cb43ad6734dafeb556970736f33351f5732a9e8"}
Jul 16 21:10:48.377669 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:48.377638    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-glgkx\""
Jul 16 21:10:48.384338 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:48.384307    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-74pf6"
Jul 16 21:10:48.571969 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:48.571937    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-74pf6"]
Jul 16 21:10:48.575720 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:10:48.575694    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod961b693a_6897_4204_a5cc_1c1c80f06693.slice/crio-ac8188437fce266bb0936cbc91e5bf2cf693400e18ee1c449d86b7b229249f98 WatchSource:0}: Error finding container ac8188437fce266bb0936cbc91e5bf2cf693400e18ee1c449d86b7b229249f98: Status 404 returned error can't find the container with id ac8188437fce266bb0936cbc91e5bf2cf693400e18ee1c449d86b7b229249f98
Jul 16 21:10:49.258398 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:49.258317    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-74pf6" event={"ID":"961b693a-6897-4204-a5cc-1c1c80f06693","Type":"ContainerStarted","Data":"ac8188437fce266bb0936cbc91e5bf2cf693400e18ee1c449d86b7b229249f98"}
Jul 16 21:10:49.394023 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:49.393722    2579 patch_prober.go:28] interesting pod/image-registry-68f59f6c69-c4gqw container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 16 21:10:49.394023 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:49.393783    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-68f59f6c69-c4gqw" podUID="8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 16 21:10:50.272371 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:50.271534    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-qfx5x" event={"ID":"9cd874e9-ac2e-4a23-ab69-b0be53f0588d","Type":"ContainerStarted","Data":"c5df82c22bf39131d08a4b999fe8bcbf02db0e48348684ff8066b3e8464b6eb6"}
Jul 16 21:10:50.272371 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:50.271603    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-qfx5x" event={"ID":"9cd874e9-ac2e-4a23-ab69-b0be53f0588d","Type":"ContainerStarted","Data":"d47a099c3050406dd5613cf12ffb386f5cd1010b68dfef1227fed16308de698f"}
Jul 16 21:10:52.878872 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:52.878815    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-qfx5x" podStartSLOduration=5.110597926 podStartE2EDuration="7.878796499s" totalImagesPullingTime="2.768198573s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:10:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:10:50.300767338 +0000 UTC m=+68.914947682" watchObservedRunningTime="2026-07-16 21:10:52.878796499 +0000 UTC m=+71.492976816"
Jul 16 21:10:52.879786 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:52.879765    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-vskpk"]
Jul 16 21:10:52.882242 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:52.882223    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vskpk"
Jul 16 21:10:52.886146 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:52.885907    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 16 21:10:52.886146 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:52.886011    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-5vfpq\""
Jul 16 21:10:52.886543 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:52.886527    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 16 21:10:52.886966 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:52.886803    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 16 21:10:52.937420 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:52.937383    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8483a35d-1351-40fe-a74f-8defef056a52-root\") pod \"node-exporter-vskpk\" (UID: \"8483a35d-1351-40fe-a74f-8defef056a52\") " pod="openshift-monitoring/node-exporter-vskpk"
Jul 16 21:10:52.937590 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:52.937436    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8483a35d-1351-40fe-a74f-8defef056a52-node-exporter-tls\") pod \"node-exporter-vskpk\" (UID: \"8483a35d-1351-40fe-a74f-8defef056a52\") " pod="openshift-monitoring/node-exporter-vskpk"
Jul 16 21:10:52.937590 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:52.937462    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-724bg\" (UniqueName: \"kubernetes.io/projected/8483a35d-1351-40fe-a74f-8defef056a52-kube-api-access-724bg\") pod \"node-exporter-vskpk\" (UID: \"8483a35d-1351-40fe-a74f-8defef056a52\") " pod="openshift-monitoring/node-exporter-vskpk"
Jul 16 21:10:52.937590 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:52.937496    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8483a35d-1351-40fe-a74f-8defef056a52-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vskpk\" (UID: \"8483a35d-1351-40fe-a74f-8defef056a52\") " pod="openshift-monitoring/node-exporter-vskpk"
Jul 16 21:10:52.937590 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:52.937545    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8483a35d-1351-40fe-a74f-8defef056a52-node-exporter-textfile\") pod \"node-exporter-vskpk\" (UID: \"8483a35d-1351-40fe-a74f-8defef056a52\") " pod="openshift-monitoring/node-exporter-vskpk"
Jul 16 21:10:52.937590 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:52.937575    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8483a35d-1351-40fe-a74f-8defef056a52-node-exporter-accelerators-collector-config\") pod \"node-exporter-vskpk\" (UID: \"8483a35d-1351-40fe-a74f-8defef056a52\") " pod="openshift-monitoring/node-exporter-vskpk"
Jul 16 21:10:52.937855 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:52.937602    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8483a35d-1351-40fe-a74f-8defef056a52-sys\") pod \"node-exporter-vskpk\" (UID: \"8483a35d-1351-40fe-a74f-8defef056a52\") " pod="openshift-monitoring/node-exporter-vskpk"
Jul 16 21:10:52.937855 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:52.937692    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8483a35d-1351-40fe-a74f-8defef056a52-metrics-client-ca\") pod \"node-exporter-vskpk\" (UID: \"8483a35d-1351-40fe-a74f-8defef056a52\") " pod="openshift-monitoring/node-exporter-vskpk"
Jul 16 21:10:52.937855 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:52.937729    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8483a35d-1351-40fe-a74f-8defef056a52-node-exporter-wtmp\") pod \"node-exporter-vskpk\" (UID: \"8483a35d-1351-40fe-a74f-8defef056a52\") " pod="openshift-monitoring/node-exporter-vskpk"
Jul 16 21:10:53.038550 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:53.038517    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8483a35d-1351-40fe-a74f-8defef056a52-node-exporter-textfile\") pod \"node-exporter-vskpk\" (UID: \"8483a35d-1351-40fe-a74f-8defef056a52\") " pod="openshift-monitoring/node-exporter-vskpk"
Jul 16 21:10:53.038550 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:53.038561    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8483a35d-1351-40fe-a74f-8defef056a52-node-exporter-accelerators-collector-config\") pod \"node-exporter-vskpk\" (UID: \"8483a35d-1351-40fe-a74f-8defef056a52\") " pod="openshift-monitoring/node-exporter-vskpk"
Jul 16 21:10:53.038788 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:53.038594    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8483a35d-1351-40fe-a74f-8defef056a52-sys\") pod \"node-exporter-vskpk\" (UID: \"8483a35d-1351-40fe-a74f-8defef056a52\") " pod="openshift-monitoring/node-exporter-vskpk"
Jul 16 21:10:53.038788 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:53.038625    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8483a35d-1351-40fe-a74f-8defef056a52-metrics-client-ca\") pod \"node-exporter-vskpk\" (UID: \"8483a35d-1351-40fe-a74f-8defef056a52\") " pod="openshift-monitoring/node-exporter-vskpk"
Jul 16 21:10:53.038788 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:53.038642    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8483a35d-1351-40fe-a74f-8defef056a52-node-exporter-wtmp\") pod \"node-exporter-vskpk\" (UID: \"8483a35d-1351-40fe-a74f-8defef056a52\") " pod="openshift-monitoring/node-exporter-vskpk"
Jul 16 21:10:53.038788 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:53.038663    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8483a35d-1351-40fe-a74f-8defef056a52-root\") pod \"node-exporter-vskpk\" (UID: \"8483a35d-1351-40fe-a74f-8defef056a52\") " pod="openshift-monitoring/node-exporter-vskpk"
Jul 16 21:10:53.038788 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:53.038688    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8483a35d-1351-40fe-a74f-8defef056a52-node-exporter-tls\") pod \"node-exporter-vskpk\" (UID: \"8483a35d-1351-40fe-a74f-8defef056a52\") " pod="openshift-monitoring/node-exporter-vskpk"
Jul 16 21:10:53.038788 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:53.038703    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-724bg\" (UniqueName: \"kubernetes.io/projected/8483a35d-1351-40fe-a74f-8defef056a52-kube-api-access-724bg\") pod \"node-exporter-vskpk\" (UID: \"8483a35d-1351-40fe-a74f-8defef056a52\") " pod="openshift-monitoring/node-exporter-vskpk"
Jul 16 21:10:53.038788 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:53.038726    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8483a35d-1351-40fe-a74f-8defef056a52-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vskpk\" (UID: \"8483a35d-1351-40fe-a74f-8defef056a52\") " pod="openshift-monitoring/node-exporter-vskpk"
Jul 16 21:10:53.039592 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:53.039185    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8483a35d-1351-40fe-a74f-8defef056a52-root\") pod \"node-exporter-vskpk\" (UID: \"8483a35d-1351-40fe-a74f-8defef056a52\") " pod="openshift-monitoring/node-exporter-vskpk"
Jul 16 21:10:53.039592 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:53.039186    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8483a35d-1351-40fe-a74f-8defef056a52-sys\") pod \"node-exporter-vskpk\" (UID: \"8483a35d-1351-40fe-a74f-8defef056a52\") " pod="openshift-monitoring/node-exporter-vskpk"
Jul 16 21:10:53.039592 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:53.039341    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8483a35d-1351-40fe-a74f-8defef056a52-node-exporter-wtmp\") pod \"node-exporter-vskpk\" (UID: \"8483a35d-1351-40fe-a74f-8defef056a52\") " pod="openshift-monitoring/node-exporter-vskpk"
Jul 16 21:10:53.039592 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:53.039374    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8483a35d-1351-40fe-a74f-8defef056a52-node-exporter-textfile\") pod \"node-exporter-vskpk\" (UID: \"8483a35d-1351-40fe-a74f-8defef056a52\") " pod="openshift-monitoring/node-exporter-vskpk"
Jul 16 21:10:53.039592 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:53.039434    2579 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 16 21:10:53.039592 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:10:53.039489    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8483a35d-1351-40fe-a74f-8defef056a52-node-exporter-tls podName:8483a35d-1351-40fe-a74f-8defef056a52 nodeName:}" failed. No retries permitted until 2026-07-16 21:10:53.539471199 +0000 UTC m=+72.153651494 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/8483a35d-1351-40fe-a74f-8defef056a52-node-exporter-tls") pod "node-exporter-vskpk" (UID: "8483a35d-1351-40fe-a74f-8defef056a52") : secret "node-exporter-tls" not found
Jul 16 21:10:53.039971 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:53.039699    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8483a35d-1351-40fe-a74f-8defef056a52-metrics-client-ca\") pod \"node-exporter-vskpk\" (UID: \"8483a35d-1351-40fe-a74f-8defef056a52\") " pod="openshift-monitoring/node-exporter-vskpk"
Jul 16 21:10:53.039971 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:53.039854    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8483a35d-1351-40fe-a74f-8defef056a52-node-exporter-accelerators-collector-config\") pod \"node-exporter-vskpk\" (UID: \"8483a35d-1351-40fe-a74f-8defef056a52\") " pod="openshift-monitoring/node-exporter-vskpk"
Jul 16 21:10:53.041395 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:53.041371    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8483a35d-1351-40fe-a74f-8defef056a52-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vskpk\" (UID: \"8483a35d-1351-40fe-a74f-8defef056a52\") " pod="openshift-monitoring/node-exporter-vskpk"
Jul 16 21:10:53.056181 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:53.056156    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-724bg\" (UniqueName: \"kubernetes.io/projected/8483a35d-1351-40fe-a74f-8defef056a52-kube-api-access-724bg\") pod \"node-exporter-vskpk\" (UID: \"8483a35d-1351-40fe-a74f-8defef056a52\") " pod="openshift-monitoring/node-exporter-vskpk"
Jul 16 21:10:53.542813 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:53.542771    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8483a35d-1351-40fe-a74f-8defef056a52-node-exporter-tls\") pod \"node-exporter-vskpk\" (UID: \"8483a35d-1351-40fe-a74f-8defef056a52\") " pod="openshift-monitoring/node-exporter-vskpk"
Jul 16 21:10:53.545576 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:53.545551    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8483a35d-1351-40fe-a74f-8defef056a52-node-exporter-tls\") pod \"node-exporter-vskpk\" (UID: \"8483a35d-1351-40fe-a74f-8defef056a52\") " pod="openshift-monitoring/node-exporter-vskpk"
Jul 16 21:10:53.793180 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:53.793088    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vskpk"
Jul 16 21:10:55.738367 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:55.738328    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-654bf8fb59-lrqj4"]
Jul 16 21:10:55.741314 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:55.741290    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-654bf8fb59-lrqj4"
Jul 16 21:10:55.744720 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:55.744672    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 16 21:10:55.746001 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:55.745982    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-phvds\""
Jul 16 21:10:55.746126 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:55.746005    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 16 21:10:55.746257 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:55.746235    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 16 21:10:55.746257 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:55.746253    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-blnt73sjgtks4\""
Jul 16 21:10:55.746430 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:55.746303    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 16 21:10:55.746430 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:55.746308    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 16 21:10:55.757951 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:55.757929    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-654bf8fb59-lrqj4"]
Jul 16 21:10:55.863520 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:55.863485    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/74c9eeb2-f65d-403a-9d99-e8745bfb19c8-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-654bf8fb59-lrqj4\" (UID: \"74c9eeb2-f65d-403a-9d99-e8745bfb19c8\") " pod="openshift-monitoring/thanos-querier-654bf8fb59-lrqj4"
Jul 16 21:10:55.863715 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:55.863530    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wj2wl\" (UniqueName: \"kubernetes.io/projected/74c9eeb2-f65d-403a-9d99-e8745bfb19c8-kube-api-access-wj2wl\") pod \"thanos-querier-654bf8fb59-lrqj4\" (UID: \"74c9eeb2-f65d-403a-9d99-e8745bfb19c8\") " pod="openshift-monitoring/thanos-querier-654bf8fb59-lrqj4"
Jul 16 21:10:55.863715 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:55.863565    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/74c9eeb2-f65d-403a-9d99-e8745bfb19c8-metrics-client-ca\") pod \"thanos-querier-654bf8fb59-lrqj4\" (UID: \"74c9eeb2-f65d-403a-9d99-e8745bfb19c8\") " pod="openshift-monitoring/thanos-querier-654bf8fb59-lrqj4"
Jul 16 21:10:55.863715 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:55.863595    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/74c9eeb2-f65d-403a-9d99-e8745bfb19c8-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-654bf8fb59-lrqj4\" (UID: \"74c9eeb2-f65d-403a-9d99-e8745bfb19c8\") " pod="openshift-monitoring/thanos-querier-654bf8fb59-lrqj4"
Jul 16 21:10:55.863715 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:55.863621    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/74c9eeb2-f65d-403a-9d99-e8745bfb19c8-secret-thanos-querier-tls\") pod \"thanos-querier-654bf8fb59-lrqj4\" (UID: \"74c9eeb2-f65d-403a-9d99-e8745bfb19c8\") " pod="openshift-monitoring/thanos-querier-654bf8fb59-lrqj4"
Jul 16 21:10:55.863715 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:55.863654    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/74c9eeb2-f65d-403a-9d99-e8745bfb19c8-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-654bf8fb59-lrqj4\" (UID: \"74c9eeb2-f65d-403a-9d99-e8745bfb19c8\") " pod="openshift-monitoring/thanos-querier-654bf8fb59-lrqj4"
Jul 16 21:10:55.863965 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:55.863771    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/74c9eeb2-f65d-403a-9d99-e8745bfb19c8-secret-grpc-tls\") pod \"thanos-querier-654bf8fb59-lrqj4\" (UID: \"74c9eeb2-f65d-403a-9d99-e8745bfb19c8\") " pod="openshift-monitoring/thanos-querier-654bf8fb59-lrqj4"
Jul 16 21:10:55.863965 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:55.863823    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/74c9eeb2-f65d-403a-9d99-e8745bfb19c8-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-654bf8fb59-lrqj4\" (UID: \"74c9eeb2-f65d-403a-9d99-e8745bfb19c8\") " pod="openshift-monitoring/thanos-querier-654bf8fb59-lrqj4"
Jul 16 21:10:55.964932 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:55.964887    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/74c9eeb2-f65d-403a-9d99-e8745bfb19c8-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-654bf8fb59-lrqj4\" (UID: \"74c9eeb2-f65d-403a-9d99-e8745bfb19c8\") " pod="openshift-monitoring/thanos-querier-654bf8fb59-lrqj4"
Jul 16 21:10:55.965149 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:55.964945    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wj2wl\" (UniqueName: \"kubernetes.io/projected/74c9eeb2-f65d-403a-9d99-e8745bfb19c8-kube-api-access-wj2wl\") pod \"thanos-querier-654bf8fb59-lrqj4\" (UID: \"74c9eeb2-f65d-403a-9d99-e8745bfb19c8\") " pod="openshift-monitoring/thanos-querier-654bf8fb59-lrqj4"
Jul 16 21:10:55.965149 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:55.964978    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/74c9eeb2-f65d-403a-9d99-e8745bfb19c8-metrics-client-ca\") pod \"thanos-querier-654bf8fb59-lrqj4\" (UID: \"74c9eeb2-f65d-403a-9d99-e8745bfb19c8\") " pod="openshift-monitoring/thanos-querier-654bf8fb59-lrqj4"
Jul 16 21:10:55.965149 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:55.965027    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/74c9eeb2-f65d-403a-9d99-e8745bfb19c8-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-654bf8fb59-lrqj4\" (UID: \"74c9eeb2-f65d-403a-9d99-e8745bfb19c8\") " pod="openshift-monitoring/thanos-querier-654bf8fb59-lrqj4"
Jul 16 21:10:55.965149 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:55.965054    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/74c9eeb2-f65d-403a-9d99-e8745bfb19c8-secret-thanos-querier-tls\") pod \"thanos-querier-654bf8fb59-lrqj4\" (UID: \"74c9eeb2-f65d-403a-9d99-e8745bfb19c8\") " pod="openshift-monitoring/thanos-querier-654bf8fb59-lrqj4"
Jul 16 21:10:55.965149 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:55.965090    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/74c9eeb2-f65d-403a-9d99-e8745bfb19c8-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-654bf8fb59-lrqj4\" (UID: \"74c9eeb2-f65d-403a-9d99-e8745bfb19c8\") " pod="openshift-monitoring/thanos-querier-654bf8fb59-lrqj4"
Jul 16 21:10:55.965149 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:55.965146    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/74c9eeb2-f65d-403a-9d99-e8745bfb19c8-secret-grpc-tls\") pod \"thanos-querier-654bf8fb59-lrqj4\" (UID: \"74c9eeb2-f65d-403a-9d99-e8745bfb19c8\") " pod="openshift-monitoring/thanos-querier-654bf8fb59-lrqj4"
Jul 16 21:10:55.965492 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:55.965180    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/74c9eeb2-f65d-403a-9d99-e8745bfb19c8-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-654bf8fb59-lrqj4\" (UID: \"74c9eeb2-f65d-403a-9d99-e8745bfb19c8\") " pod="openshift-monitoring/thanos-querier-654bf8fb59-lrqj4"
Jul 16 21:10:55.966140 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:55.965814    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/74c9eeb2-f65d-403a-9d99-e8745bfb19c8-metrics-client-ca\") pod \"thanos-querier-654bf8fb59-lrqj4\" (UID: \"74c9eeb2-f65d-403a-9d99-e8745bfb19c8\") " pod="openshift-monitoring/thanos-querier-654bf8fb59-lrqj4"
Jul 16 21:10:55.968810 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:55.968255    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/74c9eeb2-f65d-403a-9d99-e8745bfb19c8-secret-grpc-tls\") pod \"thanos-querier-654bf8fb59-lrqj4\" (UID: \"74c9eeb2-f65d-403a-9d99-e8745bfb19c8\") " pod="openshift-monitoring/thanos-querier-654bf8fb59-lrqj4"
Jul 16 21:10:55.968810 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:55.968490    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/74c9eeb2-f65d-403a-9d99-e8745bfb19c8-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-654bf8fb59-lrqj4\" (UID: \"74c9eeb2-f65d-403a-9d99-e8745bfb19c8\") " pod="openshift-monitoring/thanos-querier-654bf8fb59-lrqj4"
Jul 16 21:10:55.969085 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:55.969060    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/74c9eeb2-f65d-403a-9d99-e8745bfb19c8-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-654bf8fb59-lrqj4\" (UID: \"74c9eeb2-f65d-403a-9d99-e8745bfb19c8\") " pod="openshift-monitoring/thanos-querier-654bf8fb59-lrqj4"
Jul 16 21:10:55.969704 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:55.969677    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/74c9eeb2-f65d-403a-9d99-e8745bfb19c8-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-654bf8fb59-lrqj4\" (UID: \"74c9eeb2-f65d-403a-9d99-e8745bfb19c8\") " pod="openshift-monitoring/thanos-querier-654bf8fb59-lrqj4"
Jul 16 21:10:55.969795 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:55.969749    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/74c9eeb2-f65d-403a-9d99-e8745bfb19c8-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-654bf8fb59-lrqj4\" (UID: \"74c9eeb2-f65d-403a-9d99-e8745bfb19c8\") " pod="openshift-monitoring/thanos-querier-654bf8fb59-lrqj4"
Jul 16 21:10:55.970217 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:55.970168    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/74c9eeb2-f65d-403a-9d99-e8745bfb19c8-secret-thanos-querier-tls\") pod \"thanos-querier-654bf8fb59-lrqj4\" (UID: \"74c9eeb2-f65d-403a-9d99-e8745bfb19c8\") " pod="openshift-monitoring/thanos-querier-654bf8fb59-lrqj4"
Jul 16 21:10:55.977398 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:55.977365    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wj2wl\" (UniqueName: \"kubernetes.io/projected/74c9eeb2-f65d-403a-9d99-e8745bfb19c8-kube-api-access-wj2wl\") pod \"thanos-querier-654bf8fb59-lrqj4\" (UID: \"74c9eeb2-f65d-403a-9d99-e8745bfb19c8\") " pod="openshift-monitoring/thanos-querier-654bf8fb59-lrqj4"
Jul 16 21:10:56.053352 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:56.053258    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-654bf8fb59-lrqj4"
Jul 16 21:10:58.810445 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:58.810410    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 16 21:10:58.814850 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:58.814798    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:10:58.817759 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:58.817734    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-wrkff\""
Jul 16 21:10:58.820984 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:58.820854    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 16 21:10:58.820984 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:58.820933    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 16 21:10:58.821543 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:58.821503    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 16 21:10:58.822151 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:58.822133    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 16 21:10:58.822254 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:58.822205    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 16 21:10:58.822410 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:58.822323    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 16 21:10:58.822823 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:58.822622    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 16 21:10:58.822823 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:58.822673    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 16 21:10:58.823577 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:58.823456    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-5fulfaao09n46\""
Jul 16 21:10:58.823577 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:58.823570    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 16 21:10:58.823791 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:58.823769    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 16 21:10:58.823920 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:58.823901    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 16 21:10:58.823996 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:58.823930    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 16 21:10:58.823996 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:58.823979    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 16 21:10:58.825300 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:58.825044    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 16 21:10:58.825300 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:58.825052    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 16 21:10:58.843527 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:58.843496    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 16 21:10:58.891045 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:58.891006    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:10:58.891241 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:58.891054    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:10:58.891241 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:58.891084    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:10:58.891241 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:58.891141    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:10:58.891241 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:58.891166    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:10:58.891241 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:58.891193    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-config-out\") pod \"prometheus-k8s-0\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:10:58.891513 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:58.891238    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-web-config\") pod \"prometheus-k8s-0\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:10:58.891513 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:58.891296    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:10:58.891513 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:58.891333    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzkcw\" (UniqueName: \"kubernetes.io/projected/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-kube-api-access-mzkcw\") pod \"prometheus-k8s-0\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:10:58.891513 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:58.891360    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:10:58.891513 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:58.891386    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:10:58.891513 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:58.891432    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:10:58.891513 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:58.891456    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:10:58.891513 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:58.891485    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:10:58.891513 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:58.891513    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:10:58.893650 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:58.893623    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:10:58.893797 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:58.893658    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:10:58.893797 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:58.893675    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:10:58.893797 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:58.893764    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-config\") pod \"prometheus-k8s-0\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:10:58.894044 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:58.893798    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:10:58.995198 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:58.995160    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:10:58.995198 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:58.995208    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:10:58.995440 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:58.995240    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:10:58.995440 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:58.995264    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:10:58.995440 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:58.995287    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-config-out\") pod \"prometheus-k8s-0\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:10:58.995440 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:58.995307    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-web-config\") pod \"prometheus-k8s-0\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:10:58.995440 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:58.995341    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:10:58.995440 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:58.995372    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzkcw\" (UniqueName: \"kubernetes.io/projected/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-kube-api-access-mzkcw\") pod \"prometheus-k8s-0\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:10:58.995730 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:58.995654    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:10:58.996466 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:58.995838    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:10:58.996466 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:58.995881    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:10:58.996466 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:58.995921    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:10:58.996466 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:58.995951    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:10:58.996466 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:58.995979    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:10:58.996466 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:58.996007    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:10:58.996466 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:58.996071    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:10:58.996466 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:58.996127    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:10:58.996466 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:58.996153    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:10:58.996466 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:58.996198    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-config\") pod \"prometheus-k8s-0\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:10:58.996466 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:58.996227    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:10:58.996466 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:58.996253    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:10:58.997227 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:58.996837    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:10:58.997227 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:58.996929    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:10:58.998639 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:58.997446    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:10:58.998639 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:58.998281    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:10:58.999013 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:58.998988    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:10:58.999444 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:58.999421    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:10:59.000024 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:58.999999    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:10:59.002829 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:59.001461    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:10:59.002829 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:59.001774    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:10:59.002829 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:59.002652    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-config\") pod \"prometheus-k8s-0\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:10:59.002829 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:59.002782    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:10:59.003134 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:59.002866    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-config-out\") pod \"prometheus-k8s-0\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:10:59.004146 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:59.004082    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:10:59.004679 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:59.004641    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-web-config\") pod \"prometheus-k8s-0\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:10:59.005010 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:59.004988    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:10:59.005562 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:59.005542    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:10:59.008367 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:59.008344    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzkcw\" (UniqueName: \"kubernetes.io/projected/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-kube-api-access-mzkcw\") pod \"prometheus-k8s-0\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:10:59.008804 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:59.008768    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:10:59.008804 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:59.008790    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:10:59.127562 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:59.127477    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:10:59.389370 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:10:59.389295    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-68f59f6c69-c4gqw"
Jul 16 21:11:00.433066 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:00.433029    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f487b55f6-vlr7j"]
Jul 16 21:11:04.403551 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:04.403478    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-68f59f6c69-c4gqw" podUID="8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf" containerName="registry" containerID="cri-o://84060dd743bfd9a4d7c1723072bdcf48c33b3926c0a67635b392d3288245d55e" gracePeriod=30
Jul 16 21:11:05.337152 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:05.337079    2579 generic.go:356] "Generic (PLEG): container finished" podID="8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf" containerID="84060dd743bfd9a4d7c1723072bdcf48c33b3926c0a67635b392d3288245d55e" exitCode=0
Jul 16 21:11:05.337309 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:05.337142    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68f59f6c69-c4gqw" event={"ID":"8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf","Type":"ContainerDied","Data":"84060dd743bfd9a4d7c1723072bdcf48c33b3926c0a67635b392d3288245d55e"}
Jul 16 21:11:05.434931 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:05.434913    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68f59f6c69-c4gqw"
Jul 16 21:11:05.555487 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:05.555405    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g7jls\" (UniqueName: \"kubernetes.io/projected/8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf-kube-api-access-g7jls\") pod \"8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf\" (UID: \"8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf\") "
Jul 16 21:11:05.555487 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:05.555454    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf-trusted-ca\") pod \"8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf\" (UID: \"8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf\") "
Jul 16 21:11:05.555700 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:05.555521    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf-registry-certificates\") pod \"8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf\" (UID: \"8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf\") "
Jul 16 21:11:05.555700 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:05.555561    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf-installation-pull-secrets\") pod \"8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf\" (UID: \"8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf\") "
Jul 16 21:11:05.555700 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:05.555610    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf-registry-tls\") pod \"8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf\" (UID: \"8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf\") "
Jul 16 21:11:05.555700 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:05.555632    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf-bound-sa-token\") pod \"8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf\" (UID: \"8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf\") "
Jul 16 21:11:05.555700 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:05.555670    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf-image-registry-private-configuration\") pod \"8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf\" (UID: \"8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf\") "
Jul 16 21:11:05.555951 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:05.555709    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf-ca-trust-extracted\") pod \"8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf\" (UID: \"8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf\") "
Jul 16 21:11:05.555996 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:05.555969    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf" (UID: "8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 21:11:05.556143 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:05.556077    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf" (UID: "8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 21:11:05.558607 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:05.558558    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf-kube-api-access-g7jls" (OuterVolumeSpecName: "kube-api-access-g7jls") pod "8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf" (UID: "8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf"). InnerVolumeSpecName "kube-api-access-g7jls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 21:11:05.558607 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:05.558564    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf" (UID: "8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 21:11:05.558757 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:05.558694    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf" (UID: "8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 21:11:05.559127 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:05.559070    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf" (UID: "8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 21:11:05.559468 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:05.559446    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf" (UID: "8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 21:11:05.567206 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:05.567178    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf" (UID: "8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 21:11:05.656963 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:05.656932    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g7jls\" (UniqueName: \"kubernetes.io/projected/8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf-kube-api-access-g7jls\") on node \"ip-10-0-133-58.ec2.internal\" DevicePath \"\""
Jul 16 21:11:05.656963 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:05.656964    2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf-trusted-ca\") on node \"ip-10-0-133-58.ec2.internal\" DevicePath \"\""
Jul 16 21:11:05.657212 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:05.656978    2579 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf-registry-certificates\") on node \"ip-10-0-133-58.ec2.internal\" DevicePath \"\""
Jul 16 21:11:05.657212 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:05.656991    2579 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf-installation-pull-secrets\") on node \"ip-10-0-133-58.ec2.internal\" DevicePath \"\""
Jul 16 21:11:05.657212 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:05.657002    2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf-registry-tls\") on node \"ip-10-0-133-58.ec2.internal\" DevicePath \"\""
Jul 16 21:11:05.657212 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:05.657013    2579 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf-bound-sa-token\") on node \"ip-10-0-133-58.ec2.internal\" DevicePath \"\""
Jul 16 21:11:05.657212 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:05.657024    2579 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf-image-registry-private-configuration\") on node \"ip-10-0-133-58.ec2.internal\" DevicePath \"\""
Jul 16 21:11:05.657212 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:05.657035    2579 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf-ca-trust-extracted\") on node \"ip-10-0-133-58.ec2.internal\" DevicePath \"\""
Jul 16 21:11:05.887477 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:05.887448    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 16 21:11:06.075671 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:11:06.075617    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8d74520_7b5c_4b63_88c9_1f53d4b9232d.slice/crio-023300ee348a102cd2052708535824c0ede73b38fbd7d3444ee216fa16b8e3f0 WatchSource:0}: Error finding container 023300ee348a102cd2052708535824c0ede73b38fbd7d3444ee216fa16b8e3f0: Status 404 returned error can't find the container with id 023300ee348a102cd2052708535824c0ede73b38fbd7d3444ee216fa16b8e3f0
Jul 16 21:11:06.080246 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:11:06.079721    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8483a35d_1351_40fe_a74f_8defef056a52.slice/crio-6c410cacb432dabe3634fd69c5f381903583d1adb2b8dbcb32abbd980d135741 WatchSource:0}: Error finding container 6c410cacb432dabe3634fd69c5f381903583d1adb2b8dbcb32abbd980d135741: Status 404 returned error can't find the container with id 6c410cacb432dabe3634fd69c5f381903583d1adb2b8dbcb32abbd980d135741
Jul 16 21:11:06.258216 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:06.258076    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-654bf8fb59-lrqj4"]
Jul 16 21:11:06.348209 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:06.348177    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-654bf8fb59-lrqj4" event={"ID":"74c9eeb2-f65d-403a-9d99-e8745bfb19c8","Type":"ContainerStarted","Data":"5d3fe27050538d8446c51ad676a327252f81bf3c844f7be5cc985e36f90e81f4"}
Jul 16 21:11:06.350165 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:06.350066    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68f59f6c69-c4gqw" event={"ID":"8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf","Type":"ContainerDied","Data":"cb8c7aaf68b035e10593d72528d47668eb35c36f7629cb36ad9f9842ae2d12fb"}
Jul 16 21:11:06.350165 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:06.350148    2579 scope.go:117] "RemoveContainer" containerID="84060dd743bfd9a4d7c1723072bdcf48c33b3926c0a67635b392d3288245d55e"
Jul 16 21:11:06.350369 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:06.350280    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68f59f6c69-c4gqw"
Jul 16 21:11:06.353820 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:06.353787    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6z877" event={"ID":"97f73b7d-47ea-4d24-a45e-fab8a2f5cda2","Type":"ContainerStarted","Data":"07c7ec41160ebae406063d8e8ca6e45b952e1864b203cd31c12b2afb2b81547b"}
Jul 16 21:11:06.356026 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:06.355973    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-v5bvd" event={"ID":"abc6bb6b-5fd0-4978-9416-d0582775a520","Type":"ContainerStarted","Data":"74103a1443d3fa13f223f1ddf8008b9c4a020eb4a37a59de42cea73c03c7bb40"}
Jul 16 21:11:06.358491 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:06.358417    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e8d74520-7b5c-4b63-88c9-1f53d4b9232d","Type":"ContainerStarted","Data":"023300ee348a102cd2052708535824c0ede73b38fbd7d3444ee216fa16b8e3f0"}
Jul 16 21:11:06.360747 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:06.360502    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f487b55f6-vlr7j" event={"ID":"03991db4-1111-430b-a3db-2da9e5e7d23b","Type":"ContainerStarted","Data":"a9b0b89d52dc4399ac91e2c14ce3bfd876c6efbfb55e8667ff0576cbce933f3c"}
Jul 16 21:11:06.363287 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:06.363218    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-74pf6" event={"ID":"961b693a-6897-4204-a5cc-1c1c80f06693","Type":"ContainerStarted","Data":"d2e020231a8d50e2dd164ed86c0f64e20466ec9fb6e89fedba9f3a62feac9d64"}
Jul 16 21:11:06.366669 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:06.366614    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-gxnhw" event={"ID":"f298d5ff-45b8-433f-a167-c0576efff356","Type":"ContainerStarted","Data":"f5f25393b0d8b85146d7744fd1bfa046687ea2dfd272749c15be8f2f3bc48e3c"}
Jul 16 21:11:06.367462 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:06.367264    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-gxnhw"
Jul 16 21:11:06.368950 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:06.368711    2579 patch_prober.go:28] interesting pod/downloads-5bc67dcd46-gxnhw container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.133.0.11:8080/\": dial tcp 10.133.0.11:8080: connect: connection refused" start-of-body=
Jul 16 21:11:06.368950 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:06.368758    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-5bc67dcd46-gxnhw" podUID="f298d5ff-45b8-433f-a167-c0576efff356" containerName="download-server" probeResult="failure" output="Get \"http://10.133.0.11:8080/\": dial tcp 10.133.0.11:8080: connect: connection refused"
Jul 16 21:11:06.370219 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:06.370174    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9mdcw" event={"ID":"e9422503-3736-42d5-85de-6160c39f65bf","Type":"ContainerStarted","Data":"132a0301d7d703518c5d2d7266607beea4263a549a76ed55092f518a1e944463"}
Jul 16 21:11:06.370338 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:06.370320    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-9mdcw"
Jul 16 21:11:06.372176 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:06.372089    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vskpk" event={"ID":"8483a35d-1351-40fe-a74f-8defef056a52","Type":"ContainerStarted","Data":"6c410cacb432dabe3634fd69c5f381903583d1adb2b8dbcb32abbd980d135741"}
Jul 16 21:11:06.381916 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:06.381870    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-68f59f6c69-c4gqw"]
Jul 16 21:11:06.388406 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:06.388353    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-68f59f6c69-c4gqw"]
Jul 16 21:11:06.438964 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:06.438852    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-gxnhw" podStartSLOduration=1.815696032 podStartE2EDuration="27.438818835s" totalImagesPullingTime="25.623122803s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:10:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:11:06.43848006 +0000 UTC m=+85.052660371" watchObservedRunningTime="2026-07-16 21:11:06.438818835 +0000 UTC m=+85.052999351"
Jul 16 21:11:06.439475 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:06.438964    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6z877" podStartSLOduration=66.512490176 podStartE2EDuration="1m24.438957578s" totalImagesPullingTime="17.926467402s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:09:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:11:06.414166212 +0000 UTC m=+85.028346581" watchObservedRunningTime="2026-07-16 21:11:06.438957578 +0000 UTC m=+85.053137895"
Jul 16 21:11:06.468703 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:06.468652    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5f487b55f6-vlr7j" podStartSLOduration=0.925465702 podStartE2EDuration="19.468635176s" totalImagesPullingTime="18.543169474s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:10:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:11:06.46797156 +0000 UTC m=+85.082151878" watchObservedRunningTime="2026-07-16 21:11:06.468635176 +0000 UTC m=+85.082815491"
Jul 16 21:11:06.497400 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:06.497343    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-9mdcw" podStartSLOduration=66.520048865 podStartE2EDuration="1m24.497323968s" totalImagesPullingTime="17.977275103s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:09:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:11:06.495810559 +0000 UTC m=+85.109990875" watchObservedRunningTime="2026-07-16 21:11:06.497323968 +0000 UTC m=+85.111504286"
Jul 16 21:11:07.367619 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:07.367582    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f487b55f6-vlr7j"
Jul 16 21:11:07.388070 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:07.386548    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-v5bvd" event={"ID":"abc6bb6b-5fd0-4978-9416-d0582775a520","Type":"ContainerStarted","Data":"61282dd66f1eff5e943c26074827c6f522d4ca34f2565dbcda409764e6c8b79d"}
Jul 16 21:11:07.400350 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:07.400321    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-gxnhw"
Jul 16 21:11:07.414008 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:07.412452    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-v5bvd" podStartSLOduration=67.461430903 podStartE2EDuration="1m25.412431507s" totalImagesPullingTime="17.951000604s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:09:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:11:07.409467597 +0000 UTC m=+86.023647915" watchObservedRunningTime="2026-07-16 21:11:07.412431507 +0000 UTC m=+86.026611824"
Jul 16 21:11:07.974057 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:07.974017    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf" path="/var/lib/kubelet/pods/8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf/volumes"
Jul 16 21:11:13.412028 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:13.411984    2579 generic.go:356] "Generic (PLEG): container finished" podID="e8d74520-7b5c-4b63-88c9-1f53d4b9232d" containerID="7783ace4aef9e39a5f7a6a32b6929c475a9e8093daef055a3892f44b98f14f77" exitCode=0
Jul 16 21:11:13.412566 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:13.412032    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e8d74520-7b5c-4b63-88c9-1f53d4b9232d","Type":"ContainerDied","Data":"7783ace4aef9e39a5f7a6a32b6929c475a9e8093daef055a3892f44b98f14f77"}
Jul 16 21:11:13.414277 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:13.414242    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-74pf6" event={"ID":"961b693a-6897-4204-a5cc-1c1c80f06693","Type":"ContainerStarted","Data":"a10119adfd8ae074da9c0f7989e3602fbc1ab5bd8a836656286e86647d4e5356"}
Jul 16 21:11:13.416163 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:13.416138    2579 generic.go:356] "Generic (PLEG): container finished" podID="8483a35d-1351-40fe-a74f-8defef056a52" containerID="b5233a9dda0b525dd88810aca3ef374897a24eef1a185f98c3b7dd46049cdc78" exitCode=0
Jul 16 21:11:13.416261 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:13.416221    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vskpk" event={"ID":"8483a35d-1351-40fe-a74f-8defef056a52","Type":"ContainerDied","Data":"b5233a9dda0b525dd88810aca3ef374897a24eef1a185f98c3b7dd46049cdc78"}
Jul 16 21:11:13.418824 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:13.418785    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-654bf8fb59-lrqj4" event={"ID":"74c9eeb2-f65d-403a-9d99-e8745bfb19c8","Type":"ContainerStarted","Data":"340b532da4add4505df79339339ea34abe1b9ecfc89869a23085b56ac240946f"}
Jul 16 21:11:13.418925 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:13.418857    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-654bf8fb59-lrqj4" event={"ID":"74c9eeb2-f65d-403a-9d99-e8745bfb19c8","Type":"ContainerStarted","Data":"5e9f392ccce073be56dca7afe326f0daec8a61ff992f0017a98e21a6ddfd2087"}
Jul 16 21:11:13.418925 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:13.418887    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-654bf8fb59-lrqj4" event={"ID":"74c9eeb2-f65d-403a-9d99-e8745bfb19c8","Type":"ContainerStarted","Data":"fb091290d1086864357b28e5cff280c9176a89be273d99b6cf0f063971408d1a"}
Jul 16 21:11:14.427710 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:14.427649    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vskpk" event={"ID":"8483a35d-1351-40fe-a74f-8defef056a52","Type":"ContainerStarted","Data":"1e5bc37d0b80e2caaa41d6ed7df6f41f1ad2bed1bbe02f559e4228352885d88a"}
Jul 16 21:11:14.427710 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:14.427714    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vskpk" event={"ID":"8483a35d-1351-40fe-a74f-8defef056a52","Type":"ContainerStarted","Data":"74ce2e40b168c04f46081f615baa367135913277edcf445a42965a714a66b7d9"}
Jul 16 21:11:15.440413 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:15.440371    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-654bf8fb59-lrqj4" event={"ID":"74c9eeb2-f65d-403a-9d99-e8745bfb19c8","Type":"ContainerStarted","Data":"e76af3735c6769dc13fb59f5d5976616207265612bae9a5f156abc2d7e2b1fe5"}
Jul 16 21:11:15.440889 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:15.440486    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-654bf8fb59-lrqj4" event={"ID":"74c9eeb2-f65d-403a-9d99-e8745bfb19c8","Type":"ContainerStarted","Data":"87946b4f86797f6665e71fe5819100a7c284466c9096596cfd85f2ccc68721db"}
Jul 16 21:11:15.440889 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:15.440519    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-654bf8fb59-lrqj4" event={"ID":"74c9eeb2-f65d-403a-9d99-e8745bfb19c8","Type":"ContainerStarted","Data":"d72f8c1a993c280cf96135e1f79b8c31dd6c08de2ef69564ac48672701731218"}
Jul 16 21:11:15.471160 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:15.471109    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-654bf8fb59-lrqj4" podStartSLOduration=12.499880513 podStartE2EDuration="20.471081113s" totalImagesPullingTime="7.9712006s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:10:55 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:11:15.469532556 +0000 UTC m=+94.083712872" watchObservedRunningTime="2026-07-16 21:11:15.471081113 +0000 UTC m=+94.085261427"
Jul 16 21:11:15.471389 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:15.471359    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-vskpk" podStartSLOduration=16.905873827 podStartE2EDuration="23.471351014s" totalImagesPullingTime="6.461436979s" totalInitContainerRuntime="104.040208ms" isStatefulPod=true podCreationTimestamp="2026-07-16 21:10:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:11:14.460033141 +0000 UTC m=+93.074213474" watchObservedRunningTime="2026-07-16 21:11:15.471351014 +0000 UTC m=+94.085531352"
Jul 16 21:11:16.446070 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:16.446039    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-654bf8fb59-lrqj4"
Jul 16 21:11:17.457118 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:17.457005    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-654bf8fb59-lrqj4"
Jul 16 21:11:19.459911 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:19.459885    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e8d74520-7b5c-4b63-88c9-1f53d4b9232d","Type":"ContainerStarted","Data":"a6734c24578c56ace9ec7979ce15578adf305eff56d868954b7be58a2df29f55"}
Jul 16 21:11:19.460323 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:19.460001    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e8d74520-7b5c-4b63-88c9-1f53d4b9232d","Type":"ContainerStarted","Data":"9514e684957cfda8e3434bfe6c254cdfaefb7739ab35eee0a2a7c555e71b01c3"}
Jul 16 21:11:19.461974 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:19.461940    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-74pf6" event={"ID":"961b693a-6897-4204-a5cc-1c1c80f06693","Type":"ContainerStarted","Data":"0227f354bf4fc75b24718abb29e50e6c6dd7030e4d6c294a490364991f246bb5"}
Jul 16 21:11:19.486400 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:19.486336    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-74pf6" podStartSLOduration=33.167959031 podStartE2EDuration="1m3.486317338s" totalImagesPullingTime="30.318358307s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:10:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:11:19.485009816 +0000 UTC m=+98.099190134" watchObservedRunningTime="2026-07-16 21:11:19.486317338 +0000 UTC m=+98.100497655"
Jul 16 21:11:20.468803 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:20.468767    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e8d74520-7b5c-4b63-88c9-1f53d4b9232d","Type":"ContainerStarted","Data":"1f0dcb424cf6610f62de46cdce659b9974b8f1403a4ad5ef90743483531ceed6"}
Jul 16 21:11:20.469303 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:20.468848    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e8d74520-7b5c-4b63-88c9-1f53d4b9232d","Type":"ContainerStarted","Data":"66f3bb79ce342b13ad40e8a5500e66edb7c71f0f94b313210b18f1d9743d6184"}
Jul 16 21:11:20.469303 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:20.468889    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e8d74520-7b5c-4b63-88c9-1f53d4b9232d","Type":"ContainerStarted","Data":"498b070bdd54b568cf13ecc2f7f0b2c80945d49437defedb3464145e21b93583"}
Jul 16 21:11:20.469303 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:20.468935    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e8d74520-7b5c-4b63-88c9-1f53d4b9232d","Type":"ContainerStarted","Data":"175d70fb898f28bac1f6bdc23d289ffa2ae86b5ed388bed6be805acd3eeeeb4b"}
Jul 16 21:11:20.504932 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:20.504875    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=10.307524279999999 podStartE2EDuration="22.504855292s" totalImagesPullingTime="12.175694795s" totalInitContainerRuntime="21.636217ms" isStatefulPod=false podCreationTimestamp="2026-07-16 21:10:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:11:20.503472706 +0000 UTC m=+99.117653044" watchObservedRunningTime="2026-07-16 21:11:20.504855292 +0000 UTC m=+99.119035608"
Jul 16 21:11:24.127951 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:24.127912    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:11:31.387423 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:31.387370    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5f487b55f6-vlr7j" podUID="03991db4-1111-430b-a3db-2da9e5e7d23b" containerName="console" containerID="cri-o://a9b0b89d52dc4399ac91e2c14ce3bfd876c6efbfb55e8667ff0576cbce933f3c" gracePeriod=15
Jul 16 21:11:31.507518 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:31.507494    2579 generic.go:356] "Generic (PLEG): container finished" podID="03991db4-1111-430b-a3db-2da9e5e7d23b" containerID="a9b0b89d52dc4399ac91e2c14ce3bfd876c6efbfb55e8667ff0576cbce933f3c" exitCode=0
Jul 16 21:11:31.507576 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:31.507550    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f487b55f6-vlr7j" event={"ID":"03991db4-1111-430b-a3db-2da9e5e7d23b","Type":"ContainerDied","Data":"a9b0b89d52dc4399ac91e2c14ce3bfd876c6efbfb55e8667ff0576cbce933f3c"}
Jul 16 21:11:31.642654 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:31.642589    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f487b55f6-vlr7j"
Jul 16 21:11:31.690080 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:31.690055    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/03991db4-1111-430b-a3db-2da9e5e7d23b-service-ca\") pod \"03991db4-1111-430b-a3db-2da9e5e7d23b\" (UID: \"03991db4-1111-430b-a3db-2da9e5e7d23b\") "
Jul 16 21:11:31.690219 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:31.690122    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/03991db4-1111-430b-a3db-2da9e5e7d23b-console-config\") pod \"03991db4-1111-430b-a3db-2da9e5e7d23b\" (UID: \"03991db4-1111-430b-a3db-2da9e5e7d23b\") "
Jul 16 21:11:31.690260 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:31.690242    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/03991db4-1111-430b-a3db-2da9e5e7d23b-oauth-serving-cert\") pod \"03991db4-1111-430b-a3db-2da9e5e7d23b\" (UID: \"03991db4-1111-430b-a3db-2da9e5e7d23b\") "
Jul 16 21:11:31.690321 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:31.690306    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/03991db4-1111-430b-a3db-2da9e5e7d23b-console-serving-cert\") pod \"03991db4-1111-430b-a3db-2da9e5e7d23b\" (UID: \"03991db4-1111-430b-a3db-2da9e5e7d23b\") "
Jul 16 21:11:31.690368 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:31.690346    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/03991db4-1111-430b-a3db-2da9e5e7d23b-console-oauth-config\") pod \"03991db4-1111-430b-a3db-2da9e5e7d23b\" (UID: \"03991db4-1111-430b-a3db-2da9e5e7d23b\") "
Jul 16 21:11:31.690412 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:31.690377    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qqvq5\" (UniqueName: \"kubernetes.io/projected/03991db4-1111-430b-a3db-2da9e5e7d23b-kube-api-access-qqvq5\") pod \"03991db4-1111-430b-a3db-2da9e5e7d23b\" (UID: \"03991db4-1111-430b-a3db-2da9e5e7d23b\") "
Jul 16 21:11:31.690560 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:31.690525    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03991db4-1111-430b-a3db-2da9e5e7d23b-console-config" (OuterVolumeSpecName: "console-config") pod "03991db4-1111-430b-a3db-2da9e5e7d23b" (UID: "03991db4-1111-430b-a3db-2da9e5e7d23b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 21:11:31.690560 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:31.690546    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03991db4-1111-430b-a3db-2da9e5e7d23b-service-ca" (OuterVolumeSpecName: "service-ca") pod "03991db4-1111-430b-a3db-2da9e5e7d23b" (UID: "03991db4-1111-430b-a3db-2da9e5e7d23b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 21:11:31.690736 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:31.690632    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03991db4-1111-430b-a3db-2da9e5e7d23b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "03991db4-1111-430b-a3db-2da9e5e7d23b" (UID: "03991db4-1111-430b-a3db-2da9e5e7d23b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 21:11:31.690736 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:31.690693    2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/03991db4-1111-430b-a3db-2da9e5e7d23b-service-ca\") on node \"ip-10-0-133-58.ec2.internal\" DevicePath \"\""
Jul 16 21:11:31.690736 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:31.690713    2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/03991db4-1111-430b-a3db-2da9e5e7d23b-console-config\") on node \"ip-10-0-133-58.ec2.internal\" DevicePath \"\""
Jul 16 21:11:31.690736 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:31.690727    2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/03991db4-1111-430b-a3db-2da9e5e7d23b-oauth-serving-cert\") on node \"ip-10-0-133-58.ec2.internal\" DevicePath \"\""
Jul 16 21:11:31.692672 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:31.692640    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03991db4-1111-430b-a3db-2da9e5e7d23b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "03991db4-1111-430b-a3db-2da9e5e7d23b" (UID: "03991db4-1111-430b-a3db-2da9e5e7d23b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 21:11:31.692764 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:31.692645    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03991db4-1111-430b-a3db-2da9e5e7d23b-kube-api-access-qqvq5" (OuterVolumeSpecName: "kube-api-access-qqvq5") pod "03991db4-1111-430b-a3db-2da9e5e7d23b" (UID: "03991db4-1111-430b-a3db-2da9e5e7d23b"). InnerVolumeSpecName "kube-api-access-qqvq5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 21:11:31.692764 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:31.692729    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03991db4-1111-430b-a3db-2da9e5e7d23b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "03991db4-1111-430b-a3db-2da9e5e7d23b" (UID: "03991db4-1111-430b-a3db-2da9e5e7d23b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 21:11:31.792045 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:31.792017    2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/03991db4-1111-430b-a3db-2da9e5e7d23b-console-serving-cert\") on node \"ip-10-0-133-58.ec2.internal\" DevicePath \"\""
Jul 16 21:11:31.792045 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:31.792042    2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/03991db4-1111-430b-a3db-2da9e5e7d23b-console-oauth-config\") on node \"ip-10-0-133-58.ec2.internal\" DevicePath \"\""
Jul 16 21:11:31.792209 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:31.792051    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qqvq5\" (UniqueName: \"kubernetes.io/projected/03991db4-1111-430b-a3db-2da9e5e7d23b-kube-api-access-qqvq5\") on node \"ip-10-0-133-58.ec2.internal\" DevicePath \"\""
Jul 16 21:11:32.514113 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:32.514054    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f487b55f6-vlr7j" event={"ID":"03991db4-1111-430b-a3db-2da9e5e7d23b","Type":"ContainerDied","Data":"2333dd44b4790a393a12ec6f22677341ab8ed703d0e0e4aa3c4c8515579c23f1"}
Jul 16 21:11:32.514507 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:32.514135    2579 scope.go:117] "RemoveContainer" containerID="a9b0b89d52dc4399ac91e2c14ce3bfd876c6efbfb55e8667ff0576cbce933f3c"
Jul 16 21:11:32.514507 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:32.514075    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f487b55f6-vlr7j"
Jul 16 21:11:32.541051 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:32.541021    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f487b55f6-vlr7j"]
Jul 16 21:11:32.546670 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:32.546651    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5f487b55f6-vlr7j"]
Jul 16 21:11:33.969938 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:33.969904    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03991db4-1111-430b-a3db-2da9e5e7d23b" path="/var/lib/kubelet/pods/03991db4-1111-430b-a3db-2da9e5e7d23b/volumes"
Jul 16 21:11:37.388721 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:37.388690    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-9mdcw"
Jul 16 21:11:59.128067 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:59.128028    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:11:59.180952 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:59.180925    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:11:59.634905 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:11:59.634879    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:12:17.295639 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:17.295603    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 16 21:12:17.296610 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:17.296545    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e8d74520-7b5c-4b63-88c9-1f53d4b9232d" containerName="prometheus" containerID="cri-o://9514e684957cfda8e3434bfe6c254cdfaefb7739ab35eee0a2a7c555e71b01c3" gracePeriod=600
Jul 16 21:12:17.296746 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:17.296697    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e8d74520-7b5c-4b63-88c9-1f53d4b9232d" containerName="thanos-sidecar" containerID="cri-o://175d70fb898f28bac1f6bdc23d289ffa2ae86b5ed388bed6be805acd3eeeeb4b" gracePeriod=600
Jul 16 21:12:17.296824 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:17.296800    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e8d74520-7b5c-4b63-88c9-1f53d4b9232d" containerName="kube-rbac-proxy-web" containerID="cri-o://498b070bdd54b568cf13ecc2f7f0b2c80945d49437defedb3464145e21b93583" gracePeriod=600
Jul 16 21:12:17.297510 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:17.296776    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e8d74520-7b5c-4b63-88c9-1f53d4b9232d" containerName="config-reloader" containerID="cri-o://a6734c24578c56ace9ec7979ce15578adf305eff56d868954b7be58a2df29f55" gracePeriod=600
Jul 16 21:12:17.297510 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:17.296841    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e8d74520-7b5c-4b63-88c9-1f53d4b9232d" containerName="kube-rbac-proxy-thanos" containerID="cri-o://1f0dcb424cf6610f62de46cdce659b9974b8f1403a4ad5ef90743483531ceed6" gracePeriod=600
Jul 16 21:12:17.297510 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:17.297077    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e8d74520-7b5c-4b63-88c9-1f53d4b9232d" containerName="kube-rbac-proxy" containerID="cri-o://66f3bb79ce342b13ad40e8a5500e66edb7c71f0f94b313210b18f1d9743d6184" gracePeriod=600
Jul 16 21:12:17.687817 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:17.687779    2579 generic.go:356] "Generic (PLEG): container finished" podID="e8d74520-7b5c-4b63-88c9-1f53d4b9232d" containerID="1f0dcb424cf6610f62de46cdce659b9974b8f1403a4ad5ef90743483531ceed6" exitCode=0
Jul 16 21:12:17.687817 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:17.687812    2579 generic.go:356] "Generic (PLEG): container finished" podID="e8d74520-7b5c-4b63-88c9-1f53d4b9232d" containerID="66f3bb79ce342b13ad40e8a5500e66edb7c71f0f94b313210b18f1d9743d6184" exitCode=0
Jul 16 21:12:17.687817 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:17.687811    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e8d74520-7b5c-4b63-88c9-1f53d4b9232d","Type":"ContainerDied","Data":"1f0dcb424cf6610f62de46cdce659b9974b8f1403a4ad5ef90743483531ceed6"}
Jul 16 21:12:17.688135 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:17.687888    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e8d74520-7b5c-4b63-88c9-1f53d4b9232d","Type":"ContainerDied","Data":"66f3bb79ce342b13ad40e8a5500e66edb7c71f0f94b313210b18f1d9743d6184"}
Jul 16 21:12:17.688135 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:17.687821    2579 generic.go:356] "Generic (PLEG): container finished" podID="e8d74520-7b5c-4b63-88c9-1f53d4b9232d" containerID="175d70fb898f28bac1f6bdc23d289ffa2ae86b5ed388bed6be805acd3eeeeb4b" exitCode=0
Jul 16 21:12:17.688135 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:17.687911    2579 generic.go:356] "Generic (PLEG): container finished" podID="e8d74520-7b5c-4b63-88c9-1f53d4b9232d" containerID="a6734c24578c56ace9ec7979ce15578adf305eff56d868954b7be58a2df29f55" exitCode=0
Jul 16 21:12:17.688135 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:17.687916    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e8d74520-7b5c-4b63-88c9-1f53d4b9232d","Type":"ContainerDied","Data":"175d70fb898f28bac1f6bdc23d289ffa2ae86b5ed388bed6be805acd3eeeeb4b"}
Jul 16 21:12:17.688135 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:17.687954    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e8d74520-7b5c-4b63-88c9-1f53d4b9232d","Type":"ContainerDied","Data":"a6734c24578c56ace9ec7979ce15578adf305eff56d868954b7be58a2df29f55"}
Jul 16 21:12:17.688135 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:17.687979    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e8d74520-7b5c-4b63-88c9-1f53d4b9232d","Type":"ContainerDied","Data":"9514e684957cfda8e3434bfe6c254cdfaefb7739ab35eee0a2a7c555e71b01c3"}
Jul 16 21:12:17.688135 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:17.687917    2579 generic.go:356] "Generic (PLEG): container finished" podID="e8d74520-7b5c-4b63-88c9-1f53d4b9232d" containerID="9514e684957cfda8e3434bfe6c254cdfaefb7739ab35eee0a2a7c555e71b01c3" exitCode=0
Jul 16 21:12:18.565435 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.565415    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:12:18.664582 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.664549    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-configmap-kubelet-serving-ca-bundle\") pod \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") "
Jul 16 21:12:18.664753 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.664602    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-prometheus-k8s-rulefiles-2\") pod \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") "
Jul 16 21:12:18.664753 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.664636    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-prometheus-trusted-ca-bundle\") pod \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") "
Jul 16 21:12:18.664753 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.664661    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") "
Jul 16 21:12:18.664753 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.664684    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-secret-metrics-client-certs\") pod \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") "
Jul 16 21:12:18.664753 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.664712    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-prometheus-k8s-db\") pod \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") "
Jul 16 21:12:18.664753 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.664732    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-config-out\") pod \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") "
Jul 16 21:12:18.665058 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.664759    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-tls-assets\") pod \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") "
Jul 16 21:12:18.665058 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.664785    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-web-config\") pod \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") "
Jul 16 21:12:18.665058 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.664814    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mzkcw\" (UniqueName: \"kubernetes.io/projected/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-kube-api-access-mzkcw\") pod \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") "
Jul 16 21:12:18.665058 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.664842    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-config\") pod \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") "
Jul 16 21:12:18.665058 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.664872    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-secret-grpc-tls\") pod \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") "
Jul 16 21:12:18.665058 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.664900    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-secret-prometheus-k8s-tls\") pod \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") "
Jul 16 21:12:18.665058 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.664942    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-thanos-prometheus-http-client-file\") pod \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") "
Jul 16 21:12:18.665058 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.664938    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "e8d74520-7b5c-4b63-88c9-1f53d4b9232d" (UID: "e8d74520-7b5c-4b63-88c9-1f53d4b9232d"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 21:12:18.665058 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.664969    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-secret-kube-rbac-proxy\") pod \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") "
Jul 16 21:12:18.665058 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.664974    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "e8d74520-7b5c-4b63-88c9-1f53d4b9232d" (UID: "e8d74520-7b5c-4b63-88c9-1f53d4b9232d"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 21:12:18.665058 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.664997    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-configmap-serving-certs-ca-bundle\") pod \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") "
Jul 16 21:12:18.665058 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.665043    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-prometheus-k8s-rulefiles-1\") pod \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") "
Jul 16 21:12:18.666012 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.665067    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-configmap-metrics-client-ca\") pod \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") "
Jul 16 21:12:18.666012 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.665120    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-prometheus-k8s-rulefiles-0\") pod \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") "
Jul 16 21:12:18.666012 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.665160    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "e8d74520-7b5c-4b63-88c9-1f53d4b9232d" (UID: "e8d74520-7b5c-4b63-88c9-1f53d4b9232d"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 21:12:18.666012 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.665176    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\" (UID: \"e8d74520-7b5c-4b63-88c9-1f53d4b9232d\") "
Jul 16 21:12:18.666012 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.665391    2579 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-133-58.ec2.internal\" DevicePath \"\""
Jul 16 21:12:18.666012 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.665408    2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-133-58.ec2.internal\" DevicePath \"\""
Jul 16 21:12:18.666012 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.665422    2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-prometheus-trusted-ca-bundle\") on node \"ip-10-0-133-58.ec2.internal\" DevicePath \"\""
Jul 16 21:12:18.666012 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.665887    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "e8d74520-7b5c-4b63-88c9-1f53d4b9232d" (UID: "e8d74520-7b5c-4b63-88c9-1f53d4b9232d"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 21:12:18.666012 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.665931    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "e8d74520-7b5c-4b63-88c9-1f53d4b9232d" (UID: "e8d74520-7b5c-4b63-88c9-1f53d4b9232d"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 21:12:18.666502 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.666238    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "e8d74520-7b5c-4b63-88c9-1f53d4b9232d" (UID: "e8d74520-7b5c-4b63-88c9-1f53d4b9232d"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 21:12:18.666502 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.666475    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "e8d74520-7b5c-4b63-88c9-1f53d4b9232d" (UID: "e8d74520-7b5c-4b63-88c9-1f53d4b9232d"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 21:12:18.667920 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.667687    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "e8d74520-7b5c-4b63-88c9-1f53d4b9232d" (UID: "e8d74520-7b5c-4b63-88c9-1f53d4b9232d"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 21:12:18.667920 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.668343    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "e8d74520-7b5c-4b63-88c9-1f53d4b9232d" (UID: "e8d74520-7b5c-4b63-88c9-1f53d4b9232d"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 21:12:18.667920 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.668508    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "e8d74520-7b5c-4b63-88c9-1f53d4b9232d" (UID: "e8d74520-7b5c-4b63-88c9-1f53d4b9232d"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 21:12:18.669462 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.669435    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "e8d74520-7b5c-4b63-88c9-1f53d4b9232d" (UID: "e8d74520-7b5c-4b63-88c9-1f53d4b9232d"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 21:12:18.670109 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.670064    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "e8d74520-7b5c-4b63-88c9-1f53d4b9232d" (UID: "e8d74520-7b5c-4b63-88c9-1f53d4b9232d"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 21:12:18.670181 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.670144    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "e8d74520-7b5c-4b63-88c9-1f53d4b9232d" (UID: "e8d74520-7b5c-4b63-88c9-1f53d4b9232d"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 21:12:18.670243 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.670219    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-kube-api-access-mzkcw" (OuterVolumeSpecName: "kube-api-access-mzkcw") pod "e8d74520-7b5c-4b63-88c9-1f53d4b9232d" (UID: "e8d74520-7b5c-4b63-88c9-1f53d4b9232d"). InnerVolumeSpecName "kube-api-access-mzkcw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 21:12:18.670318 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.670300    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "e8d74520-7b5c-4b63-88c9-1f53d4b9232d" (UID: "e8d74520-7b5c-4b63-88c9-1f53d4b9232d"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 21:12:18.670428 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.670401    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-config" (OuterVolumeSpecName: "config") pod "e8d74520-7b5c-4b63-88c9-1f53d4b9232d" (UID: "e8d74520-7b5c-4b63-88c9-1f53d4b9232d"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 21:12:18.670548 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.670504    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "e8d74520-7b5c-4b63-88c9-1f53d4b9232d" (UID: "e8d74520-7b5c-4b63-88c9-1f53d4b9232d"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 21:12:18.670611 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.670579    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "e8d74520-7b5c-4b63-88c9-1f53d4b9232d" (UID: "e8d74520-7b5c-4b63-88c9-1f53d4b9232d"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 21:12:18.670758 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.670743    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-config-out" (OuterVolumeSpecName: "config-out") pod "e8d74520-7b5c-4b63-88c9-1f53d4b9232d" (UID: "e8d74520-7b5c-4b63-88c9-1f53d4b9232d"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 21:12:18.679923 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.679901    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-web-config" (OuterVolumeSpecName: "web-config") pod "e8d74520-7b5c-4b63-88c9-1f53d4b9232d" (UID: "e8d74520-7b5c-4b63-88c9-1f53d4b9232d"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 21:12:18.695383 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.695360    2579 generic.go:356] "Generic (PLEG): container finished" podID="e8d74520-7b5c-4b63-88c9-1f53d4b9232d" containerID="498b070bdd54b568cf13ecc2f7f0b2c80945d49437defedb3464145e21b93583" exitCode=0
Jul 16 21:12:18.695507 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.695443    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e8d74520-7b5c-4b63-88c9-1f53d4b9232d","Type":"ContainerDied","Data":"498b070bdd54b568cf13ecc2f7f0b2c80945d49437defedb3464145e21b93583"}
Jul 16 21:12:18.695507 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.695456    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:12:18.695619 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.695513    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e8d74520-7b5c-4b63-88c9-1f53d4b9232d","Type":"ContainerDied","Data":"023300ee348a102cd2052708535824c0ede73b38fbd7d3444ee216fa16b8e3f0"}
Jul 16 21:12:18.695619 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.695545    2579 scope.go:117] "RemoveContainer" containerID="1f0dcb424cf6610f62de46cdce659b9974b8f1403a4ad5ef90743483531ceed6"
Jul 16 21:12:18.702682 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.702665    2579 scope.go:117] "RemoveContainer" containerID="66f3bb79ce342b13ad40e8a5500e66edb7c71f0f94b313210b18f1d9743d6184"
Jul 16 21:12:18.712599 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.710367    2579 scope.go:117] "RemoveContainer" containerID="498b070bdd54b568cf13ecc2f7f0b2c80945d49437defedb3464145e21b93583"
Jul 16 21:12:18.718241 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.718219    2579 scope.go:117] "RemoveContainer" containerID="175d70fb898f28bac1f6bdc23d289ffa2ae86b5ed388bed6be805acd3eeeeb4b"
Jul 16 21:12:18.725234 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.724606    2579 scope.go:117] "RemoveContainer" containerID="a6734c24578c56ace9ec7979ce15578adf305eff56d868954b7be58a2df29f55"
Jul 16 21:12:18.726851 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.726828    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 16 21:12:18.731901 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.731880    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 16 21:12:18.732275 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.732260    2579 scope.go:117] "RemoveContainer" containerID="9514e684957cfda8e3434bfe6c254cdfaefb7739ab35eee0a2a7c555e71b01c3"
Jul 16 21:12:18.739080 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.739065    2579 scope.go:117] "RemoveContainer" containerID="7783ace4aef9e39a5f7a6a32b6929c475a9e8093daef055a3892f44b98f14f77"
Jul 16 21:12:18.745385 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.745368    2579 scope.go:117] "RemoveContainer" containerID="1f0dcb424cf6610f62de46cdce659b9974b8f1403a4ad5ef90743483531ceed6"
Jul 16 21:12:18.745645 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:12:18.745622    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f0dcb424cf6610f62de46cdce659b9974b8f1403a4ad5ef90743483531ceed6\": container with ID starting with 1f0dcb424cf6610f62de46cdce659b9974b8f1403a4ad5ef90743483531ceed6 not found: ID does not exist" containerID="1f0dcb424cf6610f62de46cdce659b9974b8f1403a4ad5ef90743483531ceed6"
Jul 16 21:12:18.745685 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.745654    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f0dcb424cf6610f62de46cdce659b9974b8f1403a4ad5ef90743483531ceed6"} err="failed to get container status \"1f0dcb424cf6610f62de46cdce659b9974b8f1403a4ad5ef90743483531ceed6\": rpc error: code = NotFound desc = could not find container \"1f0dcb424cf6610f62de46cdce659b9974b8f1403a4ad5ef90743483531ceed6\": container with ID starting with 1f0dcb424cf6610f62de46cdce659b9974b8f1403a4ad5ef90743483531ceed6 not found: ID does not exist"
Jul 16 21:12:18.745728 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.745686    2579 scope.go:117] "RemoveContainer" containerID="66f3bb79ce342b13ad40e8a5500e66edb7c71f0f94b313210b18f1d9743d6184"
Jul 16 21:12:18.745923 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:12:18.745905    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66f3bb79ce342b13ad40e8a5500e66edb7c71f0f94b313210b18f1d9743d6184\": container with ID starting with 66f3bb79ce342b13ad40e8a5500e66edb7c71f0f94b313210b18f1d9743d6184 not found: ID does not exist" containerID="66f3bb79ce342b13ad40e8a5500e66edb7c71f0f94b313210b18f1d9743d6184"
Jul 16 21:12:18.745962 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.745929    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66f3bb79ce342b13ad40e8a5500e66edb7c71f0f94b313210b18f1d9743d6184"} err="failed to get container status \"66f3bb79ce342b13ad40e8a5500e66edb7c71f0f94b313210b18f1d9743d6184\": rpc error: code = NotFound desc = could not find container \"66f3bb79ce342b13ad40e8a5500e66edb7c71f0f94b313210b18f1d9743d6184\": container with ID starting with 66f3bb79ce342b13ad40e8a5500e66edb7c71f0f94b313210b18f1d9743d6184 not found: ID does not exist"
Jul 16 21:12:18.745962 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.745945    2579 scope.go:117] "RemoveContainer" containerID="498b070bdd54b568cf13ecc2f7f0b2c80945d49437defedb3464145e21b93583"
Jul 16 21:12:18.746160 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:12:18.746144    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"498b070bdd54b568cf13ecc2f7f0b2c80945d49437defedb3464145e21b93583\": container with ID starting with 498b070bdd54b568cf13ecc2f7f0b2c80945d49437defedb3464145e21b93583 not found: ID does not exist" containerID="498b070bdd54b568cf13ecc2f7f0b2c80945d49437defedb3464145e21b93583"
Jul 16 21:12:18.746208 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.746164    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"498b070bdd54b568cf13ecc2f7f0b2c80945d49437defedb3464145e21b93583"} err="failed to get container status \"498b070bdd54b568cf13ecc2f7f0b2c80945d49437defedb3464145e21b93583\": rpc error: code = NotFound desc = could not find container \"498b070bdd54b568cf13ecc2f7f0b2c80945d49437defedb3464145e21b93583\": container with ID starting with 498b070bdd54b568cf13ecc2f7f0b2c80945d49437defedb3464145e21b93583 not found: ID does not exist"
Jul 16 21:12:18.746208 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.746177    2579 scope.go:117] "RemoveContainer" containerID="175d70fb898f28bac1f6bdc23d289ffa2ae86b5ed388bed6be805acd3eeeeb4b"
Jul 16 21:12:18.746408 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:12:18.746392    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"175d70fb898f28bac1f6bdc23d289ffa2ae86b5ed388bed6be805acd3eeeeb4b\": container with ID starting with 175d70fb898f28bac1f6bdc23d289ffa2ae86b5ed388bed6be805acd3eeeeb4b not found: ID does not exist" containerID="175d70fb898f28bac1f6bdc23d289ffa2ae86b5ed388bed6be805acd3eeeeb4b"
Jul 16 21:12:18.746453 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.746412    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"175d70fb898f28bac1f6bdc23d289ffa2ae86b5ed388bed6be805acd3eeeeb4b"} err="failed to get container status \"175d70fb898f28bac1f6bdc23d289ffa2ae86b5ed388bed6be805acd3eeeeb4b\": rpc error: code = NotFound desc = could not find container \"175d70fb898f28bac1f6bdc23d289ffa2ae86b5ed388bed6be805acd3eeeeb4b\": container with ID starting with 175d70fb898f28bac1f6bdc23d289ffa2ae86b5ed388bed6be805acd3eeeeb4b not found: ID does not exist"
Jul 16 21:12:18.746453 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.746426    2579 scope.go:117] "RemoveContainer" containerID="a6734c24578c56ace9ec7979ce15578adf305eff56d868954b7be58a2df29f55"
Jul 16 21:12:18.746624 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:12:18.746610    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6734c24578c56ace9ec7979ce15578adf305eff56d868954b7be58a2df29f55\": container with ID starting with a6734c24578c56ace9ec7979ce15578adf305eff56d868954b7be58a2df29f55 not found: ID does not exist" containerID="a6734c24578c56ace9ec7979ce15578adf305eff56d868954b7be58a2df29f55"
Jul 16 21:12:18.746662 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.746627    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6734c24578c56ace9ec7979ce15578adf305eff56d868954b7be58a2df29f55"} err="failed to get container status \"a6734c24578c56ace9ec7979ce15578adf305eff56d868954b7be58a2df29f55\": rpc error: code = NotFound desc = could not find container \"a6734c24578c56ace9ec7979ce15578adf305eff56d868954b7be58a2df29f55\": container with ID starting with a6734c24578c56ace9ec7979ce15578adf305eff56d868954b7be58a2df29f55 not found: ID does not exist"
Jul 16 21:12:18.746662 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.746640    2579 scope.go:117] "RemoveContainer" containerID="9514e684957cfda8e3434bfe6c254cdfaefb7739ab35eee0a2a7c555e71b01c3"
Jul 16 21:12:18.746852 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:12:18.746836    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9514e684957cfda8e3434bfe6c254cdfaefb7739ab35eee0a2a7c555e71b01c3\": container with ID starting with 9514e684957cfda8e3434bfe6c254cdfaefb7739ab35eee0a2a7c555e71b01c3 not found: ID does not exist" containerID="9514e684957cfda8e3434bfe6c254cdfaefb7739ab35eee0a2a7c555e71b01c3"
Jul 16 21:12:18.746898 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.746856    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9514e684957cfda8e3434bfe6c254cdfaefb7739ab35eee0a2a7c555e71b01c3"} err="failed to get container status \"9514e684957cfda8e3434bfe6c254cdfaefb7739ab35eee0a2a7c555e71b01c3\": rpc error: code = NotFound desc = could not find container \"9514e684957cfda8e3434bfe6c254cdfaefb7739ab35eee0a2a7c555e71b01c3\": container with ID starting with 9514e684957cfda8e3434bfe6c254cdfaefb7739ab35eee0a2a7c555e71b01c3 not found: ID does not exist"
Jul 16 21:12:18.746898 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.746869    2579 scope.go:117] "RemoveContainer" containerID="7783ace4aef9e39a5f7a6a32b6929c475a9e8093daef055a3892f44b98f14f77"
Jul 16 21:12:18.747055 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:12:18.747041    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7783ace4aef9e39a5f7a6a32b6929c475a9e8093daef055a3892f44b98f14f77\": container with ID starting with 7783ace4aef9e39a5f7a6a32b6929c475a9e8093daef055a3892f44b98f14f77 not found: ID does not exist" containerID="7783ace4aef9e39a5f7a6a32b6929c475a9e8093daef055a3892f44b98f14f77"
Jul 16 21:12:18.747111 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.747055    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7783ace4aef9e39a5f7a6a32b6929c475a9e8093daef055a3892f44b98f14f77"} err="failed to get container status \"7783ace4aef9e39a5f7a6a32b6929c475a9e8093daef055a3892f44b98f14f77\": rpc error: code = NotFound desc = could not find container \"7783ace4aef9e39a5f7a6a32b6929c475a9e8093daef055a3892f44b98f14f77\": container with ID starting with 7783ace4aef9e39a5f7a6a32b6929c475a9e8093daef055a3892f44b98f14f77 not found: ID does not exist"
Jul 16 21:12:18.766469 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.766436    2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-133-58.ec2.internal\" DevicePath \"\""
Jul 16 21:12:18.766469 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.766464    2579 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-secret-metrics-client-certs\") on node \"ip-10-0-133-58.ec2.internal\" DevicePath \"\""
Jul 16 21:12:18.766469 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.766475    2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-prometheus-k8s-db\") on node \"ip-10-0-133-58.ec2.internal\" DevicePath \"\""
Jul 16 21:12:18.766665 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.766485    2579 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-config-out\") on node \"ip-10-0-133-58.ec2.internal\" DevicePath \"\""
Jul 16 21:12:18.766665 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.766517    2579 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-tls-assets\") on node \"ip-10-0-133-58.ec2.internal\" DevicePath \"\""
Jul 16 21:12:18.766665 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.766526    2579 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-web-config\") on node \"ip-10-0-133-58.ec2.internal\" DevicePath \"\""
Jul 16 21:12:18.766665 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.766533    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mzkcw\" (UniqueName: \"kubernetes.io/projected/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-kube-api-access-mzkcw\") on node \"ip-10-0-133-58.ec2.internal\" DevicePath \"\""
Jul 16 21:12:18.766665 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.766542    2579 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-config\") on node \"ip-10-0-133-58.ec2.internal\" DevicePath \"\""
Jul 16 21:12:18.766665 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.766550    2579 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-secret-grpc-tls\") on node \"ip-10-0-133-58.ec2.internal\" DevicePath \"\""
Jul 16 21:12:18.766665 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.766559    2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-secret-prometheus-k8s-tls\") on node \"ip-10-0-133-58.ec2.internal\" DevicePath \"\""
Jul 16 21:12:18.766665 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.766567    2579 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-thanos-prometheus-http-client-file\") on node \"ip-10-0-133-58.ec2.internal\" DevicePath \"\""
Jul 16 21:12:18.766665 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.766576    2579 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-secret-kube-rbac-proxy\") on node \"ip-10-0-133-58.ec2.internal\" DevicePath \"\""
Jul 16 21:12:18.766665 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.766585    2579 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-133-58.ec2.internal\" DevicePath \"\""
Jul 16 21:12:18.766665 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.766595    2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-133-58.ec2.internal\" DevicePath \"\""
Jul 16 21:12:18.766665 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.766603    2579 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-configmap-metrics-client-ca\") on node \"ip-10-0-133-58.ec2.internal\" DevicePath \"\""
Jul 16 21:12:18.766665 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.766612    2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-133-58.ec2.internal\" DevicePath \"\""
Jul 16 21:12:18.766665 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.766620    2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e8d74520-7b5c-4b63-88c9-1f53d4b9232d-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-133-58.ec2.internal\" DevicePath \"\""
Jul 16 21:12:18.773755 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.773730    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 16 21:12:18.774002 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.773991    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8d74520-7b5c-4b63-88c9-1f53d4b9232d" containerName="init-config-reloader"
Jul 16 21:12:18.774044 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.774004    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8d74520-7b5c-4b63-88c9-1f53d4b9232d" containerName="init-config-reloader"
Jul 16 21:12:18.774044 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.774014    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03991db4-1111-430b-a3db-2da9e5e7d23b" containerName="console"
Jul 16 21:12:18.774044 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.774020    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="03991db4-1111-430b-a3db-2da9e5e7d23b" containerName="console"
Jul 16 21:12:18.774044 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.774031    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8d74520-7b5c-4b63-88c9-1f53d4b9232d" containerName="thanos-sidecar"
Jul 16 21:12:18.774044 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.774036    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8d74520-7b5c-4b63-88c9-1f53d4b9232d" containerName="thanos-sidecar"
Jul 16 21:12:18.774044 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.774043    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8d74520-7b5c-4b63-88c9-1f53d4b9232d" containerName="kube-rbac-proxy"
Jul 16 21:12:18.774233 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.774048    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8d74520-7b5c-4b63-88c9-1f53d4b9232d" containerName="kube-rbac-proxy"
Jul 16 21:12:18.774233 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.774058    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf" containerName="registry"
Jul 16 21:12:18.774233 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.774064    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf" containerName="registry"
Jul 16 21:12:18.774233 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.774072    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8d74520-7b5c-4b63-88c9-1f53d4b9232d" containerName="prometheus"
Jul 16 21:12:18.774233 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.774077    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8d74520-7b5c-4b63-88c9-1f53d4b9232d" containerName="prometheus"
Jul 16 21:12:18.774233 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.774084    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8d74520-7b5c-4b63-88c9-1f53d4b9232d" containerName="config-reloader"
Jul 16 21:12:18.774233 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.774089    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8d74520-7b5c-4b63-88c9-1f53d4b9232d" containerName="config-reloader"
Jul 16 21:12:18.774233 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.774109    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8d74520-7b5c-4b63-88c9-1f53d4b9232d" containerName="kube-rbac-proxy-web"
Jul 16 21:12:18.774233 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.774116    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8d74520-7b5c-4b63-88c9-1f53d4b9232d" containerName="kube-rbac-proxy-web"
Jul 16 21:12:18.774233 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.774122    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8d74520-7b5c-4b63-88c9-1f53d4b9232d" containerName="kube-rbac-proxy-thanos"
Jul 16 21:12:18.774233 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.774127    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8d74520-7b5c-4b63-88c9-1f53d4b9232d" containerName="kube-rbac-proxy-thanos"
Jul 16 21:12:18.774233 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.774164    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c1df253-a0ea-4d02-80b4-dad5a9f6bfdf" containerName="registry"
Jul 16 21:12:18.774233 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.774172    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8d74520-7b5c-4b63-88c9-1f53d4b9232d" containerName="prometheus"
Jul 16 21:12:18.774233 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.774177    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8d74520-7b5c-4b63-88c9-1f53d4b9232d" containerName="kube-rbac-proxy"
Jul 16 21:12:18.774233 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.774182    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8d74520-7b5c-4b63-88c9-1f53d4b9232d" containerName="kube-rbac-proxy-thanos"
Jul 16 21:12:18.774233 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.774188    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8d74520-7b5c-4b63-88c9-1f53d4b9232d" containerName="config-reloader"
Jul 16 21:12:18.774233 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.774193    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8d74520-7b5c-4b63-88c9-1f53d4b9232d" containerName="thanos-sidecar"
Jul 16 21:12:18.774233 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.774197    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8d74520-7b5c-4b63-88c9-1f53d4b9232d" containerName="kube-rbac-proxy-web"
Jul 16 21:12:18.774233 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.774203    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="03991db4-1111-430b-a3db-2da9e5e7d23b" containerName="console"
Jul 16 21:12:18.778230 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.778210    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:12:18.782426 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.782407    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 16 21:12:18.782528 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.782404    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 16 21:12:18.785324 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.785292    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 16 21:12:18.785594 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.785536    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 16 21:12:18.785594 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.785566    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 16 21:12:18.785749 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.785569    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 16 21:12:18.785749 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.785688    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 16 21:12:18.787074 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.787051    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 16 21:12:18.787074 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.787064    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-5fulfaao09n46\""
Jul 16 21:12:18.787258 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.787134    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 16 21:12:18.787323 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.787263    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-wrkff\""
Jul 16 21:12:18.787770 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.787756    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 16 21:12:18.787840 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.787827    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 16 21:12:18.787870 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.787849    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 16 21:12:18.787870 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.787834    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 16 21:12:18.789192 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.789173    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 16 21:12:18.791057 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.791038    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 16 21:12:18.804599 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.804578    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 16 21:12:18.867112 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.867061    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f220fc93-56fd-4052-bc5b-a174378c6de2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f220fc93-56fd-4052-bc5b-a174378c6de2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:12:18.867112 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.867093    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f220fc93-56fd-4052-bc5b-a174378c6de2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f220fc93-56fd-4052-bc5b-a174378c6de2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:12:18.867313 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.867129    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f220fc93-56fd-4052-bc5b-a174378c6de2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f220fc93-56fd-4052-bc5b-a174378c6de2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:12:18.867313 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.867190    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f220fc93-56fd-4052-bc5b-a174378c6de2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f220fc93-56fd-4052-bc5b-a174378c6de2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:12:18.867313 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.867215    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f220fc93-56fd-4052-bc5b-a174378c6de2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f220fc93-56fd-4052-bc5b-a174378c6de2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:12:18.867313 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.867250    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f220fc93-56fd-4052-bc5b-a174378c6de2-config-out\") pod \"prometheus-k8s-0\" (UID: \"f220fc93-56fd-4052-bc5b-a174378c6de2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:12:18.867313 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.867280    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsmb2\" (UniqueName: \"kubernetes.io/projected/f220fc93-56fd-4052-bc5b-a174378c6de2-kube-api-access-lsmb2\") pod \"prometheus-k8s-0\" (UID: \"f220fc93-56fd-4052-bc5b-a174378c6de2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:12:18.867313 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.867310    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f220fc93-56fd-4052-bc5b-a174378c6de2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f220fc93-56fd-4052-bc5b-a174378c6de2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:12:18.867534 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.867325    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f220fc93-56fd-4052-bc5b-a174378c6de2-web-config\") pod \"prometheus-k8s-0\" (UID: \"f220fc93-56fd-4052-bc5b-a174378c6de2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:12:18.867534 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.867354    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f220fc93-56fd-4052-bc5b-a174378c6de2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f220fc93-56fd-4052-bc5b-a174378c6de2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:12:18.867534 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.867371    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f220fc93-56fd-4052-bc5b-a174378c6de2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f220fc93-56fd-4052-bc5b-a174378c6de2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:12:18.867534 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.867393    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f220fc93-56fd-4052-bc5b-a174378c6de2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f220fc93-56fd-4052-bc5b-a174378c6de2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:12:18.867534 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.867408    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f220fc93-56fd-4052-bc5b-a174378c6de2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f220fc93-56fd-4052-bc5b-a174378c6de2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:12:18.867534 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.867441    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f220fc93-56fd-4052-bc5b-a174378c6de2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f220fc93-56fd-4052-bc5b-a174378c6de2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:12:18.867534 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.867483    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f220fc93-56fd-4052-bc5b-a174378c6de2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f220fc93-56fd-4052-bc5b-a174378c6de2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:12:18.867534 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.867523    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f220fc93-56fd-4052-bc5b-a174378c6de2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f220fc93-56fd-4052-bc5b-a174378c6de2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:12:18.867828 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.867553    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f220fc93-56fd-4052-bc5b-a174378c6de2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f220fc93-56fd-4052-bc5b-a174378c6de2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:12:18.867828 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.867588    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f220fc93-56fd-4052-bc5b-a174378c6de2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f220fc93-56fd-4052-bc5b-a174378c6de2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:12:18.867828 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.867617    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f220fc93-56fd-4052-bc5b-a174378c6de2-config\") pod \"prometheus-k8s-0\" (UID: \"f220fc93-56fd-4052-bc5b-a174378c6de2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:12:18.867828 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.867643    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f220fc93-56fd-4052-bc5b-a174378c6de2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f220fc93-56fd-4052-bc5b-a174378c6de2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:12:18.968655 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.968555    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f220fc93-56fd-4052-bc5b-a174378c6de2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f220fc93-56fd-4052-bc5b-a174378c6de2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:12:18.968655 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.968602    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f220fc93-56fd-4052-bc5b-a174378c6de2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f220fc93-56fd-4052-bc5b-a174378c6de2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:12:18.968655 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.968619    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f220fc93-56fd-4052-bc5b-a174378c6de2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f220fc93-56fd-4052-bc5b-a174378c6de2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:12:18.968655 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.968636    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f220fc93-56fd-4052-bc5b-a174378c6de2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f220fc93-56fd-4052-bc5b-a174378c6de2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:12:18.968655 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.968655    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f220fc93-56fd-4052-bc5b-a174378c6de2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f220fc93-56fd-4052-bc5b-a174378c6de2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:12:18.968655 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.968674    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f220fc93-56fd-4052-bc5b-a174378c6de2-config\") pod \"prometheus-k8s-0\" (UID: \"f220fc93-56fd-4052-bc5b-a174378c6de2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:12:18.969048 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.968690    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f220fc93-56fd-4052-bc5b-a174378c6de2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f220fc93-56fd-4052-bc5b-a174378c6de2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:12:18.969048 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.968712    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f220fc93-56fd-4052-bc5b-a174378c6de2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f220fc93-56fd-4052-bc5b-a174378c6de2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:12:18.969048 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.968736    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f220fc93-56fd-4052-bc5b-a174378c6de2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f220fc93-56fd-4052-bc5b-a174378c6de2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:12:18.969048 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.968762    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f220fc93-56fd-4052-bc5b-a174378c6de2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f220fc93-56fd-4052-bc5b-a174378c6de2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:12:18.969048 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.968790    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f220fc93-56fd-4052-bc5b-a174378c6de2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f220fc93-56fd-4052-bc5b-a174378c6de2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:12:18.969048 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.968815    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f220fc93-56fd-4052-bc5b-a174378c6de2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f220fc93-56fd-4052-bc5b-a174378c6de2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:12:18.969048 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.968839    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f220fc93-56fd-4052-bc5b-a174378c6de2-config-out\") pod \"prometheus-k8s-0\" (UID: \"f220fc93-56fd-4052-bc5b-a174378c6de2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:12:18.969048 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.968859    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsmb2\" (UniqueName: \"kubernetes.io/projected/f220fc93-56fd-4052-bc5b-a174378c6de2-kube-api-access-lsmb2\") pod \"prometheus-k8s-0\" (UID: \"f220fc93-56fd-4052-bc5b-a174378c6de2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:12:18.969048 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.968893    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f220fc93-56fd-4052-bc5b-a174378c6de2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f220fc93-56fd-4052-bc5b-a174378c6de2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:12:18.969048 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.968913    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f220fc93-56fd-4052-bc5b-a174378c6de2-web-config\") pod \"prometheus-k8s-0\" (UID: \"f220fc93-56fd-4052-bc5b-a174378c6de2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:12:18.969048 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.968943    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f220fc93-56fd-4052-bc5b-a174378c6de2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f220fc93-56fd-4052-bc5b-a174378c6de2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:12:18.969048 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.968969    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f220fc93-56fd-4052-bc5b-a174378c6de2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f220fc93-56fd-4052-bc5b-a174378c6de2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:12:18.969048 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.969003    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f220fc93-56fd-4052-bc5b-a174378c6de2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f220fc93-56fd-4052-bc5b-a174378c6de2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:12:18.969048 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.969029    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f220fc93-56fd-4052-bc5b-a174378c6de2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f220fc93-56fd-4052-bc5b-a174378c6de2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:12:18.969759 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.969496    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f220fc93-56fd-4052-bc5b-a174378c6de2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f220fc93-56fd-4052-bc5b-a174378c6de2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:12:18.969759 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.969636    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f220fc93-56fd-4052-bc5b-a174378c6de2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f220fc93-56fd-4052-bc5b-a174378c6de2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:12:18.969870 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.969785    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f220fc93-56fd-4052-bc5b-a174378c6de2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f220fc93-56fd-4052-bc5b-a174378c6de2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:12:18.970224 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.970191    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f220fc93-56fd-4052-bc5b-a174378c6de2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f220fc93-56fd-4052-bc5b-a174378c6de2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:12:18.970686 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.970659    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f220fc93-56fd-4052-bc5b-a174378c6de2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f220fc93-56fd-4052-bc5b-a174378c6de2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:12:18.971807 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.971776    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f220fc93-56fd-4052-bc5b-a174378c6de2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f220fc93-56fd-4052-bc5b-a174378c6de2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:12:18.971807 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.971791    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/f220fc93-56fd-4052-bc5b-a174378c6de2-config\") pod \"prometheus-k8s-0\" (UID: \"f220fc93-56fd-4052-bc5b-a174378c6de2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:12:18.971961 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.971858    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f220fc93-56fd-4052-bc5b-a174378c6de2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f220fc93-56fd-4052-bc5b-a174378c6de2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:12:18.972471 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.972445    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f220fc93-56fd-4052-bc5b-a174378c6de2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f220fc93-56fd-4052-bc5b-a174378c6de2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:12:18.972724 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.972698    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f220fc93-56fd-4052-bc5b-a174378c6de2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f220fc93-56fd-4052-bc5b-a174378c6de2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:12:18.972724 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.972714    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f220fc93-56fd-4052-bc5b-a174378c6de2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f220fc93-56fd-4052-bc5b-a174378c6de2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:12:18.972858 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.972785    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f220fc93-56fd-4052-bc5b-a174378c6de2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f220fc93-56fd-4052-bc5b-a174378c6de2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:12:18.972858 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.972794    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f220fc93-56fd-4052-bc5b-a174378c6de2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f220fc93-56fd-4052-bc5b-a174378c6de2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:12:18.972858 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.972796    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f220fc93-56fd-4052-bc5b-a174378c6de2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f220fc93-56fd-4052-bc5b-a174378c6de2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:12:18.973137 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.973112    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f220fc93-56fd-4052-bc5b-a174378c6de2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f220fc93-56fd-4052-bc5b-a174378c6de2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:12:18.974369 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.974344    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f220fc93-56fd-4052-bc5b-a174378c6de2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f220fc93-56fd-4052-bc5b-a174378c6de2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:12:18.974448 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.974434    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f220fc93-56fd-4052-bc5b-a174378c6de2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f220fc93-56fd-4052-bc5b-a174378c6de2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:12:18.974583 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.974567    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f220fc93-56fd-4052-bc5b-a174378c6de2-config-out\") pod \"prometheus-k8s-0\" (UID: \"f220fc93-56fd-4052-bc5b-a174378c6de2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:12:18.974623 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.974607    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f220fc93-56fd-4052-bc5b-a174378c6de2-web-config\") pod \"prometheus-k8s-0\" (UID: \"f220fc93-56fd-4052-bc5b-a174378c6de2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:12:18.978959 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:18.978938    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsmb2\" (UniqueName: \"kubernetes.io/projected/f220fc93-56fd-4052-bc5b-a174378c6de2-kube-api-access-lsmb2\") pod \"prometheus-k8s-0\" (UID: \"f220fc93-56fd-4052-bc5b-a174378c6de2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:12:19.088480 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:19.088432    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:12:19.229553 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:19.229473    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 16 21:12:19.233062 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:12:19.233029    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf220fc93_56fd_4052_bc5b_a174378c6de2.slice/crio-81da0cf58d4df9f1d3be8a6fd5365071b07733ee1dae875df666c2ae1496837b WatchSource:0}: Error finding container 81da0cf58d4df9f1d3be8a6fd5365071b07733ee1dae875df666c2ae1496837b: Status 404 returned error can't find the container with id 81da0cf58d4df9f1d3be8a6fd5365071b07733ee1dae875df666c2ae1496837b
Jul 16 21:12:19.703158 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:19.703122    2579 generic.go:356] "Generic (PLEG): container finished" podID="f220fc93-56fd-4052-bc5b-a174378c6de2" containerID="0b02b5e4eb3dbd460bca485ba723f07899963f4ce62b14973e1b9c68aa743b9d" exitCode=0
Jul 16 21:12:19.703553 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:19.703188    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f220fc93-56fd-4052-bc5b-a174378c6de2","Type":"ContainerDied","Data":"0b02b5e4eb3dbd460bca485ba723f07899963f4ce62b14973e1b9c68aa743b9d"}
Jul 16 21:12:19.703553 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:19.703257    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f220fc93-56fd-4052-bc5b-a174378c6de2","Type":"ContainerStarted","Data":"81da0cf58d4df9f1d3be8a6fd5365071b07733ee1dae875df666c2ae1496837b"}
Jul 16 21:12:19.971521 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:19.971494    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8d74520-7b5c-4b63-88c9-1f53d4b9232d" path="/var/lib/kubelet/pods/e8d74520-7b5c-4b63-88c9-1f53d4b9232d/volumes"
Jul 16 21:12:20.709764 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:20.709725    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f220fc93-56fd-4052-bc5b-a174378c6de2","Type":"ContainerStarted","Data":"d9985763d542c99d0b7a6e6371886cb152dece0d577109c7e84bbbd3ee5393e9"}
Jul 16 21:12:20.710144 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:20.709806    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f220fc93-56fd-4052-bc5b-a174378c6de2","Type":"ContainerStarted","Data":"95a28fd167d1e409284834c1a0cb677fd8f82c8f32b2f4f13c8a8b29ea4a7506"}
Jul 16 21:12:20.710144 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:20.709846    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f220fc93-56fd-4052-bc5b-a174378c6de2","Type":"ContainerStarted","Data":"79042ade6a7daaa67220918e3a1c5bba030441fc0aa10508e9a3de7ce757e532"}
Jul 16 21:12:20.710144 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:20.709883    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f220fc93-56fd-4052-bc5b-a174378c6de2","Type":"ContainerStarted","Data":"3b74922fd9a1ff198bc553f449e21ad56a4d303039eb87c9a539df8ec62cd90f"}
Jul 16 21:12:20.710144 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:20.709918    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f220fc93-56fd-4052-bc5b-a174378c6de2","Type":"ContainerStarted","Data":"ec15a1dcf818e1f7e2acc957aef751d040ec5742d2afaaa53c1f8c1887c8671f"}
Jul 16 21:12:20.710144 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:20.709952    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f220fc93-56fd-4052-bc5b-a174378c6de2","Type":"ContainerStarted","Data":"8024c9aba606bf83371fe660398b9ebe2b38d14691f3580e74a2420c15b7ca4c"}
Jul 16 21:12:20.759291 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:20.759242    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.739705072 podStartE2EDuration="2.759221351s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.516279ms" isStatefulPod=false podCreationTimestamp="2026-07-16 21:12:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:12:20.756717306 +0000 UTC m=+159.370897621" watchObservedRunningTime="2026-07-16 21:12:20.759221351 +0000 UTC m=+159.373401666"
Jul 16 21:12:24.088731 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:12:24.088684    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:13:19.089524 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:13:19.089483    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:13:19.104288 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:13:19.104260    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:13:19.927272 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:13:19.927236    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:14:41.770841 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:14:41.770812    2579 kubelet.go:1648] "Image garbage collection succeeded"
Jul 16 21:15:44.639665 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:15:44.639585    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-ws5w9"]
Jul 16 21:15:44.643167 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:15:44.643151    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-ws5w9"
Jul 16 21:15:44.646801 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:15:44.646775    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 16 21:15:44.647047 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:15:44.647012    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 16 21:15:44.648203 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:15:44.648177    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-9kkxb\""
Jul 16 21:15:44.656307 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:15:44.656285    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-ws5w9"]
Jul 16 21:15:44.789388 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:15:44.789353    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-278lc\" (UniqueName: \"kubernetes.io/projected/03144b95-257b-442b-8789-322ef11ec6d5-kube-api-access-278lc\") pod \"cert-manager-55b4d954d5-ws5w9\" (UID: \"03144b95-257b-442b-8789-322ef11ec6d5\") " pod="cert-manager/cert-manager-55b4d954d5-ws5w9"
Jul 16 21:15:44.789552 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:15:44.789403    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/03144b95-257b-442b-8789-322ef11ec6d5-bound-sa-token\") pod \"cert-manager-55b4d954d5-ws5w9\" (UID: \"03144b95-257b-442b-8789-322ef11ec6d5\") " pod="cert-manager/cert-manager-55b4d954d5-ws5w9"
Jul 16 21:15:44.890254 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:15:44.890177    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/03144b95-257b-442b-8789-322ef11ec6d5-bound-sa-token\") pod \"cert-manager-55b4d954d5-ws5w9\" (UID: \"03144b95-257b-442b-8789-322ef11ec6d5\") " pod="cert-manager/cert-manager-55b4d954d5-ws5w9"
Jul 16 21:15:44.890254 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:15:44.890234    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-278lc\" (UniqueName: \"kubernetes.io/projected/03144b95-257b-442b-8789-322ef11ec6d5-kube-api-access-278lc\") pod \"cert-manager-55b4d954d5-ws5w9\" (UID: \"03144b95-257b-442b-8789-322ef11ec6d5\") " pod="cert-manager/cert-manager-55b4d954d5-ws5w9"
Jul 16 21:15:44.900073 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:15:44.900050    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/03144b95-257b-442b-8789-322ef11ec6d5-bound-sa-token\") pod \"cert-manager-55b4d954d5-ws5w9\" (UID: \"03144b95-257b-442b-8789-322ef11ec6d5\") " pod="cert-manager/cert-manager-55b4d954d5-ws5w9"
Jul 16 21:15:44.900843 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:15:44.900818    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-278lc\" (UniqueName: \"kubernetes.io/projected/03144b95-257b-442b-8789-322ef11ec6d5-kube-api-access-278lc\") pod \"cert-manager-55b4d954d5-ws5w9\" (UID: \"03144b95-257b-442b-8789-322ef11ec6d5\") " pod="cert-manager/cert-manager-55b4d954d5-ws5w9"
Jul 16 21:15:44.962766 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:15:44.962742    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-ws5w9"
Jul 16 21:15:45.092703 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:15:45.092674    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-ws5w9"]
Jul 16 21:15:45.095618 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:15:45.095595    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod03144b95_257b_442b_8789_322ef11ec6d5.slice/crio-ce099fe99e4b9c20b4cc8cb955c59c9a2ddaa14e55586ef5c4a2e123598bbab0 WatchSource:0}: Error finding container ce099fe99e4b9c20b4cc8cb955c59c9a2ddaa14e55586ef5c4a2e123598bbab0: Status 404 returned error can't find the container with id ce099fe99e4b9c20b4cc8cb955c59c9a2ddaa14e55586ef5c4a2e123598bbab0
Jul 16 21:15:45.097468 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:15:45.097453    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 21:15:45.395558 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:15:45.395522    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-ws5w9" event={"ID":"03144b95-257b-442b-8789-322ef11ec6d5","Type":"ContainerStarted","Data":"ce099fe99e4b9c20b4cc8cb955c59c9a2ddaa14e55586ef5c4a2e123598bbab0"}
Jul 16 21:15:47.658035 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:15:47.657984    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v8rg7"]
Jul 16 21:15:47.660892 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:15:47.660870    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v8rg7"
Jul 16 21:15:47.665602 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:15:47.665572    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 16 21:15:47.665737 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:15:47.665572    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-44q4p\""
Jul 16 21:15:47.666702 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:15:47.666684    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 16 21:15:47.689578 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:15:47.689553    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v8rg7"]
Jul 16 21:15:47.824542 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:15:47.824501    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/842cd219-c060-4f3e-80ca-13fb75136f7c-tmp\") pod \"openshift-lws-operator-fd8ccff4c-v8rg7\" (UID: \"842cd219-c060-4f3e-80ca-13fb75136f7c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v8rg7"
Jul 16 21:15:47.824720 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:15:47.824551    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvkvf\" (UniqueName: \"kubernetes.io/projected/842cd219-c060-4f3e-80ca-13fb75136f7c-kube-api-access-vvkvf\") pod \"openshift-lws-operator-fd8ccff4c-v8rg7\" (UID: \"842cd219-c060-4f3e-80ca-13fb75136f7c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v8rg7"
Jul 16 21:15:47.925901 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:15:47.925807    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/842cd219-c060-4f3e-80ca-13fb75136f7c-tmp\") pod \"openshift-lws-operator-fd8ccff4c-v8rg7\" (UID: \"842cd219-c060-4f3e-80ca-13fb75136f7c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v8rg7"
Jul 16 21:15:47.925901 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:15:47.925852    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvkvf\" (UniqueName: \"kubernetes.io/projected/842cd219-c060-4f3e-80ca-13fb75136f7c-kube-api-access-vvkvf\") pod \"openshift-lws-operator-fd8ccff4c-v8rg7\" (UID: \"842cd219-c060-4f3e-80ca-13fb75136f7c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v8rg7"
Jul 16 21:15:47.926349 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:15:47.926293    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/842cd219-c060-4f3e-80ca-13fb75136f7c-tmp\") pod \"openshift-lws-operator-fd8ccff4c-v8rg7\" (UID: \"842cd219-c060-4f3e-80ca-13fb75136f7c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v8rg7"
Jul 16 21:15:47.942907 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:15:47.942877    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvkvf\" (UniqueName: \"kubernetes.io/projected/842cd219-c060-4f3e-80ca-13fb75136f7c-kube-api-access-vvkvf\") pod \"openshift-lws-operator-fd8ccff4c-v8rg7\" (UID: \"842cd219-c060-4f3e-80ca-13fb75136f7c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v8rg7"
Jul 16 21:15:47.972201 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:15:47.972181    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v8rg7"
Jul 16 21:15:48.129515 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:15:48.129464    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v8rg7"]
Jul 16 21:15:48.132499 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:15:48.132466    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod842cd219_c060_4f3e_80ca_13fb75136f7c.slice/crio-91740948e31961867da4a97dc0358f7626211db8bb7066015d33a989f950f49d WatchSource:0}: Error finding container 91740948e31961867da4a97dc0358f7626211db8bb7066015d33a989f950f49d: Status 404 returned error can't find the container with id 91740948e31961867da4a97dc0358f7626211db8bb7066015d33a989f950f49d
Jul 16 21:15:48.409827 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:15:48.409793    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v8rg7" event={"ID":"842cd219-c060-4f3e-80ca-13fb75136f7c","Type":"ContainerStarted","Data":"91740948e31961867da4a97dc0358f7626211db8bb7066015d33a989f950f49d"}
Jul 16 21:15:48.411287 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:15:48.411258    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-ws5w9" event={"ID":"03144b95-257b-442b-8789-322ef11ec6d5","Type":"ContainerStarted","Data":"85da44f50cfafe5951b3e94796b83c7c850bffdaebb3522370b003f17bcc4723"}
Jul 16 21:15:48.433129 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:15:48.433071    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-ws5w9" podStartSLOduration=1.5218323580000002 podStartE2EDuration="4.433055625s" totalImagesPullingTime="2.911223267s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:15:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:15:48.431447473 +0000 UTC m=+367.045627788" watchObservedRunningTime="2026-07-16 21:15:48.433055625 +0000 UTC m=+367.047235940"
Jul 16 21:15:51.428047 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:15:51.428012    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v8rg7" event={"ID":"842cd219-c060-4f3e-80ca-13fb75136f7c","Type":"ContainerStarted","Data":"c09443b24463038e70353717fd617b155488a7aeeb0a955ee0d43e8b54ed88b0"}
Jul 16 21:15:51.454818 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:15:51.454758    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v8rg7" podStartSLOduration=2.0342769450000002 podStartE2EDuration="4.454739089s" totalImagesPullingTime="2.420462144s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:15:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:15:51.454011849 +0000 UTC m=+370.068192165" watchObservedRunningTime="2026-07-16 21:15:51.454739089 +0000 UTC m=+370.068919398"
Jul 16 21:16:15.162737 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:15.162706    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9f7d7dc89-bqgr9"]
Jul 16 21:16:15.165795 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:15.165778    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9f7d7dc89-bqgr9"
Jul 16 21:16:15.182037 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:15.182011    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 16 21:16:15.182133 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:15.182013    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-drfg4\""
Jul 16 21:16:15.182264 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:15.182252    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 16 21:16:15.182834 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:15.182824    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 16 21:16:15.183354 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:15.183343    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 16 21:16:15.238627 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:15.238596    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vggk\" (UniqueName: \"kubernetes.io/projected/92784711-0b3d-47c6-b6eb-105b0632b04a-kube-api-access-9vggk\") pod \"opendatahub-operator-controller-manager-9f7d7dc89-bqgr9\" (UID: \"92784711-0b3d-47c6-b6eb-105b0632b04a\") " pod="opendatahub/opendatahub-operator-controller-manager-9f7d7dc89-bqgr9"
Jul 16 21:16:15.238793 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:15.238639    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/92784711-0b3d-47c6-b6eb-105b0632b04a-manifests\") pod \"opendatahub-operator-controller-manager-9f7d7dc89-bqgr9\" (UID: \"92784711-0b3d-47c6-b6eb-105b0632b04a\") " pod="opendatahub/opendatahub-operator-controller-manager-9f7d7dc89-bqgr9"
Jul 16 21:16:15.238793 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:15.238661    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/92784711-0b3d-47c6-b6eb-105b0632b04a-webhook-cert\") pod \"opendatahub-operator-controller-manager-9f7d7dc89-bqgr9\" (UID: \"92784711-0b3d-47c6-b6eb-105b0632b04a\") " pod="opendatahub/opendatahub-operator-controller-manager-9f7d7dc89-bqgr9"
Jul 16 21:16:15.238793 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:15.238775    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/92784711-0b3d-47c6-b6eb-105b0632b04a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9f7d7dc89-bqgr9\" (UID: \"92784711-0b3d-47c6-b6eb-105b0632b04a\") " pod="opendatahub/opendatahub-operator-controller-manager-9f7d7dc89-bqgr9"
Jul 16 21:16:15.238943 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:15.238819    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/92784711-0b3d-47c6-b6eb-105b0632b04a-tmp\") pod \"opendatahub-operator-controller-manager-9f7d7dc89-bqgr9\" (UID: \"92784711-0b3d-47c6-b6eb-105b0632b04a\") " pod="opendatahub/opendatahub-operator-controller-manager-9f7d7dc89-bqgr9"
Jul 16 21:16:15.243303 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:15.243276    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9f7d7dc89-bqgr9"]
Jul 16 21:16:15.339967 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:15.339936    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/92784711-0b3d-47c6-b6eb-105b0632b04a-tmp\") pod \"opendatahub-operator-controller-manager-9f7d7dc89-bqgr9\" (UID: \"92784711-0b3d-47c6-b6eb-105b0632b04a\") " pod="opendatahub/opendatahub-operator-controller-manager-9f7d7dc89-bqgr9"
Jul 16 21:16:15.340134 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:15.339981    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vggk\" (UniqueName: \"kubernetes.io/projected/92784711-0b3d-47c6-b6eb-105b0632b04a-kube-api-access-9vggk\") pod \"opendatahub-operator-controller-manager-9f7d7dc89-bqgr9\" (UID: \"92784711-0b3d-47c6-b6eb-105b0632b04a\") " pod="opendatahub/opendatahub-operator-controller-manager-9f7d7dc89-bqgr9"
Jul 16 21:16:15.340134 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:15.340006    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/92784711-0b3d-47c6-b6eb-105b0632b04a-manifests\") pod \"opendatahub-operator-controller-manager-9f7d7dc89-bqgr9\" (UID: \"92784711-0b3d-47c6-b6eb-105b0632b04a\") " pod="opendatahub/opendatahub-operator-controller-manager-9f7d7dc89-bqgr9"
Jul 16 21:16:15.340134 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:15.340030    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/92784711-0b3d-47c6-b6eb-105b0632b04a-webhook-cert\") pod \"opendatahub-operator-controller-manager-9f7d7dc89-bqgr9\" (UID: \"92784711-0b3d-47c6-b6eb-105b0632b04a\") " pod="opendatahub/opendatahub-operator-controller-manager-9f7d7dc89-bqgr9"
Jul 16 21:16:15.340323 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:15.340147    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/92784711-0b3d-47c6-b6eb-105b0632b04a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9f7d7dc89-bqgr9\" (UID: \"92784711-0b3d-47c6-b6eb-105b0632b04a\") " pod="opendatahub/opendatahub-operator-controller-manager-9f7d7dc89-bqgr9"
Jul 16 21:16:15.340507 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:15.340486    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/92784711-0b3d-47c6-b6eb-105b0632b04a-manifests\") pod \"opendatahub-operator-controller-manager-9f7d7dc89-bqgr9\" (UID: \"92784711-0b3d-47c6-b6eb-105b0632b04a\") " pod="opendatahub/opendatahub-operator-controller-manager-9f7d7dc89-bqgr9"
Jul 16 21:16:15.342469 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:15.342452    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/92784711-0b3d-47c6-b6eb-105b0632b04a-webhook-cert\") pod \"opendatahub-operator-controller-manager-9f7d7dc89-bqgr9\" (UID: \"92784711-0b3d-47c6-b6eb-105b0632b04a\") " pod="opendatahub/opendatahub-operator-controller-manager-9f7d7dc89-bqgr9"
Jul 16 21:16:15.342469 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:15.342459    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/92784711-0b3d-47c6-b6eb-105b0632b04a-tmp\") pod \"opendatahub-operator-controller-manager-9f7d7dc89-bqgr9\" (UID: \"92784711-0b3d-47c6-b6eb-105b0632b04a\") " pod="opendatahub/opendatahub-operator-controller-manager-9f7d7dc89-bqgr9"
Jul 16 21:16:15.342624 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:15.342609    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/92784711-0b3d-47c6-b6eb-105b0632b04a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9f7d7dc89-bqgr9\" (UID: \"92784711-0b3d-47c6-b6eb-105b0632b04a\") " pod="opendatahub/opendatahub-operator-controller-manager-9f7d7dc89-bqgr9"
Jul 16 21:16:15.356649 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:15.356627    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vggk\" (UniqueName: \"kubernetes.io/projected/92784711-0b3d-47c6-b6eb-105b0632b04a-kube-api-access-9vggk\") pod \"opendatahub-operator-controller-manager-9f7d7dc89-bqgr9\" (UID: \"92784711-0b3d-47c6-b6eb-105b0632b04a\") " pod="opendatahub/opendatahub-operator-controller-manager-9f7d7dc89-bqgr9"
Jul 16 21:16:15.474715 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:15.474626    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9f7d7dc89-bqgr9"
Jul 16 21:16:15.629442 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:15.629421    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9f7d7dc89-bqgr9"]
Jul 16 21:16:15.634211 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:16:15.634182    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92784711_0b3d_47c6_b6eb_105b0632b04a.slice/crio-096340c2e72d74df3a58b4beffbc0a1cde2e82702a80114d60c4426379b39cb6 WatchSource:0}: Error finding container 096340c2e72d74df3a58b4beffbc0a1cde2e82702a80114d60c4426379b39cb6: Status 404 returned error can't find the container with id 096340c2e72d74df3a58b4beffbc0a1cde2e82702a80114d60c4426379b39cb6
Jul 16 21:16:16.524112 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:16.524063    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9f7d7dc89-bqgr9" event={"ID":"92784711-0b3d-47c6-b6eb-105b0632b04a","Type":"ContainerStarted","Data":"096340c2e72d74df3a58b4beffbc0a1cde2e82702a80114d60c4426379b39cb6"}
Jul 16 21:16:16.592314 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:16.592271    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-68bcfc7f9d-lrhnz"]
Jul 16 21:16:16.596561 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:16.596511    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-68bcfc7f9d-lrhnz"
Jul 16 21:16:16.625212 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:16.625154    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 16 21:16:16.626309 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:16.626287    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 16 21:16:16.626443 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:16.626288    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 16 21:16:16.636353 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:16.636329    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-68bcfc7f9d-lrhnz"]
Jul 16 21:16:16.644529 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:16.644324    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-rhnrc\""
Jul 16 21:16:16.651790 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:16.651767    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1c331d3b-1cd9-4ff2-af2f-f81c884ecf47-metrics-cert\") pod \"lws-controller-manager-68bcfc7f9d-lrhnz\" (UID: \"1c331d3b-1cd9-4ff2-af2f-f81c884ecf47\") " pod="openshift-lws-operator/lws-controller-manager-68bcfc7f9d-lrhnz"
Jul 16 21:16:16.651902 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:16.651805    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbnkq\" (UniqueName: \"kubernetes.io/projected/1c331d3b-1cd9-4ff2-af2f-f81c884ecf47-kube-api-access-vbnkq\") pod \"lws-controller-manager-68bcfc7f9d-lrhnz\" (UID: \"1c331d3b-1cd9-4ff2-af2f-f81c884ecf47\") " pod="openshift-lws-operator/lws-controller-manager-68bcfc7f9d-lrhnz"
Jul 16 21:16:16.651957 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:16.651915    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1c331d3b-1cd9-4ff2-af2f-f81c884ecf47-manager-config\") pod \"lws-controller-manager-68bcfc7f9d-lrhnz\" (UID: \"1c331d3b-1cd9-4ff2-af2f-f81c884ecf47\") " pod="openshift-lws-operator/lws-controller-manager-68bcfc7f9d-lrhnz"
Jul 16 21:16:16.651994 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:16.651958    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1c331d3b-1cd9-4ff2-af2f-f81c884ecf47-cert\") pod \"lws-controller-manager-68bcfc7f9d-lrhnz\" (UID: \"1c331d3b-1cd9-4ff2-af2f-f81c884ecf47\") " pod="openshift-lws-operator/lws-controller-manager-68bcfc7f9d-lrhnz"
Jul 16 21:16:16.753326 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:16.753281    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1c331d3b-1cd9-4ff2-af2f-f81c884ecf47-metrics-cert\") pod \"lws-controller-manager-68bcfc7f9d-lrhnz\" (UID: \"1c331d3b-1cd9-4ff2-af2f-f81c884ecf47\") " pod="openshift-lws-operator/lws-controller-manager-68bcfc7f9d-lrhnz"
Jul 16 21:16:16.753517 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:16.753352    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbnkq\" (UniqueName: \"kubernetes.io/projected/1c331d3b-1cd9-4ff2-af2f-f81c884ecf47-kube-api-access-vbnkq\") pod \"lws-controller-manager-68bcfc7f9d-lrhnz\" (UID: \"1c331d3b-1cd9-4ff2-af2f-f81c884ecf47\") " pod="openshift-lws-operator/lws-controller-manager-68bcfc7f9d-lrhnz"
Jul 16 21:16:16.753517 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:16.753427    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1c331d3b-1cd9-4ff2-af2f-f81c884ecf47-manager-config\") pod \"lws-controller-manager-68bcfc7f9d-lrhnz\" (UID: \"1c331d3b-1cd9-4ff2-af2f-f81c884ecf47\") " pod="openshift-lws-operator/lws-controller-manager-68bcfc7f9d-lrhnz"
Jul 16 21:16:16.753517 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:16.753463    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1c331d3b-1cd9-4ff2-af2f-f81c884ecf47-cert\") pod \"lws-controller-manager-68bcfc7f9d-lrhnz\" (UID: \"1c331d3b-1cd9-4ff2-af2f-f81c884ecf47\") " pod="openshift-lws-operator/lws-controller-manager-68bcfc7f9d-lrhnz"
Jul 16 21:16:16.754593 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:16.754543    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1c331d3b-1cd9-4ff2-af2f-f81c884ecf47-manager-config\") pod \"lws-controller-manager-68bcfc7f9d-lrhnz\" (UID: \"1c331d3b-1cd9-4ff2-af2f-f81c884ecf47\") " pod="openshift-lws-operator/lws-controller-manager-68bcfc7f9d-lrhnz"
Jul 16 21:16:16.756753 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:16.756711    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1c331d3b-1cd9-4ff2-af2f-f81c884ecf47-metrics-cert\") pod \"lws-controller-manager-68bcfc7f9d-lrhnz\" (UID: \"1c331d3b-1cd9-4ff2-af2f-f81c884ecf47\") " pod="openshift-lws-operator/lws-controller-manager-68bcfc7f9d-lrhnz"
Jul 16 21:16:16.757554 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:16.757531    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1c331d3b-1cd9-4ff2-af2f-f81c884ecf47-cert\") pod \"lws-controller-manager-68bcfc7f9d-lrhnz\" (UID: \"1c331d3b-1cd9-4ff2-af2f-f81c884ecf47\") " pod="openshift-lws-operator/lws-controller-manager-68bcfc7f9d-lrhnz"
Jul 16 21:16:16.768360 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:16.768315    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbnkq\" (UniqueName: \"kubernetes.io/projected/1c331d3b-1cd9-4ff2-af2f-f81c884ecf47-kube-api-access-vbnkq\") pod \"lws-controller-manager-68bcfc7f9d-lrhnz\" (UID: \"1c331d3b-1cd9-4ff2-af2f-f81c884ecf47\") " pod="openshift-lws-operator/lws-controller-manager-68bcfc7f9d-lrhnz"
Jul 16 21:16:16.909305 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:16.909274    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-68bcfc7f9d-lrhnz"
Jul 16 21:16:17.080687 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:17.080612    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-68bcfc7f9d-lrhnz"]
Jul 16 21:16:17.084255 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:16:17.084223    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c331d3b_1cd9_4ff2_af2f_f81c884ecf47.slice/crio-7621fc61ebe9e60ff4a4083f92e898fc9e34e2330108fea871007d051495a698 WatchSource:0}: Error finding container 7621fc61ebe9e60ff4a4083f92e898fc9e34e2330108fea871007d051495a698: Status 404 returned error can't find the container with id 7621fc61ebe9e60ff4a4083f92e898fc9e34e2330108fea871007d051495a698
Jul 16 21:16:17.530392 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:17.530360    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-68bcfc7f9d-lrhnz" event={"ID":"1c331d3b-1cd9-4ff2-af2f-f81c884ecf47","Type":"ContainerStarted","Data":"7621fc61ebe9e60ff4a4083f92e898fc9e34e2330108fea871007d051495a698"}
Jul 16 21:16:19.541080 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:19.541050    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9f7d7dc89-bqgr9" event={"ID":"92784711-0b3d-47c6-b6eb-105b0632b04a","Type":"ContainerStarted","Data":"d9367aa6da4ae251fdac5f3a2a3f958609c61d05b62d39785c1ac533e56ba7cd"}
Jul 16 21:16:20.546612 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:20.546511    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-68bcfc7f9d-lrhnz" event={"ID":"1c331d3b-1cd9-4ff2-af2f-f81c884ecf47","Type":"ContainerStarted","Data":"40dd85f1e163c510bb24f684436208941dea8802cff3e24f63bcb43399c3b879"}
Jul 16 21:16:20.546612 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:20.546574    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-68bcfc7f9d-lrhnz"
Jul 16 21:16:20.548081 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:20.548057    2579 generic.go:356] "Generic (PLEG): container finished" podID="92784711-0b3d-47c6-b6eb-105b0632b04a" containerID="d9367aa6da4ae251fdac5f3a2a3f958609c61d05b62d39785c1ac533e56ba7cd" exitCode=0
Jul 16 21:16:20.548203 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:20.548087    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9f7d7dc89-bqgr9" event={"ID":"92784711-0b3d-47c6-b6eb-105b0632b04a","Type":"ContainerDied","Data":"d9367aa6da4ae251fdac5f3a2a3f958609c61d05b62d39785c1ac533e56ba7cd"}
Jul 16 21:16:20.573813 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:20.573759    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-68bcfc7f9d-lrhnz" podStartSLOduration=1.7620477970000001 podStartE2EDuration="4.573744598s" totalImagesPullingTime="2.811696801s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:16:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:16:20.572618824 +0000 UTC m=+399.186799140" watchObservedRunningTime="2026-07-16 21:16:20.573744598 +0000 UTC m=+399.187924925"
Jul 16 21:16:21.558448 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:21.558408    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9f7d7dc89-bqgr9" event={"ID":"92784711-0b3d-47c6-b6eb-105b0632b04a","Type":"ContainerStarted","Data":"5bfc58fce05cd5602863242e16d020f69d7b53695b0cd8be80885660841c2f34"}
Jul 16 21:16:21.614627 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:21.614572    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-9f7d7dc89-bqgr9" podStartSLOduration=1.6031486 podStartE2EDuration="6.614559081s" totalImagesPullingTime="3.760023851s" totalInitContainerRuntime="1.25138663s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:16:15 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:16:21.612766619 +0000 UTC m=+400.226946935" watchObservedRunningTime="2026-07-16 21:16:21.614559081 +0000 UTC m=+400.228739438"
Jul 16 21:16:22.562598 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:22.562570    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-9f7d7dc89-bqgr9"
Jul 16 21:16:31.561009 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:31.560978    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-68bcfc7f9d-lrhnz"
Jul 16 21:16:33.567464 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:33.567433    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-9f7d7dc89-bqgr9"
Jul 16 21:16:38.233274 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:38.233233    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5b9fcf8c8b-tm8mg"]
Jul 16 21:16:38.235627 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:38.235612    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5b9fcf8c8b-tm8mg"
Jul 16 21:16:38.240522 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:38.240502    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 16 21:16:38.241719 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:38.241695    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-hzf5s\""
Jul 16 21:16:38.241839 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:38.241720    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 16 21:16:38.241839 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:38.241742    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 16 21:16:38.244186 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:38.244169    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 16 21:16:38.295792 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:38.295759    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5b9fcf8c8b-tm8mg"]
Jul 16 21:16:38.333979 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:38.333945    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4c4c2a46-52f1-4ef6-aa62-1a9e07aad76a-tmp\") pod \"kube-auth-proxy-5b9fcf8c8b-tm8mg\" (UID: \"4c4c2a46-52f1-4ef6-aa62-1a9e07aad76a\") " pod="openshift-ingress/kube-auth-proxy-5b9fcf8c8b-tm8mg"
Jul 16 21:16:38.334168 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:38.333991    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pswqr\" (UniqueName: \"kubernetes.io/projected/4c4c2a46-52f1-4ef6-aa62-1a9e07aad76a-kube-api-access-pswqr\") pod \"kube-auth-proxy-5b9fcf8c8b-tm8mg\" (UID: \"4c4c2a46-52f1-4ef6-aa62-1a9e07aad76a\") " pod="openshift-ingress/kube-auth-proxy-5b9fcf8c8b-tm8mg"
Jul 16 21:16:38.334168 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:38.334016    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c4c2a46-52f1-4ef6-aa62-1a9e07aad76a-tls-certs\") pod \"kube-auth-proxy-5b9fcf8c8b-tm8mg\" (UID: \"4c4c2a46-52f1-4ef6-aa62-1a9e07aad76a\") " pod="openshift-ingress/kube-auth-proxy-5b9fcf8c8b-tm8mg"
Jul 16 21:16:38.434901 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:38.434870    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c4c2a46-52f1-4ef6-aa62-1a9e07aad76a-tls-certs\") pod \"kube-auth-proxy-5b9fcf8c8b-tm8mg\" (UID: \"4c4c2a46-52f1-4ef6-aa62-1a9e07aad76a\") " pod="openshift-ingress/kube-auth-proxy-5b9fcf8c8b-tm8mg"
Jul 16 21:16:38.435078 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:38.434948    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4c4c2a46-52f1-4ef6-aa62-1a9e07aad76a-tmp\") pod \"kube-auth-proxy-5b9fcf8c8b-tm8mg\" (UID: \"4c4c2a46-52f1-4ef6-aa62-1a9e07aad76a\") " pod="openshift-ingress/kube-auth-proxy-5b9fcf8c8b-tm8mg"
Jul 16 21:16:38.435078 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:38.434991    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pswqr\" (UniqueName: \"kubernetes.io/projected/4c4c2a46-52f1-4ef6-aa62-1a9e07aad76a-kube-api-access-pswqr\") pod \"kube-auth-proxy-5b9fcf8c8b-tm8mg\" (UID: \"4c4c2a46-52f1-4ef6-aa62-1a9e07aad76a\") " pod="openshift-ingress/kube-auth-proxy-5b9fcf8c8b-tm8mg"
Jul 16 21:16:38.437196 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:38.437175    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4c4c2a46-52f1-4ef6-aa62-1a9e07aad76a-tmp\") pod \"kube-auth-proxy-5b9fcf8c8b-tm8mg\" (UID: \"4c4c2a46-52f1-4ef6-aa62-1a9e07aad76a\") " pod="openshift-ingress/kube-auth-proxy-5b9fcf8c8b-tm8mg"
Jul 16 21:16:38.437399 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:38.437381    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c4c2a46-52f1-4ef6-aa62-1a9e07aad76a-tls-certs\") pod \"kube-auth-proxy-5b9fcf8c8b-tm8mg\" (UID: \"4c4c2a46-52f1-4ef6-aa62-1a9e07aad76a\") " pod="openshift-ingress/kube-auth-proxy-5b9fcf8c8b-tm8mg"
Jul 16 21:16:38.463347 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:38.463316    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pswqr\" (UniqueName: \"kubernetes.io/projected/4c4c2a46-52f1-4ef6-aa62-1a9e07aad76a-kube-api-access-pswqr\") pod \"kube-auth-proxy-5b9fcf8c8b-tm8mg\" (UID: \"4c4c2a46-52f1-4ef6-aa62-1a9e07aad76a\") " pod="openshift-ingress/kube-auth-proxy-5b9fcf8c8b-tm8mg"
Jul 16 21:16:38.545405 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:38.545315    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5b9fcf8c8b-tm8mg"
Jul 16 21:16:38.715799 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:16:38.715768    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c4c2a46_52f1_4ef6_aa62_1a9e07aad76a.slice/crio-6d7fe77ac1b40d5c66e8af25b709645b26570386e913c607bf6a2fcfff267354 WatchSource:0}: Error finding container 6d7fe77ac1b40d5c66e8af25b709645b26570386e913c607bf6a2fcfff267354: Status 404 returned error can't find the container with id 6d7fe77ac1b40d5c66e8af25b709645b26570386e913c607bf6a2fcfff267354
Jul 16 21:16:38.720794 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:38.720773    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5b9fcf8c8b-tm8mg"]
Jul 16 21:16:39.627500 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:39.627458    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5b9fcf8c8b-tm8mg" event={"ID":"4c4c2a46-52f1-4ef6-aa62-1a9e07aad76a","Type":"ContainerStarted","Data":"6d7fe77ac1b40d5c66e8af25b709645b26570386e913c607bf6a2fcfff267354"}
Jul 16 21:16:41.640675 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:16:41.640642    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5b9fcf8c8b-tm8mg" event={"ID":"4c4c2a46-52f1-4ef6-aa62-1a9e07aad76a","Type":"ContainerStarted","Data":"5d3d37ebe012676ba57f280560e5bfa65c75622d6072199c26c97fe8d21e8082"}
Jul 16 21:17:29.463707 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:17:29.463653    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5b9fcf8c8b-tm8mg" podStartSLOduration=48.640275014 podStartE2EDuration="51.46363879s" totalImagesPullingTime="2.823363776s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:16:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:16:41.705448044 +0000 UTC m=+420.319628361" watchObservedRunningTime="2026-07-16 21:17:29.46363879 +0000 UTC m=+468.077819105"
Jul 16 21:17:29.464844 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:17:29.464826    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-767c76c9bf-5vc48"]
Jul 16 21:17:29.467374 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:17:29.467354    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-767c76c9bf-5vc48"
Jul 16 21:17:29.471305 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:17:29.471280    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 16 21:17:29.471420 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:17:29.471323    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 16 21:17:29.471724 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:17:29.471709    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 16 21:17:29.472619 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:17:29.472596    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 16 21:17:29.473934 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:17:29.473911    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 16 21:17:29.474056 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:17:29.473935    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-9nxmq\""
Jul 16 21:17:29.477146 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:17:29.477130    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 16 21:17:29.497863 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:17:29.497836    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-767c76c9bf-5vc48"]
Jul 16 21:17:29.556342 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:17:29.556309    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fa8b6c44-89b3-491f-9b27-d9348515b4a0-console-serving-cert\") pod \"console-767c76c9bf-5vc48\" (UID: \"fa8b6c44-89b3-491f-9b27-d9348515b4a0\") " pod="openshift-console/console-767c76c9bf-5vc48"
Jul 16 21:17:29.556487 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:17:29.556360    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fa8b6c44-89b3-491f-9b27-d9348515b4a0-console-oauth-config\") pod \"console-767c76c9bf-5vc48\" (UID: \"fa8b6c44-89b3-491f-9b27-d9348515b4a0\") " pod="openshift-console/console-767c76c9bf-5vc48"
Jul 16 21:17:29.556487 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:17:29.556397    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa8b6c44-89b3-491f-9b27-d9348515b4a0-trusted-ca-bundle\") pod \"console-767c76c9bf-5vc48\" (UID: \"fa8b6c44-89b3-491f-9b27-d9348515b4a0\") " pod="openshift-console/console-767c76c9bf-5vc48"
Jul 16 21:17:29.556487 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:17:29.556457    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fa8b6c44-89b3-491f-9b27-d9348515b4a0-oauth-serving-cert\") pod \"console-767c76c9bf-5vc48\" (UID: \"fa8b6c44-89b3-491f-9b27-d9348515b4a0\") " pod="openshift-console/console-767c76c9bf-5vc48"
Jul 16 21:17:29.556595 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:17:29.556491    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fa8b6c44-89b3-491f-9b27-d9348515b4a0-console-config\") pod \"console-767c76c9bf-5vc48\" (UID: \"fa8b6c44-89b3-491f-9b27-d9348515b4a0\") " pod="openshift-console/console-767c76c9bf-5vc48"
Jul 16 21:17:29.556595 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:17:29.556514    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9ph7\" (UniqueName: \"kubernetes.io/projected/fa8b6c44-89b3-491f-9b27-d9348515b4a0-kube-api-access-v9ph7\") pod \"console-767c76c9bf-5vc48\" (UID: \"fa8b6c44-89b3-491f-9b27-d9348515b4a0\") " pod="openshift-console/console-767c76c9bf-5vc48"
Jul 16 21:17:29.556595 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:17:29.556571    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fa8b6c44-89b3-491f-9b27-d9348515b4a0-service-ca\") pod \"console-767c76c9bf-5vc48\" (UID: \"fa8b6c44-89b3-491f-9b27-d9348515b4a0\") " pod="openshift-console/console-767c76c9bf-5vc48"
Jul 16 21:17:29.657603 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:17:29.657557    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fa8b6c44-89b3-491f-9b27-d9348515b4a0-console-serving-cert\") pod \"console-767c76c9bf-5vc48\" (UID: \"fa8b6c44-89b3-491f-9b27-d9348515b4a0\") " pod="openshift-console/console-767c76c9bf-5vc48"
Jul 16 21:17:29.657603 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:17:29.657614    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fa8b6c44-89b3-491f-9b27-d9348515b4a0-console-oauth-config\") pod \"console-767c76c9bf-5vc48\" (UID: \"fa8b6c44-89b3-491f-9b27-d9348515b4a0\") " pod="openshift-console/console-767c76c9bf-5vc48"
Jul 16 21:17:29.657781 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:17:29.657658    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa8b6c44-89b3-491f-9b27-d9348515b4a0-trusted-ca-bundle\") pod \"console-767c76c9bf-5vc48\" (UID: \"fa8b6c44-89b3-491f-9b27-d9348515b4a0\") " pod="openshift-console/console-767c76c9bf-5vc48"
Jul 16 21:17:29.657781 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:17:29.657690    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fa8b6c44-89b3-491f-9b27-d9348515b4a0-oauth-serving-cert\") pod \"console-767c76c9bf-5vc48\" (UID: \"fa8b6c44-89b3-491f-9b27-d9348515b4a0\") " pod="openshift-console/console-767c76c9bf-5vc48"
Jul 16 21:17:29.657781 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:17:29.657714    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fa8b6c44-89b3-491f-9b27-d9348515b4a0-console-config\") pod \"console-767c76c9bf-5vc48\" (UID: \"fa8b6c44-89b3-491f-9b27-d9348515b4a0\") " pod="openshift-console/console-767c76c9bf-5vc48"
Jul 16 21:17:29.657899 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:17:29.657836    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9ph7\" (UniqueName: \"kubernetes.io/projected/fa8b6c44-89b3-491f-9b27-d9348515b4a0-kube-api-access-v9ph7\") pod \"console-767c76c9bf-5vc48\" (UID: \"fa8b6c44-89b3-491f-9b27-d9348515b4a0\") " pod="openshift-console/console-767c76c9bf-5vc48"
Jul 16 21:17:29.657956 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:17:29.657902    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fa8b6c44-89b3-491f-9b27-d9348515b4a0-service-ca\") pod \"console-767c76c9bf-5vc48\" (UID: \"fa8b6c44-89b3-491f-9b27-d9348515b4a0\") " pod="openshift-console/console-767c76c9bf-5vc48"
Jul 16 21:17:29.658470 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:17:29.658447    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fa8b6c44-89b3-491f-9b27-d9348515b4a0-console-config\") pod \"console-767c76c9bf-5vc48\" (UID: \"fa8b6c44-89b3-491f-9b27-d9348515b4a0\") " pod="openshift-console/console-767c76c9bf-5vc48"
Jul 16 21:17:29.658592 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:17:29.658550    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fa8b6c44-89b3-491f-9b27-d9348515b4a0-oauth-serving-cert\") pod \"console-767c76c9bf-5vc48\" (UID: \"fa8b6c44-89b3-491f-9b27-d9348515b4a0\") " pod="openshift-console/console-767c76c9bf-5vc48"
Jul 16 21:17:29.658658 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:17:29.658624    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fa8b6c44-89b3-491f-9b27-d9348515b4a0-service-ca\") pod \"console-767c76c9bf-5vc48\" (UID: \"fa8b6c44-89b3-491f-9b27-d9348515b4a0\") " pod="openshift-console/console-767c76c9bf-5vc48"
Jul 16 21:17:29.658658 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:17:29.658642    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa8b6c44-89b3-491f-9b27-d9348515b4a0-trusted-ca-bundle\") pod \"console-767c76c9bf-5vc48\" (UID: \"fa8b6c44-89b3-491f-9b27-d9348515b4a0\") " pod="openshift-console/console-767c76c9bf-5vc48"
Jul 16 21:17:29.660188 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:17:29.660171    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fa8b6c44-89b3-491f-9b27-d9348515b4a0-console-serving-cert\") pod \"console-767c76c9bf-5vc48\" (UID: \"fa8b6c44-89b3-491f-9b27-d9348515b4a0\") " pod="openshift-console/console-767c76c9bf-5vc48"
Jul 16 21:17:29.660278 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:17:29.660187    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fa8b6c44-89b3-491f-9b27-d9348515b4a0-console-oauth-config\") pod \"console-767c76c9bf-5vc48\" (UID: \"fa8b6c44-89b3-491f-9b27-d9348515b4a0\") " pod="openshift-console/console-767c76c9bf-5vc48"
Jul 16 21:17:29.673113 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:17:29.673079    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9ph7\" (UniqueName: \"kubernetes.io/projected/fa8b6c44-89b3-491f-9b27-d9348515b4a0-kube-api-access-v9ph7\") pod \"console-767c76c9bf-5vc48\" (UID: \"fa8b6c44-89b3-491f-9b27-d9348515b4a0\") " pod="openshift-console/console-767c76c9bf-5vc48"
Jul 16 21:17:29.776048 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:17:29.775980    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-767c76c9bf-5vc48"
Jul 16 21:17:29.924960 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:17:29.924928    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-767c76c9bf-5vc48"]
Jul 16 21:17:29.930489 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:17:29.930461    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa8b6c44_89b3_491f_9b27_d9348515b4a0.slice/crio-4690af731104770419685262ce83d4e3fb50dfdf602fee1e85d856e8eb8cf1ee WatchSource:0}: Error finding container 4690af731104770419685262ce83d4e3fb50dfdf602fee1e85d856e8eb8cf1ee: Status 404 returned error can't find the container with id 4690af731104770419685262ce83d4e3fb50dfdf602fee1e85d856e8eb8cf1ee
Jul 16 21:17:30.844705 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:17:30.844670    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-767c76c9bf-5vc48" event={"ID":"fa8b6c44-89b3-491f-9b27-d9348515b4a0","Type":"ContainerStarted","Data":"e824f099ed8c1c655352fac2c754223bb102f689ed136e8e9eee4e24aaf8ae83"}
Jul 16 21:17:30.845299 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:17:30.844718    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-767c76c9bf-5vc48" event={"ID":"fa8b6c44-89b3-491f-9b27-d9348515b4a0","Type":"ContainerStarted","Data":"4690af731104770419685262ce83d4e3fb50dfdf602fee1e85d856e8eb8cf1ee"}
Jul 16 21:17:39.776952 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:17:39.776911    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-767c76c9bf-5vc48"
Jul 16 21:17:39.777396 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:17:39.776979    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-767c76c9bf-5vc48"
Jul 16 21:17:39.781652 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:17:39.781634    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-767c76c9bf-5vc48"
Jul 16 21:17:39.859584 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:17:39.859533    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-767c76c9bf-5vc48" podStartSLOduration=10.85951539 podStartE2EDuration="10.85951539s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:17:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:17:30.898679875 +0000 UTC m=+469.512860192" watchObservedRunningTime="2026-07-16 21:17:39.85951539 +0000 UTC m=+478.473695709"
Jul 16 21:17:39.890644 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:17:39.890617    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-767c76c9bf-5vc48"
Jul 16 21:18:16.387193 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:18:16.387159    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-2qt9z"]
Jul 16 21:18:16.389610 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:18:16.389589    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2qt9z"
Jul 16 21:18:16.397777 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:18:16.397756    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 16 21:18:16.398947 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:18:16.398929    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 16 21:18:16.398947 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:18:16.398939    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 16 21:18:16.399077 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:18:16.398954    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-mwjkp\""
Jul 16 21:18:16.430880 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:18:16.430857    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-2qt9z"]
Jul 16 21:18:16.545965 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:18:16.545929    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7h972\" (UniqueName: \"kubernetes.io/projected/db14599e-064f-4a29-a188-236c7d26c152-kube-api-access-7h972\") pod \"dns-operator-controller-manager-864dd78c4c-2qt9z\" (UID: \"db14599e-064f-4a29-a188-236c7d26c152\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2qt9z"
Jul 16 21:18:16.647305 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:18:16.647215    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7h972\" (UniqueName: \"kubernetes.io/projected/db14599e-064f-4a29-a188-236c7d26c152-kube-api-access-7h972\") pod \"dns-operator-controller-manager-864dd78c4c-2qt9z\" (UID: \"db14599e-064f-4a29-a188-236c7d26c152\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2qt9z"
Jul 16 21:18:16.672529 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:18:16.672509    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7h972\" (UniqueName: \"kubernetes.io/projected/db14599e-064f-4a29-a188-236c7d26c152-kube-api-access-7h972\") pod \"dns-operator-controller-manager-864dd78c4c-2qt9z\" (UID: \"db14599e-064f-4a29-a188-236c7d26c152\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2qt9z"
Jul 16 21:18:16.699605 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:18:16.699579    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2qt9z"
Jul 16 21:18:16.846529 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:18:16.846505    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-2qt9z"]
Jul 16 21:18:16.849007 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:18:16.848984    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb14599e_064f_4a29_a188_236c7d26c152.slice/crio-1396b3b72d70f411178a3c6aceb4ccb78d3bdd9ee29c237097903e0dc2ad969a WatchSource:0}: Error finding container 1396b3b72d70f411178a3c6aceb4ccb78d3bdd9ee29c237097903e0dc2ad969a: Status 404 returned error can't find the container with id 1396b3b72d70f411178a3c6aceb4ccb78d3bdd9ee29c237097903e0dc2ad969a
Jul 16 21:18:17.033164 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:18:17.033125    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2qt9z" event={"ID":"db14599e-064f-4a29-a188-236c7d26c152","Type":"ContainerStarted","Data":"1396b3b72d70f411178a3c6aceb4ccb78d3bdd9ee29c237097903e0dc2ad969a"}
Jul 16 21:18:19.043517 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:18:19.043487    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2qt9z" event={"ID":"db14599e-064f-4a29-a188-236c7d26c152","Type":"ContainerStarted","Data":"c413dbae8f8ad25633b3507e17c16d9f7020e1a8ed99348b26818de61864966b"}
Jul 16 21:18:19.043850 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:18:19.043613    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2qt9z"
Jul 16 21:18:19.099868 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:18:19.099822    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2qt9z" podStartSLOduration=0.99347189 podStartE2EDuration="3.099808946s" totalImagesPullingTime="2.106337056s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:18:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:18:19.09967619 +0000 UTC m=+517.713856506" watchObservedRunningTime="2026-07-16 21:18:19.099808946 +0000 UTC m=+517.713989262"
Jul 16 21:18:22.864260 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:18:22.864230    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-sv9gt"]
Jul 16 21:18:22.866593 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:18:22.866577    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sv9gt"
Jul 16 21:18:22.869804 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:18:22.869785    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-nnslt\""
Jul 16 21:18:22.870270 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:18:22.870178    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 16 21:18:22.870270 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:18:22.870186    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 16 21:18:22.891658 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:18:22.891635    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-sv9gt"]
Jul 16 21:18:23.002337 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:18:23.002305    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e3f7f716-31bc-4d80-94b6-3c7317a0a278-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-sv9gt\" (UID: \"e3f7f716-31bc-4d80-94b6-3c7317a0a278\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sv9gt"
Jul 16 21:18:23.002512 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:18:23.002357    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mq8vt\" (UniqueName: \"kubernetes.io/projected/e3f7f716-31bc-4d80-94b6-3c7317a0a278-kube-api-access-mq8vt\") pod \"kuadrant-console-plugin-66b5774985-sv9gt\" (UID: \"e3f7f716-31bc-4d80-94b6-3c7317a0a278\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sv9gt"
Jul 16 21:18:23.002512 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:18:23.002437    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e3f7f716-31bc-4d80-94b6-3c7317a0a278-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-sv9gt\" (UID: \"e3f7f716-31bc-4d80-94b6-3c7317a0a278\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sv9gt"
Jul 16 21:18:23.103262 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:18:23.103234    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e3f7f716-31bc-4d80-94b6-3c7317a0a278-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-sv9gt\" (UID: \"e3f7f716-31bc-4d80-94b6-3c7317a0a278\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sv9gt"
Jul 16 21:18:23.103437 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:18:23.103304    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mq8vt\" (UniqueName: \"kubernetes.io/projected/e3f7f716-31bc-4d80-94b6-3c7317a0a278-kube-api-access-mq8vt\") pod \"kuadrant-console-plugin-66b5774985-sv9gt\" (UID: \"e3f7f716-31bc-4d80-94b6-3c7317a0a278\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sv9gt"
Jul 16 21:18:23.103437 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:18:23.103348    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e3f7f716-31bc-4d80-94b6-3c7317a0a278-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-sv9gt\" (UID: \"e3f7f716-31bc-4d80-94b6-3c7317a0a278\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sv9gt"
Jul 16 21:18:23.103626 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:18:23.103607    2579 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 16 21:18:23.103700 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:18:23.103688    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3f7f716-31bc-4d80-94b6-3c7317a0a278-plugin-serving-cert podName:e3f7f716-31bc-4d80-94b6-3c7317a0a278 nodeName:}" failed. No retries permitted until 2026-07-16 21:18:23.603668675 +0000 UTC m=+522.217848970 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/e3f7f716-31bc-4d80-94b6-3c7317a0a278-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-sv9gt" (UID: "e3f7f716-31bc-4d80-94b6-3c7317a0a278") : secret "plugin-serving-cert" not found
Jul 16 21:18:23.103982 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:18:23.103963    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e3f7f716-31bc-4d80-94b6-3c7317a0a278-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-sv9gt\" (UID: \"e3f7f716-31bc-4d80-94b6-3c7317a0a278\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sv9gt"
Jul 16 21:18:23.115581 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:18:23.115522    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mq8vt\" (UniqueName: \"kubernetes.io/projected/e3f7f716-31bc-4d80-94b6-3c7317a0a278-kube-api-access-mq8vt\") pod \"kuadrant-console-plugin-66b5774985-sv9gt\" (UID: \"e3f7f716-31bc-4d80-94b6-3c7317a0a278\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sv9gt"
Jul 16 21:18:23.607039 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:18:23.606997    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e3f7f716-31bc-4d80-94b6-3c7317a0a278-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-sv9gt\" (UID: \"e3f7f716-31bc-4d80-94b6-3c7317a0a278\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sv9gt"
Jul 16 21:18:23.609416 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:18:23.609396    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e3f7f716-31bc-4d80-94b6-3c7317a0a278-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-sv9gt\" (UID: \"e3f7f716-31bc-4d80-94b6-3c7317a0a278\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sv9gt"
Jul 16 21:18:23.776058 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:18:23.776024    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sv9gt"
Jul 16 21:18:23.912865 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:18:23.912836    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-sv9gt"]
Jul 16 21:18:23.915519 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:18:23.915489    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode3f7f716_31bc_4d80_94b6_3c7317a0a278.slice/crio-3e1df56bf4d29214c6d16c8c3aafb3e975765cb278e6f049244a243899cca97c WatchSource:0}: Error finding container 3e1df56bf4d29214c6d16c8c3aafb3e975765cb278e6f049244a243899cca97c: Status 404 returned error can't find the container with id 3e1df56bf4d29214c6d16c8c3aafb3e975765cb278e6f049244a243899cca97c
Jul 16 21:18:24.065557 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:18:24.065519    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sv9gt" event={"ID":"e3f7f716-31bc-4d80-94b6-3c7317a0a278","Type":"ContainerStarted","Data":"3e1df56bf4d29214c6d16c8c3aafb3e975765cb278e6f049244a243899cca97c"}
Jul 16 21:18:30.050557 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:18:30.050522    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2qt9z"
Jul 16 21:18:47.180407 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:18:47.180373    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sv9gt" event={"ID":"e3f7f716-31bc-4d80-94b6-3c7317a0a278","Type":"ContainerStarted","Data":"143e30fe3d215c2a395d9bc0cc554ee3df3ccd609a9d5f3b5306c79f3803e359"}
Jul 16 21:19:15.924651 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:19:15.924594    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sv9gt" podStartSLOduration=31.292019697 podStartE2EDuration="53.924574679s" totalImagesPullingTime="22.632554982s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:18:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:18:47.20634641 +0000 UTC m=+545.820526725" watchObservedRunningTime="2026-07-16 21:19:15.924574679 +0000 UTC m=+574.538754996"
Jul 16 21:19:15.926249 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:19:15.926226    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:19:16.206976 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:19:16.206886    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-h88m5"
Jul 16 21:19:16.209877 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:19:16.209852    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 16 21:19:16.213070 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:19:16.213048    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:19:16.213178 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:19:16.213118    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:19:16.262450 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:19:16.262415    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2xjf\" (UniqueName: \"kubernetes.io/projected/43a9e44c-3287-450d-8d6d-91778504e3d5-kube-api-access-s2xjf\") pod \"limitador-limitador-54d6d988d5-h88m5\" (UID: \"43a9e44c-3287-450d-8d6d-91778504e3d5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-h88m5"
Jul 16 21:19:16.262611 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:19:16.262471    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/43a9e44c-3287-450d-8d6d-91778504e3d5-config-file\") pod \"limitador-limitador-54d6d988d5-h88m5\" (UID: \"43a9e44c-3287-450d-8d6d-91778504e3d5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-h88m5"
Jul 16 21:19:16.363292 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:19:16.363259    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2xjf\" (UniqueName: \"kubernetes.io/projected/43a9e44c-3287-450d-8d6d-91778504e3d5-kube-api-access-s2xjf\") pod \"limitador-limitador-54d6d988d5-h88m5\" (UID: \"43a9e44c-3287-450d-8d6d-91778504e3d5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-h88m5"
Jul 16 21:19:16.363448 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:19:16.363309    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/43a9e44c-3287-450d-8d6d-91778504e3d5-config-file\") pod \"limitador-limitador-54d6d988d5-h88m5\" (UID: \"43a9e44c-3287-450d-8d6d-91778504e3d5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-h88m5"
Jul 16 21:19:16.363887 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:19:16.363867    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/43a9e44c-3287-450d-8d6d-91778504e3d5-config-file\") pod \"limitador-limitador-54d6d988d5-h88m5\" (UID: \"43a9e44c-3287-450d-8d6d-91778504e3d5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-h88m5"
Jul 16 21:19:16.374509 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:19:16.374488    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2xjf\" (UniqueName: \"kubernetes.io/projected/43a9e44c-3287-450d-8d6d-91778504e3d5-kube-api-access-s2xjf\") pod \"limitador-limitador-54d6d988d5-h88m5\" (UID: \"43a9e44c-3287-450d-8d6d-91778504e3d5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-h88m5"
Jul 16 21:19:16.486672 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:19:16.486591    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-7mnjh"]
Jul 16 21:19:16.488990 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:19:16.488974    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-7mnjh"
Jul 16 21:19:16.491839 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:19:16.491817    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-f2xhd\""
Jul 16 21:19:16.499878 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:19:16.499858    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7mnjh"]
Jul 16 21:19:16.517210 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:19:16.517189    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-h88m5"
Jul 16 21:19:16.564258 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:19:16.564230    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49v4w\" (UniqueName: \"kubernetes.io/projected/a0197698-ceb1-463c-ad5a-59c0427c55f6-kube-api-access-49v4w\") pod \"authorino-75d556bd77-7mnjh\" (UID: \"a0197698-ceb1-463c-ad5a-59c0427c55f6\") " pod="kuadrant-system/authorino-75d556bd77-7mnjh"
Jul 16 21:19:16.643842 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:19:16.643814    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:19:16.647139 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:19:16.647117    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43a9e44c_3287_450d_8d6d_91778504e3d5.slice/crio-6f4e458efdf62bd2f9d6d9e57f9e7179fb7c90ea98dac4d67b319ef23f8c0bc3 WatchSource:0}: Error finding container 6f4e458efdf62bd2f9d6d9e57f9e7179fb7c90ea98dac4d67b319ef23f8c0bc3: Status 404 returned error can't find the container with id 6f4e458efdf62bd2f9d6d9e57f9e7179fb7c90ea98dac4d67b319ef23f8c0bc3
Jul 16 21:19:16.664662 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:19:16.664632    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49v4w\" (UniqueName: \"kubernetes.io/projected/a0197698-ceb1-463c-ad5a-59c0427c55f6-kube-api-access-49v4w\") pod \"authorino-75d556bd77-7mnjh\" (UID: \"a0197698-ceb1-463c-ad5a-59c0427c55f6\") " pod="kuadrant-system/authorino-75d556bd77-7mnjh"
Jul 16 21:19:16.674198 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:19:16.674177    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-49v4w\" (UniqueName: \"kubernetes.io/projected/a0197698-ceb1-463c-ad5a-59c0427c55f6-kube-api-access-49v4w\") pod \"authorino-75d556bd77-7mnjh\" (UID: \"a0197698-ceb1-463c-ad5a-59c0427c55f6\") " pod="kuadrant-system/authorino-75d556bd77-7mnjh"
Jul 16 21:19:16.798356 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:19:16.798269    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-7mnjh"
Jul 16 21:19:16.929992 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:19:16.929961    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7mnjh"]
Jul 16 21:19:16.933748 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:19:16.933722    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda0197698_ceb1_463c_ad5a_59c0427c55f6.slice/crio-3aa305cd9b882487d46b9822b1a86827588d6d47d793d98076876df839ce523b WatchSource:0}: Error finding container 3aa305cd9b882487d46b9822b1a86827588d6d47d793d98076876df839ce523b: Status 404 returned error can't find the container with id 3aa305cd9b882487d46b9822b1a86827588d6d47d793d98076876df839ce523b
Jul 16 21:19:17.309632 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:19:17.309592    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-7mnjh" event={"ID":"a0197698-ceb1-463c-ad5a-59c0427c55f6","Type":"ContainerStarted","Data":"3aa305cd9b882487d46b9822b1a86827588d6d47d793d98076876df839ce523b"}
Jul 16 21:19:17.311208 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:19:17.311175    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-h88m5" event={"ID":"43a9e44c-3287-450d-8d6d-91778504e3d5","Type":"ContainerStarted","Data":"6f4e458efdf62bd2f9d6d9e57f9e7179fb7c90ea98dac4d67b319ef23f8c0bc3"}
Jul 16 21:19:21.332231 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:19:21.332129    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-7mnjh" event={"ID":"a0197698-ceb1-463c-ad5a-59c0427c55f6","Type":"ContainerStarted","Data":"7e626a89cf7f6e3cb3aa70e5997afac8ea14c2853aa6ac06581946fa50af0ef9"}
Jul 16 21:19:21.333634 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:19:21.333610    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-h88m5" event={"ID":"43a9e44c-3287-450d-8d6d-91778504e3d5","Type":"ContainerStarted","Data":"c5530d03b5cacc521c83dabc4df70b6f0ec96e92711ffaebe1bd976bf51dc2c8"}
Jul 16 21:19:21.333754 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:19:21.333711    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-h88m5"
Jul 16 21:19:21.347988 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:19:21.347943    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-7mnjh" podStartSLOduration=1.315128616 podStartE2EDuration="5.347929836s" totalImagesPullingTime="4.03280122s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:19:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:19:21.347799128 +0000 UTC m=+579.961979444" watchObservedRunningTime="2026-07-16 21:19:21.347929836 +0000 UTC m=+579.962110152"
Jul 16 21:19:21.367149 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:19:21.367093    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-h88m5" podStartSLOduration=2.050436211 podStartE2EDuration="6.367078942s" totalImagesPullingTime="4.316642731s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:19:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:19:21.365114769 +0000 UTC m=+579.979295108" watchObservedRunningTime="2026-07-16 21:19:21.367078942 +0000 UTC m=+579.981259303"
Jul 16 21:19:32.338733 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:19:32.338701    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-h88m5"
Jul 16 21:19:49.574899 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:19:49.574867    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7mnjh"]
Jul 16 21:19:49.575320 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:19:49.575084    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-7mnjh" podUID="a0197698-ceb1-463c-ad5a-59c0427c55f6" containerName="authorino" containerID="cri-o://7e626a89cf7f6e3cb3aa70e5997afac8ea14c2853aa6ac06581946fa50af0ef9" gracePeriod=30
Jul 16 21:19:49.815020 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:19:49.814997    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-7mnjh"
Jul 16 21:19:49.948738 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:19:49.948703    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-49v4w\" (UniqueName: \"kubernetes.io/projected/a0197698-ceb1-463c-ad5a-59c0427c55f6-kube-api-access-49v4w\") pod \"a0197698-ceb1-463c-ad5a-59c0427c55f6\" (UID: \"a0197698-ceb1-463c-ad5a-59c0427c55f6\") "
Jul 16 21:19:49.950803 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:19:49.950774    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0197698-ceb1-463c-ad5a-59c0427c55f6-kube-api-access-49v4w" (OuterVolumeSpecName: "kube-api-access-49v4w") pod "a0197698-ceb1-463c-ad5a-59c0427c55f6" (UID: "a0197698-ceb1-463c-ad5a-59c0427c55f6"). InnerVolumeSpecName "kube-api-access-49v4w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 21:19:50.049487 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:19:50.049444    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-49v4w\" (UniqueName: \"kubernetes.io/projected/a0197698-ceb1-463c-ad5a-59c0427c55f6-kube-api-access-49v4w\") on node \"ip-10-0-133-58.ec2.internal\" DevicePath \"\""
Jul 16 21:19:50.459228 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:19:50.459189    2579 generic.go:356] "Generic (PLEG): container finished" podID="a0197698-ceb1-463c-ad5a-59c0427c55f6" containerID="7e626a89cf7f6e3cb3aa70e5997afac8ea14c2853aa6ac06581946fa50af0ef9" exitCode=0
Jul 16 21:19:50.459228 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:19:50.459230    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-7mnjh"
Jul 16 21:19:50.459479 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:19:50.459278    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-7mnjh" event={"ID":"a0197698-ceb1-463c-ad5a-59c0427c55f6","Type":"ContainerDied","Data":"7e626a89cf7f6e3cb3aa70e5997afac8ea14c2853aa6ac06581946fa50af0ef9"}
Jul 16 21:19:50.459479 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:19:50.459323    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-7mnjh" event={"ID":"a0197698-ceb1-463c-ad5a-59c0427c55f6","Type":"ContainerDied","Data":"3aa305cd9b882487d46b9822b1a86827588d6d47d793d98076876df839ce523b"}
Jul 16 21:19:50.459479 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:19:50.459341    2579 scope.go:117] "RemoveContainer" containerID="7e626a89cf7f6e3cb3aa70e5997afac8ea14c2853aa6ac06581946fa50af0ef9"
Jul 16 21:19:50.467528 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:19:50.467510    2579 scope.go:117] "RemoveContainer" containerID="7e626a89cf7f6e3cb3aa70e5997afac8ea14c2853aa6ac06581946fa50af0ef9"
Jul 16 21:19:50.467768 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:19:50.467751    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e626a89cf7f6e3cb3aa70e5997afac8ea14c2853aa6ac06581946fa50af0ef9\": container with ID starting with 7e626a89cf7f6e3cb3aa70e5997afac8ea14c2853aa6ac06581946fa50af0ef9 not found: ID does not exist" containerID="7e626a89cf7f6e3cb3aa70e5997afac8ea14c2853aa6ac06581946fa50af0ef9"
Jul 16 21:19:50.467810 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:19:50.467776    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e626a89cf7f6e3cb3aa70e5997afac8ea14c2853aa6ac06581946fa50af0ef9"} err="failed to get container status \"7e626a89cf7f6e3cb3aa70e5997afac8ea14c2853aa6ac06581946fa50af0ef9\": rpc error: code = NotFound desc = could not find container \"7e626a89cf7f6e3cb3aa70e5997afac8ea14c2853aa6ac06581946fa50af0ef9\": container with ID starting with 7e626a89cf7f6e3cb3aa70e5997afac8ea14c2853aa6ac06581946fa50af0ef9 not found: ID does not exist"
Jul 16 21:19:50.476398 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:19:50.476374    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7mnjh"]
Jul 16 21:19:50.480628 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:19:50.480605    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7mnjh"]
Jul 16 21:19:51.971923 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:19:51.971889    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0197698-ceb1-463c-ad5a-59c0427c55f6" path="/var/lib/kubelet/pods/a0197698-ceb1-463c-ad5a-59c0427c55f6/volumes"
Jul 16 21:20:30.530887 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:20:30.530848    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-f7zpq"]
Jul 16 21:20:30.531477 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:20:30.531189    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0197698-ceb1-463c-ad5a-59c0427c55f6" containerName="authorino"
Jul 16 21:20:30.531477 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:20:30.531202    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0197698-ceb1-463c-ad5a-59c0427c55f6" containerName="authorino"
Jul 16 21:20:30.531477 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:20:30.531274    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0197698-ceb1-463c-ad5a-59c0427c55f6" containerName="authorino"
Jul 16 21:20:30.533405 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:20:30.533385    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-f7zpq"
Jul 16 21:20:30.536157 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:20:30.536138    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-j7sf7\""
Jul 16 21:20:30.536785 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:20:30.536771    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 16 21:20:30.545200 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:20:30.545177    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-f7zpq"]
Jul 16 21:20:30.564681 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:20:30.564652    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:20:30.595448 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:20:30.595427    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mp5hq\" (UniqueName: \"kubernetes.io/projected/8a47df2f-954b-452c-a701-1e01c75bd8bc-kube-api-access-mp5hq\") pod \"payload-processing-5bf47cd988-f7zpq\" (UID: \"8a47df2f-954b-452c-a701-1e01c75bd8bc\") " pod="openshift-ingress/payload-processing-5bf47cd988-f7zpq"
Jul 16 21:20:30.595543 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:20:30.595469    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8a47df2f-954b-452c-a701-1e01c75bd8bc-plugins-config-volume\") pod \"payload-processing-5bf47cd988-f7zpq\" (UID: \"8a47df2f-954b-452c-a701-1e01c75bd8bc\") " pod="openshift-ingress/payload-processing-5bf47cd988-f7zpq"
Jul 16 21:20:30.696647 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:20:30.696618    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mp5hq\" (UniqueName: \"kubernetes.io/projected/8a47df2f-954b-452c-a701-1e01c75bd8bc-kube-api-access-mp5hq\") pod \"payload-processing-5bf47cd988-f7zpq\" (UID: \"8a47df2f-954b-452c-a701-1e01c75bd8bc\") " pod="openshift-ingress/payload-processing-5bf47cd988-f7zpq"
Jul 16 21:20:30.696818 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:20:30.696674    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8a47df2f-954b-452c-a701-1e01c75bd8bc-plugins-config-volume\") pod \"payload-processing-5bf47cd988-f7zpq\" (UID: \"8a47df2f-954b-452c-a701-1e01c75bd8bc\") " pod="openshift-ingress/payload-processing-5bf47cd988-f7zpq"
Jul 16 21:20:30.697416 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:20:30.697398    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8a47df2f-954b-452c-a701-1e01c75bd8bc-plugins-config-volume\") pod \"payload-processing-5bf47cd988-f7zpq\" (UID: \"8a47df2f-954b-452c-a701-1e01c75bd8bc\") " pod="openshift-ingress/payload-processing-5bf47cd988-f7zpq"
Jul 16 21:20:30.705240 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:20:30.705213    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mp5hq\" (UniqueName: \"kubernetes.io/projected/8a47df2f-954b-452c-a701-1e01c75bd8bc-kube-api-access-mp5hq\") pod \"payload-processing-5bf47cd988-f7zpq\" (UID: \"8a47df2f-954b-452c-a701-1e01c75bd8bc\") " pod="openshift-ingress/payload-processing-5bf47cd988-f7zpq"
Jul 16 21:20:30.843253 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:20:30.843175    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-f7zpq"
Jul 16 21:20:30.970981 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:20:30.970959    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-f7zpq"]
Jul 16 21:20:30.973638 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:20:30.973613    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a47df2f_954b_452c_a701_1e01c75bd8bc.slice/crio-3d3118c5d67c23e5559bbd23698c2af0bff17e451370e7f1bfe8d6c417cb85f5 WatchSource:0}: Error finding container 3d3118c5d67c23e5559bbd23698c2af0bff17e451370e7f1bfe8d6c417cb85f5: Status 404 returned error can't find the container with id 3d3118c5d67c23e5559bbd23698c2af0bff17e451370e7f1bfe8d6c417cb85f5
Jul 16 21:20:31.633315 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:20:31.633282    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-f7zpq" event={"ID":"8a47df2f-954b-452c-a701-1e01c75bd8bc","Type":"ContainerStarted","Data":"3d3118c5d67c23e5559bbd23698c2af0bff17e451370e7f1bfe8d6c417cb85f5"}
Jul 16 21:20:33.645941 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:20:33.645906    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-f7zpq" event={"ID":"8a47df2f-954b-452c-a701-1e01c75bd8bc","Type":"ContainerStarted","Data":"4dc62f38379778bdcead4d6b06e37d964f800ea8d569a434ea6d569fa5b54348"}
Jul 16 21:20:33.646339 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:20:33.646016    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5bf47cd988-f7zpq"
Jul 16 21:20:33.664666 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:20:33.664616    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5bf47cd988-f7zpq" podStartSLOduration=2.000626955 podStartE2EDuration="3.66460065s" totalImagesPullingTime="1.663973695s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:20:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:20:33.663073827 +0000 UTC m=+652.277254145" watchObservedRunningTime="2026-07-16 21:20:33.66460065 +0000 UTC m=+652.278780965"
Jul 16 21:20:44.652460 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:20:44.652425    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5bf47cd988-f7zpq"
Jul 16 21:20:50.817691 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:20:50.817656    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:20:59.110554 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:20:59.110520    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:21:06.714729 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:06.714695    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-2xvjw"]
Jul 16 21:21:06.717016 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:06.717000    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2xvjw"
Jul 16 21:21:06.719899 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:06.719871    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 16 21:21:06.720028 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:06.719917    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 16 21:21:06.720028 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:06.719958    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-j767n\""
Jul 16 21:21:06.720907 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:06.720893    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 16 21:21:06.729208 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:06.729189    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-2xvjw"]
Jul 16 21:21:06.800946 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:06.800917    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtt5r\" (UniqueName: \"kubernetes.io/projected/6ebfb2c0-01e8-400b-804d-b902fc48b7b4-kube-api-access-dtt5r\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2xvjw\" (UID: \"6ebfb2c0-01e8-400b-804d-b902fc48b7b4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2xvjw"
Jul 16 21:21:06.800946 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:06.800952    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ebfb2c0-01e8-400b-804d-b902fc48b7b4-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2xvjw\" (UID: \"6ebfb2c0-01e8-400b-804d-b902fc48b7b4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2xvjw"
Jul 16 21:21:06.801172 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:06.801014    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ebfb2c0-01e8-400b-804d-b902fc48b7b4-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2xvjw\" (UID: \"6ebfb2c0-01e8-400b-804d-b902fc48b7b4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2xvjw"
Jul 16 21:21:06.801172 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:06.801041    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ebfb2c0-01e8-400b-804d-b902fc48b7b4-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2xvjw\" (UID: \"6ebfb2c0-01e8-400b-804d-b902fc48b7b4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2xvjw"
Jul 16 21:21:06.801172 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:06.801082    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ebfb2c0-01e8-400b-804d-b902fc48b7b4-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2xvjw\" (UID: \"6ebfb2c0-01e8-400b-804d-b902fc48b7b4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2xvjw"
Jul 16 21:21:06.801172 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:06.801153    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ebfb2c0-01e8-400b-804d-b902fc48b7b4-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2xvjw\" (UID: \"6ebfb2c0-01e8-400b-804d-b902fc48b7b4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2xvjw"
Jul 16 21:21:06.901729 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:06.901699    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ebfb2c0-01e8-400b-804d-b902fc48b7b4-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2xvjw\" (UID: \"6ebfb2c0-01e8-400b-804d-b902fc48b7b4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2xvjw"
Jul 16 21:21:06.901878 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:06.901736    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ebfb2c0-01e8-400b-804d-b902fc48b7b4-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2xvjw\" (UID: \"6ebfb2c0-01e8-400b-804d-b902fc48b7b4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2xvjw"
Jul 16 21:21:06.901878 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:06.901777    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtt5r\" (UniqueName: \"kubernetes.io/projected/6ebfb2c0-01e8-400b-804d-b902fc48b7b4-kube-api-access-dtt5r\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2xvjw\" (UID: \"6ebfb2c0-01e8-400b-804d-b902fc48b7b4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2xvjw"
Jul 16 21:21:06.901878 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:06.901796    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ebfb2c0-01e8-400b-804d-b902fc48b7b4-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2xvjw\" (UID: \"6ebfb2c0-01e8-400b-804d-b902fc48b7b4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2xvjw"
Jul 16 21:21:06.901878 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:06.901840    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ebfb2c0-01e8-400b-804d-b902fc48b7b4-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2xvjw\" (UID: \"6ebfb2c0-01e8-400b-804d-b902fc48b7b4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2xvjw"
Jul 16 21:21:06.901878 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:06.901862    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ebfb2c0-01e8-400b-804d-b902fc48b7b4-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2xvjw\" (UID: \"6ebfb2c0-01e8-400b-804d-b902fc48b7b4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2xvjw"
Jul 16 21:21:06.902190 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:06.902160    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ebfb2c0-01e8-400b-804d-b902fc48b7b4-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2xvjw\" (UID: \"6ebfb2c0-01e8-400b-804d-b902fc48b7b4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2xvjw"
Jul 16 21:21:06.902256 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:06.902187    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ebfb2c0-01e8-400b-804d-b902fc48b7b4-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2xvjw\" (UID: \"6ebfb2c0-01e8-400b-804d-b902fc48b7b4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2xvjw"
Jul 16 21:21:06.902256 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:06.902237    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ebfb2c0-01e8-400b-804d-b902fc48b7b4-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2xvjw\" (UID: \"6ebfb2c0-01e8-400b-804d-b902fc48b7b4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2xvjw"
Jul 16 21:21:06.904024 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:06.904001    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ebfb2c0-01e8-400b-804d-b902fc48b7b4-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2xvjw\" (UID: \"6ebfb2c0-01e8-400b-804d-b902fc48b7b4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2xvjw"
Jul 16 21:21:06.904272 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:06.904257    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ebfb2c0-01e8-400b-804d-b902fc48b7b4-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2xvjw\" (UID: \"6ebfb2c0-01e8-400b-804d-b902fc48b7b4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2xvjw"
Jul 16 21:21:06.911387 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:06.911358    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtt5r\" (UniqueName: \"kubernetes.io/projected/6ebfb2c0-01e8-400b-804d-b902fc48b7b4-kube-api-access-dtt5r\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2xvjw\" (UID: \"6ebfb2c0-01e8-400b-804d-b902fc48b7b4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2xvjw"
Jul 16 21:21:07.027121 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:07.027017    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2xvjw"
Jul 16 21:21:07.163360 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:07.160858    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-2xvjw"]
Jul 16 21:21:07.164598 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:21:07.164566    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ebfb2c0_01e8_400b_804d_b902fc48b7b4.slice/crio-2f20ed573363e6562576a6b5f3e1c6dd092628d815b01a2a6212d5aa9b2b7890 WatchSource:0}: Error finding container 2f20ed573363e6562576a6b5f3e1c6dd092628d815b01a2a6212d5aa9b2b7890: Status 404 returned error can't find the container with id 2f20ed573363e6562576a6b5f3e1c6dd092628d815b01a2a6212d5aa9b2b7890
Jul 16 21:21:07.166169 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:07.166151    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 21:21:07.794031 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:07.793996    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2xvjw" event={"ID":"6ebfb2c0-01e8-400b-804d-b902fc48b7b4","Type":"ContainerStarted","Data":"2f20ed573363e6562576a6b5f3e1c6dd092628d815b01a2a6212d5aa9b2b7890"}
Jul 16 21:21:08.220909 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:08.217572    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:21:08.800124 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:08.800063    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2xvjw" event={"ID":"6ebfb2c0-01e8-400b-804d-b902fc48b7b4","Type":"ContainerStarted","Data":"2029a6a54be5a21ce0fa0496a63ed18f9e38440d5e69ed2fa63d44c6d89b8ded"}
Jul 16 21:21:08.828889 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:08.828835    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2xvjw" podStartSLOduration=1.839259514 podStartE2EDuration="2.828819563s" totalImagesPullingTime="989.560049ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:21:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:21:08.828008753 +0000 UTC m=+687.442189070" watchObservedRunningTime="2026-07-16 21:21:08.828819563 +0000 UTC m=+687.442999879"
Jul 16 21:21:17.028168 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:17.028128    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2xvjw"
Jul 16 21:21:17.028565 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:17.028196    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2xvjw"
Jul 16 21:21:17.040413 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:17.040393    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2xvjw"
Jul 16 21:21:17.850561 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:17.850536    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2xvjw"
Jul 16 21:21:24.409762 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:24.409725    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:21:31.673083 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:31.673054    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-xl2zf"]
Jul 16 21:21:31.676529 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:31.676514    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xl2zf"
Jul 16 21:21:31.680826 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:31.680804    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 16 21:21:31.690793 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:31.690772    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-xl2zf"]
Jul 16 21:21:31.816231 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:31.816200    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/40fe75c3-a795-4b3f-b5a9-74e528b77c52-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xl2zf\" (UID: \"40fe75c3-a795-4b3f-b5a9-74e528b77c52\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xl2zf"
Jul 16 21:21:31.816231 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:31.816233    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/40fe75c3-a795-4b3f-b5a9-74e528b77c52-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xl2zf\" (UID: \"40fe75c3-a795-4b3f-b5a9-74e528b77c52\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xl2zf"
Jul 16 21:21:31.816407 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:31.816281    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/40fe75c3-a795-4b3f-b5a9-74e528b77c52-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xl2zf\" (UID: \"40fe75c3-a795-4b3f-b5a9-74e528b77c52\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xl2zf"
Jul 16 21:21:31.816407 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:31.816327    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8jlj\" (UniqueName: \"kubernetes.io/projected/40fe75c3-a795-4b3f-b5a9-74e528b77c52-kube-api-access-r8jlj\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xl2zf\" (UID: \"40fe75c3-a795-4b3f-b5a9-74e528b77c52\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xl2zf"
Jul 16 21:21:31.816407 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:31.816357    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40fe75c3-a795-4b3f-b5a9-74e528b77c52-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xl2zf\" (UID: \"40fe75c3-a795-4b3f-b5a9-74e528b77c52\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xl2zf"
Jul 16 21:21:31.816407 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:31.816374    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40fe75c3-a795-4b3f-b5a9-74e528b77c52-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xl2zf\" (UID: \"40fe75c3-a795-4b3f-b5a9-74e528b77c52\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xl2zf"
Jul 16 21:21:31.917309 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:31.917282    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8jlj\" (UniqueName: \"kubernetes.io/projected/40fe75c3-a795-4b3f-b5a9-74e528b77c52-kube-api-access-r8jlj\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xl2zf\" (UID: \"40fe75c3-a795-4b3f-b5a9-74e528b77c52\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xl2zf"
Jul 16 21:21:31.917490 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:31.917316    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40fe75c3-a795-4b3f-b5a9-74e528b77c52-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xl2zf\" (UID: \"40fe75c3-a795-4b3f-b5a9-74e528b77c52\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xl2zf"
Jul 16 21:21:31.917490 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:31.917336    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40fe75c3-a795-4b3f-b5a9-74e528b77c52-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xl2zf\" (UID: \"40fe75c3-a795-4b3f-b5a9-74e528b77c52\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xl2zf"
Jul 16 21:21:31.917490 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:31.917357    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/40fe75c3-a795-4b3f-b5a9-74e528b77c52-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xl2zf\" (UID: \"40fe75c3-a795-4b3f-b5a9-74e528b77c52\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xl2zf"
Jul 16 21:21:31.917490 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:31.917381    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/40fe75c3-a795-4b3f-b5a9-74e528b77c52-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xl2zf\" (UID: \"40fe75c3-a795-4b3f-b5a9-74e528b77c52\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xl2zf"
Jul 16 21:21:31.917490 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:31.917420    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/40fe75c3-a795-4b3f-b5a9-74e528b77c52-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xl2zf\" (UID: \"40fe75c3-a795-4b3f-b5a9-74e528b77c52\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xl2zf"
Jul 16 21:21:31.917781 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:31.917758    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40fe75c3-a795-4b3f-b5a9-74e528b77c52-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xl2zf\" (UID: \"40fe75c3-a795-4b3f-b5a9-74e528b77c52\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xl2zf"
Jul 16 21:21:31.917863 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:31.917844    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/40fe75c3-a795-4b3f-b5a9-74e528b77c52-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xl2zf\" (UID: \"40fe75c3-a795-4b3f-b5a9-74e528b77c52\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xl2zf"
Jul 16 21:21:31.917922 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:31.917861    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/40fe75c3-a795-4b3f-b5a9-74e528b77c52-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xl2zf\" (UID: \"40fe75c3-a795-4b3f-b5a9-74e528b77c52\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xl2zf"
Jul 16 21:21:31.919619 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:31.919600    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/40fe75c3-a795-4b3f-b5a9-74e528b77c52-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xl2zf\" (UID: \"40fe75c3-a795-4b3f-b5a9-74e528b77c52\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xl2zf"
Jul 16 21:21:31.919838 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:31.919821    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40fe75c3-a795-4b3f-b5a9-74e528b77c52-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xl2zf\" (UID: \"40fe75c3-a795-4b3f-b5a9-74e528b77c52\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xl2zf"
Jul 16 21:21:31.928181 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:31.928047    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8jlj\" (UniqueName: \"kubernetes.io/projected/40fe75c3-a795-4b3f-b5a9-74e528b77c52-kube-api-access-r8jlj\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xl2zf\" (UID: \"40fe75c3-a795-4b3f-b5a9-74e528b77c52\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xl2zf"
Jul 16 21:21:31.985764 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:31.985732    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xl2zf"
Jul 16 21:21:32.150230 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:32.150192    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-xl2zf"]
Jul 16 21:21:32.154724 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:21:32.154697    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40fe75c3_a795_4b3f_b5a9_74e528b77c52.slice/crio-eaa824e4837fc3cbe452f73b14bae3af1bbb2a48d0efd6b4cf9ee86da8107d74 WatchSource:0}: Error finding container eaa824e4837fc3cbe452f73b14bae3af1bbb2a48d0efd6b4cf9ee86da8107d74: Status 404 returned error can't find the container with id eaa824e4837fc3cbe452f73b14bae3af1bbb2a48d0efd6b4cf9ee86da8107d74
Jul 16 21:21:32.906083 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:32.906043    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xl2zf" event={"ID":"40fe75c3-a795-4b3f-b5a9-74e528b77c52","Type":"ContainerStarted","Data":"5015eb3fcc33d5131e4b579e987f4faef05e0882a582231bc4ce372e8285f88e"}
Jul 16 21:21:32.906497 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:32.906146    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xl2zf" event={"ID":"40fe75c3-a795-4b3f-b5a9-74e528b77c52","Type":"ContainerStarted","Data":"eaa824e4837fc3cbe452f73b14bae3af1bbb2a48d0efd6b4cf9ee86da8107d74"}
Jul 16 21:21:32.951146 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:32.951073    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xl2zf" podStartSLOduration=1.780788384 podStartE2EDuration="1.951055698s" totalImagesPullingTime="170.267314ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:21:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:21:32.950127909 +0000 UTC m=+711.564308240" watchObservedRunningTime="2026-07-16 21:21:32.951055698 +0000 UTC m=+711.565236013"
Jul 16 21:21:33.654262 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:33.654232    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:21:41.986417 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:41.986386    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xl2zf"
Jul 16 21:21:41.986859 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:41.986435    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xl2zf"
Jul 16 21:21:41.999912 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:41.999886    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xl2zf"
Jul 16 21:21:42.959258 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:42.959234    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xl2zf"
Jul 16 21:21:48.715991 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:48.715947    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-982x7"]
Jul 16 21:21:48.722246 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:48.722219    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-982x7"
Jul 16 21:21:48.725423 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:48.725401    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 16 21:21:48.731293 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:48.731272    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-982x7"]
Jul 16 21:21:48.860625 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:48.860593    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/39c9a04f-f8c7-41f3-a72b-b3b3112a6456-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-982x7\" (UID: \"39c9a04f-f8c7-41f3-a72b-b3b3112a6456\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-982x7"
Jul 16 21:21:48.860625 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:48.860627    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kds22\" (UniqueName: \"kubernetes.io/projected/39c9a04f-f8c7-41f3-a72b-b3b3112a6456-kube-api-access-kds22\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-982x7\" (UID: \"39c9a04f-f8c7-41f3-a72b-b3b3112a6456\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-982x7"
Jul 16 21:21:48.860812 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:48.860694    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39c9a04f-f8c7-41f3-a72b-b3b3112a6456-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-982x7\" (UID: \"39c9a04f-f8c7-41f3-a72b-b3b3112a6456\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-982x7"
Jul 16 21:21:48.860812 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:48.860712    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/39c9a04f-f8c7-41f3-a72b-b3b3112a6456-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-982x7\" (UID: \"39c9a04f-f8c7-41f3-a72b-b3b3112a6456\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-982x7"
Jul 16 21:21:48.860812 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:48.860732    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/39c9a04f-f8c7-41f3-a72b-b3b3112a6456-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-982x7\" (UID: \"39c9a04f-f8c7-41f3-a72b-b3b3112a6456\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-982x7"
Jul 16 21:21:48.860812 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:48.860750    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39c9a04f-f8c7-41f3-a72b-b3b3112a6456-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-982x7\" (UID: \"39c9a04f-f8c7-41f3-a72b-b3b3112a6456\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-982x7"
Jul 16 21:21:48.961726 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:48.961693    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/39c9a04f-f8c7-41f3-a72b-b3b3112a6456-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-982x7\" (UID: \"39c9a04f-f8c7-41f3-a72b-b3b3112a6456\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-982x7"
Jul 16 21:21:48.961726 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:48.961728    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kds22\" (UniqueName: \"kubernetes.io/projected/39c9a04f-f8c7-41f3-a72b-b3b3112a6456-kube-api-access-kds22\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-982x7\" (UID: \"39c9a04f-f8c7-41f3-a72b-b3b3112a6456\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-982x7"
Jul 16 21:21:48.961916 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:48.961782    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39c9a04f-f8c7-41f3-a72b-b3b3112a6456-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-982x7\" (UID: \"39c9a04f-f8c7-41f3-a72b-b3b3112a6456\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-982x7"
Jul 16 21:21:48.961916 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:48.961806    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/39c9a04f-f8c7-41f3-a72b-b3b3112a6456-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-982x7\" (UID: \"39c9a04f-f8c7-41f3-a72b-b3b3112a6456\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-982x7"
Jul 16 21:21:48.961916 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:48.961831    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/39c9a04f-f8c7-41f3-a72b-b3b3112a6456-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-982x7\" (UID: \"39c9a04f-f8c7-41f3-a72b-b3b3112a6456\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-982x7"
Jul 16 21:21:48.961916 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:48.961853    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39c9a04f-f8c7-41f3-a72b-b3b3112a6456-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-982x7\" (UID: \"39c9a04f-f8c7-41f3-a72b-b3b3112a6456\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-982x7"
Jul 16 21:21:48.962139 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:48.962125    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/39c9a04f-f8c7-41f3-a72b-b3b3112a6456-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-982x7\" (UID: \"39c9a04f-f8c7-41f3-a72b-b3b3112a6456\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-982x7"
Jul 16 21:21:48.962206 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:48.962185    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/39c9a04f-f8c7-41f3-a72b-b3b3112a6456-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-982x7\" (UID: \"39c9a04f-f8c7-41f3-a72b-b3b3112a6456\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-982x7"
Jul 16 21:21:48.962319 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:48.962303    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39c9a04f-f8c7-41f3-a72b-b3b3112a6456-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-982x7\" (UID: \"39c9a04f-f8c7-41f3-a72b-b3b3112a6456\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-982x7"
Jul 16 21:21:48.964063 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:48.964038    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/39c9a04f-f8c7-41f3-a72b-b3b3112a6456-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-982x7\" (UID: \"39c9a04f-f8c7-41f3-a72b-b3b3112a6456\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-982x7"
Jul 16 21:21:48.964309 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:48.964293    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39c9a04f-f8c7-41f3-a72b-b3b3112a6456-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-982x7\" (UID: \"39c9a04f-f8c7-41f3-a72b-b3b3112a6456\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-982x7"
Jul 16 21:21:48.971316 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:48.971252    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kds22\" (UniqueName: \"kubernetes.io/projected/39c9a04f-f8c7-41f3-a72b-b3b3112a6456-kube-api-access-kds22\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-982x7\" (UID: \"39c9a04f-f8c7-41f3-a72b-b3b3112a6456\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-982x7"
Jul 16 21:21:49.032511 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:49.032482    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-982x7"
Jul 16 21:21:49.161734 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:49.161708    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-982x7"]
Jul 16 21:21:49.164534 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:21:49.164508    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod39c9a04f_f8c7_41f3_a72b_b3b3112a6456.slice/crio-fc328a5aa8e38257717bdbfd7b737a9d1c676af057bda59281094476373f3059 WatchSource:0}: Error finding container fc328a5aa8e38257717bdbfd7b737a9d1c676af057bda59281094476373f3059: Status 404 returned error can't find the container with id fc328a5aa8e38257717bdbfd7b737a9d1c676af057bda59281094476373f3059
Jul 16 21:21:49.979388 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:49.979352    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-982x7" event={"ID":"39c9a04f-f8c7-41f3-a72b-b3b3112a6456","Type":"ContainerStarted","Data":"fc328a5aa8e38257717bdbfd7b737a9d1c676af057bda59281094476373f3059"}
Jul 16 21:21:51.211716 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:51.211678    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:21:55.001738 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:55.001707    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-982x7" event={"ID":"39c9a04f-f8c7-41f3-a72b-b3b3112a6456","Type":"ContainerStarted","Data":"497fe9b0c2d22b834f57aabf832123220c8fcc51352e3d4f43655f87ac0df6a0"}
Jul 16 21:21:55.022512 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:55.022464    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-982x7" podStartSLOduration=1.844577551 podStartE2EDuration="7.022447585s" totalImagesPullingTime="5.177870034s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:21:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:21:55.02119341 +0000 UTC m=+733.635373755" watchObservedRunningTime="2026-07-16 21:21:55.022447585 +0000 UTC m=+733.636627900"
Jul 16 21:21:59.033244 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:59.033213    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-982x7"
Jul 16 21:21:59.033685 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:59.033254    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-982x7"
Jul 16 21:21:59.045862 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:21:59.045840    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-982x7"
Jul 16 21:22:00.033291 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:22:00.033256    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-982x7"
Jul 16 21:22:41.620710 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:22:41.620670    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-784bb79bdb-kf4r2"]
Jul 16 21:22:41.624139 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:22:41.624123    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-784bb79bdb-kf4r2"
Jul 16 21:22:41.628286 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:22:41.628266    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-f2xhd\""
Jul 16 21:22:41.628395 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:22:41.628268    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 16 21:22:41.633539 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:22:41.633519    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-784bb79bdb-kf4r2"]
Jul 16 21:22:41.719657 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:22:41.719627    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5t7w4\" (UniqueName: \"kubernetes.io/projected/1d1bc6d9-5692-4705-95d9-bf411ae591d4-kube-api-access-5t7w4\") pod \"authorino-784bb79bdb-kf4r2\" (UID: \"1d1bc6d9-5692-4705-95d9-bf411ae591d4\") " pod="kuadrant-system/authorino-784bb79bdb-kf4r2"
Jul 16 21:22:41.719828 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:22:41.719702    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1d1bc6d9-5692-4705-95d9-bf411ae591d4-tls-cert\") pod \"authorino-784bb79bdb-kf4r2\" (UID: \"1d1bc6d9-5692-4705-95d9-bf411ae591d4\") " pod="kuadrant-system/authorino-784bb79bdb-kf4r2"
Jul 16 21:22:41.821121 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:22:41.821074    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5t7w4\" (UniqueName: \"kubernetes.io/projected/1d1bc6d9-5692-4705-95d9-bf411ae591d4-kube-api-access-5t7w4\") pod \"authorino-784bb79bdb-kf4r2\" (UID: \"1d1bc6d9-5692-4705-95d9-bf411ae591d4\") " pod="kuadrant-system/authorino-784bb79bdb-kf4r2"
Jul 16 21:22:41.821303 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:22:41.821172    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1d1bc6d9-5692-4705-95d9-bf411ae591d4-tls-cert\") pod \"authorino-784bb79bdb-kf4r2\" (UID: \"1d1bc6d9-5692-4705-95d9-bf411ae591d4\") " pod="kuadrant-system/authorino-784bb79bdb-kf4r2"
Jul 16 21:22:41.823963 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:22:41.823946    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 16 21:22:41.830222 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:22:41.830202    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5t7w4\" (UniqueName: \"kubernetes.io/projected/1d1bc6d9-5692-4705-95d9-bf411ae591d4-kube-api-access-5t7w4\") pod \"authorino-784bb79bdb-kf4r2\" (UID: \"1d1bc6d9-5692-4705-95d9-bf411ae591d4\") " pod="kuadrant-system/authorino-784bb79bdb-kf4r2"
Jul 16 21:22:41.833880 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:22:41.833863    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1d1bc6d9-5692-4705-95d9-bf411ae591d4-tls-cert\") pod \"authorino-784bb79bdb-kf4r2\" (UID: \"1d1bc6d9-5692-4705-95d9-bf411ae591d4\") " pod="kuadrant-system/authorino-784bb79bdb-kf4r2"
Jul 16 21:22:41.937848 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:22:41.937827    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-f2xhd\""
Jul 16 21:22:41.944400 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:22:41.944375    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-784bb79bdb-kf4r2"
Jul 16 21:22:42.081671 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:22:42.081650    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-784bb79bdb-kf4r2"]
Jul 16 21:22:42.083756 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:22:42.083720    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1d1bc6d9_5692_4705_95d9_bf411ae591d4.slice/crio-1369d2de9e2304d76ee95f8731d8725ef9afb5ed9cf95257b9dee099e1c9d1d4 WatchSource:0}: Error finding container 1369d2de9e2304d76ee95f8731d8725ef9afb5ed9cf95257b9dee099e1c9d1d4: Status 404 returned error can't find the container with id 1369d2de9e2304d76ee95f8731d8725ef9afb5ed9cf95257b9dee099e1c9d1d4
Jul 16 21:22:42.213277 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:22:42.213193    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-784bb79bdb-kf4r2" event={"ID":"1d1bc6d9-5692-4705-95d9-bf411ae591d4","Type":"ContainerStarted","Data":"1369d2de9e2304d76ee95f8731d8725ef9afb5ed9cf95257b9dee099e1c9d1d4"}
Jul 16 21:22:43.221305 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:22:43.221271    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-784bb79bdb-kf4r2" event={"ID":"1d1bc6d9-5692-4705-95d9-bf411ae591d4","Type":"ContainerStarted","Data":"3feb238acc16969758b50ebe000f529b8d1c535f70261d3cbe5ef08b3051e291"}
Jul 16 21:22:43.406385 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:22:43.405303    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-784bb79bdb-kf4r2" podStartSLOduration=1.85233681 podStartE2EDuration="2.405278393s" totalImagesPullingTime="552.941583ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:22:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:22:43.358650209 +0000 UTC m=+781.972830524" watchObservedRunningTime="2026-07-16 21:22:43.405278393 +0000 UTC m=+782.019458711"
Jul 16 21:23:10.824090 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:23:10.824052    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:23:20.024062 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:23:20.024023    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:23:30.909411 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:23:30.909374    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:25:16.013737 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:25:16.013697    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:25:25.507151 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:25:25.507119    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:26:01.122355 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:26:01.122322    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:26:15.619208 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:26:15.619177    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:26:24.813383 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:26:24.813345    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:26:37.914406 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:26:37.914365    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:26:48.114939 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:26:48.114903    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:26:57.708457 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:26:57.708412    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:27:08.910371 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:27:08.910335    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:27:18.604246 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:27:18.604210    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:27:44.623021 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:27:44.622942    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:27:56.031150 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:27:56.031111    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:28:17.408047 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:28:17.408016    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:28:27.812126 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:28:27.812080    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:28:43.613025 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:28:43.612992    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:28:53.023829 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:28:53.023786    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:29:04.413501 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:29:04.413469    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:29:14.033070 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:29:14.033029    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:29:24.806897 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:29:24.806859    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:31:09.529443 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:31:09.529406    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:31:19.310314 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:31:19.310279    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:31:33.015671 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:31:33.015631    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:31:43.516752 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:31:43.516716    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:31:54.104613 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:31:54.104576    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:32:02.305362 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:32:02.305326    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:32:11.716888 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:32:11.716849    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:32:23.611810 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:32:23.611768    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:32:31.905013 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:32:31.904980    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:32:42.210498 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:32:42.210463    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:32:53.809050 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:32:53.809007    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:33:02.921442 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:33:02.921404    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:33:19.613165 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:33:19.613124    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:33:29.456445 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:33:29.456408    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:33:39.410242 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:33:39.410162    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:33:48.615150 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:33:48.615091    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:33:55.712345 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:33:55.712308    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:34:13.808915 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:34:13.808879    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:34:22.508826 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:34:22.508787    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:34:32.409218 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:34:32.409182    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:34:41.511434 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:34:41.511400    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:34:52.313696 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:34:52.313661    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:35:01.529417 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:35:01.529383    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:35:14.813964 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:35:14.813929    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:35:24.264155 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:35:24.264122    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:35:33.505684 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:35:33.505645    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:35:44.039935 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:35:44.039896    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:35:57.214045 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:35:57.214010    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:36:07.524498 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:36:07.524461    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:36:21.213394 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:36:21.213359    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:36:33.614703 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:36:33.614624    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:36:48.020371 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:36:48.020334    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:36:58.813795 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:36:58.813758    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:37:12.015742 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:37:12.015705    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:37:25.117521 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:37:25.117487    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:40:29.011819 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:40:29.011786    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:40:43.913246 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:40:43.913213    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:41:48.116649 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:41:48.116599    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:42:02.714425 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:42:02.714389    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:48:07.413085 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:48:07.413052    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:48:21.820578 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:48:21.820542    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:51:26.045834 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:51:26.045799    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:53:04.316026 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:53:04.315989    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:53:13.713171 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:53:13.713129    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:53:27.419959 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:53:27.419912    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:53:46.222911 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:53:46.222878    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:54:29.311729 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:54:29.311693    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:54:38.466652 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:54:38.466573    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:55:01.618978 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:55:01.618942    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:55:19.419257 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:55:19.419221    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:56:06.830162 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:56:06.830124    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:56:18.626117 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:56:18.626066    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:57:12.542735 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:57:12.542699    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:57:28.337704 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:57:28.337673    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:57:36.045011 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:57:36.044931    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:57:48.109825 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:57:48.109789    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:58:02.355354 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:58:02.355316    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-6e4744/test-model-6e4744-kserve-86596d76f7-xvlp9"]
Jul 16 21:58:02.358653 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:58:02.358637    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-6e4744/test-model-6e4744-kserve-86596d76f7-xvlp9"
Jul 16 21:58:02.364736 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:58:02.364713    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-6e4744\"/\"kube-root-ca.crt\""
Jul 16 21:58:02.365509 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:58:02.365303    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-6e4744\"/\"default-dockercfg-tzwg6\""
Jul 16 21:58:02.365509 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:58:02.365322    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-6e4744\"/\"openshift-service-ca.crt\""
Jul 16 21:58:02.365509 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:58:02.365440    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-6e4744\"/\"test-model-6e4744-kserve-self-signed-certs\""
Jul 16 21:58:02.380763 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:58:02.380737    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-6e4744/test-model-6e4744-kserve-86596d76f7-xvlp9"]
Jul 16 21:58:02.525223 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:58:02.525186    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd98d27c-b88f-4f54-85cd-f5f6365913c2-tmp-dir\") pod \"test-model-6e4744-kserve-86596d76f7-xvlp9\" (UID: \"fd98d27c-b88f-4f54-85cd-f5f6365913c2\") " pod="ai-tenant-e2e-inf-b-6e4744/test-model-6e4744-kserve-86596d76f7-xvlp9"
Jul 16 21:58:02.525423 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:58:02.525257    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fd98d27c-b88f-4f54-85cd-f5f6365913c2-home\") pod \"test-model-6e4744-kserve-86596d76f7-xvlp9\" (UID: \"fd98d27c-b88f-4f54-85cd-f5f6365913c2\") " pod="ai-tenant-e2e-inf-b-6e4744/test-model-6e4744-kserve-86596d76f7-xvlp9"
Jul 16 21:58:02.525423 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:58:02.525286    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rk6gt\" (UniqueName: \"kubernetes.io/projected/fd98d27c-b88f-4f54-85cd-f5f6365913c2-kube-api-access-rk6gt\") pod \"test-model-6e4744-kserve-86596d76f7-xvlp9\" (UID: \"fd98d27c-b88f-4f54-85cd-f5f6365913c2\") " pod="ai-tenant-e2e-inf-b-6e4744/test-model-6e4744-kserve-86596d76f7-xvlp9"
Jul 16 21:58:02.525423 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:58:02.525369    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd98d27c-b88f-4f54-85cd-f5f6365913c2-tls-certs\") pod \"test-model-6e4744-kserve-86596d76f7-xvlp9\" (UID: \"fd98d27c-b88f-4f54-85cd-f5f6365913c2\") " pod="ai-tenant-e2e-inf-b-6e4744/test-model-6e4744-kserve-86596d76f7-xvlp9"
Jul 16 21:58:02.525582 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:58:02.525436    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fd98d27c-b88f-4f54-85cd-f5f6365913c2-dshm\") pod \"test-model-6e4744-kserve-86596d76f7-xvlp9\" (UID: \"fd98d27c-b88f-4f54-85cd-f5f6365913c2\") " pod="ai-tenant-e2e-inf-b-6e4744/test-model-6e4744-kserve-86596d76f7-xvlp9"
Jul 16 21:58:02.525582 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:58:02.525476    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fd98d27c-b88f-4f54-85cd-f5f6365913c2-model-cache\") pod \"test-model-6e4744-kserve-86596d76f7-xvlp9\" (UID: \"fd98d27c-b88f-4f54-85cd-f5f6365913c2\") " pod="ai-tenant-e2e-inf-b-6e4744/test-model-6e4744-kserve-86596d76f7-xvlp9"
Jul 16 21:58:02.626559 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:58:02.626470    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fd98d27c-b88f-4f54-85cd-f5f6365913c2-home\") pod \"test-model-6e4744-kserve-86596d76f7-xvlp9\" (UID: \"fd98d27c-b88f-4f54-85cd-f5f6365913c2\") " pod="ai-tenant-e2e-inf-b-6e4744/test-model-6e4744-kserve-86596d76f7-xvlp9"
Jul 16 21:58:02.626559 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:58:02.626517    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rk6gt\" (UniqueName: \"kubernetes.io/projected/fd98d27c-b88f-4f54-85cd-f5f6365913c2-kube-api-access-rk6gt\") pod \"test-model-6e4744-kserve-86596d76f7-xvlp9\" (UID: \"fd98d27c-b88f-4f54-85cd-f5f6365913c2\") " pod="ai-tenant-e2e-inf-b-6e4744/test-model-6e4744-kserve-86596d76f7-xvlp9"
Jul 16 21:58:02.626793 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:58:02.626571    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd98d27c-b88f-4f54-85cd-f5f6365913c2-tls-certs\") pod \"test-model-6e4744-kserve-86596d76f7-xvlp9\" (UID: \"fd98d27c-b88f-4f54-85cd-f5f6365913c2\") " pod="ai-tenant-e2e-inf-b-6e4744/test-model-6e4744-kserve-86596d76f7-xvlp9"
Jul 16 21:58:02.626793 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:58:02.626614    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fd98d27c-b88f-4f54-85cd-f5f6365913c2-dshm\") pod \"test-model-6e4744-kserve-86596d76f7-xvlp9\" (UID: \"fd98d27c-b88f-4f54-85cd-f5f6365913c2\") " pod="ai-tenant-e2e-inf-b-6e4744/test-model-6e4744-kserve-86596d76f7-xvlp9"
Jul 16 21:58:02.626793 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:58:02.626644    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fd98d27c-b88f-4f54-85cd-f5f6365913c2-model-cache\") pod \"test-model-6e4744-kserve-86596d76f7-xvlp9\" (UID: \"fd98d27c-b88f-4f54-85cd-f5f6365913c2\") " pod="ai-tenant-e2e-inf-b-6e4744/test-model-6e4744-kserve-86596d76f7-xvlp9"
Jul 16 21:58:02.626793 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:58:02.626667    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd98d27c-b88f-4f54-85cd-f5f6365913c2-tmp-dir\") pod \"test-model-6e4744-kserve-86596d76f7-xvlp9\" (UID: \"fd98d27c-b88f-4f54-85cd-f5f6365913c2\") " pod="ai-tenant-e2e-inf-b-6e4744/test-model-6e4744-kserve-86596d76f7-xvlp9"
Jul 16 21:58:02.626983 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:58:02.626930    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fd98d27c-b88f-4f54-85cd-f5f6365913c2-home\") pod \"test-model-6e4744-kserve-86596d76f7-xvlp9\" (UID: \"fd98d27c-b88f-4f54-85cd-f5f6365913c2\") " pod="ai-tenant-e2e-inf-b-6e4744/test-model-6e4744-kserve-86596d76f7-xvlp9"
Jul 16 21:58:02.626983 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:58:02.626967    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd98d27c-b88f-4f54-85cd-f5f6365913c2-tmp-dir\") pod \"test-model-6e4744-kserve-86596d76f7-xvlp9\" (UID: \"fd98d27c-b88f-4f54-85cd-f5f6365913c2\") " pod="ai-tenant-e2e-inf-b-6e4744/test-model-6e4744-kserve-86596d76f7-xvlp9"
Jul 16 21:58:02.627118 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:58:02.627081    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fd98d27c-b88f-4f54-85cd-f5f6365913c2-model-cache\") pod \"test-model-6e4744-kserve-86596d76f7-xvlp9\" (UID: \"fd98d27c-b88f-4f54-85cd-f5f6365913c2\") " pod="ai-tenant-e2e-inf-b-6e4744/test-model-6e4744-kserve-86596d76f7-xvlp9"
Jul 16 21:58:02.628875 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:58:02.628853    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fd98d27c-b88f-4f54-85cd-f5f6365913c2-dshm\") pod \"test-model-6e4744-kserve-86596d76f7-xvlp9\" (UID: \"fd98d27c-b88f-4f54-85cd-f5f6365913c2\") " pod="ai-tenant-e2e-inf-b-6e4744/test-model-6e4744-kserve-86596d76f7-xvlp9"
Jul 16 21:58:02.629300 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:58:02.629283    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd98d27c-b88f-4f54-85cd-f5f6365913c2-tls-certs\") pod \"test-model-6e4744-kserve-86596d76f7-xvlp9\" (UID: \"fd98d27c-b88f-4f54-85cd-f5f6365913c2\") " pod="ai-tenant-e2e-inf-b-6e4744/test-model-6e4744-kserve-86596d76f7-xvlp9"
Jul 16 21:58:02.636628 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:58:02.636597    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rk6gt\" (UniqueName: \"kubernetes.io/projected/fd98d27c-b88f-4f54-85cd-f5f6365913c2-kube-api-access-rk6gt\") pod \"test-model-6e4744-kserve-86596d76f7-xvlp9\" (UID: \"fd98d27c-b88f-4f54-85cd-f5f6365913c2\") " pod="ai-tenant-e2e-inf-b-6e4744/test-model-6e4744-kserve-86596d76f7-xvlp9"
Jul 16 21:58:02.667481 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:58:02.667442    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-6e4744/test-model-6e4744-kserve-86596d76f7-xvlp9"
Jul 16 21:58:02.805982 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:58:02.805957    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-6e4744/test-model-6e4744-kserve-86596d76f7-xvlp9"]
Jul 16 21:58:02.808222 ip-10-0-133-58 kubenswrapper[2579]: W0716 21:58:02.808199    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfd98d27c_b88f_4f54_85cd_f5f6365913c2.slice/crio-301e18545991ffabb18388d2e51982c9eb96170750fe43735357f72a8ff05a41 WatchSource:0}: Error finding container 301e18545991ffabb18388d2e51982c9eb96170750fe43735357f72a8ff05a41: Status 404 returned error can't find the container with id 301e18545991ffabb18388d2e51982c9eb96170750fe43735357f72a8ff05a41
Jul 16 21:58:03.710721 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:58:03.710684    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-6e4744/test-model-6e4744-kserve-86596d76f7-xvlp9" event={"ID":"fd98d27c-b88f-4f54-85cd-f5f6365913c2","Type":"ContainerStarted","Data":"26f8c687cad9ca3633c7d8d499dba54a176ee1ed834c3bf8b73bc1e5c3578196"}
Jul 16 21:58:03.710721 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:58:03.710729    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-6e4744/test-model-6e4744-kserve-86596d76f7-xvlp9" event={"ID":"fd98d27c-b88f-4f54-85cd-f5f6365913c2","Type":"ContainerStarted","Data":"301e18545991ffabb18388d2e51982c9eb96170750fe43735357f72a8ff05a41"}
Jul 16 21:58:03.730630 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:58:03.730584    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-6e4744/test-model-6e4744-kserve-86596d76f7-xvlp9" podStartSLOduration=1.7305694310000002 podStartE2EDuration="1.730569431s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:58:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:58:03.728091673 +0000 UTC m=+2902.342271990" watchObservedRunningTime="2026-07-16 21:58:03.730569431 +0000 UTC m=+2902.344749802"
Jul 16 21:58:12.667954 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:58:12.667913    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-6e4744/test-model-6e4744-kserve-86596d76f7-xvlp9"
Jul 16 21:58:12.668413 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:58:12.668173    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-6e4744/test-model-6e4744-kserve-86596d76f7-xvlp9"
Jul 16 21:58:12.680243 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:58:12.680224    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-6e4744/test-model-6e4744-kserve-86596d76f7-xvlp9"
Jul 16 21:58:12.761456 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:58:12.761430    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-6e4744/test-model-6e4744-kserve-86596d76f7-xvlp9"
Jul 16 21:58:16.748015 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:58:16.747966    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:58:24.236324 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:58:24.236280    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-6e4744/test-model-6e4744-kserve-86596d76f7-xvlp9"]
Jul 16 21:58:36.318846 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:58:36.318809    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:58:39.255987 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:58:39.255948    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-6e4744/test-model-6e4744-kserve-86596d76f7-xvlp9" podUID="fd98d27c-b88f-4f54-85cd-f5f6365913c2" containerName="main" containerID="cri-o://26f8c687cad9ca3633c7d8d499dba54a176ee1ed834c3bf8b73bc1e5c3578196" gracePeriod=45
Jul 16 21:58:39.500913 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:58:39.500889    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-6e4744/test-model-6e4744-kserve-86596d76f7-xvlp9"
Jul 16 21:58:39.535601 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:58:39.535536    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd98d27c-b88f-4f54-85cd-f5f6365913c2-tls-certs\") pod \"fd98d27c-b88f-4f54-85cd-f5f6365913c2\" (UID: \"fd98d27c-b88f-4f54-85cd-f5f6365913c2\") "
Jul 16 21:58:39.535601 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:58:39.535582    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fd98d27c-b88f-4f54-85cd-f5f6365913c2-dshm\") pod \"fd98d27c-b88f-4f54-85cd-f5f6365913c2\" (UID: \"fd98d27c-b88f-4f54-85cd-f5f6365913c2\") "
Jul 16 21:58:39.535785 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:58:39.535646    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd98d27c-b88f-4f54-85cd-f5f6365913c2-tmp-dir\") pod \"fd98d27c-b88f-4f54-85cd-f5f6365913c2\" (UID: \"fd98d27c-b88f-4f54-85cd-f5f6365913c2\") "
Jul 16 21:58:39.535785 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:58:39.535682    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rk6gt\" (UniqueName: \"kubernetes.io/projected/fd98d27c-b88f-4f54-85cd-f5f6365913c2-kube-api-access-rk6gt\") pod \"fd98d27c-b88f-4f54-85cd-f5f6365913c2\" (UID: \"fd98d27c-b88f-4f54-85cd-f5f6365913c2\") "
Jul 16 21:58:39.535785 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:58:39.535714    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fd98d27c-b88f-4f54-85cd-f5f6365913c2-home\") pod \"fd98d27c-b88f-4f54-85cd-f5f6365913c2\" (UID: \"fd98d27c-b88f-4f54-85cd-f5f6365913c2\") "
Jul 16 21:58:39.535785 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:58:39.535736    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fd98d27c-b88f-4f54-85cd-f5f6365913c2-model-cache\") pod \"fd98d27c-b88f-4f54-85cd-f5f6365913c2\" (UID: \"fd98d27c-b88f-4f54-85cd-f5f6365913c2\") "
Jul 16 21:58:39.536003 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:58:39.535918    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd98d27c-b88f-4f54-85cd-f5f6365913c2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fd98d27c-b88f-4f54-85cd-f5f6365913c2" (UID: "fd98d27c-b88f-4f54-85cd-f5f6365913c2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 21:58:39.536054 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:58:39.536025    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd98d27c-b88f-4f54-85cd-f5f6365913c2-tmp-dir\") on node \"ip-10-0-133-58.ec2.internal\" DevicePath \"\""
Jul 16 21:58:39.536155 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:58:39.536134    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd98d27c-b88f-4f54-85cd-f5f6365913c2-model-cache" (OuterVolumeSpecName: "model-cache") pod "fd98d27c-b88f-4f54-85cd-f5f6365913c2" (UID: "fd98d27c-b88f-4f54-85cd-f5f6365913c2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 21:58:39.536228 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:58:39.536154    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd98d27c-b88f-4f54-85cd-f5f6365913c2-home" (OuterVolumeSpecName: "home") pod "fd98d27c-b88f-4f54-85cd-f5f6365913c2" (UID: "fd98d27c-b88f-4f54-85cd-f5f6365913c2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 21:58:39.537857 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:58:39.537831    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd98d27c-b88f-4f54-85cd-f5f6365913c2-dshm" (OuterVolumeSpecName: "dshm") pod "fd98d27c-b88f-4f54-85cd-f5f6365913c2" (UID: "fd98d27c-b88f-4f54-85cd-f5f6365913c2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 21:58:39.537857 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:58:39.537830    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd98d27c-b88f-4f54-85cd-f5f6365913c2-kube-api-access-rk6gt" (OuterVolumeSpecName: "kube-api-access-rk6gt") pod "fd98d27c-b88f-4f54-85cd-f5f6365913c2" (UID: "fd98d27c-b88f-4f54-85cd-f5f6365913c2"). InnerVolumeSpecName "kube-api-access-rk6gt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 21:58:39.537983 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:58:39.537875    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd98d27c-b88f-4f54-85cd-f5f6365913c2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fd98d27c-b88f-4f54-85cd-f5f6365913c2" (UID: "fd98d27c-b88f-4f54-85cd-f5f6365913c2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 21:58:39.637245 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:58:39.637216    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rk6gt\" (UniqueName: \"kubernetes.io/projected/fd98d27c-b88f-4f54-85cd-f5f6365913c2-kube-api-access-rk6gt\") on node \"ip-10-0-133-58.ec2.internal\" DevicePath \"\""
Jul 16 21:58:39.637245 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:58:39.637241    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fd98d27c-b88f-4f54-85cd-f5f6365913c2-home\") on node \"ip-10-0-133-58.ec2.internal\" DevicePath \"\""
Jul 16 21:58:39.637245 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:58:39.637252    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fd98d27c-b88f-4f54-85cd-f5f6365913c2-model-cache\") on node \"ip-10-0-133-58.ec2.internal\" DevicePath \"\""
Jul 16 21:58:39.637443 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:58:39.637261    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd98d27c-b88f-4f54-85cd-f5f6365913c2-tls-certs\") on node \"ip-10-0-133-58.ec2.internal\" DevicePath \"\""
Jul 16 21:58:39.637443 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:58:39.637269    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fd98d27c-b88f-4f54-85cd-f5f6365913c2-dshm\") on node \"ip-10-0-133-58.ec2.internal\" DevicePath \"\""
Jul 16 21:58:39.869739 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:58:39.869651    2579 generic.go:356] "Generic (PLEG): container finished" podID="fd98d27c-b88f-4f54-85cd-f5f6365913c2" containerID="26f8c687cad9ca3633c7d8d499dba54a176ee1ed834c3bf8b73bc1e5c3578196" exitCode=0
Jul 16 21:58:39.869739 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:58:39.869701    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-6e4744/test-model-6e4744-kserve-86596d76f7-xvlp9"
Jul 16 21:58:39.869979 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:58:39.869731    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-6e4744/test-model-6e4744-kserve-86596d76f7-xvlp9" event={"ID":"fd98d27c-b88f-4f54-85cd-f5f6365913c2","Type":"ContainerDied","Data":"26f8c687cad9ca3633c7d8d499dba54a176ee1ed834c3bf8b73bc1e5c3578196"}
Jul 16 21:58:39.869979 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:58:39.869773    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-6e4744/test-model-6e4744-kserve-86596d76f7-xvlp9" event={"ID":"fd98d27c-b88f-4f54-85cd-f5f6365913c2","Type":"ContainerDied","Data":"301e18545991ffabb18388d2e51982c9eb96170750fe43735357f72a8ff05a41"}
Jul 16 21:58:39.869979 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:58:39.869790    2579 scope.go:117] "RemoveContainer" containerID="26f8c687cad9ca3633c7d8d499dba54a176ee1ed834c3bf8b73bc1e5c3578196"
Jul 16 21:58:39.878997 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:58:39.878978    2579 scope.go:117] "RemoveContainer" containerID="26f8c687cad9ca3633c7d8d499dba54a176ee1ed834c3bf8b73bc1e5c3578196"
Jul 16 21:58:39.879265 ip-10-0-133-58 kubenswrapper[2579]: E0716 21:58:39.879246    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26f8c687cad9ca3633c7d8d499dba54a176ee1ed834c3bf8b73bc1e5c3578196\": container with ID starting with 26f8c687cad9ca3633c7d8d499dba54a176ee1ed834c3bf8b73bc1e5c3578196 not found: ID does not exist" containerID="26f8c687cad9ca3633c7d8d499dba54a176ee1ed834c3bf8b73bc1e5c3578196"
Jul 16 21:58:39.879321 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:58:39.879277    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26f8c687cad9ca3633c7d8d499dba54a176ee1ed834c3bf8b73bc1e5c3578196"} err="failed to get container status \"26f8c687cad9ca3633c7d8d499dba54a176ee1ed834c3bf8b73bc1e5c3578196\": rpc error: code = NotFound desc = could not find container \"26f8c687cad9ca3633c7d8d499dba54a176ee1ed834c3bf8b73bc1e5c3578196\": container with ID starting with 26f8c687cad9ca3633c7d8d499dba54a176ee1ed834c3bf8b73bc1e5c3578196 not found: ID does not exist"
Jul 16 21:58:39.892349 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:58:39.892329    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-6e4744/test-model-6e4744-kserve-86596d76f7-xvlp9"]
Jul 16 21:58:39.896064 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:58:39.896043    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-6e4744/test-model-6e4744-kserve-86596d76f7-xvlp9"]
Jul 16 21:58:39.971496 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:58:39.971465    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd98d27c-b88f-4f54-85cd-f5f6365913c2" path="/var/lib/kubelet/pods/fd98d27c-b88f-4f54-85cd-f5f6365913c2/volumes"
Jul 16 21:58:47.000236 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:58:47.000198    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:59:04.416929 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:59:04.416886    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:59:25.441069 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:59:25.441019    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:59:40.522019 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:59:40.521986    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 21:59:55.716620 ip-10-0-133-58 kubenswrapper[2579]: I0716 21:59:55.716572    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 22:00:22.417808 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:00:22.417776    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 22:00:43.238176 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:00:43.238078    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 22:00:58.811263 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:00:58.811234    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 22:01:10.613765 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:01:10.613728    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 22:01:31.716941 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:01:31.716909    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-a87ce2/auth-test-model-a87ce2-kserve-86b5fc479-757xm"]
Jul 16 22:01:31.717365 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:01:31.717294    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd98d27c-b88f-4f54-85cd-f5f6365913c2" containerName="main"
Jul 16 22:01:31.717365 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:01:31.717307    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd98d27c-b88f-4f54-85cd-f5f6365913c2" containerName="main"
Jul 16 22:01:31.717365 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:01:31.717366    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd98d27c-b88f-4f54-85cd-f5f6365913c2" containerName="main"
Jul 16 22:01:31.720073 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:01:31.720059    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a87ce2/auth-test-model-a87ce2-kserve-86b5fc479-757xm"
Jul 16 22:01:31.723059 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:01:31.723036    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-a87ce2\"/\"kube-root-ca.crt\""
Jul 16 22:01:31.724329 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:01:31.724309    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-a87ce2\"/\"default-dockercfg-xjdhw\""
Jul 16 22:01:31.724445 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:01:31.724312    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-a87ce2\"/\"auth-test-model-a87ce2-kserve-self-signed-certs\""
Jul 16 22:01:31.724445 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:01:31.724312    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-a87ce2\"/\"openshift-service-ca.crt\""
Jul 16 22:01:31.733076 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:01:31.733054    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-a87ce2/auth-test-model-a87ce2-kserve-86b5fc479-757xm"]
Jul 16 22:01:31.836564 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:01:31.836531    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5533b47f-c848-46ea-8d02-f323672044e8-tmp-dir\") pod \"auth-test-model-a87ce2-kserve-86b5fc479-757xm\" (UID: \"5533b47f-c848-46ea-8d02-f323672044e8\") " pod="ai-tenant-e2e-shared-b-a87ce2/auth-test-model-a87ce2-kserve-86b5fc479-757xm"
Jul 16 22:01:31.836732 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:01:31.836571    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bw2fp\" (UniqueName: \"kubernetes.io/projected/5533b47f-c848-46ea-8d02-f323672044e8-kube-api-access-bw2fp\") pod \"auth-test-model-a87ce2-kserve-86b5fc479-757xm\" (UID: \"5533b47f-c848-46ea-8d02-f323672044e8\") " pod="ai-tenant-e2e-shared-b-a87ce2/auth-test-model-a87ce2-kserve-86b5fc479-757xm"
Jul 16 22:01:31.836732 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:01:31.836645    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5533b47f-c848-46ea-8d02-f323672044e8-dshm\") pod \"auth-test-model-a87ce2-kserve-86b5fc479-757xm\" (UID: \"5533b47f-c848-46ea-8d02-f323672044e8\") " pod="ai-tenant-e2e-shared-b-a87ce2/auth-test-model-a87ce2-kserve-86b5fc479-757xm"
Jul 16 22:01:31.836732 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:01:31.836673    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5533b47f-c848-46ea-8d02-f323672044e8-model-cache\") pod \"auth-test-model-a87ce2-kserve-86b5fc479-757xm\" (UID: \"5533b47f-c848-46ea-8d02-f323672044e8\") " pod="ai-tenant-e2e-shared-b-a87ce2/auth-test-model-a87ce2-kserve-86b5fc479-757xm"
Jul 16 22:01:31.836732 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:01:31.836697    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5533b47f-c848-46ea-8d02-f323672044e8-home\") pod \"auth-test-model-a87ce2-kserve-86b5fc479-757xm\" (UID: \"5533b47f-c848-46ea-8d02-f323672044e8\") " pod="ai-tenant-e2e-shared-b-a87ce2/auth-test-model-a87ce2-kserve-86b5fc479-757xm"
Jul 16 22:01:31.836732 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:01:31.836719    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5533b47f-c848-46ea-8d02-f323672044e8-tls-certs\") pod \"auth-test-model-a87ce2-kserve-86b5fc479-757xm\" (UID: \"5533b47f-c848-46ea-8d02-f323672044e8\") " pod="ai-tenant-e2e-shared-b-a87ce2/auth-test-model-a87ce2-kserve-86b5fc479-757xm"
Jul 16 22:01:31.937598 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:01:31.937558    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bw2fp\" (UniqueName: \"kubernetes.io/projected/5533b47f-c848-46ea-8d02-f323672044e8-kube-api-access-bw2fp\") pod \"auth-test-model-a87ce2-kserve-86b5fc479-757xm\" (UID: \"5533b47f-c848-46ea-8d02-f323672044e8\") " pod="ai-tenant-e2e-shared-b-a87ce2/auth-test-model-a87ce2-kserve-86b5fc479-757xm"
Jul 16 22:01:31.937776 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:01:31.937637    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5533b47f-c848-46ea-8d02-f323672044e8-dshm\") pod \"auth-test-model-a87ce2-kserve-86b5fc479-757xm\" (UID: \"5533b47f-c848-46ea-8d02-f323672044e8\") " pod="ai-tenant-e2e-shared-b-a87ce2/auth-test-model-a87ce2-kserve-86b5fc479-757xm"
Jul 16 22:01:31.937776 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:01:31.937664    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5533b47f-c848-46ea-8d02-f323672044e8-model-cache\") pod \"auth-test-model-a87ce2-kserve-86b5fc479-757xm\" (UID: \"5533b47f-c848-46ea-8d02-f323672044e8\") " pod="ai-tenant-e2e-shared-b-a87ce2/auth-test-model-a87ce2-kserve-86b5fc479-757xm"
Jul 16 22:01:31.937776 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:01:31.937690    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5533b47f-c848-46ea-8d02-f323672044e8-home\") pod \"auth-test-model-a87ce2-kserve-86b5fc479-757xm\" (UID: \"5533b47f-c848-46ea-8d02-f323672044e8\") " pod="ai-tenant-e2e-shared-b-a87ce2/auth-test-model-a87ce2-kserve-86b5fc479-757xm"
Jul 16 22:01:31.937776 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:01:31.937723    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5533b47f-c848-46ea-8d02-f323672044e8-tls-certs\") pod \"auth-test-model-a87ce2-kserve-86b5fc479-757xm\" (UID: \"5533b47f-c848-46ea-8d02-f323672044e8\") " pod="ai-tenant-e2e-shared-b-a87ce2/auth-test-model-a87ce2-kserve-86b5fc479-757xm"
Jul 16 22:01:31.938030 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:01:31.937835    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5533b47f-c848-46ea-8d02-f323672044e8-tmp-dir\") pod \"auth-test-model-a87ce2-kserve-86b5fc479-757xm\" (UID: \"5533b47f-c848-46ea-8d02-f323672044e8\") " pod="ai-tenant-e2e-shared-b-a87ce2/auth-test-model-a87ce2-kserve-86b5fc479-757xm"
Jul 16 22:01:31.938087 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:01:31.938068    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5533b47f-c848-46ea-8d02-f323672044e8-home\") pod \"auth-test-model-a87ce2-kserve-86b5fc479-757xm\" (UID: \"5533b47f-c848-46ea-8d02-f323672044e8\") " pod="ai-tenant-e2e-shared-b-a87ce2/auth-test-model-a87ce2-kserve-86b5fc479-757xm"
Jul 16 22:01:31.938244 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:01:31.938217    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5533b47f-c848-46ea-8d02-f323672044e8-tmp-dir\") pod \"auth-test-model-a87ce2-kserve-86b5fc479-757xm\" (UID: \"5533b47f-c848-46ea-8d02-f323672044e8\") " pod="ai-tenant-e2e-shared-b-a87ce2/auth-test-model-a87ce2-kserve-86b5fc479-757xm"
Jul 16 22:01:31.938379 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:01:31.938353    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5533b47f-c848-46ea-8d02-f323672044e8-model-cache\") pod \"auth-test-model-a87ce2-kserve-86b5fc479-757xm\" (UID: \"5533b47f-c848-46ea-8d02-f323672044e8\") " pod="ai-tenant-e2e-shared-b-a87ce2/auth-test-model-a87ce2-kserve-86b5fc479-757xm"
Jul 16 22:01:31.940638 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:01:31.940616    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5533b47f-c848-46ea-8d02-f323672044e8-dshm\") pod \"auth-test-model-a87ce2-kserve-86b5fc479-757xm\" (UID: \"5533b47f-c848-46ea-8d02-f323672044e8\") " pod="ai-tenant-e2e-shared-b-a87ce2/auth-test-model-a87ce2-kserve-86b5fc479-757xm"
Jul 16 22:01:31.940811 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:01:31.940793    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5533b47f-c848-46ea-8d02-f323672044e8-tls-certs\") pod \"auth-test-model-a87ce2-kserve-86b5fc479-757xm\" (UID: \"5533b47f-c848-46ea-8d02-f323672044e8\") " pod="ai-tenant-e2e-shared-b-a87ce2/auth-test-model-a87ce2-kserve-86b5fc479-757xm"
Jul 16 22:01:31.948631 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:01:31.948598    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bw2fp\" (UniqueName: \"kubernetes.io/projected/5533b47f-c848-46ea-8d02-f323672044e8-kube-api-access-bw2fp\") pod \"auth-test-model-a87ce2-kserve-86b5fc479-757xm\" (UID: \"5533b47f-c848-46ea-8d02-f323672044e8\") " pod="ai-tenant-e2e-shared-b-a87ce2/auth-test-model-a87ce2-kserve-86b5fc479-757xm"
Jul 16 22:01:32.029266 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:01:32.029187    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a87ce2/auth-test-model-a87ce2-kserve-86b5fc479-757xm"
Jul 16 22:01:32.161213 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:01:32.161190    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-a87ce2/auth-test-model-a87ce2-kserve-86b5fc479-757xm"]
Jul 16 22:01:32.163197 ip-10-0-133-58 kubenswrapper[2579]: W0716 22:01:32.163169    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5533b47f_c848_46ea_8d02_f323672044e8.slice/crio-de51de1c51c95eb08e42297b99a3947f7596f0e790df6cc899e8c55755c05eb8 WatchSource:0}: Error finding container de51de1c51c95eb08e42297b99a3947f7596f0e790df6cc899e8c55755c05eb8: Status 404 returned error can't find the container with id de51de1c51c95eb08e42297b99a3947f7596f0e790df6cc899e8c55755c05eb8
Jul 16 22:01:32.660204 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:01:32.660168    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a87ce2/auth-test-model-a87ce2-kserve-86b5fc479-757xm" event={"ID":"5533b47f-c848-46ea-8d02-f323672044e8","Type":"ContainerStarted","Data":"8cea81fae2fe193cac42cb6fe5a0e734d66e4132e0eee80b7b1d2b178d14e665"}
Jul 16 22:01:32.660390 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:01:32.660217    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a87ce2/auth-test-model-a87ce2-kserve-86b5fc479-757xm" event={"ID":"5533b47f-c848-46ea-8d02-f323672044e8","Type":"ContainerStarted","Data":"de51de1c51c95eb08e42297b99a3947f7596f0e790df6cc899e8c55755c05eb8"}
Jul 16 22:01:32.678673 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:01:32.678630    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-a87ce2/auth-test-model-a87ce2-kserve-86b5fc479-757xm" podStartSLOduration=1.678614943 podStartE2EDuration="1.678614943s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:01:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:01:32.677223273 +0000 UTC m=+3111.291403590" watchObservedRunningTime="2026-07-16 22:01:32.678614943 +0000 UTC m=+3111.292795292"
Jul 16 22:01:35.213661 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:01:35.213624    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 22:01:42.029703 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:01:42.029668    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-a87ce2/auth-test-model-a87ce2-kserve-86b5fc479-757xm"
Jul 16 22:01:42.030079 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:01:42.029714    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-a87ce2/auth-test-model-a87ce2-kserve-86b5fc479-757xm"
Jul 16 22:01:42.041916 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:01:42.041892    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-a87ce2/auth-test-model-a87ce2-kserve-86b5fc479-757xm"
Jul 16 22:01:42.717027 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:01:42.716993    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-a87ce2/auth-test-model-a87ce2-kserve-86b5fc479-757xm"
Jul 16 22:01:53.013798 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:01:53.013763    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 22:02:10.155929 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:02:10.155895    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 22:02:25.410897 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:02:25.410863    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 22:02:42.705544 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:02:42.705508    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 22:03:01.609012 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:03:01.608973    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 22:03:18.608756 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:03:18.608723    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 22:03:33.432239 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:03:33.432154    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-a87ce2/auth-test-model-a87ce2-kserve-86b5fc479-757xm"]
Jul 16 22:03:37.226393 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:03:37.226359    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 22:03:40.325774 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:03:40.325737    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-2140ea/sub-test-model-2140ea-kserve-59d58c8d69-xcd9g"]
Jul 16 22:03:40.329225 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:03:40.329209    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2140ea/sub-test-model-2140ea-kserve-59d58c8d69-xcd9g"
Jul 16 22:03:40.332167 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:03:40.332091    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-2140ea\"/\"openshift-service-ca.crt\""
Jul 16 22:03:40.332366 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:03:40.332349    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-2140ea\"/\"sub-test-model-2140ea-kserve-self-signed-certs\""
Jul 16 22:03:40.333485 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:03:40.333469    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-2140ea\"/\"default-dockercfg-c6g54\""
Jul 16 22:03:40.333576 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:03:40.333542    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-2140ea\"/\"kube-root-ca.crt\""
Jul 16 22:03:40.340966 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:03:40.340945    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-2140ea/sub-test-model-2140ea-kserve-59d58c8d69-xcd9g"]
Jul 16 22:03:40.490819 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:03:40.490781    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/afab8b6b-f8af-494a-a5e7-30dc4e8e97be-tmp-dir\") pod \"sub-test-model-2140ea-kserve-59d58c8d69-xcd9g\" (UID: \"afab8b6b-f8af-494a-a5e7-30dc4e8e97be\") " pod="ai-tenant-e2e-shared-a-2140ea/sub-test-model-2140ea-kserve-59d58c8d69-xcd9g"
Jul 16 22:03:40.490819 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:03:40.490825    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/afab8b6b-f8af-494a-a5e7-30dc4e8e97be-home\") pod \"sub-test-model-2140ea-kserve-59d58c8d69-xcd9g\" (UID: \"afab8b6b-f8af-494a-a5e7-30dc4e8e97be\") " pod="ai-tenant-e2e-shared-a-2140ea/sub-test-model-2140ea-kserve-59d58c8d69-xcd9g"
Jul 16 22:03:40.491029 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:03:40.490881    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/afab8b6b-f8af-494a-a5e7-30dc4e8e97be-dshm\") pod \"sub-test-model-2140ea-kserve-59d58c8d69-xcd9g\" (UID: \"afab8b6b-f8af-494a-a5e7-30dc4e8e97be\") " pod="ai-tenant-e2e-shared-a-2140ea/sub-test-model-2140ea-kserve-59d58c8d69-xcd9g"
Jul 16 22:03:40.491029 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:03:40.490954    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/afab8b6b-f8af-494a-a5e7-30dc4e8e97be-tls-certs\") pod \"sub-test-model-2140ea-kserve-59d58c8d69-xcd9g\" (UID: \"afab8b6b-f8af-494a-a5e7-30dc4e8e97be\") " pod="ai-tenant-e2e-shared-a-2140ea/sub-test-model-2140ea-kserve-59d58c8d69-xcd9g"
Jul 16 22:03:40.491029 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:03:40.490978    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/afab8b6b-f8af-494a-a5e7-30dc4e8e97be-model-cache\") pod \"sub-test-model-2140ea-kserve-59d58c8d69-xcd9g\" (UID: \"afab8b6b-f8af-494a-a5e7-30dc4e8e97be\") " pod="ai-tenant-e2e-shared-a-2140ea/sub-test-model-2140ea-kserve-59d58c8d69-xcd9g"
Jul 16 22:03:40.491029 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:03:40.491011    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbvhz\" (UniqueName: \"kubernetes.io/projected/afab8b6b-f8af-494a-a5e7-30dc4e8e97be-kube-api-access-sbvhz\") pod \"sub-test-model-2140ea-kserve-59d58c8d69-xcd9g\" (UID: \"afab8b6b-f8af-494a-a5e7-30dc4e8e97be\") " pod="ai-tenant-e2e-shared-a-2140ea/sub-test-model-2140ea-kserve-59d58c8d69-xcd9g"
Jul 16 22:03:40.592186 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:03:40.592081    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/afab8b6b-f8af-494a-a5e7-30dc4e8e97be-home\") pod \"sub-test-model-2140ea-kserve-59d58c8d69-xcd9g\" (UID: \"afab8b6b-f8af-494a-a5e7-30dc4e8e97be\") " pod="ai-tenant-e2e-shared-a-2140ea/sub-test-model-2140ea-kserve-59d58c8d69-xcd9g"
Jul 16 22:03:40.592186 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:03:40.592150    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/afab8b6b-f8af-494a-a5e7-30dc4e8e97be-dshm\") pod \"sub-test-model-2140ea-kserve-59d58c8d69-xcd9g\" (UID: \"afab8b6b-f8af-494a-a5e7-30dc4e8e97be\") " pod="ai-tenant-e2e-shared-a-2140ea/sub-test-model-2140ea-kserve-59d58c8d69-xcd9g"
Jul 16 22:03:40.592384 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:03:40.592201    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/afab8b6b-f8af-494a-a5e7-30dc4e8e97be-tls-certs\") pod \"sub-test-model-2140ea-kserve-59d58c8d69-xcd9g\" (UID: \"afab8b6b-f8af-494a-a5e7-30dc4e8e97be\") " pod="ai-tenant-e2e-shared-a-2140ea/sub-test-model-2140ea-kserve-59d58c8d69-xcd9g"
Jul 16 22:03:40.592384 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:03:40.592223    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/afab8b6b-f8af-494a-a5e7-30dc4e8e97be-model-cache\") pod \"sub-test-model-2140ea-kserve-59d58c8d69-xcd9g\" (UID: \"afab8b6b-f8af-494a-a5e7-30dc4e8e97be\") " pod="ai-tenant-e2e-shared-a-2140ea/sub-test-model-2140ea-kserve-59d58c8d69-xcd9g"
Jul 16 22:03:40.592384 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:03:40.592248    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbvhz\" (UniqueName: \"kubernetes.io/projected/afab8b6b-f8af-494a-a5e7-30dc4e8e97be-kube-api-access-sbvhz\") pod \"sub-test-model-2140ea-kserve-59d58c8d69-xcd9g\" (UID: \"afab8b6b-f8af-494a-a5e7-30dc4e8e97be\") " pod="ai-tenant-e2e-shared-a-2140ea/sub-test-model-2140ea-kserve-59d58c8d69-xcd9g"
Jul 16 22:03:40.592384 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:03:40.592301    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/afab8b6b-f8af-494a-a5e7-30dc4e8e97be-tmp-dir\") pod \"sub-test-model-2140ea-kserve-59d58c8d69-xcd9g\" (UID: \"afab8b6b-f8af-494a-a5e7-30dc4e8e97be\") " pod="ai-tenant-e2e-shared-a-2140ea/sub-test-model-2140ea-kserve-59d58c8d69-xcd9g"
Jul 16 22:03:40.592538 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:03:40.592519    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/afab8b6b-f8af-494a-a5e7-30dc4e8e97be-home\") pod \"sub-test-model-2140ea-kserve-59d58c8d69-xcd9g\" (UID: \"afab8b6b-f8af-494a-a5e7-30dc4e8e97be\") " pod="ai-tenant-e2e-shared-a-2140ea/sub-test-model-2140ea-kserve-59d58c8d69-xcd9g"
Jul 16 22:03:40.592750 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:03:40.592731    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/afab8b6b-f8af-494a-a5e7-30dc4e8e97be-tmp-dir\") pod \"sub-test-model-2140ea-kserve-59d58c8d69-xcd9g\" (UID: \"afab8b6b-f8af-494a-a5e7-30dc4e8e97be\") " pod="ai-tenant-e2e-shared-a-2140ea/sub-test-model-2140ea-kserve-59d58c8d69-xcd9g"
Jul 16 22:03:40.592832 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:03:40.592807    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/afab8b6b-f8af-494a-a5e7-30dc4e8e97be-model-cache\") pod \"sub-test-model-2140ea-kserve-59d58c8d69-xcd9g\" (UID: \"afab8b6b-f8af-494a-a5e7-30dc4e8e97be\") " pod="ai-tenant-e2e-shared-a-2140ea/sub-test-model-2140ea-kserve-59d58c8d69-xcd9g"
Jul 16 22:03:40.594430 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:03:40.594409    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/afab8b6b-f8af-494a-a5e7-30dc4e8e97be-dshm\") pod \"sub-test-model-2140ea-kserve-59d58c8d69-xcd9g\" (UID: \"afab8b6b-f8af-494a-a5e7-30dc4e8e97be\") " pod="ai-tenant-e2e-shared-a-2140ea/sub-test-model-2140ea-kserve-59d58c8d69-xcd9g"
Jul 16 22:03:40.594829 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:03:40.594810    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/afab8b6b-f8af-494a-a5e7-30dc4e8e97be-tls-certs\") pod \"sub-test-model-2140ea-kserve-59d58c8d69-xcd9g\" (UID: \"afab8b6b-f8af-494a-a5e7-30dc4e8e97be\") " pod="ai-tenant-e2e-shared-a-2140ea/sub-test-model-2140ea-kserve-59d58c8d69-xcd9g"
Jul 16 22:03:40.600906 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:03:40.600889    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbvhz\" (UniqueName: \"kubernetes.io/projected/afab8b6b-f8af-494a-a5e7-30dc4e8e97be-kube-api-access-sbvhz\") pod \"sub-test-model-2140ea-kserve-59d58c8d69-xcd9g\" (UID: \"afab8b6b-f8af-494a-a5e7-30dc4e8e97be\") " pod="ai-tenant-e2e-shared-a-2140ea/sub-test-model-2140ea-kserve-59d58c8d69-xcd9g"
Jul 16 22:03:40.638025 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:03:40.637990    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2140ea/sub-test-model-2140ea-kserve-59d58c8d69-xcd9g"
Jul 16 22:03:40.768790 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:03:40.768765    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-2140ea/sub-test-model-2140ea-kserve-59d58c8d69-xcd9g"]
Jul 16 22:03:40.771197 ip-10-0-133-58 kubenswrapper[2579]: W0716 22:03:40.771167    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podafab8b6b_f8af_494a_a5e7_30dc4e8e97be.slice/crio-e480caea569e977526e5016f18e4e77f2d2866f15c8a9bcc3b06fd75459390d9 WatchSource:0}: Error finding container e480caea569e977526e5016f18e4e77f2d2866f15c8a9bcc3b06fd75459390d9: Status 404 returned error can't find the container with id e480caea569e977526e5016f18e4e77f2d2866f15c8a9bcc3b06fd75459390d9
Jul 16 22:03:41.238175 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:03:41.238138    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2140ea/sub-test-model-2140ea-kserve-59d58c8d69-xcd9g" event={"ID":"afab8b6b-f8af-494a-a5e7-30dc4e8e97be","Type":"ContainerStarted","Data":"1194c994c722824340c6773c1bc9eb90fc37d985c1e4d35507f644ec9b68eb0f"}
Jul 16 22:03:41.238349 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:03:41.238189    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2140ea/sub-test-model-2140ea-kserve-59d58c8d69-xcd9g" event={"ID":"afab8b6b-f8af-494a-a5e7-30dc4e8e97be","Type":"ContainerStarted","Data":"e480caea569e977526e5016f18e4e77f2d2866f15c8a9bcc3b06fd75459390d9"}
Jul 16 22:03:41.258497 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:03:41.258449    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-2140ea/sub-test-model-2140ea-kserve-59d58c8d69-xcd9g" podStartSLOduration=1.258434372 podStartE2EDuration="1.258434372s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:03:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:03:41.257890667 +0000 UTC m=+3239.872070984" watchObservedRunningTime="2026-07-16 22:03:41.258434372 +0000 UTC m=+3239.872614749"
Jul 16 22:03:48.451754 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:03:48.451704    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-a87ce2/auth-test-model-a87ce2-kserve-86b5fc479-757xm" podUID="5533b47f-c848-46ea-8d02-f323672044e8" containerName="main" containerID="cri-o://8cea81fae2fe193cac42cb6fe5a0e734d66e4132e0eee80b7b1d2b178d14e665" gracePeriod=45
Jul 16 22:03:48.725594 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:03:48.725569    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a87ce2/auth-test-model-a87ce2-kserve-86b5fc479-757xm"
Jul 16 22:03:48.769843 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:03:48.769813    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5533b47f-c848-46ea-8d02-f323672044e8-tls-certs\") pod \"5533b47f-c848-46ea-8d02-f323672044e8\" (UID: \"5533b47f-c848-46ea-8d02-f323672044e8\") "
Jul 16 22:03:48.769993 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:03:48.769855    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bw2fp\" (UniqueName: \"kubernetes.io/projected/5533b47f-c848-46ea-8d02-f323672044e8-kube-api-access-bw2fp\") pod \"5533b47f-c848-46ea-8d02-f323672044e8\" (UID: \"5533b47f-c848-46ea-8d02-f323672044e8\") "
Jul 16 22:03:48.769993 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:03:48.769873    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5533b47f-c848-46ea-8d02-f323672044e8-dshm\") pod \"5533b47f-c848-46ea-8d02-f323672044e8\" (UID: \"5533b47f-c848-46ea-8d02-f323672044e8\") "
Jul 16 22:03:48.769993 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:03:48.769893    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5533b47f-c848-46ea-8d02-f323672044e8-tmp-dir\") pod \"5533b47f-c848-46ea-8d02-f323672044e8\" (UID: \"5533b47f-c848-46ea-8d02-f323672044e8\") "
Jul 16 22:03:48.769993 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:03:48.769917    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5533b47f-c848-46ea-8d02-f323672044e8-home\") pod \"5533b47f-c848-46ea-8d02-f323672044e8\" (UID: \"5533b47f-c848-46ea-8d02-f323672044e8\") "
Jul 16 22:03:48.769993 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:03:48.769959    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5533b47f-c848-46ea-8d02-f323672044e8-model-cache\") pod \"5533b47f-c848-46ea-8d02-f323672044e8\" (UID: \"5533b47f-c848-46ea-8d02-f323672044e8\") "
Jul 16 22:03:48.770268 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:03:48.770196    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5533b47f-c848-46ea-8d02-f323672044e8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5533b47f-c848-46ea-8d02-f323672044e8" (UID: "5533b47f-c848-46ea-8d02-f323672044e8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:03:48.770268 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:03:48.770227    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5533b47f-c848-46ea-8d02-f323672044e8-home" (OuterVolumeSpecName: "home") pod "5533b47f-c848-46ea-8d02-f323672044e8" (UID: "5533b47f-c848-46ea-8d02-f323672044e8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:03:48.770434 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:03:48.770403    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5533b47f-c848-46ea-8d02-f323672044e8-model-cache" (OuterVolumeSpecName: "model-cache") pod "5533b47f-c848-46ea-8d02-f323672044e8" (UID: "5533b47f-c848-46ea-8d02-f323672044e8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:03:48.772196 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:03:48.772167    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5533b47f-c848-46ea-8d02-f323672044e8-dshm" (OuterVolumeSpecName: "dshm") pod "5533b47f-c848-46ea-8d02-f323672044e8" (UID: "5533b47f-c848-46ea-8d02-f323672044e8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:03:48.772286 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:03:48.772216    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5533b47f-c848-46ea-8d02-f323672044e8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5533b47f-c848-46ea-8d02-f323672044e8" (UID: "5533b47f-c848-46ea-8d02-f323672044e8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 22:03:48.772286 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:03:48.772238    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5533b47f-c848-46ea-8d02-f323672044e8-kube-api-access-bw2fp" (OuterVolumeSpecName: "kube-api-access-bw2fp") pod "5533b47f-c848-46ea-8d02-f323672044e8" (UID: "5533b47f-c848-46ea-8d02-f323672044e8"). InnerVolumeSpecName "kube-api-access-bw2fp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:03:48.870680 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:03:48.870641    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5533b47f-c848-46ea-8d02-f323672044e8-model-cache\") on node \"ip-10-0-133-58.ec2.internal\" DevicePath \"\""
Jul 16 22:03:48.870680 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:03:48.870681    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5533b47f-c848-46ea-8d02-f323672044e8-tls-certs\") on node \"ip-10-0-133-58.ec2.internal\" DevicePath \"\""
Jul 16 22:03:48.870859 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:03:48.870698    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bw2fp\" (UniqueName: \"kubernetes.io/projected/5533b47f-c848-46ea-8d02-f323672044e8-kube-api-access-bw2fp\") on node \"ip-10-0-133-58.ec2.internal\" DevicePath \"\""
Jul 16 22:03:48.870859 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:03:48.870715    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5533b47f-c848-46ea-8d02-f323672044e8-dshm\") on node \"ip-10-0-133-58.ec2.internal\" DevicePath \"\""
Jul 16 22:03:48.870859 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:03:48.870729    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5533b47f-c848-46ea-8d02-f323672044e8-tmp-dir\") on node \"ip-10-0-133-58.ec2.internal\" DevicePath \"\""
Jul 16 22:03:48.870859 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:03:48.870740    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5533b47f-c848-46ea-8d02-f323672044e8-home\") on node \"ip-10-0-133-58.ec2.internal\" DevicePath \"\""
Jul 16 22:03:49.276575 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:03:49.276541    2579 generic.go:356] "Generic (PLEG): container finished" podID="5533b47f-c848-46ea-8d02-f323672044e8" containerID="8cea81fae2fe193cac42cb6fe5a0e734d66e4132e0eee80b7b1d2b178d14e665" exitCode=0
Jul 16 22:03:49.276763 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:03:49.276618    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a87ce2/auth-test-model-a87ce2-kserve-86b5fc479-757xm"
Jul 16 22:03:49.276763 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:03:49.276627    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a87ce2/auth-test-model-a87ce2-kserve-86b5fc479-757xm" event={"ID":"5533b47f-c848-46ea-8d02-f323672044e8","Type":"ContainerDied","Data":"8cea81fae2fe193cac42cb6fe5a0e734d66e4132e0eee80b7b1d2b178d14e665"}
Jul 16 22:03:49.276763 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:03:49.276675    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a87ce2/auth-test-model-a87ce2-kserve-86b5fc479-757xm" event={"ID":"5533b47f-c848-46ea-8d02-f323672044e8","Type":"ContainerDied","Data":"de51de1c51c95eb08e42297b99a3947f7596f0e790df6cc899e8c55755c05eb8"}
Jul 16 22:03:49.276763 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:03:49.276691    2579 scope.go:117] "RemoveContainer" containerID="8cea81fae2fe193cac42cb6fe5a0e734d66e4132e0eee80b7b1d2b178d14e665"
Jul 16 22:03:49.285856 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:03:49.285834    2579 scope.go:117] "RemoveContainer" containerID="8cea81fae2fe193cac42cb6fe5a0e734d66e4132e0eee80b7b1d2b178d14e665"
Jul 16 22:03:49.286090 ip-10-0-133-58 kubenswrapper[2579]: E0716 22:03:49.286071    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8cea81fae2fe193cac42cb6fe5a0e734d66e4132e0eee80b7b1d2b178d14e665\": container with ID starting with 8cea81fae2fe193cac42cb6fe5a0e734d66e4132e0eee80b7b1d2b178d14e665 not found: ID does not exist" containerID="8cea81fae2fe193cac42cb6fe5a0e734d66e4132e0eee80b7b1d2b178d14e665"
Jul 16 22:03:49.286194 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:03:49.286131    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8cea81fae2fe193cac42cb6fe5a0e734d66e4132e0eee80b7b1d2b178d14e665"} err="failed to get container status \"8cea81fae2fe193cac42cb6fe5a0e734d66e4132e0eee80b7b1d2b178d14e665\": rpc error: code = NotFound desc = could not find container \"8cea81fae2fe193cac42cb6fe5a0e734d66e4132e0eee80b7b1d2b178d14e665\": container with ID starting with 8cea81fae2fe193cac42cb6fe5a0e734d66e4132e0eee80b7b1d2b178d14e665 not found: ID does not exist"
Jul 16 22:03:49.298946 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:03:49.298914    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-a87ce2/auth-test-model-a87ce2-kserve-86b5fc479-757xm"]
Jul 16 22:03:49.304989 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:03:49.304968    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-a87ce2/auth-test-model-a87ce2-kserve-86b5fc479-757xm"]
Jul 16 22:03:49.973564 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:03:49.973521    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5533b47f-c848-46ea-8d02-f323672044e8" path="/var/lib/kubelet/pods/5533b47f-c848-46ea-8d02-f323672044e8/volumes"
Jul 16 22:03:50.638631 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:03:50.638594    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-2140ea/sub-test-model-2140ea-kserve-59d58c8d69-xcd9g"
Jul 16 22:03:50.638795 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:03:50.638673    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-2140ea/sub-test-model-2140ea-kserve-59d58c8d69-xcd9g"
Jul 16 22:03:50.650955 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:03:50.650934    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-2140ea/sub-test-model-2140ea-kserve-59d58c8d69-xcd9g"
Jul 16 22:03:51.297971 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:03:51.297943    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-2140ea/sub-test-model-2140ea-kserve-59d58c8d69-xcd9g"
Jul 16 22:03:54.104692 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:03:54.104662    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 22:04:05.309155 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:04:05.309117    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 22:04:33.922454 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:04:33.922418    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 22:04:52.312411 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:04:52.312376    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 22:04:57.559506 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:04:57.559473    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-2140ea/sub-test-model-2140ea-kserve-59d58c8d69-xcd9g"]
Jul 16 22:05:11.908068 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:05:11.908032    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 22:05:12.579085 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:05:12.579047    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-2140ea/sub-test-model-2140ea-kserve-59d58c8d69-xcd9g" podUID="afab8b6b-f8af-494a-a5e7-30dc4e8e97be" containerName="main" containerID="cri-o://1194c994c722824340c6773c1bc9eb90fc37d985c1e4d35507f644ec9b68eb0f" gracePeriod=45
Jul 16 22:05:12.829648 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:05:12.829588    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2140ea/sub-test-model-2140ea-kserve-59d58c8d69-xcd9g"
Jul 16 22:05:12.915460 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:05:12.915430    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/afab8b6b-f8af-494a-a5e7-30dc4e8e97be-model-cache\") pod \"afab8b6b-f8af-494a-a5e7-30dc4e8e97be\" (UID: \"afab8b6b-f8af-494a-a5e7-30dc4e8e97be\") "
Jul 16 22:05:12.915920 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:05:12.915472    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/afab8b6b-f8af-494a-a5e7-30dc4e8e97be-tmp-dir\") pod \"afab8b6b-f8af-494a-a5e7-30dc4e8e97be\" (UID: \"afab8b6b-f8af-494a-a5e7-30dc4e8e97be\") "
Jul 16 22:05:12.915920 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:05:12.915513    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sbvhz\" (UniqueName: \"kubernetes.io/projected/afab8b6b-f8af-494a-a5e7-30dc4e8e97be-kube-api-access-sbvhz\") pod \"afab8b6b-f8af-494a-a5e7-30dc4e8e97be\" (UID: \"afab8b6b-f8af-494a-a5e7-30dc4e8e97be\") "
Jul 16 22:05:12.915920 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:05:12.915537    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/afab8b6b-f8af-494a-a5e7-30dc4e8e97be-tls-certs\") pod \"afab8b6b-f8af-494a-a5e7-30dc4e8e97be\" (UID: \"afab8b6b-f8af-494a-a5e7-30dc4e8e97be\") "
Jul 16 22:05:12.915920 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:05:12.915586    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/afab8b6b-f8af-494a-a5e7-30dc4e8e97be-home\") pod \"afab8b6b-f8af-494a-a5e7-30dc4e8e97be\" (UID: \"afab8b6b-f8af-494a-a5e7-30dc4e8e97be\") "
Jul 16 22:05:12.915920 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:05:12.915634    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/afab8b6b-f8af-494a-a5e7-30dc4e8e97be-dshm\") pod \"afab8b6b-f8af-494a-a5e7-30dc4e8e97be\" (UID: \"afab8b6b-f8af-494a-a5e7-30dc4e8e97be\") "
Jul 16 22:05:12.915920 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:05:12.915712    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afab8b6b-f8af-494a-a5e7-30dc4e8e97be-model-cache" (OuterVolumeSpecName: "model-cache") pod "afab8b6b-f8af-494a-a5e7-30dc4e8e97be" (UID: "afab8b6b-f8af-494a-a5e7-30dc4e8e97be"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:05:12.915920 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:05:12.915754    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afab8b6b-f8af-494a-a5e7-30dc4e8e97be-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "afab8b6b-f8af-494a-a5e7-30dc4e8e97be" (UID: "afab8b6b-f8af-494a-a5e7-30dc4e8e97be"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:05:12.916237 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:05:12.915934    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afab8b6b-f8af-494a-a5e7-30dc4e8e97be-home" (OuterVolumeSpecName: "home") pod "afab8b6b-f8af-494a-a5e7-30dc4e8e97be" (UID: "afab8b6b-f8af-494a-a5e7-30dc4e8e97be"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:05:12.916237 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:05:12.915965    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/afab8b6b-f8af-494a-a5e7-30dc4e8e97be-model-cache\") on node \"ip-10-0-133-58.ec2.internal\" DevicePath \"\""
Jul 16 22:05:12.916237 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:05:12.915983    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/afab8b6b-f8af-494a-a5e7-30dc4e8e97be-tmp-dir\") on node \"ip-10-0-133-58.ec2.internal\" DevicePath \"\""
Jul 16 22:05:12.917714 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:05:12.917691    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afab8b6b-f8af-494a-a5e7-30dc4e8e97be-dshm" (OuterVolumeSpecName: "dshm") pod "afab8b6b-f8af-494a-a5e7-30dc4e8e97be" (UID: "afab8b6b-f8af-494a-a5e7-30dc4e8e97be"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:05:12.917796 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:05:12.917712    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/afab8b6b-f8af-494a-a5e7-30dc4e8e97be-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "afab8b6b-f8af-494a-a5e7-30dc4e8e97be" (UID: "afab8b6b-f8af-494a-a5e7-30dc4e8e97be"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 22:05:12.917832 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:05:12.917792    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afab8b6b-f8af-494a-a5e7-30dc4e8e97be-kube-api-access-sbvhz" (OuterVolumeSpecName: "kube-api-access-sbvhz") pod "afab8b6b-f8af-494a-a5e7-30dc4e8e97be" (UID: "afab8b6b-f8af-494a-a5e7-30dc4e8e97be"). InnerVolumeSpecName "kube-api-access-sbvhz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:05:13.016946 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:05:13.016914    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sbvhz\" (UniqueName: \"kubernetes.io/projected/afab8b6b-f8af-494a-a5e7-30dc4e8e97be-kube-api-access-sbvhz\") on node \"ip-10-0-133-58.ec2.internal\" DevicePath \"\""
Jul 16 22:05:13.016946 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:05:13.016940    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/afab8b6b-f8af-494a-a5e7-30dc4e8e97be-tls-certs\") on node \"ip-10-0-133-58.ec2.internal\" DevicePath \"\""
Jul 16 22:05:13.016946 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:05:13.016951    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/afab8b6b-f8af-494a-a5e7-30dc4e8e97be-home\") on node \"ip-10-0-133-58.ec2.internal\" DevicePath \"\""
Jul 16 22:05:13.016946 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:05:13.016958    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/afab8b6b-f8af-494a-a5e7-30dc4e8e97be-dshm\") on node \"ip-10-0-133-58.ec2.internal\" DevicePath \"\""
Jul 16 22:05:13.662569 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:05:13.662532    2579 generic.go:356] "Generic (PLEG): container finished" podID="afab8b6b-f8af-494a-a5e7-30dc4e8e97be" containerID="1194c994c722824340c6773c1bc9eb90fc37d985c1e4d35507f644ec9b68eb0f" exitCode=0
Jul 16 22:05:13.662740 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:05:13.662578    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2140ea/sub-test-model-2140ea-kserve-59d58c8d69-xcd9g"
Jul 16 22:05:13.662740 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:05:13.662615    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2140ea/sub-test-model-2140ea-kserve-59d58c8d69-xcd9g" event={"ID":"afab8b6b-f8af-494a-a5e7-30dc4e8e97be","Type":"ContainerDied","Data":"1194c994c722824340c6773c1bc9eb90fc37d985c1e4d35507f644ec9b68eb0f"}
Jul 16 22:05:13.662740 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:05:13.662659    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2140ea/sub-test-model-2140ea-kserve-59d58c8d69-xcd9g" event={"ID":"afab8b6b-f8af-494a-a5e7-30dc4e8e97be","Type":"ContainerDied","Data":"e480caea569e977526e5016f18e4e77f2d2866f15c8a9bcc3b06fd75459390d9"}
Jul 16 22:05:13.662740 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:05:13.662680    2579 scope.go:117] "RemoveContainer" containerID="1194c994c722824340c6773c1bc9eb90fc37d985c1e4d35507f644ec9b68eb0f"
Jul 16 22:05:13.671373 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:05:13.671352    2579 scope.go:117] "RemoveContainer" containerID="1194c994c722824340c6773c1bc9eb90fc37d985c1e4d35507f644ec9b68eb0f"
Jul 16 22:05:13.671634 ip-10-0-133-58 kubenswrapper[2579]: E0716 22:05:13.671617    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1194c994c722824340c6773c1bc9eb90fc37d985c1e4d35507f644ec9b68eb0f\": container with ID starting with 1194c994c722824340c6773c1bc9eb90fc37d985c1e4d35507f644ec9b68eb0f not found: ID does not exist" containerID="1194c994c722824340c6773c1bc9eb90fc37d985c1e4d35507f644ec9b68eb0f"
Jul 16 22:05:13.671686 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:05:13.671642    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1194c994c722824340c6773c1bc9eb90fc37d985c1e4d35507f644ec9b68eb0f"} err="failed to get container status \"1194c994c722824340c6773c1bc9eb90fc37d985c1e4d35507f644ec9b68eb0f\": rpc error: code = NotFound desc = could not find container \"1194c994c722824340c6773c1bc9eb90fc37d985c1e4d35507f644ec9b68eb0f\": container with ID starting with 1194c994c722824340c6773c1bc9eb90fc37d985c1e4d35507f644ec9b68eb0f not found: ID does not exist"
Jul 16 22:05:13.697595 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:05:13.697562    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-2140ea/sub-test-model-2140ea-kserve-59d58c8d69-xcd9g"]
Jul 16 22:05:13.707187 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:05:13.707162    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-2140ea/sub-test-model-2140ea-kserve-59d58c8d69-xcd9g"]
Jul 16 22:05:13.971767 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:05:13.971689    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="afab8b6b-f8af-494a-a5e7-30dc4e8e97be" path="/var/lib/kubelet/pods/afab8b6b-f8af-494a-a5e7-30dc4e8e97be/volumes"
Jul 16 22:05:15.725785 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:05:15.725753    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-2140ea/rate-test-model-2140ea-kserve-7955d596dc-l5nqd"]
Jul 16 22:05:15.726156 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:05:15.726138    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5533b47f-c848-46ea-8d02-f323672044e8" containerName="main"
Jul 16 22:05:15.726156 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:05:15.726149    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5533b47f-c848-46ea-8d02-f323672044e8" containerName="main"
Jul 16 22:05:15.726233 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:05:15.726173    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afab8b6b-f8af-494a-a5e7-30dc4e8e97be" containerName="main"
Jul 16 22:05:15.726233 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:05:15.726179    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="afab8b6b-f8af-494a-a5e7-30dc4e8e97be" containerName="main"
Jul 16 22:05:15.726293 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:05:15.726249    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5533b47f-c848-46ea-8d02-f323672044e8" containerName="main"
Jul 16 22:05:15.726293 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:05:15.726260    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="afab8b6b-f8af-494a-a5e7-30dc4e8e97be" containerName="main"
Jul 16 22:05:15.729161 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:05:15.729145    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2140ea/rate-test-model-2140ea-kserve-7955d596dc-l5nqd"
Jul 16 22:05:15.733233 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:05:15.733210    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-2140ea\"/\"openshift-service-ca.crt\""
Jul 16 22:05:15.733371 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:05:15.733211    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-2140ea\"/\"rate-test-model-2140ea-kserve-self-signed-certs\""
Jul 16 22:05:15.733371 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:05:15.733268    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-2140ea\"/\"kube-root-ca.crt\""
Jul 16 22:05:15.733497 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:05:15.733393    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-2140ea\"/\"default-dockercfg-c6g54\""
Jul 16 22:05:15.739311 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:05:15.739291    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-2140ea/rate-test-model-2140ea-kserve-7955d596dc-l5nqd"]
Jul 16 22:05:15.840052 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:05:15.840018    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a402eaa6-c97b-4232-b0e5-8fb091ee4e34-home\") pod \"rate-test-model-2140ea-kserve-7955d596dc-l5nqd\" (UID: \"a402eaa6-c97b-4232-b0e5-8fb091ee4e34\") " pod="ai-tenant-e2e-shared-a-2140ea/rate-test-model-2140ea-kserve-7955d596dc-l5nqd"
Jul 16 22:05:15.840249 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:05:15.840060    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a402eaa6-c97b-4232-b0e5-8fb091ee4e34-tmp-dir\") pod \"rate-test-model-2140ea-kserve-7955d596dc-l5nqd\" (UID: \"a402eaa6-c97b-4232-b0e5-8fb091ee4e34\") " pod="ai-tenant-e2e-shared-a-2140ea/rate-test-model-2140ea-kserve-7955d596dc-l5nqd"
Jul 16 22:05:15.840249 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:05:15.840128    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a402eaa6-c97b-4232-b0e5-8fb091ee4e34-dshm\") pod \"rate-test-model-2140ea-kserve-7955d596dc-l5nqd\" (UID: \"a402eaa6-c97b-4232-b0e5-8fb091ee4e34\") " pod="ai-tenant-e2e-shared-a-2140ea/rate-test-model-2140ea-kserve-7955d596dc-l5nqd"
Jul 16 22:05:15.840249 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:05:15.840184    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a402eaa6-c97b-4232-b0e5-8fb091ee4e34-model-cache\") pod \"rate-test-model-2140ea-kserve-7955d596dc-l5nqd\" (UID: \"a402eaa6-c97b-4232-b0e5-8fb091ee4e34\") " pod="ai-tenant-e2e-shared-a-2140ea/rate-test-model-2140ea-kserve-7955d596dc-l5nqd"
Jul 16 22:05:15.840249 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:05:15.840211    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a402eaa6-c97b-4232-b0e5-8fb091ee4e34-tls-certs\") pod \"rate-test-model-2140ea-kserve-7955d596dc-l5nqd\" (UID: \"a402eaa6-c97b-4232-b0e5-8fb091ee4e34\") " pod="ai-tenant-e2e-shared-a-2140ea/rate-test-model-2140ea-kserve-7955d596dc-l5nqd"
Jul 16 22:05:15.840249 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:05:15.840245    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmp28\" (UniqueName: \"kubernetes.io/projected/a402eaa6-c97b-4232-b0e5-8fb091ee4e34-kube-api-access-mmp28\") pod \"rate-test-model-2140ea-kserve-7955d596dc-l5nqd\" (UID: \"a402eaa6-c97b-4232-b0e5-8fb091ee4e34\") " pod="ai-tenant-e2e-shared-a-2140ea/rate-test-model-2140ea-kserve-7955d596dc-l5nqd"
Jul 16 22:05:15.941248 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:05:15.941214    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a402eaa6-c97b-4232-b0e5-8fb091ee4e34-tls-certs\") pod \"rate-test-model-2140ea-kserve-7955d596dc-l5nqd\" (UID: \"a402eaa6-c97b-4232-b0e5-8fb091ee4e34\") " pod="ai-tenant-e2e-shared-a-2140ea/rate-test-model-2140ea-kserve-7955d596dc-l5nqd"
Jul 16 22:05:15.941423 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:05:15.941261    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmp28\" (UniqueName: \"kubernetes.io/projected/a402eaa6-c97b-4232-b0e5-8fb091ee4e34-kube-api-access-mmp28\") pod \"rate-test-model-2140ea-kserve-7955d596dc-l5nqd\" (UID: \"a402eaa6-c97b-4232-b0e5-8fb091ee4e34\") " pod="ai-tenant-e2e-shared-a-2140ea/rate-test-model-2140ea-kserve-7955d596dc-l5nqd"
Jul 16 22:05:15.941423 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:05:15.941311    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a402eaa6-c97b-4232-b0e5-8fb091ee4e34-home\") pod \"rate-test-model-2140ea-kserve-7955d596dc-l5nqd\" (UID: \"a402eaa6-c97b-4232-b0e5-8fb091ee4e34\") " pod="ai-tenant-e2e-shared-a-2140ea/rate-test-model-2140ea-kserve-7955d596dc-l5nqd"
Jul 16 22:05:15.941423 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:05:15.941338    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a402eaa6-c97b-4232-b0e5-8fb091ee4e34-tmp-dir\") pod \"rate-test-model-2140ea-kserve-7955d596dc-l5nqd\" (UID: \"a402eaa6-c97b-4232-b0e5-8fb091ee4e34\") " pod="ai-tenant-e2e-shared-a-2140ea/rate-test-model-2140ea-kserve-7955d596dc-l5nqd"
Jul 16 22:05:15.941423 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:05:15.941358    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a402eaa6-c97b-4232-b0e5-8fb091ee4e34-dshm\") pod \"rate-test-model-2140ea-kserve-7955d596dc-l5nqd\" (UID: \"a402eaa6-c97b-4232-b0e5-8fb091ee4e34\") " pod="ai-tenant-e2e-shared-a-2140ea/rate-test-model-2140ea-kserve-7955d596dc-l5nqd"
Jul 16 22:05:15.941423 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:05:15.941398    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a402eaa6-c97b-4232-b0e5-8fb091ee4e34-model-cache\") pod \"rate-test-model-2140ea-kserve-7955d596dc-l5nqd\" (UID: \"a402eaa6-c97b-4232-b0e5-8fb091ee4e34\") " pod="ai-tenant-e2e-shared-a-2140ea/rate-test-model-2140ea-kserve-7955d596dc-l5nqd"
Jul 16 22:05:15.941827 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:05:15.941805    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a402eaa6-c97b-4232-b0e5-8fb091ee4e34-model-cache\") pod \"rate-test-model-2140ea-kserve-7955d596dc-l5nqd\" (UID: \"a402eaa6-c97b-4232-b0e5-8fb091ee4e34\") " pod="ai-tenant-e2e-shared-a-2140ea/rate-test-model-2140ea-kserve-7955d596dc-l5nqd"
Jul 16 22:05:15.941905 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:05:15.941826    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a402eaa6-c97b-4232-b0e5-8fb091ee4e34-tmp-dir\") pod \"rate-test-model-2140ea-kserve-7955d596dc-l5nqd\" (UID: \"a402eaa6-c97b-4232-b0e5-8fb091ee4e34\") " pod="ai-tenant-e2e-shared-a-2140ea/rate-test-model-2140ea-kserve-7955d596dc-l5nqd"
Jul 16 22:05:15.941905 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:05:15.941879    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a402eaa6-c97b-4232-b0e5-8fb091ee4e34-home\") pod \"rate-test-model-2140ea-kserve-7955d596dc-l5nqd\" (UID: \"a402eaa6-c97b-4232-b0e5-8fb091ee4e34\") " pod="ai-tenant-e2e-shared-a-2140ea/rate-test-model-2140ea-kserve-7955d596dc-l5nqd"
Jul 16 22:05:15.943550 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:05:15.943528    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a402eaa6-c97b-4232-b0e5-8fb091ee4e34-dshm\") pod \"rate-test-model-2140ea-kserve-7955d596dc-l5nqd\" (UID: \"a402eaa6-c97b-4232-b0e5-8fb091ee4e34\") " pod="ai-tenant-e2e-shared-a-2140ea/rate-test-model-2140ea-kserve-7955d596dc-l5nqd"
Jul 16 22:05:15.943719 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:05:15.943702    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a402eaa6-c97b-4232-b0e5-8fb091ee4e34-tls-certs\") pod \"rate-test-model-2140ea-kserve-7955d596dc-l5nqd\" (UID: \"a402eaa6-c97b-4232-b0e5-8fb091ee4e34\") " pod="ai-tenant-e2e-shared-a-2140ea/rate-test-model-2140ea-kserve-7955d596dc-l5nqd"
Jul 16 22:05:15.950654 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:05:15.950630    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmp28\" (UniqueName: \"kubernetes.io/projected/a402eaa6-c97b-4232-b0e5-8fb091ee4e34-kube-api-access-mmp28\") pod \"rate-test-model-2140ea-kserve-7955d596dc-l5nqd\" (UID: \"a402eaa6-c97b-4232-b0e5-8fb091ee4e34\") " pod="ai-tenant-e2e-shared-a-2140ea/rate-test-model-2140ea-kserve-7955d596dc-l5nqd"
Jul 16 22:05:16.039227 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:05:16.039142    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2140ea/rate-test-model-2140ea-kserve-7955d596dc-l5nqd"
Jul 16 22:05:16.183312 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:05:16.183287    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-2140ea/rate-test-model-2140ea-kserve-7955d596dc-l5nqd"]
Jul 16 22:05:16.185178 ip-10-0-133-58 kubenswrapper[2579]: W0716 22:05:16.185149    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda402eaa6_c97b_4232_b0e5_8fb091ee4e34.slice/crio-3048b9bc64f1c3126c45f71d2a3e6cda4ea02fe555bfb0412e7e47eaa88bed48 WatchSource:0}: Error finding container 3048b9bc64f1c3126c45f71d2a3e6cda4ea02fe555bfb0412e7e47eaa88bed48: Status 404 returned error can't find the container with id 3048b9bc64f1c3126c45f71d2a3e6cda4ea02fe555bfb0412e7e47eaa88bed48
Jul 16 22:05:16.677879 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:05:16.677838    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2140ea/rate-test-model-2140ea-kserve-7955d596dc-l5nqd" event={"ID":"a402eaa6-c97b-4232-b0e5-8fb091ee4e34","Type":"ContainerStarted","Data":"93d8cb31838b6507f4da28abd8851375fcaacebcfb2ad2f964b6ba9d536b4c66"}
Jul 16 22:05:16.677879 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:05:16.677875    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2140ea/rate-test-model-2140ea-kserve-7955d596dc-l5nqd" event={"ID":"a402eaa6-c97b-4232-b0e5-8fb091ee4e34","Type":"ContainerStarted","Data":"3048b9bc64f1c3126c45f71d2a3e6cda4ea02fe555bfb0412e7e47eaa88bed48"}
Jul 16 22:05:16.700429 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:05:16.700383    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-2140ea/rate-test-model-2140ea-kserve-7955d596dc-l5nqd" podStartSLOduration=1.700369147 podStartE2EDuration="1.700369147s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:05:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:05:16.699021264 +0000 UTC m=+3335.313201591" watchObservedRunningTime="2026-07-16 22:05:16.700369147 +0000 UTC m=+3335.314549529"
Jul 16 22:05:26.040183 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:05:26.040147    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-2140ea/rate-test-model-2140ea-kserve-7955d596dc-l5nqd"
Jul 16 22:05:26.040183 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:05:26.040193    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-2140ea/rate-test-model-2140ea-kserve-7955d596dc-l5nqd"
Jul 16 22:05:26.052463 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:05:26.052440    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-2140ea/rate-test-model-2140ea-kserve-7955d596dc-l5nqd"
Jul 16 22:05:26.735413 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:05:26.735380    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-2140ea/rate-test-model-2140ea-kserve-7955d596dc-l5nqd"
Jul 16 22:05:28.315767 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:05:28.315730    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 22:05:40.927002 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:05:40.926964    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 22:05:55.210290 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:05:55.210256    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 22:06:15.329754 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:06:15.329715    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 22:06:20.107299 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:06:20.107267    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-2140ea/rate-test-model-2140ea-kserve-7955d596dc-l5nqd"]
Jul 16 22:06:26.324887 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:06:26.324846    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 22:06:35.127129 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:06:35.127003    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-2140ea/rate-test-model-2140ea-kserve-7955d596dc-l5nqd" podUID="a402eaa6-c97b-4232-b0e5-8fb091ee4e34" containerName="main" containerID="cri-o://93d8cb31838b6507f4da28abd8851375fcaacebcfb2ad2f964b6ba9d536b4c66" gracePeriod=45
Jul 16 22:06:35.376428 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:06:35.376404    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2140ea/rate-test-model-2140ea-kserve-7955d596dc-l5nqd"
Jul 16 22:06:35.424740 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:06:35.424708    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a402eaa6-c97b-4232-b0e5-8fb091ee4e34-home\") pod \"a402eaa6-c97b-4232-b0e5-8fb091ee4e34\" (UID: \"a402eaa6-c97b-4232-b0e5-8fb091ee4e34\") "
Jul 16 22:06:35.424906 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:06:35.424767    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a402eaa6-c97b-4232-b0e5-8fb091ee4e34-dshm\") pod \"a402eaa6-c97b-4232-b0e5-8fb091ee4e34\" (UID: \"a402eaa6-c97b-4232-b0e5-8fb091ee4e34\") "
Jul 16 22:06:35.424906 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:06:35.424786    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a402eaa6-c97b-4232-b0e5-8fb091ee4e34-tmp-dir\") pod \"a402eaa6-c97b-4232-b0e5-8fb091ee4e34\" (UID: \"a402eaa6-c97b-4232-b0e5-8fb091ee4e34\") "
Jul 16 22:06:35.424906 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:06:35.424814    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a402eaa6-c97b-4232-b0e5-8fb091ee4e34-tls-certs\") pod \"a402eaa6-c97b-4232-b0e5-8fb091ee4e34\" (UID: \"a402eaa6-c97b-4232-b0e5-8fb091ee4e34\") "
Jul 16 22:06:35.424906 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:06:35.424854    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mmp28\" (UniqueName: \"kubernetes.io/projected/a402eaa6-c97b-4232-b0e5-8fb091ee4e34-kube-api-access-mmp28\") pod \"a402eaa6-c97b-4232-b0e5-8fb091ee4e34\" (UID: \"a402eaa6-c97b-4232-b0e5-8fb091ee4e34\") "
Jul 16 22:06:35.424906 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:06:35.424890    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a402eaa6-c97b-4232-b0e5-8fb091ee4e34-model-cache\") pod \"a402eaa6-c97b-4232-b0e5-8fb091ee4e34\" (UID: \"a402eaa6-c97b-4232-b0e5-8fb091ee4e34\") "
Jul 16 22:06:35.425198 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:06:35.425002    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a402eaa6-c97b-4232-b0e5-8fb091ee4e34-home" (OuterVolumeSpecName: "home") pod "a402eaa6-c97b-4232-b0e5-8fb091ee4e34" (UID: "a402eaa6-c97b-4232-b0e5-8fb091ee4e34"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:06:35.425198 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:06:35.425088    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a402eaa6-c97b-4232-b0e5-8fb091ee4e34-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a402eaa6-c97b-4232-b0e5-8fb091ee4e34" (UID: "a402eaa6-c97b-4232-b0e5-8fb091ee4e34"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:06:35.425302 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:06:35.425250    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a402eaa6-c97b-4232-b0e5-8fb091ee4e34-tmp-dir\") on node \"ip-10-0-133-58.ec2.internal\" DevicePath \"\""
Jul 16 22:06:35.425302 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:06:35.425257    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a402eaa6-c97b-4232-b0e5-8fb091ee4e34-model-cache" (OuterVolumeSpecName: "model-cache") pod "a402eaa6-c97b-4232-b0e5-8fb091ee4e34" (UID: "a402eaa6-c97b-4232-b0e5-8fb091ee4e34"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:06:35.425302 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:06:35.425267    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a402eaa6-c97b-4232-b0e5-8fb091ee4e34-home\") on node \"ip-10-0-133-58.ec2.internal\" DevicePath \"\""
Jul 16 22:06:35.426946 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:06:35.426914    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a402eaa6-c97b-4232-b0e5-8fb091ee4e34-dshm" (OuterVolumeSpecName: "dshm") pod "a402eaa6-c97b-4232-b0e5-8fb091ee4e34" (UID: "a402eaa6-c97b-4232-b0e5-8fb091ee4e34"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:06:35.427032 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:06:35.426988    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a402eaa6-c97b-4232-b0e5-8fb091ee4e34-kube-api-access-mmp28" (OuterVolumeSpecName: "kube-api-access-mmp28") pod "a402eaa6-c97b-4232-b0e5-8fb091ee4e34" (UID: "a402eaa6-c97b-4232-b0e5-8fb091ee4e34"). InnerVolumeSpecName "kube-api-access-mmp28". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:06:35.427032 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:06:35.427009    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a402eaa6-c97b-4232-b0e5-8fb091ee4e34-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a402eaa6-c97b-4232-b0e5-8fb091ee4e34" (UID: "a402eaa6-c97b-4232-b0e5-8fb091ee4e34"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 22:06:35.526158 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:06:35.526121    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a402eaa6-c97b-4232-b0e5-8fb091ee4e34-dshm\") on node \"ip-10-0-133-58.ec2.internal\" DevicePath \"\""
Jul 16 22:06:35.526158 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:06:35.526151    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a402eaa6-c97b-4232-b0e5-8fb091ee4e34-tls-certs\") on node \"ip-10-0-133-58.ec2.internal\" DevicePath \"\""
Jul 16 22:06:35.526158 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:06:35.526165    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mmp28\" (UniqueName: \"kubernetes.io/projected/a402eaa6-c97b-4232-b0e5-8fb091ee4e34-kube-api-access-mmp28\") on node \"ip-10-0-133-58.ec2.internal\" DevicePath \"\""
Jul 16 22:06:35.526385 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:06:35.526175    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a402eaa6-c97b-4232-b0e5-8fb091ee4e34-model-cache\") on node \"ip-10-0-133-58.ec2.internal\" DevicePath \"\""
Jul 16 22:06:36.043693 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:06:36.043651    2579 generic.go:356] "Generic (PLEG): container finished" podID="a402eaa6-c97b-4232-b0e5-8fb091ee4e34" containerID="93d8cb31838b6507f4da28abd8851375fcaacebcfb2ad2f964b6ba9d536b4c66" exitCode=0
Jul 16 22:06:36.043882 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:06:36.043694    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2140ea/rate-test-model-2140ea-kserve-7955d596dc-l5nqd"
Jul 16 22:06:36.043882 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:06:36.043716    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2140ea/rate-test-model-2140ea-kserve-7955d596dc-l5nqd" event={"ID":"a402eaa6-c97b-4232-b0e5-8fb091ee4e34","Type":"ContainerDied","Data":"93d8cb31838b6507f4da28abd8851375fcaacebcfb2ad2f964b6ba9d536b4c66"}
Jul 16 22:06:36.043882 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:06:36.043756    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2140ea/rate-test-model-2140ea-kserve-7955d596dc-l5nqd" event={"ID":"a402eaa6-c97b-4232-b0e5-8fb091ee4e34","Type":"ContainerDied","Data":"3048b9bc64f1c3126c45f71d2a3e6cda4ea02fe555bfb0412e7e47eaa88bed48"}
Jul 16 22:06:36.043882 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:06:36.043778    2579 scope.go:117] "RemoveContainer" containerID="93d8cb31838b6507f4da28abd8851375fcaacebcfb2ad2f964b6ba9d536b4c66"
Jul 16 22:06:36.051787 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:06:36.051768    2579 scope.go:117] "RemoveContainer" containerID="93d8cb31838b6507f4da28abd8851375fcaacebcfb2ad2f964b6ba9d536b4c66"
Jul 16 22:06:36.052024 ip-10-0-133-58 kubenswrapper[2579]: E0716 22:06:36.052005    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93d8cb31838b6507f4da28abd8851375fcaacebcfb2ad2f964b6ba9d536b4c66\": container with ID starting with 93d8cb31838b6507f4da28abd8851375fcaacebcfb2ad2f964b6ba9d536b4c66 not found: ID does not exist" containerID="93d8cb31838b6507f4da28abd8851375fcaacebcfb2ad2f964b6ba9d536b4c66"
Jul 16 22:06:36.052066 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:06:36.052034    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93d8cb31838b6507f4da28abd8851375fcaacebcfb2ad2f964b6ba9d536b4c66"} err="failed to get container status \"93d8cb31838b6507f4da28abd8851375fcaacebcfb2ad2f964b6ba9d536b4c66\": rpc error: code = NotFound desc = could not find container \"93d8cb31838b6507f4da28abd8851375fcaacebcfb2ad2f964b6ba9d536b4c66\": container with ID starting with 93d8cb31838b6507f4da28abd8851375fcaacebcfb2ad2f964b6ba9d536b4c66 not found: ID does not exist"
Jul 16 22:06:36.068203 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:06:36.068180    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-2140ea/rate-test-model-2140ea-kserve-7955d596dc-l5nqd"]
Jul 16 22:06:36.073239 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:06:36.073219    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-2140ea/rate-test-model-2140ea-kserve-7955d596dc-l5nqd"]
Jul 16 22:06:37.972431 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:06:37.972395    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a402eaa6-c97b-4232-b0e5-8fb091ee4e34" path="/var/lib/kubelet/pods/a402eaa6-c97b-4232-b0e5-8fb091ee4e34/volumes"
Jul 16 22:06:54.912046 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:06:54.912011    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 22:07:20.014426 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:07:20.014385    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h88m5"]
Jul 16 22:07:32.912508 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:07:32.912473    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-784bb79bdb-kf4r2_1d1bc6d9-5692-4705-95d9-bf411ae591d4/authorino/0.log"
Jul 16 22:07:39.029429 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:07:39.029399    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9f7d7dc89-bqgr9_92784711-0b3d-47c6-b6eb-105b0632b04a/copy-manifests/0.log"
Jul 16 22:07:39.036445 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:07:39.036422    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9f7d7dc89-bqgr9_92784711-0b3d-47c6-b6eb-105b0632b04a/manager/0.log"
Jul 16 22:07:42.153498 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:07:42.153463    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-784bb79bdb-kf4r2_1d1bc6d9-5692-4705-95d9-bf411ae591d4/authorino/0.log"
Jul 16 22:07:42.392921 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:07:42.392885    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-2qt9z_db14599e-064f-4a29-a188-236c7d26c152/manager/0.log"
Jul 16 22:07:42.503277 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:07:42.503198    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-sv9gt_e3f7f716-31bc-4d80-94b6-3c7317a0a278/kuadrant-console-plugin/0.log"
Jul 16 22:07:42.934421 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:07:42.934392    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-h88m5_43a9e44c-3287-450d-8d6d-91778504e3d5/limitador/0.log"
Jul 16 22:07:43.774388 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:07:43.774356    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b9fcf8c8b-tm8mg_4c4c2a46-52f1-4ef6-aa62-1a9e07aad76a/kube-auth-proxy/0.log"
Jul 16 22:07:44.140861 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:07:44.140790    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-f7zpq_8a47df2f-954b-452c-a701-1e01c75bd8bc/payload-processing/0.log"
Jul 16 22:07:44.824556 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:07:44.824529    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-2xvjw_6ebfb2c0-01e8-400b-804d-b902fc48b7b4/main/0.log"
Jul 16 22:07:45.048072 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:07:45.048038    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-xl2zf_40fe75c3-a795-4b3f-b5a9-74e528b77c52/main/0.log"
Jul 16 22:07:45.168405 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:07:45.168381    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-982x7_39c9a04f-f8c7-41f3-a72b-b3b3112a6456/main/0.log"
Jul 16 22:07:54.376624 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:07:54.376568    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6z877_97f73b7d-47ea-4d24-a45e-fab8a2f5cda2/global-pull-secret-syncer/0.log"
Jul 16 22:07:54.523191 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:07:54.523159    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-llmw2_92e2f3e9-e610-4859-b11b-105f3e28d548/konnectivity-agent/0.log"
Jul 16 22:07:54.632205 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:07:54.632125    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-58.ec2.internal_505a84a2e65f988310008bbe35d60123/haproxy/0.log"
Jul 16 22:08:00.141258 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:08:00.141223    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-784bb79bdb-kf4r2_1d1bc6d9-5692-4705-95d9-bf411ae591d4/authorino/0.log"
Jul 16 22:08:00.211675 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:08:00.211641    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-2qt9z_db14599e-064f-4a29-a188-236c7d26c152/manager/0.log"
Jul 16 22:08:00.258800 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:08:00.258773    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-sv9gt_e3f7f716-31bc-4d80-94b6-3c7317a0a278/kuadrant-console-plugin/0.log"
Jul 16 22:08:00.524183 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:08:00.524148    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-h88m5_43a9e44c-3287-450d-8d6d-91778504e3d5/limitador/0.log"
Jul 16 22:08:02.884012 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:08:02.883986    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vskpk_8483a35d-1351-40fe-a74f-8defef056a52/node-exporter/0.log"
Jul 16 22:08:02.909094 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:08:02.909065    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vskpk_8483a35d-1351-40fe-a74f-8defef056a52/kube-rbac-proxy/0.log"
Jul 16 22:08:02.953263 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:08:02.953236    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vskpk_8483a35d-1351-40fe-a74f-8defef056a52/init-textfile/0.log"
Jul 16 22:08:03.105155 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:08:03.105080    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f220fc93-56fd-4052-bc5b-a174378c6de2/prometheus/0.log"
Jul 16 22:08:03.128921 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:08:03.128892    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f220fc93-56fd-4052-bc5b-a174378c6de2/config-reloader/0.log"
Jul 16 22:08:03.155897 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:08:03.155874    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f220fc93-56fd-4052-bc5b-a174378c6de2/thanos-sidecar/0.log"
Jul 16 22:08:03.183153 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:08:03.183130    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f220fc93-56fd-4052-bc5b-a174378c6de2/kube-rbac-proxy-web/0.log"
Jul 16 22:08:03.208878 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:08:03.208854    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f220fc93-56fd-4052-bc5b-a174378c6de2/kube-rbac-proxy/0.log"
Jul 16 22:08:03.232729 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:08:03.232710    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f220fc93-56fd-4052-bc5b-a174378c6de2/kube-rbac-proxy-thanos/0.log"
Jul 16 22:08:03.264268 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:08:03.264247    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f220fc93-56fd-4052-bc5b-a174378c6de2/init-config-reloader/0.log"
Jul 16 22:08:03.299566 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:08:03.299541    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-qfx5x_9cd874e9-ac2e-4a23-ab69-b0be53f0588d/prometheus-operator/0.log"
Jul 16 22:08:03.320910 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:08:03.320891    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-qfx5x_9cd874e9-ac2e-4a23-ab69-b0be53f0588d/kube-rbac-proxy/0.log"
Jul 16 22:08:03.484005 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:08:03.483926    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-654bf8fb59-lrqj4_74c9eeb2-f65d-403a-9d99-e8745bfb19c8/thanos-query/0.log"
Jul 16 22:08:03.508417 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:08:03.508389    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-654bf8fb59-lrqj4_74c9eeb2-f65d-403a-9d99-e8745bfb19c8/kube-rbac-proxy-web/0.log"
Jul 16 22:08:03.536587 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:08:03.536563    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-654bf8fb59-lrqj4_74c9eeb2-f65d-403a-9d99-e8745bfb19c8/kube-rbac-proxy/0.log"
Jul 16 22:08:03.562454 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:08:03.562431    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-654bf8fb59-lrqj4_74c9eeb2-f65d-403a-9d99-e8745bfb19c8/prom-label-proxy/0.log"
Jul 16 22:08:03.588538 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:08:03.588511    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-654bf8fb59-lrqj4_74c9eeb2-f65d-403a-9d99-e8745bfb19c8/kube-rbac-proxy-rules/0.log"
Jul 16 22:08:03.611732 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:08:03.611705    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-654bf8fb59-lrqj4_74c9eeb2-f65d-403a-9d99-e8745bfb19c8/kube-rbac-proxy-metrics/0.log"
Jul 16 22:08:03.855551 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:08:03.855468    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bq49w/perf-node-gather-daemonset-ws8pt"]
Jul 16 22:08:03.855840 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:08:03.855827    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a402eaa6-c97b-4232-b0e5-8fb091ee4e34" containerName="main"
Jul 16 22:08:03.855840 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:08:03.855841    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a402eaa6-c97b-4232-b0e5-8fb091ee4e34" containerName="main"
Jul 16 22:08:03.855923 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:08:03.855916    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a402eaa6-c97b-4232-b0e5-8fb091ee4e34" containerName="main"
Jul 16 22:08:03.858990 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:08:03.858972    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bq49w/perf-node-gather-daemonset-ws8pt"
Jul 16 22:08:03.862715 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:08:03.862692    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-bq49w\"/\"default-dockercfg-hm25x\""
Jul 16 22:08:03.863744 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:08:03.863730    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bq49w\"/\"openshift-service-ca.crt\""
Jul 16 22:08:03.863970 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:08:03.863954    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bq49w\"/\"kube-root-ca.crt\""
Jul 16 22:08:03.881180 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:08:03.881150    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bq49w/perf-node-gather-daemonset-ws8pt"]
Jul 16 22:08:03.899171 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:08:03.899141    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f2620ee8-af72-4a19-abca-f7db7d309b1a-proc\") pod \"perf-node-gather-daemonset-ws8pt\" (UID: \"f2620ee8-af72-4a19-abca-f7db7d309b1a\") " pod="openshift-must-gather-bq49w/perf-node-gather-daemonset-ws8pt"
Jul 16 22:08:03.899566 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:08:03.899181    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f2620ee8-af72-4a19-abca-f7db7d309b1a-podres\") pod \"perf-node-gather-daemonset-ws8pt\" (UID: \"f2620ee8-af72-4a19-abca-f7db7d309b1a\") " pod="openshift-must-gather-bq49w/perf-node-gather-daemonset-ws8pt"
Jul 16 22:08:03.899566 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:08:03.899246    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f2620ee8-af72-4a19-abca-f7db7d309b1a-lib-modules\") pod \"perf-node-gather-daemonset-ws8pt\" (UID: \"f2620ee8-af72-4a19-abca-f7db7d309b1a\") " pod="openshift-must-gather-bq49w/perf-node-gather-daemonset-ws8pt"
Jul 16 22:08:03.899566 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:08:03.899331    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f2620ee8-af72-4a19-abca-f7db7d309b1a-sys\") pod \"perf-node-gather-daemonset-ws8pt\" (UID: \"f2620ee8-af72-4a19-abca-f7db7d309b1a\") " pod="openshift-must-gather-bq49w/perf-node-gather-daemonset-ws8pt"
Jul 16 22:08:03.899566 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:08:03.899378    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqp9q\" (UniqueName: \"kubernetes.io/projected/f2620ee8-af72-4a19-abca-f7db7d309b1a-kube-api-access-gqp9q\") pod \"perf-node-gather-daemonset-ws8pt\" (UID: \"f2620ee8-af72-4a19-abca-f7db7d309b1a\") " pod="openshift-must-gather-bq49w/perf-node-gather-daemonset-ws8pt"
Jul 16 22:08:04.000578 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:08:04.000545    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqp9q\" (UniqueName: \"kubernetes.io/projected/f2620ee8-af72-4a19-abca-f7db7d309b1a-kube-api-access-gqp9q\") pod \"perf-node-gather-daemonset-ws8pt\" (UID: \"f2620ee8-af72-4a19-abca-f7db7d309b1a\") " pod="openshift-must-gather-bq49w/perf-node-gather-daemonset-ws8pt"
Jul 16 22:08:04.000920 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:08:04.000892    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f2620ee8-af72-4a19-abca-f7db7d309b1a-proc\") pod \"perf-node-gather-daemonset-ws8pt\" (UID: \"f2620ee8-af72-4a19-abca-f7db7d309b1a\") " pod="openshift-must-gather-bq49w/perf-node-gather-daemonset-ws8pt"
Jul 16 22:08:04.001034 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:08:04.000945    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f2620ee8-af72-4a19-abca-f7db7d309b1a-podres\") pod \"perf-node-gather-daemonset-ws8pt\" (UID: \"f2620ee8-af72-4a19-abca-f7db7d309b1a\") " pod="openshift-must-gather-bq49w/perf-node-gather-daemonset-ws8pt"
Jul 16 22:08:04.001034 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:08:04.000959    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f2620ee8-af72-4a19-abca-f7db7d309b1a-proc\") pod \"perf-node-gather-daemonset-ws8pt\" (UID: \"f2620ee8-af72-4a19-abca-f7db7d309b1a\") " pod="openshift-must-gather-bq49w/perf-node-gather-daemonset-ws8pt"
Jul 16 22:08:04.001171 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:08:04.001056    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f2620ee8-af72-4a19-abca-f7db7d309b1a-lib-modules\") pod \"perf-node-gather-daemonset-ws8pt\" (UID: \"f2620ee8-af72-4a19-abca-f7db7d309b1a\") " pod="openshift-must-gather-bq49w/perf-node-gather-daemonset-ws8pt"
Jul 16 22:08:04.001240 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:08:04.001176    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f2620ee8-af72-4a19-abca-f7db7d309b1a-podres\") pod \"perf-node-gather-daemonset-ws8pt\" (UID: \"f2620ee8-af72-4a19-abca-f7db7d309b1a\") " pod="openshift-must-gather-bq49w/perf-node-gather-daemonset-ws8pt"
Jul 16 22:08:04.001450 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:08:04.001428    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f2620ee8-af72-4a19-abca-f7db7d309b1a-sys\") pod \"perf-node-gather-daemonset-ws8pt\" (UID: \"f2620ee8-af72-4a19-abca-f7db7d309b1a\") " pod="openshift-must-gather-bq49w/perf-node-gather-daemonset-ws8pt"
Jul 16 22:08:04.001541 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:08:04.001476    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f2620ee8-af72-4a19-abca-f7db7d309b1a-lib-modules\") pod \"perf-node-gather-daemonset-ws8pt\" (UID: \"f2620ee8-af72-4a19-abca-f7db7d309b1a\") " pod="openshift-must-gather-bq49w/perf-node-gather-daemonset-ws8pt"
Jul 16 22:08:04.001541 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:08:04.001479    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f2620ee8-af72-4a19-abca-f7db7d309b1a-sys\") pod \"perf-node-gather-daemonset-ws8pt\" (UID: \"f2620ee8-af72-4a19-abca-f7db7d309b1a\") " pod="openshift-must-gather-bq49w/perf-node-gather-daemonset-ws8pt"
Jul 16 22:08:04.014388 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:08:04.014363    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqp9q\" (UniqueName: \"kubernetes.io/projected/f2620ee8-af72-4a19-abca-f7db7d309b1a-kube-api-access-gqp9q\") pod \"perf-node-gather-daemonset-ws8pt\" (UID: \"f2620ee8-af72-4a19-abca-f7db7d309b1a\") " pod="openshift-must-gather-bq49w/perf-node-gather-daemonset-ws8pt"
Jul 16 22:08:04.169516 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:08:04.169486    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bq49w/perf-node-gather-daemonset-ws8pt"
Jul 16 22:08:04.302401 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:08:04.302365    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bq49w/perf-node-gather-daemonset-ws8pt"]
Jul 16 22:08:04.305013 ip-10-0-133-58 kubenswrapper[2579]: W0716 22:08:04.304986    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf2620ee8_af72_4a19_abca_f7db7d309b1a.slice/crio-247a04da0a43444f5cf5d884829580b671b7f21804f70dbb8f176cddbff42eb8 WatchSource:0}: Error finding container 247a04da0a43444f5cf5d884829580b671b7f21804f70dbb8f176cddbff42eb8: Status 404 returned error can't find the container with id 247a04da0a43444f5cf5d884829580b671b7f21804f70dbb8f176cddbff42eb8
Jul 16 22:08:04.437248 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:08:04.437176    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bq49w/perf-node-gather-daemonset-ws8pt" event={"ID":"f2620ee8-af72-4a19-abca-f7db7d309b1a","Type":"ContainerStarted","Data":"247a04da0a43444f5cf5d884829580b671b7f21804f70dbb8f176cddbff42eb8"}
Jul 16 22:08:05.443408 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:08:05.443372    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bq49w/perf-node-gather-daemonset-ws8pt" event={"ID":"f2620ee8-af72-4a19-abca-f7db7d309b1a","Type":"ContainerStarted","Data":"ab644444574b89398dd3c42829962e75b6237aa38d860d5c473a93a74a8f0c26"}
Jul 16 22:08:05.443792 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:08:05.443435    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-bq49w/perf-node-gather-daemonset-ws8pt"
Jul 16 22:08:05.471353 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:08:05.471301    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-bq49w/perf-node-gather-daemonset-ws8pt" podStartSLOduration=2.471284264 podStartE2EDuration="2.471284264s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 22:08:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:08:05.469416834 +0000 UTC m=+3504.083597151" watchObservedRunningTime="2026-07-16 22:08:05.471284264 +0000 UTC m=+3504.085464580"
Jul 16 22:08:06.100026 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:08:06.099995    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-767c76c9bf-5vc48_fa8b6c44-89b3-491f-9b27-d9348515b4a0/console/0.log"
Jul 16 22:08:06.138549 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:08:06.138520    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-gxnhw_f298d5ff-45b8-433f-a167-c0576efff356/download-server/0.log"
Jul 16 22:08:07.980169 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:08:07.980144    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-67rw4_5009cd3f-ae88-48b9-a039-6b21b147306c/dns/0.log"
Jul 16 22:08:08.005067 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:08:08.005038    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-67rw4_5009cd3f-ae88-48b9-a039-6b21b147306c/kube-rbac-proxy/0.log"
Jul 16 22:08:08.193339 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:08:08.193308    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-znkwj_e52ac48f-692d-4893-a046-71dea5a7b5aa/dns-node-resolver/0.log"
Jul 16 22:08:08.872711 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:08:08.872683    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lft7l_355ad64f-aa0d-4876-a4a2-faec378a30bf/node-ca/0.log"
Jul 16 22:08:10.233217 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:08:10.233185    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b9fcf8c8b-tm8mg_4c4c2a46-52f1-4ef6-aa62-1a9e07aad76a/kube-auth-proxy/0.log"
Jul 16 22:08:10.406321 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:08:10.406290    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-f7zpq_8a47df2f-954b-452c-a701-1e01c75bd8bc/payload-processing/0.log"
Jul 16 22:08:11.179014 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:08:11.178984    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ggfl8_6ce92f9d-75e3-4c05-8ec1-5361e8ebad4c/serve-healthcheck-canary/0.log"
Jul 16 22:08:11.456820 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:08:11.456755    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-bq49w/perf-node-gather-daemonset-ws8pt"
Jul 16 22:08:11.726999 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:08:11.726927    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-74pf6_961b693a-6897-4204-a5cc-1c1c80f06693/kube-rbac-proxy/0.log"
Jul 16 22:08:11.749637 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:08:11.749605    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-74pf6_961b693a-6897-4204-a5cc-1c1c80f06693/exporter/0.log"
Jul 16 22:08:11.769455 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:08:11.769413    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-74pf6_961b693a-6897-4204-a5cc-1c1c80f06693/extractor/0.log"
Jul 16 22:08:15.047115 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:08:15.047074    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b9fcf8c8b-tm8mg_4c4c2a46-52f1-4ef6-aa62-1a9e07aad76a/kube-auth-proxy/0.log"
Jul 16 22:08:15.213710 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:08:15.213686    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-f7zpq_8a47df2f-954b-452c-a701-1e01c75bd8bc/payload-processing/0.log"
Jul 16 22:08:15.450430 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:08:15.450401    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9f7d7dc89-bqgr9_92784711-0b3d-47c6-b6eb-105b0632b04a/manager/0.log"
Jul 16 22:08:15.475857 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:08:15.475774    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9f7d7dc89-bqgr9_92784711-0b3d-47c6-b6eb-105b0632b04a/copy-manifests/0.log"
Jul 16 22:08:16.743677 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:08:16.743652    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b9fcf8c8b-tm8mg_4c4c2a46-52f1-4ef6-aa62-1a9e07aad76a/kube-auth-proxy/0.log"
Jul 16 22:08:16.800615 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:08:16.800585    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-68bcfc7f9d-lrhnz_1c331d3b-1cd9-4ff2-af2f-f81c884ecf47/manager/0.log"
Jul 16 22:08:16.845616 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:08:16.845588    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-v8rg7_842cd219-c060-4f3e-80ca-13fb75136f7c/openshift-lws-operator/0.log"
Jul 16 22:08:16.940580 ip-10-0-133-58 kubenswrapper[2579]: I0716 22:08:16.940555    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-f7zpq_8a47df2f-954b-452c-a701-1e01c75bd8bc/payload-processing/0.log"