Jul 22 13:44:18.173568 ip-10-0-129-134 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 22 13:44:18.173580 ip-10-0-129-134 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 22 13:44:18.173587 ip-10-0-129-134 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 22 13:44:18.173803 ip-10-0-129-134 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 22 13:44:29.372108 ip-10-0-129-134 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 22 13:44:29.372124 ip-10-0-129-134 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 0d11d9e6908047f184a72060ed4d3c8e --
Jul 22 13:46:29.835784 ip-10-0-129-134 systemd[1]: Starting Kubernetes Kubelet...
Jul 22 13:46:30.729279 ip-10-0-129-134 kubenswrapper[2571]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 22 13:46:30.729279 ip-10-0-129-134 kubenswrapper[2571]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 22 13:46:30.729279 ip-10-0-129-134 kubenswrapper[2571]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 22 13:46:30.729279 ip-10-0-129-134 kubenswrapper[2571]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 22 13:46:30.729279 ip-10-0-129-134 kubenswrapper[2571]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 22 13:46:30.731557 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.731428    2571 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 22 13:46:30.735502 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735468    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 13:46:30.735502 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735499    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 13:46:30.735575 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735505    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 13:46:30.735575 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735508    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 13:46:30.735575 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735512    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 13:46:30.735575 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735520    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 13:46:30.735575 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735523    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 13:46:30.735575 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735526    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 13:46:30.735575 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735529    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 13:46:30.735575 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735532    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 13:46:30.735575 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735535    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 13:46:30.735575 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735538    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 13:46:30.735575 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735541    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 13:46:30.735575 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735544    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 13:46:30.735575 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735546    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 13:46:30.735575 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735549    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 13:46:30.735575 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735552    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 13:46:30.735575 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735555    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 13:46:30.735575 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735558    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 13:46:30.736009 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735591    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 13:46:30.736009 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735595    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 13:46:30.736009 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735598    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 13:46:30.736009 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735602    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 13:46:30.736009 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735607    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 13:46:30.736009 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735610    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 13:46:30.736009 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735613    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 13:46:30.736009 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735616    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 13:46:30.736009 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735620    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 13:46:30.736009 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735623    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 13:46:30.736009 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735626    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 13:46:30.736009 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735629    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 13:46:30.736009 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735633    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 13:46:30.736009 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735636    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 13:46:30.736009 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735639    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 13:46:30.736009 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735642    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 13:46:30.736009 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735645    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 13:46:30.736009 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735647    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 13:46:30.736009 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735650    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 13:46:30.736009 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735654    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 13:46:30.736518 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735657    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 13:46:30.736518 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735659    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 13:46:30.736518 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735662    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 13:46:30.736518 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735665    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 13:46:30.736518 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735667    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 13:46:30.736518 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735671    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 13:46:30.736518 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735674    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 13:46:30.736518 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735677    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 13:46:30.736518 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735680    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 13:46:30.736518 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735682    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 13:46:30.736518 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735685    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 13:46:30.736518 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735688    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 13:46:30.736518 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735691    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 13:46:30.736518 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735695    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 13:46:30.736518 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735698    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 13:46:30.736518 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735702    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 13:46:30.736518 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735707    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 13:46:30.736518 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735710    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 13:46:30.736518 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735713    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 13:46:30.736518 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735717    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 13:46:30.737024 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735720    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 13:46:30.737024 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735723    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 13:46:30.737024 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735726    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 13:46:30.737024 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735728    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 13:46:30.737024 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735731    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 13:46:30.737024 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735734    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 13:46:30.737024 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735737    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 13:46:30.737024 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735740    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 13:46:30.737024 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735742    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 13:46:30.737024 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735745    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 13:46:30.737024 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735749    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 13:46:30.737024 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735753    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 13:46:30.737024 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735757    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 13:46:30.737024 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735760    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 13:46:30.737024 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735763    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 13:46:30.737024 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735766    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 13:46:30.737024 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735769    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 13:46:30.737024 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735772    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 13:46:30.737024 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735775    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 13:46:30.737024 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735778    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 13:46:30.737537 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735781    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 13:46:30.737537 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735784    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 13:46:30.737537 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735786    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 13:46:30.737537 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735789    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 13:46:30.737537 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735793    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 13:46:30.737537 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735796    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 13:46:30.737537 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735799    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 13:46:30.737537 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735802    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 13:46:30.737537 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735805    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 13:46:30.737537 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735808    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 13:46:30.737537 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735810    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 13:46:30.737537 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735813    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 13:46:30.737537 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735816    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 13:46:30.737537 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735818    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 13:46:30.737537 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735821    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 13:46:30.737537 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735824    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 13:46:30.737537 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735826    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 13:46:30.737537 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735829    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 13:46:30.737537 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735832    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 13:46:30.738039 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.735834    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 13:46:30.738039 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736608    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 13:46:30.738039 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736616    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 13:46:30.738039 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736620    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 13:46:30.738039 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736623    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 13:46:30.738039 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736628    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 13:46:30.738039 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736633    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 13:46:30.738039 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736636    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 13:46:30.738039 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736640    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 13:46:30.738039 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736643    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 13:46:30.738039 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736646    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 13:46:30.738039 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736650    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 13:46:30.738039 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736653    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 13:46:30.738039 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736657    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 13:46:30.738039 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736660    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 13:46:30.738039 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736665    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 13:46:30.738039 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736668    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 13:46:30.738039 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736671    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 13:46:30.738039 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736674    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 13:46:30.738039 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736678    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 13:46:30.738572 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736680    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 13:46:30.738572 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736684    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 13:46:30.738572 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736686    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 13:46:30.738572 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736690    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 13:46:30.738572 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736693    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 13:46:30.738572 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736696    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 13:46:30.738572 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736699    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 13:46:30.738572 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736702    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 13:46:30.738572 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736704    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 13:46:30.738572 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736707    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 13:46:30.738572 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736710    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 13:46:30.738572 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736713    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 13:46:30.738572 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736716    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 13:46:30.738572 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736719    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 13:46:30.738572 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736721    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 13:46:30.738572 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736724    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 13:46:30.738572 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736727    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 13:46:30.738572 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736731    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 13:46:30.738572 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736734    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 13:46:30.738572 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736737    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 13:46:30.739079 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736740    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 13:46:30.739079 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736743    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 13:46:30.739079 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736746    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 13:46:30.739079 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736748    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 13:46:30.739079 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736751    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 13:46:30.739079 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736754    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 13:46:30.739079 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736757    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 13:46:30.739079 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736760    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 13:46:30.739079 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736762    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 13:46:30.739079 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736766    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 13:46:30.739079 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736770    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 13:46:30.739079 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736773    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 13:46:30.739079 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736776    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 13:46:30.739079 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736779    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 13:46:30.739079 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736781    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 13:46:30.739079 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736784    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 13:46:30.739079 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736787    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 13:46:30.739079 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736790    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 13:46:30.739079 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736793    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 13:46:30.739582 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736796    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 13:46:30.739582 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736798    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 13:46:30.739582 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736802    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 13:46:30.739582 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736806    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 13:46:30.739582 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736810    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 13:46:30.739582 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736813    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 13:46:30.739582 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736816    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 13:46:30.739582 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736819    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 13:46:30.739582 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736822    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 13:46:30.739582 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736825    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 13:46:30.739582 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736828    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 13:46:30.739582 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736830    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 13:46:30.739582 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736833    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 13:46:30.739582 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736837    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 13:46:30.739582 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736840    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 13:46:30.739582 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736843    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 13:46:30.739582 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736846    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 13:46:30.739582 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736849    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 13:46:30.739582 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736852    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 13:46:30.739582 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736854    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 13:46:30.740088 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736857    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 13:46:30.740088 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736860    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 13:46:30.740088 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736864    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 13:46:30.740088 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736867    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 13:46:30.740088 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736870    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 13:46:30.740088 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736872    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 13:46:30.740088 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736875    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 13:46:30.740088 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736878    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 13:46:30.740088 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736880    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 13:46:30.740088 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736883    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 13:46:30.740088 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736886    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 13:46:30.740088 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736888    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 13:46:30.740088 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736891    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 13:46:30.740088 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736894    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 13:46:30.740088 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736897    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 13:46:30.740088 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736899    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 13:46:30.740088 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736902    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 13:46:30.740088 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736905    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 13:46:30.740088 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736908    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 13:46:30.740088 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736911    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 13:46:30.740633 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.736914    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 13:46:30.740633 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737323    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 13:46:30.740633 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737329    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 13:46:30.740633 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737332    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 13:46:30.740633 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737335    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 13:46:30.740633 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737339    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 13:46:30.740633 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737342    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 13:46:30.740633 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737345    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 13:46:30.740633 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737348    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 13:46:30.740633 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737351    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 13:46:30.740633 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737354    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 13:46:30.740633 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737357    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 13:46:30.740633 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737360    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 13:46:30.740633 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737363    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 13:46:30.740633 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737365    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 13:46:30.740633 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737369    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 13:46:30.740633 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737371    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 13:46:30.740633 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737374    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 13:46:30.740633 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737377    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 13:46:30.741140 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737380    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 13:46:30.741140 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737383    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 13:46:30.741140 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737386    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 13:46:30.741140 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737391    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 13:46:30.741140 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737394    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 13:46:30.741140 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737398    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 13:46:30.741140 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737401    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 13:46:30.741140 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737404    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 13:46:30.741140 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737407    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 13:46:30.741140 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737410    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 13:46:30.741140 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737413    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 13:46:30.741140 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737416    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 13:46:30.741140 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737419    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 13:46:30.741140 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737422    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 13:46:30.741140 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737425    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 13:46:30.741140 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737428    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 13:46:30.741140 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737430    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 13:46:30.741140 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737433    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 13:46:30.741140 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737436    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 13:46:30.741140 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737440    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 13:46:30.741653 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737443    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 13:46:30.741653 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737446    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 13:46:30.741653 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737449    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 13:46:30.741653 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737451    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 13:46:30.741653 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737454    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 13:46:30.741653 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737457    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 13:46:30.741653 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737459    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 13:46:30.741653 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737462    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 13:46:30.741653 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737465    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 13:46:30.741653 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737467    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 13:46:30.741653 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737472    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 13:46:30.741653 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737475    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 13:46:30.741653 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737493    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 13:46:30.741653 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737496    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 13:46:30.741653 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737500    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 13:46:30.741653 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737503    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 13:46:30.741653 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737506    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 13:46:30.741653 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737509    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 13:46:30.741653 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737512    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 13:46:30.741653 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737515    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 13:46:30.742156 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737518    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 13:46:30.742156 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737521    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 13:46:30.742156 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737529    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 13:46:30.742156 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737532    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 13:46:30.742156 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737535    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 13:46:30.742156 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737539    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 13:46:30.742156 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737543    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 13:46:30.742156 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737546    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 13:46:30.742156 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737548    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 13:46:30.742156 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737551    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 13:46:30.742156 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737554    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 13:46:30.742156 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737557    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 13:46:30.742156 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737561    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 13:46:30.742156 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737564    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 13:46:30.742156 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737566    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 13:46:30.742156 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737569    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 13:46:30.742156 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737572    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 13:46:30.742156 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737574    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 13:46:30.742156 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737577    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 13:46:30.742737 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737580    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 13:46:30.742737 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737582    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 13:46:30.742737 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737585    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 13:46:30.742737 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737588    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 13:46:30.742737 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737591    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 13:46:30.742737 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737594    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 13:46:30.742737 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737596    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 13:46:30.742737 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737599    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 13:46:30.742737 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737602    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 13:46:30.742737 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737605    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 13:46:30.742737 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737607    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 13:46:30.742737 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737610    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 13:46:30.742737 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737613    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 13:46:30.742737 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737616    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 13:46:30.742737 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737618    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 13:46:30.742737 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737622    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 13:46:30.742737 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737624    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 13:46:30.742737 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737627    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 13:46:30.742737 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737630    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 13:46:30.742737 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737633    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 13:46:30.743260 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737636    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 13:46:30.743260 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.737638    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 13:46:30.743260 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.737730    2571 flags.go:64] FLAG: --address="0.0.0.0"
Jul 22 13:46:30.743260 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.737740    2571 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 22 13:46:30.743260 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.737750    2571 flags.go:64] FLAG: --anonymous-auth="true"
Jul 22 13:46:30.743260 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.737756    2571 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 22 13:46:30.743260 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.737761    2571 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 22 13:46:30.743260 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.737765    2571 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 22 13:46:30.743260 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.737769    2571 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 22 13:46:30.743260 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.737774    2571 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 22 13:46:30.743260 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.737777    2571 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 22 13:46:30.743260 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.737780    2571 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 22 13:46:30.743260 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.737784    2571 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 22 13:46:30.743260 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.737788    2571 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 22 13:46:30.743260 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.737791    2571 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 22 13:46:30.743260 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.737794    2571 flags.go:64] FLAG: --cgroup-root=""
Jul 22 13:46:30.743260 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.737797    2571 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 22 13:46:30.743260 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.737800    2571 flags.go:64] FLAG: --client-ca-file=""
Jul 22 13:46:30.743260 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.737803    2571 flags.go:64] FLAG: --cloud-provider="external"
Jul 22 13:46:30.743260 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.737806    2571 flags.go:64] FLAG: --cluster-dns="[]"
Jul 22 13:46:30.743260 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.737812    2571 flags.go:64] FLAG: --cluster-domain=""
Jul 22 13:46:30.743260 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.737816    2571 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 22 13:46:30.743260 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.737819    2571 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 22 13:46:30.743260 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.737822    2571 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 22 13:46:30.743912 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.737826    2571 flags.go:64] FLAG: --container-log-max-files="5"
Jul 22 13:46:30.743912 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.737830    2571 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 22 13:46:30.743912 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.737833    2571 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 22 13:46:30.743912 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.737836    2571 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 22 13:46:30.743912 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.737841    2571 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 22 13:46:30.743912 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.737844    2571 flags.go:64] FLAG: --contention-profiling="false"
Jul 22 13:46:30.743912 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.737848    2571 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 22 13:46:30.743912 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.737851    2571 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 22 13:46:30.743912 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.737856    2571 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 22 13:46:30.743912 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.737859    2571 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 22 13:46:30.743912 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.737863    2571 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 22 13:46:30.743912 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.737866    2571 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 22 13:46:30.743912 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.737870    2571 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 22 13:46:30.743912 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.737873    2571 flags.go:64] FLAG: --enable-load-reader="false"
Jul 22 13:46:30.743912 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.737876    2571 flags.go:64] FLAG: --enable-server="true"
Jul 22 13:46:30.743912 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.737880    2571 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 22 13:46:30.743912 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.737884    2571 flags.go:64] FLAG: --event-burst="100"
Jul 22 13:46:30.743912 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.737888    2571 flags.go:64] FLAG: --event-qps="50"
Jul 22 13:46:30.743912 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.737891    2571 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 22 13:46:30.743912 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.737894    2571 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 22 13:46:30.743912 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.737898    2571 flags.go:64] FLAG: --eviction-hard=""
Jul 22 13:46:30.743912 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.737901    2571 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 22 13:46:30.743912 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.737905    2571 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 22 13:46:30.743912 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.737908    2571 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 22 13:46:30.743912 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.737911    2571 flags.go:64] FLAG: --eviction-soft=""
Jul 22 13:46:30.744594 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.737914    2571 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 22 13:46:30.744594 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.737917    2571 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 22 13:46:30.744594 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.737920    2571 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 22 13:46:30.744594 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.737923    2571 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 22 13:46:30.744594 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.737927    2571 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 22 13:46:30.744594 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.737929    2571 flags.go:64] FLAG: --fail-swap-on="true"
Jul 22 13:46:30.744594 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.737932    2571 flags.go:64] FLAG: --feature-gates=""
Jul 22 13:46:30.744594 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.737936    2571 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 22 13:46:30.744594 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.737940    2571 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 22 13:46:30.744594 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.737943    2571 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 22 13:46:30.744594 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.737947    2571 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 22 13:46:30.744594 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.737951    2571 flags.go:64] FLAG: --healthz-port="10248"
Jul 22 13:46:30.744594 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.737954    2571 flags.go:64] FLAG: --help="false"
Jul 22 13:46:30.744594 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.737958    2571 flags.go:64] FLAG: --hostname-override="ip-10-0-129-134.ec2.internal"
Jul 22 13:46:30.744594 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.737961    2571 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 22 13:46:30.744594 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.737964    2571 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 22 13:46:30.744594 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.737967    2571 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 22 13:46:30.744594 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.737971    2571 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 22 13:46:30.744594 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.737974    2571 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 22 13:46:30.744594 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.737978    2571 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 22 13:46:30.744594 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.737981    2571 flags.go:64] FLAG: --image-service-endpoint=""
Jul 22 13:46:30.744594 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.737984    2571 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 22 13:46:30.744594 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.737987    2571 flags.go:64] FLAG: --kube-api-burst="100"
Jul 22 13:46:30.745316 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.737991    2571 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 22 13:46:30.745316 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.737994    2571 flags.go:64] FLAG: --kube-api-qps="50"
Jul 22 13:46:30.745316 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.737997    2571 flags.go:64] FLAG: --kube-reserved=""
Jul 22 13:46:30.745316 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738000    2571 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 22 13:46:30.745316 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738003    2571 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 22 13:46:30.745316 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738006    2571 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 22 13:46:30.745316 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738010    2571 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 22 13:46:30.745316 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738012    2571 flags.go:64] FLAG: --lock-file=""
Jul 22 13:46:30.745316 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738015    2571 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 22 13:46:30.745316 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738018    2571 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 22 13:46:30.745316 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738021    2571 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 22 13:46:30.745316 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738035    2571 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 22 13:46:30.745316 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738038    2571 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 22 13:46:30.745316 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738041    2571 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 22 13:46:30.745316 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738044    2571 flags.go:64] FLAG: --logging-format="text"
Jul 22 13:46:30.745316 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738047    2571 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 22 13:46:30.745316 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738051    2571 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 22 13:46:30.745316 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738054    2571 flags.go:64] FLAG: --manifest-url=""
Jul 22 13:46:30.745316 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738058    2571 flags.go:64] FLAG: --manifest-url-header=""
Jul 22 13:46:30.745316 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738062    2571 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 22 13:46:30.745316 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738066    2571 flags.go:64] FLAG: --max-open-files="1000000"
Jul 22 13:46:30.745316 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738070    2571 flags.go:64] FLAG: --max-pods="110"
Jul 22 13:46:30.745316 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738073    2571 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 22 13:46:30.745316 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738077    2571 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 22 13:46:30.745316 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738080    2571 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 22 13:46:30.745990 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738082    2571 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 22 13:46:30.745990 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738085    2571 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 22 13:46:30.745990 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738089    2571 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 22 13:46:30.745990 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738092    2571 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 22 13:46:30.745990 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738099    2571 flags.go:64] FLAG: --node-status-max-images="50"
Jul 22 13:46:30.745990 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738103    2571 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 22 13:46:30.745990 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738107    2571 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 22 13:46:30.745990 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738110    2571 flags.go:64] FLAG: --pod-cidr=""
Jul 22 13:46:30.745990 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738113    2571 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 22 13:46:30.745990 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738121    2571 flags.go:64] FLAG: --pod-manifest-path=""
Jul 22 13:46:30.745990 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738124    2571 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 22 13:46:30.745990 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738127    2571 flags.go:64] FLAG: --pods-per-core="0"
Jul 22 13:46:30.745990 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738130    2571 flags.go:64] FLAG: --port="10250"
Jul 22 13:46:30.745990 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738134    2571 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 22 13:46:30.745990 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738137    2571 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0dfdb719c467fb27a"
Jul 22 13:46:30.745990 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738140    2571 flags.go:64] FLAG: --qos-reserved=""
Jul 22 13:46:30.745990 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738143    2571 flags.go:64] FLAG: --read-only-port="10255"
Jul 22 13:46:30.745990 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738146    2571 flags.go:64] FLAG: --register-node="true"
Jul 22 13:46:30.745990 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738149    2571 flags.go:64] FLAG: --register-with-taints=""
Jul 22 13:46:30.745990 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738157    2571 flags.go:64] FLAG: --registry-burst="10"
Jul 22 13:46:30.745990 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738160    2571 flags.go:64] FLAG: --registry-qps="5"
Jul 22 13:46:30.745990 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738163    2571 flags.go:64] FLAG: --reserved-cpus=""
Jul 22 13:46:30.745990 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738166    2571 flags.go:64] FLAG: --reserved-memory=""
Jul 22 13:46:30.745990 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738170    2571 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 22 13:46:30.745990 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738173    2571 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 22 13:46:30.746665 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738181    2571 flags.go:64] FLAG: --rotate-certificates="false"
Jul 22 13:46:30.746665 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738184    2571 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 22 13:46:30.746665 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738187    2571 flags.go:64] FLAG: --runonce="false"
Jul 22 13:46:30.746665 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738190    2571 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 22 13:46:30.746665 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738194    2571 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 22 13:46:30.746665 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738197    2571 flags.go:64] FLAG: --seccomp-default="false"
Jul 22 13:46:30.746665 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738200    2571 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 22 13:46:30.746665 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738203    2571 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 22 13:46:30.746665 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738206    2571 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 22 13:46:30.746665 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738214    2571 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 22 13:46:30.746665 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738217    2571 flags.go:64] FLAG: --storage-driver-password="root"
Jul 22 13:46:30.746665 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738220    2571 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 22 13:46:30.746665 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738224    2571 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 22 13:46:30.746665 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738227    2571 flags.go:64] FLAG: --storage-driver-user="root"
Jul 22 13:46:30.746665 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738230    2571 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 22 13:46:30.746665 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738233    2571 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 22 13:46:30.746665 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738237    2571 flags.go:64] FLAG: --system-cgroups=""
Jul 22 13:46:30.746665 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738240    2571 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 22 13:46:30.746665 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738246    2571 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 22 13:46:30.746665 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738249    2571 flags.go:64] FLAG: --tls-cert-file=""
Jul 22 13:46:30.746665 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738252    2571 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 22 13:46:30.746665 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738258    2571 flags.go:64] FLAG: --tls-min-version=""
Jul 22 13:46:30.746665 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738261    2571 flags.go:64] FLAG: --tls-private-key-file=""
Jul 22 13:46:30.746665 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738264    2571 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 22 13:46:30.746665 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738267    2571 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 22 13:46:30.747296 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738270    2571 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 22 13:46:30.747296 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738273    2571 flags.go:64] FLAG: --v="2"
Jul 22 13:46:30.747296 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738278    2571 flags.go:64] FLAG: --version="false"
Jul 22 13:46:30.747296 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738282    2571 flags.go:64] FLAG: --vmodule=""
Jul 22 13:46:30.747296 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738286    2571 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 22 13:46:30.747296 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.738290    2571 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 22 13:46:30.747296 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738416    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 13:46:30.747296 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738425    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 13:46:30.747296 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738430    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 13:46:30.747296 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738434    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 13:46:30.747296 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738438    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 13:46:30.747296 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738442    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 13:46:30.747296 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738445    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 13:46:30.747296 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738448    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 13:46:30.747296 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738451    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 13:46:30.747296 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738454    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 13:46:30.747296 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738458    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 13:46:30.747296 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738461    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 13:46:30.747296 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738464    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 13:46:30.747296 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738467    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 13:46:30.747829 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738470    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 13:46:30.747829 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738472    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 13:46:30.747829 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738475    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 13:46:30.747829 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738491    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 13:46:30.747829 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738495    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 13:46:30.747829 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738498    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 13:46:30.747829 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738501    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 13:46:30.747829 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738503    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 13:46:30.747829 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738506    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 13:46:30.747829 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738509    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 13:46:30.747829 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738512    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 13:46:30.747829 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738515    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 13:46:30.747829 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738518    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 13:46:30.747829 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738520    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 13:46:30.747829 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738523    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 13:46:30.747829 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738526    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 13:46:30.747829 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738529    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 13:46:30.747829 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738532    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 13:46:30.747829 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738535    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 13:46:30.747829 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738540    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 13:46:30.748381 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738543    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 13:46:30.748381 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738546    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 13:46:30.748381 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738550    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 13:46:30.748381 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738553    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 13:46:30.748381 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738556    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 13:46:30.748381 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738559    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 13:46:30.748381 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738579    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 13:46:30.748381 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738584    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 13:46:30.748381 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738587    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 13:46:30.748381 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738591    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 13:46:30.748381 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738593    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 13:46:30.748381 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738596    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 13:46:30.748381 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738599    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 13:46:30.748381 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738602    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 13:46:30.748381 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738605    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 13:46:30.748381 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738608    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 13:46:30.748381 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738611    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 13:46:30.748381 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738615    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 13:46:30.748381 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738618    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 13:46:30.748381 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738620    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 13:46:30.749037 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738623    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 13:46:30.749037 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738626    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 13:46:30.749037 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738628    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 13:46:30.749037 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738631    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 13:46:30.749037 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738634    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 13:46:30.749037 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738637    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 13:46:30.749037 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738640    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 13:46:30.749037 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738643    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 13:46:30.749037 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738645    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 13:46:30.749037 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738648    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 13:46:30.749037 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738650    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 13:46:30.749037 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738656    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 13:46:30.749037 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738659    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 13:46:30.749037 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738662    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 13:46:30.749037 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738665    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 13:46:30.749037 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738668    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 13:46:30.749037 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738671    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 13:46:30.749037 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738674    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 13:46:30.749037 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738677    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 13:46:30.749037 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738680    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 13:46:30.749574 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738682    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 13:46:30.749574 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738685    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 13:46:30.749574 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738688    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 13:46:30.749574 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738691    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 13:46:30.749574 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738694    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 13:46:30.749574 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738697    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 13:46:30.749574 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738700    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 13:46:30.749574 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738703    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 13:46:30.749574 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738706    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 13:46:30.749574 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738709    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 13:46:30.749574 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738712    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 13:46:30.749574 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738715    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 13:46:30.749574 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738718    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 13:46:30.749574 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738721    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 13:46:30.749574 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738723    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 13:46:30.749574 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738726    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 13:46:30.749574 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738729    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 13:46:30.749574 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738732    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 13:46:30.749574 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738734    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 13:46:30.750078 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738737    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 13:46:30.750078 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738740    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 13:46:30.750078 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738742    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 13:46:30.750078 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738745    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 13:46:30.750078 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738750    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 13:46:30.750078 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.738753    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 13:46:30.750078 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.739344    2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 22 13:46:30.750078 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.746879    2571 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 22 13:46:30.750078 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.746898    2571 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 22 13:46:30.750078 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.746921    2571 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 22 13:46:30.750078 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.746928    2571 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 22 13:46:30.750078 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747008    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 13:46:30.750078 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747013    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 13:46:30.750078 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747017    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 13:46:30.750078 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747020    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 13:46:30.750497 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747023    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 13:46:30.750497 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747027    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 13:46:30.750497 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747030    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 13:46:30.750497 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747033    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 13:46:30.750497 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747037    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 13:46:30.750497 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747040    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 13:46:30.750497 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747042    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 13:46:30.750497 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747046    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 13:46:30.750497 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747049    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 13:46:30.750497 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747052    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 13:46:30.750497 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747055    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 13:46:30.750497 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747058    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 13:46:30.750497 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747061    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 13:46:30.750497 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747064    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 13:46:30.750497 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747066    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 13:46:30.750497 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747069    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 13:46:30.750497 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747072    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 13:46:30.750497 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747075    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 13:46:30.750497 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747077    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 13:46:30.750497 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747080    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 13:46:30.751005 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747083    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 13:46:30.751005 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747086    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 13:46:30.751005 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747088    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 13:46:30.751005 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747091    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 13:46:30.751005 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747094    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 13:46:30.751005 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747100    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 13:46:30.751005 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747105    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 13:46:30.751005 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747108    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 13:46:30.751005 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747111    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 13:46:30.751005 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747114    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 13:46:30.751005 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747118    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 13:46:30.751005 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747120    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 13:46:30.751005 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747123    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 13:46:30.751005 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747126    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 13:46:30.751005 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747129    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 13:46:30.751005 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747132    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 13:46:30.751005 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747135    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 13:46:30.751005 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747138    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 13:46:30.751005 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747141    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 13:46:30.751511 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747145    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 13:46:30.751511 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747149    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 13:46:30.751511 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747154    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 13:46:30.751511 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747158    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 13:46:30.751511 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747161    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 13:46:30.751511 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747164    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 13:46:30.751511 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747168    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 13:46:30.751511 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747171    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 13:46:30.751511 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747174    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 13:46:30.751511 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747177    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 13:46:30.751511 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747180    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 13:46:30.751511 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747183    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 13:46:30.751511 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747186    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 13:46:30.751511 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747188    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 13:46:30.751511 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747191    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 13:46:30.751511 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747194    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 13:46:30.751511 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747197    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 13:46:30.751511 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747199    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 13:46:30.751511 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747203    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 13:46:30.752003 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747205    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 13:46:30.752003 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747208    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 13:46:30.752003 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747211    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 13:46:30.752003 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747214    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 13:46:30.752003 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747217    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 13:46:30.752003 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747220    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 13:46:30.752003 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747222    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 13:46:30.752003 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747225    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 13:46:30.752003 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747228    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 13:46:30.752003 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747231    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 13:46:30.752003 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747234    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 13:46:30.752003 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747236    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 13:46:30.752003 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747240    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 13:46:30.752003 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747243    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 13:46:30.752003 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747245    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 13:46:30.752003 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747248    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 13:46:30.752003 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747253    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 13:46:30.752003 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747257    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 13:46:30.752003 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747260    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 13:46:30.752598 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747263    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 13:46:30.752598 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747266    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 13:46:30.752598 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747268    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 13:46:30.752598 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747271    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 13:46:30.752598 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747274    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 13:46:30.752598 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747277    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 13:46:30.752598 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747279    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 13:46:30.752598 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747282    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 13:46:30.752598 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747285    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 13:46:30.752598 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747288    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 13:46:30.752598 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747291    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 13:46:30.752598 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747293    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 13:46:30.752598 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747296    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 13:46:30.752598 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747299    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 13:46:30.752598 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747302    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 13:46:30.752598 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747305    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 13:46:30.752598 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747308    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 13:46:30.752598 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747311    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 13:46:30.753072 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.747317    2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 22 13:46:30.753072 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747441    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 13:46:30.753072 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747446    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 13:46:30.753072 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747449    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 13:46:30.753072 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747452    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 13:46:30.753072 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747455    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 13:46:30.753072 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747460    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 13:46:30.753072 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747464    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 13:46:30.753072 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747467    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 13:46:30.753072 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747470    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 13:46:30.753072 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747474    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 13:46:30.753072 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747477    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 13:46:30.753072 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747494    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 13:46:30.753072 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747501    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 13:46:30.753445 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747504    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 13:46:30.753445 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747507    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 13:46:30.753445 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747510    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 13:46:30.753445 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747513    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 13:46:30.753445 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747515    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 13:46:30.753445 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747518    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 13:46:30.753445 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747521    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 13:46:30.753445 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747525    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 13:46:30.753445 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747528    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 13:46:30.753445 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747532    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 13:46:30.753445 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747535    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 13:46:30.753445 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747537    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 13:46:30.753445 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747540    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 13:46:30.753445 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747543    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 13:46:30.753445 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747546    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 13:46:30.753445 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747549    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 13:46:30.753445 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747552    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 13:46:30.753445 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747555    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 13:46:30.753445 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747557    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 13:46:30.753961 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747560    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 13:46:30.753961 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747563    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 13:46:30.753961 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747566    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 13:46:30.753961 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747569    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 13:46:30.753961 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747572    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 13:46:30.753961 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747574    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 13:46:30.753961 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747577    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 13:46:30.753961 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747580    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 13:46:30.753961 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747583    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 13:46:30.753961 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747586    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 13:46:30.753961 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747589    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 13:46:30.753961 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747592    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 13:46:30.753961 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747595    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 13:46:30.753961 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747598    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 13:46:30.753961 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747601    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 13:46:30.753961 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747604    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 13:46:30.753961 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747607    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 13:46:30.753961 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747610    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 13:46:30.753961 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747612    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 13:46:30.753961 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747615    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 13:46:30.754475 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747618    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 13:46:30.754475 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747621    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 13:46:30.754475 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747623    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 13:46:30.754475 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747626    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 13:46:30.754475 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747629    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 13:46:30.754475 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747631    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 13:46:30.754475 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747634    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 13:46:30.754475 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747637    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 13:46:30.754475 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747640    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 13:46:30.754475 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747642    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 13:46:30.754475 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747646    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 13:46:30.754475 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747650    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 13:46:30.754475 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747653    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 13:46:30.754475 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747656    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 13:46:30.754475 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747659    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 13:46:30.754475 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747662    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 13:46:30.754475 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747665    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 13:46:30.754475 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747668    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 13:46:30.754475 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747670    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 13:46:30.754475 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747673    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 13:46:30.755012 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747675    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 13:46:30.755012 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747678    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 13:46:30.755012 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747681    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 13:46:30.755012 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747683    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 13:46:30.755012 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747686    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 13:46:30.755012 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747689    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 13:46:30.755012 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747692    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 13:46:30.755012 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747695    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 13:46:30.755012 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747698    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 13:46:30.755012 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747701    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 13:46:30.755012 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747703    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 13:46:30.755012 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747706    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 13:46:30.755012 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747709    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 13:46:30.755012 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747712    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 13:46:30.755012 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747715    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 13:46:30.755012 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747717    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 13:46:30.755012 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747720    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 13:46:30.755012 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747723    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 13:46:30.755012 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747725    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 13:46:30.755012 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747728    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 13:46:30.755521 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747731    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 13:46:30.755521 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747733    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 13:46:30.755521 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747736    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 13:46:30.755521 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747738    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 13:46:30.755521 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747741    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 13:46:30.755521 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747744    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 13:46:30.755521 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:30.747746    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 13:46:30.755521 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.747752    2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 22 13:46:30.755521 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.747871    2571 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 22 13:46:30.755521 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.750075    2571 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 22 13:46:30.755521 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.751259    2571 server.go:1019] "Starting client certificate rotation"
Jul 22 13:46:30.755521 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.751367    2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 22 13:46:30.755521 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.752048    2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 22 13:46:30.755864 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.753762    2571 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 22 13:46:30.760647 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.760619    2571 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 22 13:46:30.775026 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.775000    2571 log.go:25] "Validated CRI v1 runtime API"
Jul 22 13:46:30.777854 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.777837    2571 log.go:25] "Validated CRI v1 image API"
Jul 22 13:46:30.778660 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.778648    2571 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 22 13:46:30.781632 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.781605    2571 fs.go:135] Filesystem UUIDs: map[1e833050-259e-4f9a-8b1a-4a9586532ddb:/dev/nvme0n1p4 2599f221-d618-45c5-a02f-726492f819e4:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Jul 22 13:46:30.781712 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.781629    2571 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 22 13:46:30.783494 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.783475    2571 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 22 13:46:30.786526 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.786394    2571 manager.go:216] Machine: {Timestamp:2026-07-22 13:46:30.785866328 +0000 UTC m=+0.840643001 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100807 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c8cd7597a112eed7280fc489bf348 SystemUUID:ec2c8cd7-597a-112e-ed72-80fc489bf348 BootID:0d11d9e6-9080-47f1-84a7-2060ed4d3c8e Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:5e:82:d6:c6:89 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:5e:82:d6:c6:89 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ae:75:72:b7:10:be Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 22 13:46:30.786526 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.786520    2571 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 22 13:46:30.786634 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.786612    2571 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 22 13:46:30.788246 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.788222    2571 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 22 13:46:30.788397 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.788249    2571 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-134.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 22 13:46:30.788940 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.788930    2571 topology_manager.go:138] "Creating topology manager with none policy"
Jul 22 13:46:30.788973 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.788943    2571 container_manager_linux.go:309] "Creating device plugin manager"
Jul 22 13:46:30.788973 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.788951    2571 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 22 13:46:30.789491 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.789472    2571 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 22 13:46:30.790565 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.790555    2571 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 22 13:46:30.793360 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.793347    2571 state_mem.go:36] "Initialized new in-memory state store"
Jul 22 13:46:30.793514 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.793504    2571 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 22 13:46:30.793548 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.793540    2571 kubelet.go:486] "Attempting to sync node with API server"
Jul 22 13:46:30.793576 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.793555    2571 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 22 13:46:30.793605 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.793575    2571 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 22 13:46:30.793605 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.793590    2571 kubelet.go:398] "Adding apiserver pod source"
Jul 22 13:46:30.793605 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.793602    2571 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 22 13:46:30.793983 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.793970    2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 22 13:46:30.794020 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.793992    2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 22 13:46:30.796273 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.796256    2571 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 22 13:46:30.798284 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.798269    2571 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 22 13:46:30.798325 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.798304    2571 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 22 13:46:30.799393 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.799381    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 22 13:46:30.799432 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.799399    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 22 13:46:30.799432 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.799407    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 22 13:46:30.799432 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.799417    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 22 13:46:30.799432 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.799430    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 22 13:46:30.799548 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.799439    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 22 13:46:30.799548 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.799448    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 22 13:46:30.799548 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.799454    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 22 13:46:30.799548 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.799461    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 22 13:46:30.799548 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.799466    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 22 13:46:30.799548 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.799497    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 22 13:46:30.799548 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.799507    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 22 13:46:30.800997 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.800982    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 22 13:46:30.800997 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.800999    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 22 13:46:30.804548 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.804534    2571 server.go:1268] "Started kubelet"
Jul 22 13:46:30.804720 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.804662    2571 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 22 13:46:30.804804 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.804648    2571 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 22 13:46:30.804804 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.804768    2571 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 22 13:46:30.805605 ip-10-0-129-134 systemd[1]: Started Kubernetes Kubelet.
Jul 22 13:46:30.809528 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.809503    2571 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 22 13:46:30.809980 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.809960    2571 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-134.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 22 13:46:30.810416 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:30.810362    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 22 13:46:30.811060 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:30.810876    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-134.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 22 13:46:30.811429 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.811334    2571 server.go:310] "Adding debug handlers to kubelet server"
Jul 22 13:46:30.811900 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:30.811614    2571 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 22 13:46:30.813752 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.813730    2571 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-flkqd"
Jul 22 13:46:30.816240 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:30.815373    2571 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-134.ec2.internal.18c4a0a6d8996308  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-134.ec2.internal,UID:ip-10-0-129-134.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-134.ec2.internal,},FirstTimestamp:2026-07-22 13:46:30.804505352 +0000 UTC m=+0.859282023,LastTimestamp:2026-07-22 13:46:30.804505352 +0000 UTC m=+0.859282023,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-134.ec2.internal,}"
Jul 22 13:46:30.816352 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.816330    2571 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 22 13:46:30.816418 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.816330    2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 22 13:46:30.816639 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:30.816617    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-134.ec2.internal\" not found"
Jul 22 13:46:30.817090 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.817072    2571 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 22 13:46:30.817223 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.817203    2571 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 22 13:46:30.817288 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.817228    2571 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 22 13:46:30.817376 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.817339    2571 reconstruct.go:97] "Volume reconstruction finished"
Jul 22 13:46:30.817376 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.817357    2571 reconciler.go:29] "Reconciler: start to sync state"
Jul 22 13:46:30.817630 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.817595    2571 factory.go:55] Registering systemd factory
Jul 22 13:46:30.817630 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.817618    2571 factory.go:223] Registration of the systemd container factory successfully
Jul 22 13:46:30.817893 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.817876    2571 factory.go:153] Registering CRI-O factory
Jul 22 13:46:30.817950 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.817898    2571 factory.go:223] Registration of the crio container factory successfully
Jul 22 13:46:30.817989 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.817956    2571 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 22 13:46:30.817989 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.817983    2571 factory.go:103] Registering Raw factory
Jul 22 13:46:30.818102 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.818002    2571 manager.go:1196] Started watching for new ooms in manager
Jul 22 13:46:30.818523 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.818497    2571 manager.go:349] Starting recovery of all containers
Jul 22 13:46:30.822065 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.822000    2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-flkqd"
Jul 22 13:46:30.823415 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:30.823389    2571 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-134.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 22 13:46:30.823610 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:30.823587    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 22 13:46:30.829045 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.829026    2571 manager.go:354] Recovery completed
Jul 22 13:46:30.833936 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.833920    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 13:46:30.836802 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.836786    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-134.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 13:46:30.836886 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.836822    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-134.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 13:46:30.836886 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.836841    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-134.ec2.internal" event="NodeHasSufficientPID"
Jul 22 13:46:30.837419 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.837392    2571 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 22 13:46:30.837419 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.837407    2571 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 22 13:46:30.837518 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.837423    2571 state_mem.go:36] "Initialized new in-memory state store"
Jul 22 13:46:30.837572 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.837514    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 13:46:30.838368 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.838338    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-134.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 13:46:30.838471 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.838371    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-134.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 13:46:30.838471 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.838385    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-134.ec2.internal" event="NodeHasSufficientPID"
Jul 22 13:46:30.838731 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.838714    2571 policy_none.go:49] "None policy: Start"
Jul 22 13:46:30.838765 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.838740    2571 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 22 13:46:30.838765 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.838758    2571 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 22 13:46:30.839177 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:30.839105    2571 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-134.ec2.internal.18c4a0a6da8636d5  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-134.ec2.internal,UID:ip-10-0-129-134.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-134.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-134.ec2.internal,},FirstTimestamp:2026-07-22 13:46:30.836803285 +0000 UTC m=+0.891579966,LastTimestamp:2026-07-22 13:46:30.836803285 +0000 UTC m=+0.891579966,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-134.ec2.internal,}"
Jul 22 13:46:30.839693 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.839680    2571 policy_none.go:47] "Start"
Jul 22 13:46:30.881293 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.881132    2571 manager.go:337] "Starting Device Plugin manager"
Jul 22 13:46:30.881402 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:30.881318    2571 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 22 13:46:30.881402 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.881332    2571 server.go:87] "Starting device plugin registration server"
Jul 22 13:46:30.881695 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.881681    2571 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 22 13:46:30.881738 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.881699    2571 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 22 13:46:30.881840 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.881815    2571 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 22 13:46:30.881982 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.881908    2571 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 22 13:46:30.881982 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.881917    2571 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 22 13:46:30.882523 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:30.882497    2571 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 22 13:46:30.882604 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:30.882552    2571 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-134.ec2.internal\" not found"
Jul 22 13:46:30.984106 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.984009    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 13:46:30.986550 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.985351    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-134.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 13:46:30.986550 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.985377    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-134.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 13:46:30.986550 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.985387    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-134.ec2.internal" event="NodeHasSufficientPID"
Jul 22 13:46:30.986550 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.985415    2571 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-134.ec2.internal"
Jul 22 13:46:30.997466 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:30.997447    2571 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-134.ec2.internal"
Jul 22 13:46:30.997582 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:30.997475    2571 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-134.ec2.internal\": node \"ip-10-0-129-134.ec2.internal\" not found"
Jul 22 13:46:31.001640 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.001603    2571 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 22 13:46:31.003189 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.003171    2571 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 22 13:46:31.003295 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.003209    2571 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 22 13:46:31.003295 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.003237    2571 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 22 13:46:31.003295 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:31.003280    2571 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 22 13:46:31.005152 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.005131    2571 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 13:46:31.032243 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:31.032207    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-134.ec2.internal\" not found"
Jul 22 13:46:31.104633 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.104588    2571 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-134.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-134.ec2.internal"]
Jul 22 13:46:31.104812 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.104748    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 13:46:31.105934 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.105918    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-134.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 13:46:31.106047 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.105954    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-134.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 13:46:31.106047 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.105975    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-134.ec2.internal" event="NodeHasSufficientPID"
Jul 22 13:46:31.108502 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.108483    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 13:46:31.108620 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.108604    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-134.ec2.internal"
Jul 22 13:46:31.108690 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.108638    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 13:46:31.109352 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.109333    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-134.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 13:46:31.109480 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.109362    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-134.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 13:46:31.109480 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.109373    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-134.ec2.internal" event="NodeHasSufficientPID"
Jul 22 13:46:31.109480 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.109341    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-134.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 13:46:31.109480 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.109441    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-134.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 13:46:31.109480 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.109457    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-134.ec2.internal" event="NodeHasSufficientPID"
Jul 22 13:46:31.111869 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.111852    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-134.ec2.internal"
Jul 22 13:46:31.111946 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.111885    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 13:46:31.112743 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.112726    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-134.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 13:46:31.112809 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.112760    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-134.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 13:46:31.112809 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.112776    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-134.ec2.internal" event="NodeHasSufficientPID"
Jul 22 13:46:31.118911 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.118891    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1a12706c8812142983885d0dac594160-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-134.ec2.internal\" (UID: \"1a12706c8812142983885d0dac594160\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-134.ec2.internal"
Jul 22 13:46:31.119006 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.118924    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1a12706c8812142983885d0dac594160-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-134.ec2.internal\" (UID: \"1a12706c8812142983885d0dac594160\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-134.ec2.internal"
Jul 22 13:46:31.119006 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.118954    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2fe22260834f3ba68797b548033e91dd-config\") pod \"kube-apiserver-proxy-ip-10-0-129-134.ec2.internal\" (UID: \"2fe22260834f3ba68797b548033e91dd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-134.ec2.internal"
Jul 22 13:46:31.132516 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:31.132468    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-134.ec2.internal\" not found"
Jul 22 13:46:31.136720 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:31.136697    2571 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-134.ec2.internal\" not found" node="ip-10-0-129-134.ec2.internal"
Jul 22 13:46:31.141773 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:31.141755    2571 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-134.ec2.internal\" not found" node="ip-10-0-129-134.ec2.internal"
Jul 22 13:46:31.219986 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.219954    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2fe22260834f3ba68797b548033e91dd-config\") pod \"kube-apiserver-proxy-ip-10-0-129-134.ec2.internal\" (UID: \"2fe22260834f3ba68797b548033e91dd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-134.ec2.internal"
Jul 22 13:46:31.219986 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.219991    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1a12706c8812142983885d0dac594160-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-134.ec2.internal\" (UID: \"1a12706c8812142983885d0dac594160\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-134.ec2.internal"
Jul 22 13:46:31.220158 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.220010    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1a12706c8812142983885d0dac594160-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-134.ec2.internal\" (UID: \"1a12706c8812142983885d0dac594160\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-134.ec2.internal"
Jul 22 13:46:31.220158 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.220068    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2fe22260834f3ba68797b548033e91dd-config\") pod \"kube-apiserver-proxy-ip-10-0-129-134.ec2.internal\" (UID: \"2fe22260834f3ba68797b548033e91dd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-134.ec2.internal"
Jul 22 13:46:31.220158 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.220071    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1a12706c8812142983885d0dac594160-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-134.ec2.internal\" (UID: \"1a12706c8812142983885d0dac594160\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-134.ec2.internal"
Jul 22 13:46:31.220158 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.220137    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1a12706c8812142983885d0dac594160-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-134.ec2.internal\" (UID: \"1a12706c8812142983885d0dac594160\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-134.ec2.internal"
Jul 22 13:46:31.232754 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:31.232728    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-134.ec2.internal\" not found"
Jul 22 13:46:31.333194 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:31.333104    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-134.ec2.internal\" not found"
Jul 22 13:46:31.434231 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:31.434182    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-134.ec2.internal\" not found"
Jul 22 13:46:31.439766 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.439739    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-134.ec2.internal"
Jul 22 13:46:31.445426 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.444958    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-134.ec2.internal"
Jul 22 13:46:31.534432 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:31.534388    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-134.ec2.internal\" not found"
Jul 22 13:46:31.635216 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:31.635155    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-134.ec2.internal\" not found"
Jul 22 13:46:31.653017 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.652993    2571 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 13:46:31.694233 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.694208    2571 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 13:46:31.717832 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.717795    2571 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-134.ec2.internal"
Jul 22 13:46:31.727794 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.727771    2571 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 22 13:46:31.729505 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.729490    2571 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-134.ec2.internal"
Jul 22 13:46:31.742242 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.742221    2571 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 22 13:46:31.751871 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.751848    2571 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 22 13:46:31.752001 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.751981    2571 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 22 13:46:31.752055 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.752029    2571 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 22 13:46:31.752055 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.752034    2571 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 22 13:46:31.796476 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.796443    2571 apiserver.go:52] "Watching apiserver"
Jul 22 13:46:31.810093 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.810066    2571 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 22 13:46:31.810931 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.810903    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzhtr","openshift-image-registry/node-ca-nqwc8","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-134.ec2.internal","openshift-multus/multus-additional-cni-plugins-fphwm","openshift-multus/network-metrics-daemon-tjsf5","openshift-ovn-kubernetes/ovnkube-node-g9zr4","kube-system/global-pull-secret-syncer-2mjnn","openshift-cluster-node-tuning-operator/tuned-fsx49","openshift-dns/node-resolver-7njvq","openshift-multus/multus-9b5t7","openshift-network-diagnostics/network-check-target-sl64w","openshift-network-operator/iptables-alerter-tmppm","kube-system/konnectivity-agent-t8btt","kube-system/kube-apiserver-proxy-ip-10-0-129-134.ec2.internal"]
Jul 22 13:46:31.813612 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.813593    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2mjnn"
Jul 22 13:46:31.813724 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:31.813670    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2mjnn" podUID="f98c3223-5fb5-4366-98ba-2fe5d046a496"
Jul 22 13:46:31.816441 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.816428    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-t8btt"
Jul 22 13:46:31.816536 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.816520    2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 22 13:46:31.818906 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.818800    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 22 13:46:31.818906 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.818824    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 22 13:46:31.818906 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.818808    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-nl2gl\""
Jul 22 13:46:31.820588 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.819245    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fsx49"
Jul 22 13:46:31.821495 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.821454    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 22 13:46:31.821656 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.821639    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-g5tbn\""
Jul 22 13:46:31.821737 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.821655    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 22 13:46:31.821836 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.821817    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fphwm"
Jul 22 13:46:31.823617 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.823599    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 22 13:46:31.823970 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.823948    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 22 13:46:31.824068 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.823980    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 22 13:46:31.824068 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.823958    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 22 13:46:31.824158 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.824081    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-x9gbb\""
Jul 22 13:46:31.824158 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.824120    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 22 13:46:31.824317 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.824300    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tjsf5"
Jul 22 13:46:31.824379 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:31.824362    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tjsf5" podUID="fd1bdec0-2890-4b8e-8be8-521df53174ac"
Jul 22 13:46:31.825250 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.825231    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f98c3223-5fb5-4366-98ba-2fe5d046a496-dbus\") pod \"global-pull-secret-syncer-2mjnn\" (UID: \"f98c3223-5fb5-4366-98ba-2fe5d046a496\") " pod="kube-system/global-pull-secret-syncer-2mjnn"
Jul 22 13:46:31.825313 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.825268    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f98c3223-5fb5-4366-98ba-2fe5d046a496-original-pull-secret\") pod \"global-pull-secret-syncer-2mjnn\" (UID: \"f98c3223-5fb5-4366-98ba-2fe5d046a496\") " pod="kube-system/global-pull-secret-syncer-2mjnn"
Jul 22 13:46:31.825313 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.825298    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0e646050-00d1-4798-9c5e-1b71fde65713-etc-kubernetes\") pod \"tuned-fsx49\" (UID: \"0e646050-00d1-4798-9c5e-1b71fde65713\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx49"
Jul 22 13:46:31.825394 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.825343    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0e646050-00d1-4798-9c5e-1b71fde65713-etc-sysctl-d\") pod \"tuned-fsx49\" (UID: \"0e646050-00d1-4798-9c5e-1b71fde65713\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx49"
Jul 22 13:46:31.825394 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.825383    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0e646050-00d1-4798-9c5e-1b71fde65713-lib-modules\") pod \"tuned-fsx49\" (UID: \"0e646050-00d1-4798-9c5e-1b71fde65713\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx49"
Jul 22 13:46:31.825519 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.825437    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e646050-00d1-4798-9c5e-1b71fde65713-var-lib-kubelet\") pod \"tuned-fsx49\" (UID: \"0e646050-00d1-4798-9c5e-1b71fde65713\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx49"
Jul 22 13:46:31.825519 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.825400    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-21 13:41:31 +0000 UTC" deadline="2028-01-07 04:22:12.520156529 +0000 UTC"
Jul 22 13:46:31.825519 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.825462    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12806h35m40.694698647s"
Jul 22 13:46:31.825519 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.825462    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0e646050-00d1-4798-9c5e-1b71fde65713-host\") pod \"tuned-fsx49\" (UID: \"0e646050-00d1-4798-9c5e-1b71fde65713\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx49"
Jul 22 13:46:31.825519 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.825494    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8cc6486a-acc2-43e8-8909-bb52ed47fd7a-konnectivity-ca\") pod \"konnectivity-agent-t8btt\" (UID: \"8cc6486a-acc2-43e8-8909-bb52ed47fd7a\") " pod="kube-system/konnectivity-agent-t8btt"
Jul 22 13:46:31.825519 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.825518    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0e646050-00d1-4798-9c5e-1b71fde65713-etc-sysctl-conf\") pod \"tuned-fsx49\" (UID: \"0e646050-00d1-4798-9c5e-1b71fde65713\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx49"
Jul 22 13:46:31.825756 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.825537    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0e646050-00d1-4798-9c5e-1b71fde65713-run\") pod \"tuned-fsx49\" (UID: \"0e646050-00d1-4798-9c5e-1b71fde65713\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx49"
Jul 22 13:46:31.825756 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.825573    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f98c3223-5fb5-4366-98ba-2fe5d046a496-kubelet-config\") pod \"global-pull-secret-syncer-2mjnn\" (UID: \"f98c3223-5fb5-4366-98ba-2fe5d046a496\") " pod="kube-system/global-pull-secret-syncer-2mjnn"
Jul 22 13:46:31.825756 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.825594    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0e646050-00d1-4798-9c5e-1b71fde65713-etc-modprobe-d\") pod \"tuned-fsx49\" (UID: \"0e646050-00d1-4798-9c5e-1b71fde65713\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx49"
Jul 22 13:46:31.825756 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.825610    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0e646050-00d1-4798-9c5e-1b71fde65713-etc-systemd\") pod \"tuned-fsx49\" (UID: \"0e646050-00d1-4798-9c5e-1b71fde65713\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx49"
Jul 22 13:46:31.825756 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.825627    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0e646050-00d1-4798-9c5e-1b71fde65713-sys\") pod \"tuned-fsx49\" (UID: \"0e646050-00d1-4798-9c5e-1b71fde65713\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx49"
Jul 22 13:46:31.825756 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.825667    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0e646050-00d1-4798-9c5e-1b71fde65713-etc-tuned\") pod \"tuned-fsx49\" (UID: \"0e646050-00d1-4798-9c5e-1b71fde65713\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx49"
Jul 22 13:46:31.825756 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.825702    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8cc6486a-acc2-43e8-8909-bb52ed47fd7a-agent-certs\") pod \"konnectivity-agent-t8btt\" (UID: \"8cc6486a-acc2-43e8-8909-bb52ed47fd7a\") " pod="kube-system/konnectivity-agent-t8btt"
Jul 22 13:46:31.825756 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.825725    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0e646050-00d1-4798-9c5e-1b71fde65713-etc-sysconfig\") pod \"tuned-fsx49\" (UID: \"0e646050-00d1-4798-9c5e-1b71fde65713\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx49"
Jul 22 13:46:31.825756 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.825742    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0e646050-00d1-4798-9c5e-1b71fde65713-tmp\") pod \"tuned-fsx49\" (UID: \"0e646050-00d1-4798-9c5e-1b71fde65713\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx49"
Jul 22 13:46:31.825756 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.825760    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzkjp\" (UniqueName: \"kubernetes.io/projected/0e646050-00d1-4798-9c5e-1b71fde65713-kube-api-access-tzkjp\") pod \"tuned-fsx49\" (UID: \"0e646050-00d1-4798-9c5e-1b71fde65713\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx49"
Jul 22 13:46:31.826496 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.826462    2571 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 22 13:46:31.826784 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.826769    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4"
Jul 22 13:46:31.828591 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.828571    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 22 13:46:31.828761 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.828742    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 22 13:46:31.828761 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.828752    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 22 13:46:31.828895 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.828827    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 22 13:46:31.828895 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.828879    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-b69jc\""
Jul 22 13:46:31.828986 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.828968    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 22 13:46:31.829097 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.829080    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 22 13:46:31.829306 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.829291    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7njvq"
Jul 22 13:46:31.831215 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.831196    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 22 13:46:31.831292 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.831201    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-fn5pz\""
Jul 22 13:46:31.831333 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.831223    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 22 13:46:31.831760 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.831746    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzhtr"
Jul 22 13:46:31.833424 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.833399    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-26965\""
Jul 22 13:46:31.833424 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.833399    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 22 13:46:31.833584 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.833548    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 22 13:46:31.833852 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.833836    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 22 13:46:31.834203 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.834183    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nqwc8"
Jul 22 13:46:31.836131 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.836108    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 22 13:46:31.836211 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.836110    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 22 13:46:31.836211 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.836152    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7l4ft\""
Jul 22 13:46:31.836294 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.836220    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 22 13:46:31.836788 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.836774    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9b5t7"
Jul 22 13:46:31.838628 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.838604    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5l8tl\""
Jul 22 13:46:31.838628 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.838608    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 22 13:46:31.839307 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.839293    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sl64w"
Jul 22 13:46:31.839399 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:31.839381    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sl64w" podUID="a671fc06-4688-47cc-a538-79cddc136f82"
Jul 22 13:46:31.841766 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.841751    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tmppm"
Jul 22 13:46:31.843797 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.843780    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 22 13:46:31.843893 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.843845    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 22 13:46:31.843893 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.843881    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 22 13:46:31.843997 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.843983    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-bhzxq\""
Jul 22 13:46:31.855074 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.855057    2571 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-b9pwq"
Jul 22 13:46:31.862176 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.862158    2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-b9pwq"
Jul 22 13:46:31.918476 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.918453    2571 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 22 13:46:31.926212 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.926193    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlmnh\" (UniqueName: \"kubernetes.io/projected/ca3f3ac1-a31f-42c8-927c-fca4c9c77f9d-kube-api-access-qlmnh\") pod \"node-resolver-7njvq\" (UID: \"ca3f3ac1-a31f-42c8-927c-fca4c9c77f9d\") " pod="openshift-dns/node-resolver-7njvq"
Jul 22 13:46:31.926296 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.926221    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d5dc46dc-6911-4a08-93ef-2a57a94bb374-registration-dir\") pod \"aws-ebs-csi-driver-node-zzhtr\" (UID: \"d5dc46dc-6911-4a08-93ef-2a57a94bb374\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzhtr"
Jul 22 13:46:31.926296 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.926241    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2143f777-15e0-47a1-b828-8a1729e26771-system-cni-dir\") pod \"multus-9b5t7\" (UID: \"2143f777-15e0-47a1-b828-8a1729e26771\") " pod="openshift-multus/multus-9b5t7"
Jul 22 13:46:31.926296 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.926259    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2143f777-15e0-47a1-b828-8a1729e26771-cni-binary-copy\") pod \"multus-9b5t7\" (UID: \"2143f777-15e0-47a1-b828-8a1729e26771\") " pod="openshift-multus/multus-9b5t7"
Jul 22 13:46:31.926296 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.926281    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2143f777-15e0-47a1-b828-8a1729e26771-hostroot\") pod \"multus-9b5t7\" (UID: \"2143f777-15e0-47a1-b828-8a1729e26771\") " pod="openshift-multus/multus-9b5t7"
Jul 22 13:46:31.926296 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.926297    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2143f777-15e0-47a1-b828-8a1729e26771-multus-daemon-config\") pod \"multus-9b5t7\" (UID: \"2143f777-15e0-47a1-b828-8a1729e26771\") " pod="openshift-multus/multus-9b5t7"
Jul 22 13:46:31.926477 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.926348    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8cc6486a-acc2-43e8-8909-bb52ed47fd7a-agent-certs\") pod \"konnectivity-agent-t8btt\" (UID: \"8cc6486a-acc2-43e8-8909-bb52ed47fd7a\") " pod="kube-system/konnectivity-agent-t8btt"
Jul 22 13:46:31.926477 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.926389    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2143f777-15e0-47a1-b828-8a1729e26771-os-release\") pod \"multus-9b5t7\" (UID: \"2143f777-15e0-47a1-b828-8a1729e26771\") " pod="openshift-multus/multus-9b5t7"
Jul 22 13:46:31.926477 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.926433    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/87152330-3c39-4ddc-be44-f3ef60380975-host-slash\") pod \"iptables-alerter-tmppm\" (UID: \"87152330-3c39-4ddc-be44-f3ef60380975\") " pod="openshift-network-operator/iptables-alerter-tmppm"
Jul 22 13:46:31.926477 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.926459    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rw52h\" (UniqueName: \"kubernetes.io/projected/87152330-3c39-4ddc-be44-f3ef60380975-kube-api-access-rw52h\") pod \"iptables-alerter-tmppm\" (UID: \"87152330-3c39-4ddc-be44-f3ef60380975\") " pod="openshift-network-operator/iptables-alerter-tmppm"
Jul 22 13:46:31.926623 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.926491    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f98c3223-5fb5-4366-98ba-2fe5d046a496-original-pull-secret\") pod \"global-pull-secret-syncer-2mjnn\" (UID: \"f98c3223-5fb5-4366-98ba-2fe5d046a496\") " pod="kube-system/global-pull-secret-syncer-2mjnn"
Jul 22 13:46:31.926623 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.926518    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0e646050-00d1-4798-9c5e-1b71fde65713-etc-sysctl-d\") pod \"tuned-fsx49\" (UID: \"0e646050-00d1-4798-9c5e-1b71fde65713\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx49"
Jul 22 13:46:31.926623 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.926543    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2143f777-15e0-47a1-b828-8a1729e26771-host-var-lib-cni-bin\") pod \"multus-9b5t7\" (UID: \"2143f777-15e0-47a1-b828-8a1729e26771\") " pod="openshift-multus/multus-9b5t7"
Jul 22 13:46:31.926623 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.926566    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2143f777-15e0-47a1-b828-8a1729e26771-host-run-multus-certs\") pod \"multus-9b5t7\" (UID: \"2143f777-15e0-47a1-b828-8a1729e26771\") " pod="openshift-multus/multus-9b5t7"
Jul 22 13:46:31.926623 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.926589    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fd1bdec0-2890-4b8e-8be8-521df53174ac-metrics-certs\") pod \"network-metrics-daemon-tjsf5\" (UID: \"fd1bdec0-2890-4b8e-8be8-521df53174ac\") " pod="openshift-multus/network-metrics-daemon-tjsf5"
Jul 22 13:46:31.926623 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:31.926600    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 13:46:31.926623 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.926612    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d8ac7e3d-a217-40f0-9051-586f353ee7d5-run-ovn\") pod \"ovnkube-node-g9zr4\" (UID: \"d8ac7e3d-a217-40f0-9051-586f353ee7d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4"
Jul 22 13:46:31.926927 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:31.926705    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f98c3223-5fb5-4366-98ba-2fe5d046a496-original-pull-secret podName:f98c3223-5fb5-4366-98ba-2fe5d046a496 nodeName:}" failed. No retries permitted until 2026-07-22 13:46:32.426676583 +0000 UTC m=+2.481453257 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f98c3223-5fb5-4366-98ba-2fe5d046a496-original-pull-secret") pod "global-pull-secret-syncer-2mjnn" (UID: "f98c3223-5fb5-4366-98ba-2fe5d046a496") : object "kube-system"/"original-pull-secret" not registered
Jul 22 13:46:31.926927 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.926701    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0e646050-00d1-4798-9c5e-1b71fde65713-etc-sysctl-d\") pod \"tuned-fsx49\" (UID: \"0e646050-00d1-4798-9c5e-1b71fde65713\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx49"
Jul 22 13:46:31.926927 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.926736    2571 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 22 13:46:31.926927 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.926735    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8cc6486a-acc2-43e8-8909-bb52ed47fd7a-konnectivity-ca\") pod \"konnectivity-agent-t8btt\" (UID: \"8cc6486a-acc2-43e8-8909-bb52ed47fd7a\") " pod="kube-system/konnectivity-agent-t8btt"
Jul 22 13:46:31.926927 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.926794    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fc26b8c7-376d-4d8c-ba98-ee3f2fe3fb6d-host\") pod \"node-ca-nqwc8\" (UID: \"fc26b8c7-376d-4d8c-ba98-ee3f2fe3fb6d\") " pod="openshift-image-registry/node-ca-nqwc8"
Jul 22 13:46:31.926927 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.926812    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d8ac7e3d-a217-40f0-9051-586f353ee7d5-ovnkube-script-lib\") pod \"ovnkube-node-g9zr4\" (UID: \"d8ac7e3d-a217-40f0-9051-586f353ee7d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4"
Jul 22 13:46:31.926927 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.926837    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0e646050-00d1-4798-9c5e-1b71fde65713-etc-systemd\") pod \"tuned-fsx49\" (UID: \"0e646050-00d1-4798-9c5e-1b71fde65713\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx49"
Jul 22 13:46:31.926927 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.926853    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2143f777-15e0-47a1-b828-8a1729e26771-multus-cni-dir\") pod \"multus-9b5t7\" (UID: \"2143f777-15e0-47a1-b828-8a1729e26771\") " pod="openshift-multus/multus-9b5t7"
Jul 22 13:46:31.926927 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.926877    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7vjg\" (UniqueName: \"kubernetes.io/projected/a671fc06-4688-47cc-a538-79cddc136f82-kube-api-access-k7vjg\") pod \"network-check-target-sl64w\" (UID: \"a671fc06-4688-47cc-a538-79cddc136f82\") " pod="openshift-network-diagnostics/network-check-target-sl64w"
Jul 22 13:46:31.926927 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.926885    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0e646050-00d1-4798-9c5e-1b71fde65713-etc-systemd\") pod \"tuned-fsx49\" (UID: \"0e646050-00d1-4798-9c5e-1b71fde65713\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx49"
Jul 22 13:46:31.926927 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.926901    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d8ac7e3d-a217-40f0-9051-586f353ee7d5-host-slash\") pod \"ovnkube-node-g9zr4\" (UID: \"d8ac7e3d-a217-40f0-9051-586f353ee7d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4"
Jul 22 13:46:31.926927 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.926926    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8ac7e3d-a217-40f0-9051-586f353ee7d5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g9zr4\" (UID: \"d8ac7e3d-a217-40f0-9051-586f353ee7d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4"
Jul 22 13:46:31.927436 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.926952    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0e646050-00d1-4798-9c5e-1b71fde65713-tmp\") pod \"tuned-fsx49\" (UID: \"0e646050-00d1-4798-9c5e-1b71fde65713\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx49"
Jul 22 13:46:31.927436 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.926968    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzkjp\" (UniqueName: \"kubernetes.io/projected/0e646050-00d1-4798-9c5e-1b71fde65713-kube-api-access-tzkjp\") pod \"tuned-fsx49\" (UID: \"0e646050-00d1-4798-9c5e-1b71fde65713\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx49"
Jul 22 13:46:31.927436 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.926983    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d5dc46dc-6911-4a08-93ef-2a57a94bb374-sys-fs\") pod \"aws-ebs-csi-driver-node-zzhtr\" (UID: \"d5dc46dc-6911-4a08-93ef-2a57a94bb374\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzhtr"
Jul 22 13:46:31.927436 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.927120    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4hlq\" (UniqueName: \"kubernetes.io/projected/fd1bdec0-2890-4b8e-8be8-521df53174ac-kube-api-access-m4hlq\") pod \"network-metrics-daemon-tjsf5\" (UID: \"fd1bdec0-2890-4b8e-8be8-521df53174ac\") " pod="openshift-multus/network-metrics-daemon-tjsf5"
Jul 22 13:46:31.927436 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.927152    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d8ac7e3d-a217-40f0-9051-586f353ee7d5-systemd-units\") pod \"ovnkube-node-g9zr4\" (UID: \"d8ac7e3d-a217-40f0-9051-586f353ee7d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4"
Jul 22 13:46:31.927436 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.927177    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d8ac7e3d-a217-40f0-9051-586f353ee7d5-node-log\") pod \"ovnkube-node-g9zr4\" (UID: \"d8ac7e3d-a217-40f0-9051-586f353ee7d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4"
Jul 22 13:46:31.927436 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.927203    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8ac7e3d-a217-40f0-9051-586f353ee7d5-host-run-ovn-kubernetes\") pod \"ovnkube-node-g9zr4\" (UID: \"d8ac7e3d-a217-40f0-9051-586f353ee7d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4"
Jul 22 13:46:31.927436 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.927235    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2143f777-15e0-47a1-b828-8a1729e26771-multus-conf-dir\") pod \"multus-9b5t7\" (UID: \"2143f777-15e0-47a1-b828-8a1729e26771\") " pod="openshift-multus/multus-9b5t7"
Jul 22 13:46:31.927436 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.927249    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8cc6486a-acc2-43e8-8909-bb52ed47fd7a-konnectivity-ca\") pod \"konnectivity-agent-t8btt\" (UID: \"8cc6486a-acc2-43e8-8909-bb52ed47fd7a\") " pod="kube-system/konnectivity-agent-t8btt"
Jul 22 13:46:31.927436 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.927266    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/76bf4e1c-a08a-48d5-965c-19c62daf827b-os-release\") pod \"multus-additional-cni-plugins-fphwm\" (UID: \"76bf4e1c-a08a-48d5-965c-19c62daf827b\") " pod="openshift-multus/multus-additional-cni-plugins-fphwm"
Jul 22 13:46:31.927436 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.927295    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/76bf4e1c-a08a-48d5-965c-19c62daf827b-cni-binary-copy\") pod \"multus-additional-cni-plugins-fphwm\" (UID: \"76bf4e1c-a08a-48d5-965c-19c62daf827b\") " pod="openshift-multus/multus-additional-cni-plugins-fphwm"
Jul 22 13:46:31.927436 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.927328    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/76bf4e1c-a08a-48d5-965c-19c62daf827b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fphwm\" (UID: \"76bf4e1c-a08a-48d5-965c-19c62daf827b\") " pod="openshift-multus/multus-additional-cni-plugins-fphwm"
Jul 22 13:46:31.927436 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.927353    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d8ac7e3d-a217-40f0-9051-586f353ee7d5-var-lib-openvswitch\") pod \"ovnkube-node-g9zr4\" (UID: \"d8ac7e3d-a217-40f0-9051-586f353ee7d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4"
Jul 22 13:46:31.927436 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.927373    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d8ac7e3d-a217-40f0-9051-586f353ee7d5-env-overrides\") pod \"ovnkube-node-g9zr4\" (UID: \"d8ac7e3d-a217-40f0-9051-586f353ee7d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4"
Jul 22 13:46:31.927436 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.927397    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2143f777-15e0-47a1-b828-8a1729e26771-host-var-lib-kubelet\") pod \"multus-9b5t7\" (UID: \"2143f777-15e0-47a1-b828-8a1729e26771\") " pod="openshift-multus/multus-9b5t7"
Jul 22 13:46:31.927436 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.927438    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8ac7e3d-a217-40f0-9051-586f353ee7d5-host-kubelet\") pod \"ovnkube-node-g9zr4\" (UID: \"d8ac7e3d-a217-40f0-9051-586f353ee7d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4"
Jul 22 13:46:31.928058 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.927455    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d8ac7e3d-a217-40f0-9051-586f353ee7d5-etc-openvswitch\") pod \"ovnkube-node-g9zr4\" (UID: \"d8ac7e3d-a217-40f0-9051-586f353ee7d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4"
Jul 22 13:46:31.928058 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.927492    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d8ac7e3d-a217-40f0-9051-586f353ee7d5-log-socket\") pod \"ovnkube-node-g9zr4\" (UID: \"d8ac7e3d-a217-40f0-9051-586f353ee7d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4"
Jul 22 13:46:31.928058 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.927535    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca3f3ac1-a31f-42c8-927c-fca4c9c77f9d-tmp-dir\") pod \"node-resolver-7njvq\" (UID: \"ca3f3ac1-a31f-42c8-927c-fca4c9c77f9d\") " pod="openshift-dns/node-resolver-7njvq"
Jul 22 13:46:31.928058 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.927569    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d5dc46dc-6911-4a08-93ef-2a57a94bb374-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zzhtr\" (UID: \"d5dc46dc-6911-4a08-93ef-2a57a94bb374\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzhtr"
Jul 22 13:46:31.928058 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.927623    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2143f777-15e0-47a1-b828-8a1729e26771-etc-kubernetes\") pod \"multus-9b5t7\" (UID: \"2143f777-15e0-47a1-b828-8a1729e26771\") " pod="openshift-multus/multus-9b5t7"
Jul 22 13:46:31.928058 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.927645    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fc26b8c7-376d-4d8c-ba98-ee3f2fe3fb6d-serviceca\") pod \"node-ca-nqwc8\" (UID: \"fc26b8c7-376d-4d8c-ba98-ee3f2fe3fb6d\") " pod="openshift-image-registry/node-ca-nqwc8"
Jul 22 13:46:31.928058 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.927662    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ca3f3ac1-a31f-42c8-927c-fca4c9c77f9d-hosts-file\") pod \"node-resolver-7njvq\" (UID: \"ca3f3ac1-a31f-42c8-927c-fca4c9c77f9d\") " pod="openshift-dns/node-resolver-7njvq"
Jul 22 13:46:31.928058 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.927685    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d5dc46dc-6911-4a08-93ef-2a57a94bb374-socket-dir\") pod \"aws-ebs-csi-driver-node-zzhtr\" (UID: \"d5dc46dc-6911-4a08-93ef-2a57a94bb374\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzhtr"
Jul 22 13:46:31.928058 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.927705    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d8ac7e3d-a217-40f0-9051-586f353ee7d5-ovnkube-config\") pod \"ovnkube-node-g9zr4\" (UID: \"d8ac7e3d-a217-40f0-9051-586f353ee7d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4"
Jul 22 13:46:31.928058 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.927721    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5qsh\" (UniqueName: \"kubernetes.io/projected/d8ac7e3d-a217-40f0-9051-586f353ee7d5-kube-api-access-q5qsh\") pod \"ovnkube-node-g9zr4\" (UID: \"d8ac7e3d-a217-40f0-9051-586f353ee7d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4"
Jul 22 13:46:31.928058 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.927752    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f98c3223-5fb5-4366-98ba-2fe5d046a496-dbus\") pod \"global-pull-secret-syncer-2mjnn\" (UID: \"f98c3223-5fb5-4366-98ba-2fe5d046a496\") " pod="kube-system/global-pull-secret-syncer-2mjnn"
Jul 22 13:46:31.928058 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.927775    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0e646050-00d1-4798-9c5e-1b71fde65713-etc-kubernetes\") pod \"tuned-fsx49\" (UID: \"0e646050-00d1-4798-9c5e-1b71fde65713\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx49"
Jul 22 13:46:31.928058 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.927790    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2143f777-15e0-47a1-b828-8a1729e26771-multus-socket-dir-parent\") pod \"multus-9b5t7\" (UID: \"2143f777-15e0-47a1-b828-8a1729e26771\") " pod="openshift-multus/multus-9b5t7"
Jul 22 13:46:31.928058 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.927811    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2143f777-15e0-47a1-b828-8a1729e26771-host-run-netns\") pod \"multus-9b5t7\" (UID: \"2143f777-15e0-47a1-b828-8a1729e26771\") " pod="openshift-multus/multus-9b5t7"
Jul 22 13:46:31.928058 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.927835    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2143f777-15e0-47a1-b828-8a1729e26771-host-var-lib-cni-multus\") pod \"multus-9b5t7\" (UID: \"2143f777-15e0-47a1-b828-8a1729e26771\") " pod="openshift-multus/multus-9b5t7"
Jul 22 13:46:31.928058 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.927858    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0e646050-00d1-4798-9c5e-1b71fde65713-etc-kubernetes\") pod \"tuned-fsx49\" (UID: \"0e646050-00d1-4798-9c5e-1b71fde65713\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx49"
Jul 22 13:46:31.928058 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.927874    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d8ac7e3d-a217-40f0-9051-586f353ee7d5-ovn-node-metrics-cert\") pod \"ovnkube-node-g9zr4\" (UID: \"d8ac7e3d-a217-40f0-9051-586f353ee7d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4"
Jul 22 13:46:31.928933 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.927905    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfdss\" (UniqueName: \"kubernetes.io/projected/d5dc46dc-6911-4a08-93ef-2a57a94bb374-kube-api-access-kfdss\") pod \"aws-ebs-csi-driver-node-zzhtr\" (UID: \"d5dc46dc-6911-4a08-93ef-2a57a94bb374\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzhtr"
Jul 22 13:46:31.928933 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.927917    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f98c3223-5fb5-4366-98ba-2fe5d046a496-dbus\") pod \"global-pull-secret-syncer-2mjnn\" (UID: \"f98c3223-5fb5-4366-98ba-2fe5d046a496\") " pod="kube-system/global-pull-secret-syncer-2mjnn"
Jul 22 13:46:31.928933 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.927928    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2143f777-15e0-47a1-b828-8a1729e26771-cnibin\") pod \"multus-9b5t7\" (UID: \"2143f777-15e0-47a1-b828-8a1729e26771\") " pod="openshift-multus/multus-9b5t7"
Jul 22 13:46:31.928933 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.927955    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/76bf4e1c-a08a-48d5-965c-19c62daf827b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fphwm\" (UID: \"76bf4e1c-a08a-48d5-965c-19c62daf827b\") " pod="openshift-multus/multus-additional-cni-plugins-fphwm"
Jul 22 13:46:31.928933 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.927978    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d8ac7e3d-a217-40f0-9051-586f353ee7d5-host-run-netns\") pod \"ovnkube-node-g9zr4\" (UID: \"d8ac7e3d-a217-40f0-9051-586f353ee7d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4"
Jul 22 13:46:31.928933 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.928004    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d8ac7e3d-a217-40f0-9051-586f353ee7d5-host-cni-bin\") pod \"ovnkube-node-g9zr4\" (UID: \"d8ac7e3d-a217-40f0-9051-586f353ee7d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4"
Jul 22 13:46:31.928933 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.928031    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0e646050-00d1-4798-9c5e-1b71fde65713-etc-modprobe-d\") pod \"tuned-fsx49\" (UID: \"0e646050-00d1-4798-9c5e-1b71fde65713\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx49"
Jul 22 13:46:31.928933 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.928049    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0e646050-00d1-4798-9c5e-1b71fde65713-etc-tuned\") pod \"tuned-fsx49\" (UID: \"0e646050-00d1-4798-9c5e-1b71fde65713\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx49"
Jul 22 13:46:31.928933 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.928067    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d5dc46dc-6911-4a08-93ef-2a57a94bb374-device-dir\") pod \"aws-ebs-csi-driver-node-zzhtr\" (UID: \"d5dc46dc-6911-4a08-93ef-2a57a94bb374\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzhtr"
Jul 22 13:46:31.928933 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.928083    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmkm5\" (UniqueName: \"kubernetes.io/projected/2143f777-15e0-47a1-b828-8a1729e26771-kube-api-access-rmkm5\") pod \"multus-9b5t7\" (UID: \"2143f777-15e0-47a1-b828-8a1729e26771\") " pod="openshift-multus/multus-9b5t7"
Jul 22 13:46:31.928933 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.928101    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/76bf4e1c-a08a-48d5-965c-19c62daf827b-cnibin\") pod \"multus-additional-cni-plugins-fphwm\" (UID: \"76bf4e1c-a08a-48d5-965c-19c62daf827b\") " pod="openshift-multus/multus-additional-cni-plugins-fphwm"
Jul 22 13:46:31.928933 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.928119    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0e646050-00d1-4798-9c5e-1b71fde65713-etc-modprobe-d\") pod \"tuned-fsx49\" (UID: \"0e646050-00d1-4798-9c5e-1b71fde65713\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx49"
Jul 22 13:46:31.928933 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.928162    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0e646050-00d1-4798-9c5e-1b71fde65713-etc-sysconfig\") pod \"tuned-fsx49\" (UID: \"0e646050-00d1-4798-9c5e-1b71fde65713\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx49"
Jul 22 13:46:31.928933 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.928199    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d5dc46dc-6911-4a08-93ef-2a57a94bb374-etc-selinux\") pod \"aws-ebs-csi-driver-node-zzhtr\" (UID: \"d5dc46dc-6911-4a08-93ef-2a57a94bb374\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzhtr"
Jul 22 13:46:31.928933 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.928220    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0e646050-00d1-4798-9c5e-1b71fde65713-etc-sysconfig\") pod \"tuned-fsx49\" (UID: \"0e646050-00d1-4798-9c5e-1b71fde65713\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx49"
Jul 22 13:46:31.928933 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.928227    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvslq\" (UniqueName: \"kubernetes.io/projected/fc26b8c7-376d-4d8c-ba98-ee3f2fe3fb6d-kube-api-access-lvslq\") pod \"node-ca-nqwc8\" (UID: \"fc26b8c7-376d-4d8c-ba98-ee3f2fe3fb6d\") " pod="openshift-image-registry/node-ca-nqwc8"
Jul 22 13:46:31.928933 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.928266    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d8ac7e3d-a217-40f0-9051-586f353ee7d5-run-systemd\") pod \"ovnkube-node-g9zr4\" (UID: \"d8ac7e3d-a217-40f0-9051-586f353ee7d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4"
Jul 22 13:46:31.929442 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.928292    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d8ac7e3d-a217-40f0-9051-586f353ee7d5-run-openvswitch\") pod \"ovnkube-node-g9zr4\" (UID: \"d8ac7e3d-a217-40f0-9051-586f353ee7d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4"
Jul 22 13:46:31.929442 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.928325    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d8ac7e3d-a217-40f0-9051-586f353ee7d5-host-cni-netd\") pod \"ovnkube-node-g9zr4\" (UID: \"d8ac7e3d-a217-40f0-9051-586f353ee7d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4"
Jul 22 13:46:31.929442 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.928356    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0e646050-00d1-4798-9c5e-1b71fde65713-lib-modules\") pod \"tuned-fsx49\" (UID: \"0e646050-00d1-4798-9c5e-1b71fde65713\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx49"
Jul 22 13:46:31.929442 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.928424    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e646050-00d1-4798-9c5e-1b71fde65713-var-lib-kubelet\") pod \"tuned-fsx49\" (UID: \"0e646050-00d1-4798-9c5e-1b71fde65713\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx49"
Jul 22 13:46:31.929442 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.928456    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0e646050-00d1-4798-9c5e-1b71fde65713-lib-modules\") pod \"tuned-fsx49\" (UID: \"0e646050-00d1-4798-9c5e-1b71fde65713\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx49"
Jul 22 13:46:31.929442 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.928460    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0e646050-00d1-4798-9c5e-1b71fde65713-host\") pod \"tuned-fsx49\" (UID: \"0e646050-00d1-4798-9c5e-1b71fde65713\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx49"
Jul 22 13:46:31.929442 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.928479    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e646050-00d1-4798-9c5e-1b71fde65713-var-lib-kubelet\") pod \"tuned-fsx49\" (UID: \"0e646050-00d1-4798-9c5e-1b71fde65713\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx49"
Jul 22 13:46:31.929442 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.928491    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2143f777-15e0-47a1-b828-8a1729e26771-host-run-k8s-cni-cncf-io\") pod \"multus-9b5t7\" (UID: \"2143f777-15e0-47a1-b828-8a1729e26771\") " pod="openshift-multus/multus-9b5t7"
Jul 22 13:46:31.929442 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.928508    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0e646050-00d1-4798-9c5e-1b71fde65713-host\") pod \"tuned-fsx49\" (UID: \"0e646050-00d1-4798-9c5e-1b71fde65713\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx49"
Jul 22 13:46:31.929442 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.928513    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/87152330-3c39-4ddc-be44-f3ef60380975-iptables-alerter-script\") pod \"iptables-alerter-tmppm\" (UID: \"87152330-3c39-4ddc-be44-f3ef60380975\") " pod="openshift-network-operator/iptables-alerter-tmppm"
Jul 22 13:46:31.929442 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.928548    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/76bf4e1c-a08a-48d5-965c-19c62daf827b-system-cni-dir\") pod \"multus-additional-cni-plugins-fphwm\" (UID: \"76bf4e1c-a08a-48d5-965c-19c62daf827b\") " pod="openshift-multus/multus-additional-cni-plugins-fphwm"
Jul 22 13:46:31.929442 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.928602    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0e646050-00d1-4798-9c5e-1b71fde65713-etc-sysctl-conf\") pod \"tuned-fsx49\" (UID: \"0e646050-00d1-4798-9c5e-1b71fde65713\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx49"
Jul 22 13:46:31.929442 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.928631    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0e646050-00d1-4798-9c5e-1b71fde65713-run\") pod \"tuned-fsx49\" (UID: \"0e646050-00d1-4798-9c5e-1b71fde65713\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx49"
Jul 22 13:46:31.929442 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.928684    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0e646050-00d1-4798-9c5e-1b71fde65713-run\") pod \"tuned-fsx49\" (UID: \"0e646050-00d1-4798-9c5e-1b71fde65713\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx49"
Jul 22 13:46:31.929442 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.928702    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/76bf4e1c-a08a-48d5-965c-19c62daf827b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fphwm\" (UID: \"76bf4e1c-a08a-48d5-965c-19c62daf827b\") " pod="openshift-multus/multus-additional-cni-plugins-fphwm"
Jul 22 13:46:31.929442 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.928725    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gl5m\" (UniqueName: \"kubernetes.io/projected/76bf4e1c-a08a-48d5-965c-19c62daf827b-kube-api-access-6gl5m\") pod \"multus-additional-cni-plugins-fphwm\" (UID: \"76bf4e1c-a08a-48d5-965c-19c62daf827b\") " pod="openshift-multus/multus-additional-cni-plugins-fphwm"
Jul 22 13:46:31.929442 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.928756    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0e646050-00d1-4798-9c5e-1b71fde65713-etc-sysctl-conf\") pod \"tuned-fsx49\" (UID: \"0e646050-00d1-4798-9c5e-1b71fde65713\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx49"
Jul 22 13:46:31.930060 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.928766    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f98c3223-5fb5-4366-98ba-2fe5d046a496-kubelet-config\") pod \"global-pull-secret-syncer-2mjnn\" (UID: \"f98c3223-5fb5-4366-98ba-2fe5d046a496\") " pod="kube-system/global-pull-secret-syncer-2mjnn"
Jul 22 13:46:31.930060 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.928789    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0e646050-00d1-4798-9c5e-1b71fde65713-sys\") pod \"tuned-fsx49\" (UID: \"0e646050-00d1-4798-9c5e-1b71fde65713\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx49"
Jul 22 13:46:31.930060 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.928824    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f98c3223-5fb5-4366-98ba-2fe5d046a496-kubelet-config\") pod \"global-pull-secret-syncer-2mjnn\" (UID: \"f98c3223-5fb5-4366-98ba-2fe5d046a496\") " pod="kube-system/global-pull-secret-syncer-2mjnn"
Jul 22 13:46:31.930060 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.928886    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0e646050-00d1-4798-9c5e-1b71fde65713-sys\") pod \"tuned-fsx49\" (UID: \"0e646050-00d1-4798-9c5e-1b71fde65713\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx49"
Jul 22 13:46:31.930249 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.930158    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0e646050-00d1-4798-9c5e-1b71fde65713-tmp\") pod \"tuned-fsx49\" (UID: \"0e646050-00d1-4798-9c5e-1b71fde65713\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx49"
Jul 22 13:46:31.930249 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.930197    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8cc6486a-acc2-43e8-8909-bb52ed47fd7a-agent-certs\") pod \"konnectivity-agent-t8btt\" (UID: \"8cc6486a-acc2-43e8-8909-bb52ed47fd7a\") " pod="kube-system/konnectivity-agent-t8btt"
Jul 22 13:46:31.930314 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.930276    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0e646050-00d1-4798-9c5e-1b71fde65713-etc-tuned\") pod \"tuned-fsx49\" (UID: \"0e646050-00d1-4798-9c5e-1b71fde65713\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx49"
Jul 22 13:46:31.934223 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:31.934205    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzkjp\" (UniqueName: \"kubernetes.io/projected/0e646050-00d1-4798-9c5e-1b71fde65713-kube-api-access-tzkjp\") pod \"tuned-fsx49\" (UID: \"0e646050-00d1-4798-9c5e-1b71fde65713\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx49"
Jul 22 13:46:32.029896 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.029859    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2143f777-15e0-47a1-b828-8a1729e26771-host-var-lib-kubelet\") pod \"multus-9b5t7\" (UID: \"2143f777-15e0-47a1-b828-8a1729e26771\") " pod="openshift-multus/multus-9b5t7"
Jul 22 13:46:32.029896 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.029894    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8ac7e3d-a217-40f0-9051-586f353ee7d5-host-kubelet\") pod \"ovnkube-node-g9zr4\" (UID: \"d8ac7e3d-a217-40f0-9051-586f353ee7d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4"
Jul 22 13:46:32.030154 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.029910    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d8ac7e3d-a217-40f0-9051-586f353ee7d5-etc-openvswitch\") pod \"ovnkube-node-g9zr4\" (UID: \"d8ac7e3d-a217-40f0-9051-586f353ee7d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4"
Jul 22 13:46:32.030154 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.029933    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d8ac7e3d-a217-40f0-9051-586f353ee7d5-log-socket\") pod \"ovnkube-node-g9zr4\" (UID: \"d8ac7e3d-a217-40f0-9051-586f353ee7d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4"
Jul 22 13:46:32.030154 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.029978    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d8ac7e3d-a217-40f0-9051-586f353ee7d5-etc-openvswitch\") pod \"ovnkube-node-g9zr4\" (UID: \"d8ac7e3d-a217-40f0-9051-586f353ee7d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4"
Jul 22 13:46:32.030154 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.029978    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2143f777-15e0-47a1-b828-8a1729e26771-host-var-lib-kubelet\") pod \"multus-9b5t7\" (UID: \"2143f777-15e0-47a1-b828-8a1729e26771\") " pod="openshift-multus/multus-9b5t7"
Jul 22 13:46:32.030154 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.029999    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca3f3ac1-a31f-42c8-927c-fca4c9c77f9d-tmp-dir\") pod \"node-resolver-7njvq\" (UID: \"ca3f3ac1-a31f-42c8-927c-fca4c9c77f9d\") " pod="openshift-dns/node-resolver-7njvq"
Jul 22 13:46:32.030154 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.030014    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8ac7e3d-a217-40f0-9051-586f353ee7d5-host-kubelet\") pod \"ovnkube-node-g9zr4\" (UID: \"d8ac7e3d-a217-40f0-9051-586f353ee7d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4"
Jul 22 13:46:32.030154 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.030033    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d5dc46dc-6911-4a08-93ef-2a57a94bb374-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zzhtr\" (UID: \"d5dc46dc-6911-4a08-93ef-2a57a94bb374\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzhtr"
Jul 22 13:46:32.030154 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.030058    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2143f777-15e0-47a1-b828-8a1729e26771-etc-kubernetes\") pod \"multus-9b5t7\" (UID: \"2143f777-15e0-47a1-b828-8a1729e26771\") " pod="openshift-multus/multus-9b5t7"
Jul 22 13:46:32.030154 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.030073    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d8ac7e3d-a217-40f0-9051-586f353ee7d5-log-socket\") pod \"ovnkube-node-g9zr4\" (UID: \"d8ac7e3d-a217-40f0-9051-586f353ee7d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4"
Jul 22 13:46:32.030154 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.030082    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fc26b8c7-376d-4d8c-ba98-ee3f2fe3fb6d-serviceca\") pod \"node-ca-nqwc8\" (UID: \"fc26b8c7-376d-4d8c-ba98-ee3f2fe3fb6d\") " pod="openshift-image-registry/node-ca-nqwc8"
Jul 22 13:46:32.030154 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.030111    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ca3f3ac1-a31f-42c8-927c-fca4c9c77f9d-hosts-file\") pod \"node-resolver-7njvq\" (UID: \"ca3f3ac1-a31f-42c8-927c-fca4c9c77f9d\") " pod="openshift-dns/node-resolver-7njvq"
Jul 22 13:46:32.030154 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.030134    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d5dc46dc-6911-4a08-93ef-2a57a94bb374-socket-dir\") pod \"aws-ebs-csi-driver-node-zzhtr\" (UID: \"d5dc46dc-6911-4a08-93ef-2a57a94bb374\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzhtr"
Jul 22 13:46:32.030154 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.030139    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d5dc46dc-6911-4a08-93ef-2a57a94bb374-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zzhtr\" (UID: \"d5dc46dc-6911-4a08-93ef-2a57a94bb374\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzhtr"
Jul 22 13:46:32.030154 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.030156    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d8ac7e3d-a217-40f0-9051-586f353ee7d5-ovnkube-config\") pod \"ovnkube-node-g9zr4\" (UID: \"d8ac7e3d-a217-40f0-9051-586f353ee7d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4"
Jul 22 13:46:32.030601 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.030182    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5qsh\" (UniqueName: \"kubernetes.io/projected/d8ac7e3d-a217-40f0-9051-586f353ee7d5-kube-api-access-q5qsh\") pod \"ovnkube-node-g9zr4\" (UID: \"d8ac7e3d-a217-40f0-9051-586f353ee7d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4"
Jul 22 13:46:32.030601 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.030189    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ca3f3ac1-a31f-42c8-927c-fca4c9c77f9d-hosts-file\") pod \"node-resolver-7njvq\" (UID: \"ca3f3ac1-a31f-42c8-927c-fca4c9c77f9d\") " pod="openshift-dns/node-resolver-7njvq"
Jul 22 13:46:32.030601 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.030246    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2143f777-15e0-47a1-b828-8a1729e26771-multus-socket-dir-parent\") pod \"multus-9b5t7\" (UID: \"2143f777-15e0-47a1-b828-8a1729e26771\") " pod="openshift-multus/multus-9b5t7"
Jul 22 13:46:32.030601 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.030269    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2143f777-15e0-47a1-b828-8a1729e26771-host-run-netns\") pod \"multus-9b5t7\" (UID: \"2143f777-15e0-47a1-b828-8a1729e26771\") " pod="openshift-multus/multus-9b5t7"
Jul 22 13:46:32.030601 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.030292    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2143f777-15e0-47a1-b828-8a1729e26771-host-var-lib-cni-multus\") pod \"multus-9b5t7\" (UID: \"2143f777-15e0-47a1-b828-8a1729e26771\") " pod="openshift-multus/multus-9b5t7"
Jul 22 13:46:32.030601 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.030319    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d8ac7e3d-a217-40f0-9051-586f353ee7d5-ovn-node-metrics-cert\") pod \"ovnkube-node-g9zr4\" (UID: \"d8ac7e3d-a217-40f0-9051-586f353ee7d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4"
Jul 22 13:46:32.030601 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.030344    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfdss\" (UniqueName: \"kubernetes.io/projected/d5dc46dc-6911-4a08-93ef-2a57a94bb374-kube-api-access-kfdss\") pod \"aws-ebs-csi-driver-node-zzhtr\" (UID: \"d5dc46dc-6911-4a08-93ef-2a57a94bb374\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzhtr"
Jul 22 13:46:32.030601 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.030361    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca3f3ac1-a31f-42c8-927c-fca4c9c77f9d-tmp-dir\") pod \"node-resolver-7njvq\" (UID: \"ca3f3ac1-a31f-42c8-927c-fca4c9c77f9d\") " pod="openshift-dns/node-resolver-7njvq"
Jul 22 13:46:32.030601 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.030369    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2143f777-15e0-47a1-b828-8a1729e26771-cnibin\") pod \"multus-9b5t7\" (UID: \"2143f777-15e0-47a1-b828-8a1729e26771\") " pod="openshift-multus/multus-9b5t7"
Jul 22 13:46:32.030601 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.030393    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/76bf4e1c-a08a-48d5-965c-19c62daf827b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fphwm\" (UID: \"76bf4e1c-a08a-48d5-965c-19c62daf827b\") " pod="openshift-multus/multus-additional-cni-plugins-fphwm"
Jul 22 13:46:32.030601 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.030419    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d8ac7e3d-a217-40f0-9051-586f353ee7d5-host-run-netns\") pod \"ovnkube-node-g9zr4\" (UID: \"d8ac7e3d-a217-40f0-9051-586f353ee7d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4"
Jul 22 13:46:32.030601 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.030445    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d8ac7e3d-a217-40f0-9051-586f353ee7d5-host-cni-bin\") pod \"ovnkube-node-g9zr4\" (UID: \"d8ac7e3d-a217-40f0-9051-586f353ee7d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4"
Jul 22 13:46:32.030601 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.030491    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d5dc46dc-6911-4a08-93ef-2a57a94bb374-device-dir\") pod \"aws-ebs-csi-driver-node-zzhtr\" (UID: \"d5dc46dc-6911-4a08-93ef-2a57a94bb374\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzhtr"
Jul 22 13:46:32.030601 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.030496    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d5dc46dc-6911-4a08-93ef-2a57a94bb374-socket-dir\") pod \"aws-ebs-csi-driver-node-zzhtr\" (UID: \"d5dc46dc-6911-4a08-93ef-2a57a94bb374\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzhtr"
Jul 22 13:46:32.030601 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.030518    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmkm5\" (UniqueName: \"kubernetes.io/projected/2143f777-15e0-47a1-b828-8a1729e26771-kube-api-access-rmkm5\") pod \"multus-9b5t7\" (UID: \"2143f777-15e0-47a1-b828-8a1729e26771\") " pod="openshift-multus/multus-9b5t7"
Jul 22 13:46:32.030601 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.030577    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fc26b8c7-376d-4d8c-ba98-ee3f2fe3fb6d-serviceca\") pod \"node-ca-nqwc8\" (UID: \"fc26b8c7-376d-4d8c-ba98-ee3f2fe3fb6d\") " pod="openshift-image-registry/node-ca-nqwc8"
Jul 22 13:46:32.031303 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.030683    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d8ac7e3d-a217-40f0-9051-586f353ee7d5-ovnkube-config\") pod \"ovnkube-node-g9zr4\" (UID: \"d8ac7e3d-a217-40f0-9051-586f353ee7d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4"
Jul 22 13:46:32.031303 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.030698    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/76bf4e1c-a08a-48d5-965c-19c62daf827b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fphwm\" (UID: \"76bf4e1c-a08a-48d5-965c-19c62daf827b\") " pod="openshift-multus/multus-additional-cni-plugins-fphwm"
Jul 22 13:46:32.031303 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.030742    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2143f777-15e0-47a1-b828-8a1729e26771-cnibin\") pod \"multus-9b5t7\" (UID: \"2143f777-15e0-47a1-b828-8a1729e26771\") " pod="openshift-multus/multus-9b5t7"
Jul 22 13:46:32.031303 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.030783    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2143f777-15e0-47a1-b828-8a1729e26771-multus-socket-dir-parent\") pod \"multus-9b5t7\" (UID: \"2143f777-15e0-47a1-b828-8a1729e26771\") " pod="openshift-multus/multus-9b5t7"
Jul 22 13:46:32.031303 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.030144    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2143f777-15e0-47a1-b828-8a1729e26771-etc-kubernetes\") pod \"multus-9b5t7\" (UID: \"2143f777-15e0-47a1-b828-8a1729e26771\") " pod="openshift-multus/multus-9b5t7"
Jul 22 13:46:32.031303 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.030831    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d8ac7e3d-a217-40f0-9051-586f353ee7d5-host-run-netns\") pod \"ovnkube-node-g9zr4\" (UID: \"d8ac7e3d-a217-40f0-9051-586f353ee7d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4"
Jul 22 13:46:32.031303 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.030832    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2143f777-15e0-47a1-b828-8a1729e26771-host-run-netns\") pod \"multus-9b5t7\" (UID: \"2143f777-15e0-47a1-b828-8a1729e26771\") " pod="openshift-multus/multus-9b5t7"
Jul 22 13:46:32.031303 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.030865    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2143f777-15e0-47a1-b828-8a1729e26771-host-var-lib-cni-multus\") pod \"multus-9b5t7\" (UID: \"2143f777-15e0-47a1-b828-8a1729e26771\") " pod="openshift-multus/multus-9b5t7"
Jul 22 13:46:32.031303 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.030873    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d8ac7e3d-a217-40f0-9051-586f353ee7d5-host-cni-bin\") pod \"ovnkube-node-g9zr4\" (UID: \"d8ac7e3d-a217-40f0-9051-586f353ee7d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4"
Jul 22 13:46:32.031303 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.030924    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d5dc46dc-6911-4a08-93ef-2a57a94bb374-device-dir\") pod \"aws-ebs-csi-driver-node-zzhtr\" (UID: \"d5dc46dc-6911-4a08-93ef-2a57a94bb374\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzhtr"
Jul 22 13:46:32.031303 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.030994    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/76bf4e1c-a08a-48d5-965c-19c62daf827b-cnibin\") pod \"multus-additional-cni-plugins-fphwm\" (UID: \"76bf4e1c-a08a-48d5-965c-19c62daf827b\") " pod="openshift-multus/multus-additional-cni-plugins-fphwm"
Jul 22 13:46:32.031303 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.031020    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d5dc46dc-6911-4a08-93ef-2a57a94bb374-etc-selinux\") pod \"aws-ebs-csi-driver-node-zzhtr\" (UID: \"d5dc46dc-6911-4a08-93ef-2a57a94bb374\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzhtr"
Jul 22 13:46:32.031303 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.031038    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvslq\" (UniqueName: \"kubernetes.io/projected/fc26b8c7-376d-4d8c-ba98-ee3f2fe3fb6d-kube-api-access-lvslq\") pod \"node-ca-nqwc8\" (UID: \"fc26b8c7-376d-4d8c-ba98-ee3f2fe3fb6d\") " pod="openshift-image-registry/node-ca-nqwc8"
Jul 22 13:46:32.031303 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.031060    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d8ac7e3d-a217-40f0-9051-586f353ee7d5-run-systemd\") pod \"ovnkube-node-g9zr4\" (UID: \"d8ac7e3d-a217-40f0-9051-586f353ee7d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4"
Jul 22 13:46:32.031805 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.031753    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d5dc46dc-6911-4a08-93ef-2a57a94bb374-etc-selinux\") pod \"aws-ebs-csi-driver-node-zzhtr\" (UID: \"d5dc46dc-6911-4a08-93ef-2a57a94bb374\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzhtr"
Jul 22 13:46:32.031805 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.031758    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d8ac7e3d-a217-40f0-9051-586f353ee7d5-run-systemd\") pod \"ovnkube-node-g9zr4\" (UID: \"d8ac7e3d-a217-40f0-9051-586f353ee7d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4"
Jul 22 13:46:32.031805 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.031760    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d8ac7e3d-a217-40f0-9051-586f353ee7d5-run-openvswitch\") pod \"ovnkube-node-g9zr4\" (UID: \"d8ac7e3d-a217-40f0-9051-586f353ee7d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4"
Jul 22 13:46:32.031925 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.031805    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d8ac7e3d-a217-40f0-9051-586f353ee7d5-run-openvswitch\") pod \"ovnkube-node-g9zr4\" (UID: \"d8ac7e3d-a217-40f0-9051-586f353ee7d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4"
Jul 22 13:46:32.031925 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.031825    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d8ac7e3d-a217-40f0-9051-586f353ee7d5-host-cni-netd\") pod \"ovnkube-node-g9zr4\" (UID: \"d8ac7e3d-a217-40f0-9051-586f353ee7d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4"
Jul 22 13:46:32.031925 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.031853    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d8ac7e3d-a217-40f0-9051-586f353ee7d5-host-cni-netd\") pod \"ovnkube-node-g9zr4\" (UID: \"d8ac7e3d-a217-40f0-9051-586f353ee7d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4"
Jul 22 13:46:32.031925 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.031858    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2143f777-15e0-47a1-b828-8a1729e26771-host-run-k8s-cni-cncf-io\") pod \"multus-9b5t7\" (UID: \"2143f777-15e0-47a1-b828-8a1729e26771\") " pod="openshift-multus/multus-9b5t7"
Jul 22 13:46:32.031925 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.031863    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/76bf4e1c-a08a-48d5-965c-19c62daf827b-cnibin\") pod \"multus-additional-cni-plugins-fphwm\" (UID: \"76bf4e1c-a08a-48d5-965c-19c62daf827b\") " pod="openshift-multus/multus-additional-cni-plugins-fphwm"
Jul 22 13:46:32.031925 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.031895    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2143f777-15e0-47a1-b828-8a1729e26771-host-run-k8s-cni-cncf-io\") pod \"multus-9b5t7\" (UID: \"2143f777-15e0-47a1-b828-8a1729e26771\") " pod="openshift-multus/multus-9b5t7"
Jul 22 13:46:32.031925 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.031915    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/87152330-3c39-4ddc-be44-f3ef60380975-iptables-alerter-script\") pod \"iptables-alerter-tmppm\" (UID: \"87152330-3c39-4ddc-be44-f3ef60380975\") " pod="openshift-network-operator/iptables-alerter-tmppm"
Jul 22 13:46:32.032187 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.031932    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/76bf4e1c-a08a-48d5-965c-19c62daf827b-system-cni-dir\") pod \"multus-additional-cni-plugins-fphwm\" (UID: \"76bf4e1c-a08a-48d5-965c-19c62daf827b\") " pod="openshift-multus/multus-additional-cni-plugins-fphwm"
Jul 22 13:46:32.032243 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.031958    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/76bf4e1c-a08a-48d5-965c-19c62daf827b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fphwm\" (UID: \"76bf4e1c-a08a-48d5-965c-19c62daf827b\") " pod="openshift-multus/multus-additional-cni-plugins-fphwm"
Jul 22 13:46:32.032297 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.032261    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gl5m\" (UniqueName: \"kubernetes.io/projected/76bf4e1c-a08a-48d5-965c-19c62daf827b-kube-api-access-6gl5m\") pod \"multus-additional-cni-plugins-fphwm\" (UID: \"76bf4e1c-a08a-48d5-965c-19c62daf827b\") " pod="openshift-multus/multus-additional-cni-plugins-fphwm"
Jul 22 13:46:32.032355 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.032304    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlmnh\" (UniqueName: \"kubernetes.io/projected/ca3f3ac1-a31f-42c8-927c-fca4c9c77f9d-kube-api-access-qlmnh\") pod \"node-resolver-7njvq\" (UID: \"ca3f3ac1-a31f-42c8-927c-fca4c9c77f9d\") " pod="openshift-dns/node-resolver-7njvq"
Jul 22 13:46:32.032355 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.032339    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d5dc46dc-6911-4a08-93ef-2a57a94bb374-registration-dir\") pod \"aws-ebs-csi-driver-node-zzhtr\" (UID: \"d5dc46dc-6911-4a08-93ef-2a57a94bb374\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzhtr"
Jul 22 13:46:32.032604 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.032553    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/76bf4e1c-a08a-48d5-965c-19c62daf827b-system-cni-dir\") pod \"multus-additional-cni-plugins-fphwm\" (UID: \"76bf4e1c-a08a-48d5-965c-19c62daf827b\") " pod="openshift-multus/multus-additional-cni-plugins-fphwm"
Jul 22 13:46:32.032711 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.032674    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2143f777-15e0-47a1-b828-8a1729e26771-system-cni-dir\") pod \"multus-9b5t7\" (UID: \"2143f777-15e0-47a1-b828-8a1729e26771\") " pod="openshift-multus/multus-9b5t7"
Jul 22 13:46:32.032776 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.032724    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2143f777-15e0-47a1-b828-8a1729e26771-cni-binary-copy\") pod \"multus-9b5t7\" (UID: \"2143f777-15e0-47a1-b828-8a1729e26771\") " pod="openshift-multus/multus-9b5t7"
Jul 22 13:46:32.032851 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.032835    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2143f777-15e0-47a1-b828-8a1729e26771-hostroot\") pod \"multus-9b5t7\" (UID: \"2143f777-15e0-47a1-b828-8a1729e26771\") " pod="openshift-multus/multus-9b5t7"
Jul 22 13:46:32.033171 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.032917    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d5dc46dc-6911-4a08-93ef-2a57a94bb374-registration-dir\") pod \"aws-ebs-csi-driver-node-zzhtr\" (UID: \"d5dc46dc-6911-4a08-93ef-2a57a94bb374\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzhtr"
Jul 22 13:46:32.033171 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.032763    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2143f777-15e0-47a1-b828-8a1729e26771-hostroot\") pod \"multus-9b5t7\" (UID: \"2143f777-15e0-47a1-b828-8a1729e26771\") " pod="openshift-multus/multus-9b5t7"
Jul 22 13:46:32.033171 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.032935    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/87152330-3c39-4ddc-be44-f3ef60380975-iptables-alerter-script\") pod \"iptables-alerter-tmppm\" (UID: \"87152330-3c39-4ddc-be44-f3ef60380975\") " pod="openshift-network-operator/iptables-alerter-tmppm"
Jul 22 13:46:32.033171 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.032975    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2143f777-15e0-47a1-b828-8a1729e26771-multus-daemon-config\") pod \"multus-9b5t7\" (UID: \"2143f777-15e0-47a1-b828-8a1729e26771\") " pod="openshift-multus/multus-9b5t7"
Jul 22 13:46:32.033171 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.032974    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2143f777-15e0-47a1-b828-8a1729e26771-system-cni-dir\") pod \"multus-9b5t7\" (UID: \"2143f777-15e0-47a1-b828-8a1729e26771\") " pod="openshift-multus/multus-9b5t7"
Jul 22 13:46:32.033171 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.033013    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2143f777-15e0-47a1-b828-8a1729e26771-os-release\") pod \"multus-9b5t7\" (UID: \"2143f777-15e0-47a1-b828-8a1729e26771\") " pod="openshift-multus/multus-9b5t7"
Jul 22 13:46:32.033171 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.033068    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/87152330-3c39-4ddc-be44-f3ef60380975-host-slash\") pod \"iptables-alerter-tmppm\" (UID: \"87152330-3c39-4ddc-be44-f3ef60380975\") " pod="openshift-network-operator/iptables-alerter-tmppm"
Jul 22 13:46:32.033171 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.033083    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2143f777-15e0-47a1-b828-8a1729e26771-os-release\") pod \"multus-9b5t7\" (UID: \"2143f777-15e0-47a1-b828-8a1729e26771\") " pod="openshift-multus/multus-9b5t7"
Jul 22 13:46:32.033171 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.033088    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/76bf4e1c-a08a-48d5-965c-19c62daf827b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fphwm\" (UID: \"76bf4e1c-a08a-48d5-965c-19c62daf827b\") " pod="openshift-multus/multus-additional-cni-plugins-fphwm"
Jul 22 13:46:32.033171 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.033102    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rw52h\" (UniqueName: \"kubernetes.io/projected/87152330-3c39-4ddc-be44-f3ef60380975-kube-api-access-rw52h\") pod \"iptables-alerter-tmppm\" (UID: \"87152330-3c39-4ddc-be44-f3ef60380975\") " pod="openshift-network-operator/iptables-alerter-tmppm"
Jul 22 13:46:32.033748 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.033186    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2143f777-15e0-47a1-b828-8a1729e26771-host-var-lib-cni-bin\") pod \"multus-9b5t7\" (UID: \"2143f777-15e0-47a1-b828-8a1729e26771\") " pod="openshift-multus/multus-9b5t7"
Jul 22 13:46:32.033748 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.033219    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2143f777-15e0-47a1-b828-8a1729e26771-host-run-multus-certs\") pod \"multus-9b5t7\" (UID: \"2143f777-15e0-47a1-b828-8a1729e26771\") " pod="openshift-multus/multus-9b5t7"
Jul 22 13:46:32.033748 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.033258    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fd1bdec0-2890-4b8e-8be8-521df53174ac-metrics-certs\") pod \"network-metrics-daemon-tjsf5\" (UID: \"fd1bdec0-2890-4b8e-8be8-521df53174ac\") " pod="openshift-multus/network-metrics-daemon-tjsf5"
Jul 22 13:46:32.033748 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.033315    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d8ac7e3d-a217-40f0-9051-586f353ee7d5-run-ovn\") pod \"ovnkube-node-g9zr4\" (UID: \"d8ac7e3d-a217-40f0-9051-586f353ee7d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4"
Jul 22 13:46:32.033748 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.033365    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fc26b8c7-376d-4d8c-ba98-ee3f2fe3fb6d-host\") pod \"node-ca-nqwc8\" (UID: \"fc26b8c7-376d-4d8c-ba98-ee3f2fe3fb6d\") " pod="openshift-image-registry/node-ca-nqwc8"
Jul 22 13:46:32.033748 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.033406    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d8ac7e3d-a217-40f0-9051-586f353ee7d5-ovnkube-script-lib\") pod \"ovnkube-node-g9zr4\" (UID: \"d8ac7e3d-a217-40f0-9051-586f353ee7d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4"
Jul 22 13:46:32.033748 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.033427    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d8ac7e3d-a217-40f0-9051-586f353ee7d5-ovn-node-metrics-cert\") pod \"ovnkube-node-g9zr4\" (UID: \"d8ac7e3d-a217-40f0-9051-586f353ee7d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4"
Jul 22 13:46:32.033748 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.033436    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2143f777-15e0-47a1-b828-8a1729e26771-multus-cni-dir\") pod \"multus-9b5t7\" (UID: \"2143f777-15e0-47a1-b828-8a1729e26771\") " pod="openshift-multus/multus-9b5t7"
Jul 22 13:46:32.033748 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.033471    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7vjg\" (UniqueName: \"kubernetes.io/projected/a671fc06-4688-47cc-a538-79cddc136f82-kube-api-access-k7vjg\") pod \"network-check-target-sl64w\" (UID: \"a671fc06-4688-47cc-a538-79cddc136f82\") " pod="openshift-network-diagnostics/network-check-target-sl64w"
Jul 22 13:46:32.033748 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.033507    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/87152330-3c39-4ddc-be44-f3ef60380975-host-slash\") pod \"iptables-alerter-tmppm\" (UID: \"87152330-3c39-4ddc-be44-f3ef60380975\") " pod="openshift-network-operator/iptables-alerter-tmppm"
Jul 22 13:46:32.033748 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.033524    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d8ac7e3d-a217-40f0-9051-586f353ee7d5-host-slash\") pod \"ovnkube-node-g9zr4\" (UID: \"d8ac7e3d-a217-40f0-9051-586f353ee7d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4"
Jul 22 13:46:32.033748 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.033537    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2143f777-15e0-47a1-b828-8a1729e26771-host-run-multus-certs\") pod \"multus-9b5t7\" (UID: \"2143f777-15e0-47a1-b828-8a1729e26771\") " pod="openshift-multus/multus-9b5t7"
Jul 22 13:46:32.033748 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.033558    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2143f777-15e0-47a1-b828-8a1729e26771-cni-binary-copy\") pod \"multus-9b5t7\" (UID: \"2143f777-15e0-47a1-b828-8a1729e26771\") " pod="openshift-multus/multus-9b5t7"
Jul 22 13:46:32.033748 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:32.033626    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 13:46:32.033748 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.033645    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d8ac7e3d-a217-40f0-9051-586f353ee7d5-run-ovn\") pod \"ovnkube-node-g9zr4\" (UID: \"d8ac7e3d-a217-40f0-9051-586f353ee7d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4"
Jul 22 13:46:32.033748 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.033664    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8ac7e3d-a217-40f0-9051-586f353ee7d5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g9zr4\" (UID: \"d8ac7e3d-a217-40f0-9051-586f353ee7d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4"
Jul 22 13:46:32.033748 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:32.033694    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd1bdec0-2890-4b8e-8be8-521df53174ac-metrics-certs podName:fd1bdec0-2890-4b8e-8be8-521df53174ac nodeName:}" failed. No retries permitted until 2026-07-22 13:46:32.533668251 +0000 UTC m=+2.588444920 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fd1bdec0-2890-4b8e-8be8-521df53174ac-metrics-certs") pod "network-metrics-daemon-tjsf5" (UID: "fd1bdec0-2890-4b8e-8be8-521df53174ac") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 13:46:32.034598 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.033730    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2143f777-15e0-47a1-b828-8a1729e26771-host-var-lib-cni-bin\") pod \"multus-9b5t7\" (UID: \"2143f777-15e0-47a1-b828-8a1729e26771\") " pod="openshift-multus/multus-9b5t7"
Jul 22 13:46:32.034598 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.033627    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fc26b8c7-376d-4d8c-ba98-ee3f2fe3fb6d-host\") pod \"node-ca-nqwc8\" (UID: \"fc26b8c7-376d-4d8c-ba98-ee3f2fe3fb6d\") " pod="openshift-image-registry/node-ca-nqwc8"
Jul 22 13:46:32.034598 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.033733    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2143f777-15e0-47a1-b828-8a1729e26771-multus-cni-dir\") pod \"multus-9b5t7\" (UID: \"2143f777-15e0-47a1-b828-8a1729e26771\") " pod="openshift-multus/multus-9b5t7"
Jul 22 13:46:32.034598 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.033775    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d8ac7e3d-a217-40f0-9051-586f353ee7d5-host-slash\") pod \"ovnkube-node-g9zr4\" (UID: \"d8ac7e3d-a217-40f0-9051-586f353ee7d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4"
Jul 22 13:46:32.034598 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.033563    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8ac7e3d-a217-40f0-9051-586f353ee7d5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g9zr4\" (UID: \"d8ac7e3d-a217-40f0-9051-586f353ee7d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4"
Jul 22 13:46:32.034598 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.033828    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d5dc46dc-6911-4a08-93ef-2a57a94bb374-sys-fs\") pod \"aws-ebs-csi-driver-node-zzhtr\" (UID: \"d5dc46dc-6911-4a08-93ef-2a57a94bb374\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzhtr"
Jul 22 13:46:32.034598 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.033861    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4hlq\" (UniqueName: \"kubernetes.io/projected/fd1bdec0-2890-4b8e-8be8-521df53174ac-kube-api-access-m4hlq\") pod \"network-metrics-daemon-tjsf5\" (UID: \"fd1bdec0-2890-4b8e-8be8-521df53174ac\") " pod="openshift-multus/network-metrics-daemon-tjsf5"
Jul 22 13:46:32.034598 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.033895    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d8ac7e3d-a217-40f0-9051-586f353ee7d5-systemd-units\") pod \"ovnkube-node-g9zr4\" (UID: \"d8ac7e3d-a217-40f0-9051-586f353ee7d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4"
Jul 22 13:46:32.034598 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.033928    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d8ac7e3d-a217-40f0-9051-586f353ee7d5-node-log\") pod \"ovnkube-node-g9zr4\" (UID: \"d8ac7e3d-a217-40f0-9051-586f353ee7d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4"
Jul 22 13:46:32.034598 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.033955    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8ac7e3d-a217-40f0-9051-586f353ee7d5-host-run-ovn-kubernetes\") pod \"ovnkube-node-g9zr4\" (UID: \"d8ac7e3d-a217-40f0-9051-586f353ee7d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4"
Jul 22 13:46:32.034598 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.033989    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2143f777-15e0-47a1-b828-8a1729e26771-multus-conf-dir\") pod \"multus-9b5t7\" (UID: \"2143f777-15e0-47a1-b828-8a1729e26771\") " pod="openshift-multus/multus-9b5t7"
Jul 22 13:46:32.034598 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.034022    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/76bf4e1c-a08a-48d5-965c-19c62daf827b-os-release\") pod \"multus-additional-cni-plugins-fphwm\" (UID: \"76bf4e1c-a08a-48d5-965c-19c62daf827b\") " pod="openshift-multus/multus-additional-cni-plugins-fphwm"
Jul 22 13:46:32.034598 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.034055    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/76bf4e1c-a08a-48d5-965c-19c62daf827b-cni-binary-copy\") pod \"multus-additional-cni-plugins-fphwm\" (UID: \"76bf4e1c-a08a-48d5-965c-19c62daf827b\") " pod="openshift-multus/multus-additional-cni-plugins-fphwm"
Jul 22 13:46:32.034598 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.034090    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/76bf4e1c-a08a-48d5-965c-19c62daf827b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fphwm\" (UID: \"76bf4e1c-a08a-48d5-965c-19c62daf827b\") " pod="openshift-multus/multus-additional-cni-plugins-fphwm"
Jul 22 13:46:32.034598 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.034118    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d8ac7e3d-a217-40f0-9051-586f353ee7d5-var-lib-openvswitch\") pod \"ovnkube-node-g9zr4\" (UID: \"d8ac7e3d-a217-40f0-9051-586f353ee7d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4"
Jul 22 13:46:32.034598 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.034139    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d5dc46dc-6911-4a08-93ef-2a57a94bb374-sys-fs\") pod \"aws-ebs-csi-driver-node-zzhtr\" (UID: \"d5dc46dc-6911-4a08-93ef-2a57a94bb374\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzhtr"
Jul 22 13:46:32.034598 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.034149    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d8ac7e3d-a217-40f0-9051-586f353ee7d5-env-overrides\") pod \"ovnkube-node-g9zr4\" (UID: \"d8ac7e3d-a217-40f0-9051-586f353ee7d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4"
Jul 22 13:46:32.035402 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.034325    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d8ac7e3d-a217-40f0-9051-586f353ee7d5-ovnkube-script-lib\") pod \"ovnkube-node-g9zr4\" (UID: \"d8ac7e3d-a217-40f0-9051-586f353ee7d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4"
Jul 22 13:46:32.035402 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.034389    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2143f777-15e0-47a1-b828-8a1729e26771-multus-conf-dir\") pod \"multus-9b5t7\" (UID: \"2143f777-15e0-47a1-b828-8a1729e26771\") " pod="openshift-multus/multus-9b5t7"
Jul 22 13:46:32.035402 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.034442    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d8ac7e3d-a217-40f0-9051-586f353ee7d5-var-lib-openvswitch\") pod \"ovnkube-node-g9zr4\" (UID: \"d8ac7e3d-a217-40f0-9051-586f353ee7d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4"
Jul 22 13:46:32.035402 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.034512    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d8ac7e3d-a217-40f0-9051-586f353ee7d5-systemd-units\") pod \"ovnkube-node-g9zr4\" (UID: \"d8ac7e3d-a217-40f0-9051-586f353ee7d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4"
Jul 22 13:46:32.035402 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.034569    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8ac7e3d-a217-40f0-9051-586f353ee7d5-host-run-ovn-kubernetes\") pod \"ovnkube-node-g9zr4\" (UID: \"d8ac7e3d-a217-40f0-9051-586f353ee7d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4"
Jul 22 13:46:32.035402 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.034902    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d8ac7e3d-a217-40f0-9051-586f353ee7d5-env-overrides\") pod \"ovnkube-node-g9zr4\" (UID: \"d8ac7e3d-a217-40f0-9051-586f353ee7d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4"
Jul 22 13:46:32.035402 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.034954    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2143f777-15e0-47a1-b828-8a1729e26771-multus-daemon-config\") pod \"multus-9b5t7\" (UID: \"2143f777-15e0-47a1-b828-8a1729e26771\") " pod="openshift-multus/multus-9b5t7"
Jul 22 13:46:32.035402 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.034969    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d8ac7e3d-a217-40f0-9051-586f353ee7d5-node-log\") pod \"ovnkube-node-g9zr4\" (UID: \"d8ac7e3d-a217-40f0-9051-586f353ee7d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4"
Jul 22 13:46:32.035402 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.035026    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/76bf4e1c-a08a-48d5-965c-19c62daf827b-os-release\") pod \"multus-additional-cni-plugins-fphwm\" (UID: \"76bf4e1c-a08a-48d5-965c-19c62daf827b\") " pod="openshift-multus/multus-additional-cni-plugins-fphwm"
Jul 22 13:46:32.035402 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.035133    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/76bf4e1c-a08a-48d5-965c-19c62daf827b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fphwm\" (UID: \"76bf4e1c-a08a-48d5-965c-19c62daf827b\") " pod="openshift-multus/multus-additional-cni-plugins-fphwm"
Jul 22 13:46:32.035402 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.035317    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/76bf4e1c-a08a-48d5-965c-19c62daf827b-cni-binary-copy\") pod \"multus-additional-cni-plugins-fphwm\" (UID: \"76bf4e1c-a08a-48d5-965c-19c62daf827b\") " pod="openshift-multus/multus-additional-cni-plugins-fphwm"
Jul 22 13:46:32.041950 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:32.041920    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 13:46:32.042133 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:32.041953    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 13:46:32.042133 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:32.041969    2571 projected.go:196] Error preparing data for projected volume kube-api-access-k7vjg for pod openshift-network-diagnostics/network-check-target-sl64w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 13:46:32.042133 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.042014    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmkm5\" (UniqueName: \"kubernetes.io/projected/2143f777-15e0-47a1-b828-8a1729e26771-kube-api-access-rmkm5\") pod \"multus-9b5t7\" (UID: \"2143f777-15e0-47a1-b828-8a1729e26771\") " pod="openshift-multus/multus-9b5t7"
Jul 22 13:46:32.042133 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:32.042035    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a671fc06-4688-47cc-a538-79cddc136f82-kube-api-access-k7vjg podName:a671fc06-4688-47cc-a538-79cddc136f82 nodeName:}" failed. No retries permitted until 2026-07-22 13:46:32.54201676 +0000 UTC m=+2.596793431 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-k7vjg" (UniqueName: "kubernetes.io/projected/a671fc06-4688-47cc-a538-79cddc136f82-kube-api-access-k7vjg") pod "network-check-target-sl64w" (UID: "a671fc06-4688-47cc-a538-79cddc136f82") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 13:46:32.044881 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.044848    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5qsh\" (UniqueName: \"kubernetes.io/projected/d8ac7e3d-a217-40f0-9051-586f353ee7d5-kube-api-access-q5qsh\") pod \"ovnkube-node-g9zr4\" (UID: \"d8ac7e3d-a217-40f0-9051-586f353ee7d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4"
Jul 22 13:46:32.045003 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.044856    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlmnh\" (UniqueName: \"kubernetes.io/projected/ca3f3ac1-a31f-42c8-927c-fca4c9c77f9d-kube-api-access-qlmnh\") pod \"node-resolver-7njvq\" (UID: \"ca3f3ac1-a31f-42c8-927c-fca4c9c77f9d\") " pod="openshift-dns/node-resolver-7njvq"
Jul 22 13:46:32.045003 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.044948    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4hlq\" (UniqueName: \"kubernetes.io/projected/fd1bdec0-2890-4b8e-8be8-521df53174ac-kube-api-access-m4hlq\") pod \"network-metrics-daemon-tjsf5\" (UID: \"fd1bdec0-2890-4b8e-8be8-521df53174ac\") " pod="openshift-multus/network-metrics-daemon-tjsf5"
Jul 22 13:46:32.045103 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.045041    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfdss\" (UniqueName: \"kubernetes.io/projected/d5dc46dc-6911-4a08-93ef-2a57a94bb374-kube-api-access-kfdss\") pod \"aws-ebs-csi-driver-node-zzhtr\" (UID: \"d5dc46dc-6911-4a08-93ef-2a57a94bb374\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzhtr"
Jul 22 13:46:32.045442 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.045421    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gl5m\" (UniqueName: \"kubernetes.io/projected/76bf4e1c-a08a-48d5-965c-19c62daf827b-kube-api-access-6gl5m\") pod \"multus-additional-cni-plugins-fphwm\" (UID: \"76bf4e1c-a08a-48d5-965c-19c62daf827b\") " pod="openshift-multus/multus-additional-cni-plugins-fphwm"
Jul 22 13:46:32.045499 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.045431    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvslq\" (UniqueName: \"kubernetes.io/projected/fc26b8c7-376d-4d8c-ba98-ee3f2fe3fb6d-kube-api-access-lvslq\") pod \"node-ca-nqwc8\" (UID: \"fc26b8c7-376d-4d8c-ba98-ee3f2fe3fb6d\") " pod="openshift-image-registry/node-ca-nqwc8"
Jul 22 13:46:32.045764 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.045747    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rw52h\" (UniqueName: \"kubernetes.io/projected/87152330-3c39-4ddc-be44-f3ef60380975-kube-api-access-rw52h\") pod \"iptables-alerter-tmppm\" (UID: \"87152330-3c39-4ddc-be44-f3ef60380975\") " pod="openshift-network-operator/iptables-alerter-tmppm"
Jul 22 13:46:32.134614 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.134565    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-t8btt"
Jul 22 13:46:32.150967 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.150895    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fsx49"
Jul 22 13:46:32.173223 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.173199    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fphwm"
Jul 22 13:46:32.175596 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.175572    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4"
Jul 22 13:46:32.188774 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.188739    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7njvq"
Jul 22 13:46:32.194249 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.194223    2571 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 13:46:32.203439 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.203405    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzhtr"
Jul 22 13:46:32.222845 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.222815    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nqwc8"
Jul 22 13:46:32.247610 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.247580    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9b5t7"
Jul 22 13:46:32.253603 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.253584    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tmppm"
Jul 22 13:46:32.287368 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:32.287327    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87152330_3c39_4ddc_be44_f3ef60380975.slice/crio-647cc25ae195f661abaa9e3301a7b9ba05c0c44917d7eb5c4f4738a4425957cb WatchSource:0}: Error finding container 647cc25ae195f661abaa9e3301a7b9ba05c0c44917d7eb5c4f4738a4425957cb: Status 404 returned error can't find the container with id 647cc25ae195f661abaa9e3301a7b9ba05c0c44917d7eb5c4f4738a4425957cb
Jul 22 13:46:32.287900 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:32.287876    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a12706c8812142983885d0dac594160.slice/crio-ef1a2b13cf2c2c9462c08006d91ff5e2b616669bedf1ec627f323318e96d367d WatchSource:0}: Error finding container ef1a2b13cf2c2c9462c08006d91ff5e2b616669bedf1ec627f323318e96d367d: Status 404 returned error can't find the container with id ef1a2b13cf2c2c9462c08006d91ff5e2b616669bedf1ec627f323318e96d367d
Jul 22 13:46:32.292167 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.292151    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 13:46:32.437861 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.437770    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f98c3223-5fb5-4366-98ba-2fe5d046a496-original-pull-secret\") pod \"global-pull-secret-syncer-2mjnn\" (UID: \"f98c3223-5fb5-4366-98ba-2fe5d046a496\") " pod="kube-system/global-pull-secret-syncer-2mjnn"
Jul 22 13:46:32.438010 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:32.437948    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 13:46:32.438055 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:32.438018    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f98c3223-5fb5-4366-98ba-2fe5d046a496-original-pull-secret podName:f98c3223-5fb5-4366-98ba-2fe5d046a496 nodeName:}" failed. No retries permitted until 2026-07-22 13:46:33.438000414 +0000 UTC m=+3.492777071 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f98c3223-5fb5-4366-98ba-2fe5d046a496-original-pull-secret") pod "global-pull-secret-syncer-2mjnn" (UID: "f98c3223-5fb5-4366-98ba-2fe5d046a496") : object "kube-system"/"original-pull-secret" not registered
Jul 22 13:46:32.461318 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:32.461292    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cc6486a_acc2_43e8_8909_bb52ed47fd7a.slice/crio-7457a35f47d440c07468e3bfb684aed0a042fd2e812f1ebe05153f3b115784b6 WatchSource:0}: Error finding container 7457a35f47d440c07468e3bfb684aed0a042fd2e812f1ebe05153f3b115784b6: Status 404 returned error can't find the container with id 7457a35f47d440c07468e3bfb684aed0a042fd2e812f1ebe05153f3b115784b6
Jul 22 13:46:32.538291 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.538254    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fd1bdec0-2890-4b8e-8be8-521df53174ac-metrics-certs\") pod \"network-metrics-daemon-tjsf5\" (UID: \"fd1bdec0-2890-4b8e-8be8-521df53174ac\") " pod="openshift-multus/network-metrics-daemon-tjsf5"
Jul 22 13:46:32.538449 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:32.538394    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 13:46:32.538526 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:32.538472    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd1bdec0-2890-4b8e-8be8-521df53174ac-metrics-certs podName:fd1bdec0-2890-4b8e-8be8-521df53174ac nodeName:}" failed. No retries permitted until 2026-07-22 13:46:33.538456482 +0000 UTC m=+3.593233152 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fd1bdec0-2890-4b8e-8be8-521df53174ac-metrics-certs") pod "network-metrics-daemon-tjsf5" (UID: "fd1bdec0-2890-4b8e-8be8-521df53174ac") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 13:46:32.543372 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:32.543347    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8ac7e3d_a217_40f0_9051_586f353ee7d5.slice/crio-35a0b8083cd9ea232df17c7a2b3f3b844e39edfe35548e01c67670af3b4d5980 WatchSource:0}: Error finding container 35a0b8083cd9ea232df17c7a2b3f3b844e39edfe35548e01c67670af3b4d5980: Status 404 returned error can't find the container with id 35a0b8083cd9ea232df17c7a2b3f3b844e39edfe35548e01c67670af3b4d5980
Jul 22 13:46:32.579668 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.579632    2571 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 13:46:32.590871 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:32.590845    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2143f777_15e0_47a1_b828_8a1729e26771.slice/crio-5516fd8a2c12417d2f3d53eb131caf6d2483243ff452e2e9f0fbbcf42b093407 WatchSource:0}: Error finding container 5516fd8a2c12417d2f3d53eb131caf6d2483243ff452e2e9f0fbbcf42b093407: Status 404 returned error can't find the container with id 5516fd8a2c12417d2f3d53eb131caf6d2483243ff452e2e9f0fbbcf42b093407
Jul 22 13:46:32.611840 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:32.611814    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5dc46dc_6911_4a08_93ef_2a57a94bb374.slice/crio-ee82396e7f9f32fec3af3035f2d7b4b57c4107ba68b241bc90e5808427388740 WatchSource:0}: Error finding container ee82396e7f9f32fec3af3035f2d7b4b57c4107ba68b241bc90e5808427388740: Status 404 returned error can't find the container with id ee82396e7f9f32fec3af3035f2d7b4b57c4107ba68b241bc90e5808427388740
Jul 22 13:46:32.639193 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.639162    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7vjg\" (UniqueName: \"kubernetes.io/projected/a671fc06-4688-47cc-a538-79cddc136f82-kube-api-access-k7vjg\") pod \"network-check-target-sl64w\" (UID: \"a671fc06-4688-47cc-a538-79cddc136f82\") " pod="openshift-network-diagnostics/network-check-target-sl64w"
Jul 22 13:46:32.639373 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:32.639353    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 13:46:32.639476 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:32.639380    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 13:46:32.639476 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:32.639393    2571 projected.go:196] Error preparing data for projected volume kube-api-access-k7vjg for pod openshift-network-diagnostics/network-check-target-sl64w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 13:46:32.639589 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:32.639487    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a671fc06-4688-47cc-a538-79cddc136f82-kube-api-access-k7vjg podName:a671fc06-4688-47cc-a538-79cddc136f82 nodeName:}" failed. No retries permitted until 2026-07-22 13:46:33.639461749 +0000 UTC m=+3.694238426 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-k7vjg" (UniqueName: "kubernetes.io/projected/a671fc06-4688-47cc-a538-79cddc136f82-kube-api-access-k7vjg") pod "network-check-target-sl64w" (UID: "a671fc06-4688-47cc-a538-79cddc136f82") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 13:46:32.700173 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:32.700143    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e646050_00d1_4798_9c5e_1b71fde65713.slice/crio-225dc0c0f01e2200ccd423dceba4946f0dc2dd2a15a2c7a54530a9f9a75693e2 WatchSource:0}: Error finding container 225dc0c0f01e2200ccd423dceba4946f0dc2dd2a15a2c7a54530a9f9a75693e2: Status 404 returned error can't find the container with id 225dc0c0f01e2200ccd423dceba4946f0dc2dd2a15a2c7a54530a9f9a75693e2
Jul 22 13:46:32.700711 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:32.700678    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76bf4e1c_a08a_48d5_965c_19c62daf827b.slice/crio-6049344a15c14dd4888e8728cab074b01207c311857c56a1d46c404af15b4c74 WatchSource:0}: Error finding container 6049344a15c14dd4888e8728cab074b01207c311857c56a1d46c404af15b4c74: Status 404 returned error can't find the container with id 6049344a15c14dd4888e8728cab074b01207c311857c56a1d46c404af15b4c74
Jul 22 13:46:32.754478 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:32.754444    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca3f3ac1_a31f_42c8_927c_fca4c9c77f9d.slice/crio-652a9edc9f73fef2dd94a4574ee5db20f1edb3b9f3efc80dc1ffe5c0c5403132 WatchSource:0}: Error finding container 652a9edc9f73fef2dd94a4574ee5db20f1edb3b9f3efc80dc1ffe5c0c5403132: Status 404 returned error can't find the container with id 652a9edc9f73fef2dd94a4574ee5db20f1edb3b9f3efc80dc1ffe5c0c5403132
Jul 22 13:46:32.864845 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.864782    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 13:41:32 +0000 UTC" deadline="2028-03-15 01:49:16.984086438 +0000 UTC"
Jul 22 13:46:32.864845 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:32.864833    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14436h2m44.119256043s"
Jul 22 13:46:33.009496 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:33.009370    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tmppm" event={"ID":"87152330-3c39-4ddc-be44-f3ef60380975","Type":"ContainerStarted","Data":"647cc25ae195f661abaa9e3301a7b9ba05c0c44917d7eb5c4f4738a4425957cb"}
Jul 22 13:46:33.010745 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:33.010713    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7njvq" event={"ID":"ca3f3ac1-a31f-42c8-927c-fca4c9c77f9d","Type":"ContainerStarted","Data":"652a9edc9f73fef2dd94a4574ee5db20f1edb3b9f3efc80dc1ffe5c0c5403132"}
Jul 22 13:46:33.011960 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:33.011936    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fsx49" event={"ID":"0e646050-00d1-4798-9c5e-1b71fde65713","Type":"ContainerStarted","Data":"225dc0c0f01e2200ccd423dceba4946f0dc2dd2a15a2c7a54530a9f9a75693e2"}
Jul 22 13:46:33.013081 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:33.013047    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzhtr" event={"ID":"d5dc46dc-6911-4a08-93ef-2a57a94bb374","Type":"ContainerStarted","Data":"ee82396e7f9f32fec3af3035f2d7b4b57c4107ba68b241bc90e5808427388740"}
Jul 22 13:46:33.014320 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:33.014293    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4" event={"ID":"d8ac7e3d-a217-40f0-9051-586f353ee7d5","Type":"ContainerStarted","Data":"35a0b8083cd9ea232df17c7a2b3f3b844e39edfe35548e01c67670af3b4d5980"}
Jul 22 13:46:33.015593 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:33.015563    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-t8btt" event={"ID":"8cc6486a-acc2-43e8-8909-bb52ed47fd7a","Type":"ContainerStarted","Data":"7457a35f47d440c07468e3bfb684aed0a042fd2e812f1ebe05153f3b115784b6"}
Jul 22 13:46:33.016687 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:33.016660    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fphwm" event={"ID":"76bf4e1c-a08a-48d5-965c-19c62daf827b","Type":"ContainerStarted","Data":"6049344a15c14dd4888e8728cab074b01207c311857c56a1d46c404af15b4c74"}
Jul 22 13:46:33.017910 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:33.017886    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9b5t7" event={"ID":"2143f777-15e0-47a1-b828-8a1729e26771","Type":"ContainerStarted","Data":"5516fd8a2c12417d2f3d53eb131caf6d2483243ff452e2e9f0fbbcf42b093407"}
Jul 22 13:46:33.019114 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:33.019093    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-134.ec2.internal" event={"ID":"1a12706c8812142983885d0dac594160","Type":"ContainerStarted","Data":"ef1a2b13cf2c2c9462c08006d91ff5e2b616669bedf1ec627f323318e96d367d"}
Jul 22 13:46:33.447320 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:33.447232    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f98c3223-5fb5-4366-98ba-2fe5d046a496-original-pull-secret\") pod \"global-pull-secret-syncer-2mjnn\" (UID: \"f98c3223-5fb5-4366-98ba-2fe5d046a496\") " pod="kube-system/global-pull-secret-syncer-2mjnn"
Jul 22 13:46:33.447552 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:33.447423    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 13:46:33.447552 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:33.447511    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f98c3223-5fb5-4366-98ba-2fe5d046a496-original-pull-secret podName:f98c3223-5fb5-4366-98ba-2fe5d046a496 nodeName:}" failed. No retries permitted until 2026-07-22 13:46:35.447491615 +0000 UTC m=+5.502268274 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f98c3223-5fb5-4366-98ba-2fe5d046a496-original-pull-secret") pod "global-pull-secret-syncer-2mjnn" (UID: "f98c3223-5fb5-4366-98ba-2fe5d046a496") : object "kube-system"/"original-pull-secret" not registered
Jul 22 13:46:33.547789 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:33.547742    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fd1bdec0-2890-4b8e-8be8-521df53174ac-metrics-certs\") pod \"network-metrics-daemon-tjsf5\" (UID: \"fd1bdec0-2890-4b8e-8be8-521df53174ac\") " pod="openshift-multus/network-metrics-daemon-tjsf5"
Jul 22 13:46:33.547983 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:33.547961    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 13:46:33.548072 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:33.548058    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd1bdec0-2890-4b8e-8be8-521df53174ac-metrics-certs podName:fd1bdec0-2890-4b8e-8be8-521df53174ac nodeName:}" failed. No retries permitted until 2026-07-22 13:46:35.548013824 +0000 UTC m=+5.602790489 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fd1bdec0-2890-4b8e-8be8-521df53174ac-metrics-certs") pod "network-metrics-daemon-tjsf5" (UID: "fd1bdec0-2890-4b8e-8be8-521df53174ac") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 13:46:33.649257 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:33.649211    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7vjg\" (UniqueName: \"kubernetes.io/projected/a671fc06-4688-47cc-a538-79cddc136f82-kube-api-access-k7vjg\") pod \"network-check-target-sl64w\" (UID: \"a671fc06-4688-47cc-a538-79cddc136f82\") " pod="openshift-network-diagnostics/network-check-target-sl64w"
Jul 22 13:46:33.649445 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:33.649429    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 13:46:33.649533 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:33.649472    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 13:46:33.649533 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:33.649492    2571 projected.go:196] Error preparing data for projected volume kube-api-access-k7vjg for pod openshift-network-diagnostics/network-check-target-sl64w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 13:46:33.649638 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:33.649562    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a671fc06-4688-47cc-a538-79cddc136f82-kube-api-access-k7vjg podName:a671fc06-4688-47cc-a538-79cddc136f82 nodeName:}" failed. No retries permitted until 2026-07-22 13:46:35.649541004 +0000 UTC m=+5.704317661 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-k7vjg" (UniqueName: "kubernetes.io/projected/a671fc06-4688-47cc-a538-79cddc136f82-kube-api-access-k7vjg") pod "network-check-target-sl64w" (UID: "a671fc06-4688-47cc-a538-79cddc136f82") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 13:46:33.865167 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:33.865053    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 13:41:32 +0000 UTC" deadline="2028-03-17 10:40:09.225636727 +0000 UTC"
Jul 22 13:46:33.865167 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:33.865111    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14492h53m35.360530897s"
Jul 22 13:46:34.004629 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:34.004573    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sl64w"
Jul 22 13:46:34.004844 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:34.004779    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sl64w" podUID="a671fc06-4688-47cc-a538-79cddc136f82"
Jul 22 13:46:34.015653 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:34.015619    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tjsf5"
Jul 22 13:46:34.015852 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:34.015819    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tjsf5" podUID="fd1bdec0-2890-4b8e-8be8-521df53174ac"
Jul 22 13:46:34.015920 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:34.015910    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2mjnn"
Jul 22 13:46:34.016129 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:34.016105    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2mjnn" podUID="f98c3223-5fb5-4366-98ba-2fe5d046a496"
Jul 22 13:46:34.232658 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:34.232568    2571 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 13:46:34.909059 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:34.908972    2571 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 13:46:35.464110 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:35.464066    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f98c3223-5fb5-4366-98ba-2fe5d046a496-original-pull-secret\") pod \"global-pull-secret-syncer-2mjnn\" (UID: \"f98c3223-5fb5-4366-98ba-2fe5d046a496\") " pod="kube-system/global-pull-secret-syncer-2mjnn"
Jul 22 13:46:35.464319 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:35.464260    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 13:46:35.464392 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:35.464329    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f98c3223-5fb5-4366-98ba-2fe5d046a496-original-pull-secret podName:f98c3223-5fb5-4366-98ba-2fe5d046a496 nodeName:}" failed. No retries permitted until 2026-07-22 13:46:39.464309018 +0000 UTC m=+9.519085680 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f98c3223-5fb5-4366-98ba-2fe5d046a496-original-pull-secret") pod "global-pull-secret-syncer-2mjnn" (UID: "f98c3223-5fb5-4366-98ba-2fe5d046a496") : object "kube-system"/"original-pull-secret" not registered
Jul 22 13:46:35.565056 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:35.564839    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fd1bdec0-2890-4b8e-8be8-521df53174ac-metrics-certs\") pod \"network-metrics-daemon-tjsf5\" (UID: \"fd1bdec0-2890-4b8e-8be8-521df53174ac\") " pod="openshift-multus/network-metrics-daemon-tjsf5"
Jul 22 13:46:35.565056 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:35.564989    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 13:46:35.565056 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:35.565059    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd1bdec0-2890-4b8e-8be8-521df53174ac-metrics-certs podName:fd1bdec0-2890-4b8e-8be8-521df53174ac nodeName:}" failed. No retries permitted until 2026-07-22 13:46:39.565038035 +0000 UTC m=+9.619814699 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fd1bdec0-2890-4b8e-8be8-521df53174ac-metrics-certs") pod "network-metrics-daemon-tjsf5" (UID: "fd1bdec0-2890-4b8e-8be8-521df53174ac") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 13:46:35.665515 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:35.665475    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7vjg\" (UniqueName: \"kubernetes.io/projected/a671fc06-4688-47cc-a538-79cddc136f82-kube-api-access-k7vjg\") pod \"network-check-target-sl64w\" (UID: \"a671fc06-4688-47cc-a538-79cddc136f82\") " pod="openshift-network-diagnostics/network-check-target-sl64w"
Jul 22 13:46:35.665721 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:35.665681    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 13:46:35.665721 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:35.665708    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 13:46:35.665721 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:35.665721    2571 projected.go:196] Error preparing data for projected volume kube-api-access-k7vjg for pod openshift-network-diagnostics/network-check-target-sl64w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 13:46:35.665891 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:35.665795    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a671fc06-4688-47cc-a538-79cddc136f82-kube-api-access-k7vjg podName:a671fc06-4688-47cc-a538-79cddc136f82 nodeName:}" failed. No retries permitted until 2026-07-22 13:46:39.665771933 +0000 UTC m=+9.720548594 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-k7vjg" (UniqueName: "kubernetes.io/projected/a671fc06-4688-47cc-a538-79cddc136f82-kube-api-access-k7vjg") pod "network-check-target-sl64w" (UID: "a671fc06-4688-47cc-a538-79cddc136f82") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 13:46:36.004072 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:36.004032    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sl64w"
Jul 22 13:46:36.004072 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:36.004075    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tjsf5"
Jul 22 13:46:36.004673 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:36.004038    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2mjnn"
Jul 22 13:46:36.004673 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:36.004183    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sl64w" podUID="a671fc06-4688-47cc-a538-79cddc136f82"
Jul 22 13:46:36.004673 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:36.004287    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2mjnn" podUID="f98c3223-5fb5-4366-98ba-2fe5d046a496"
Jul 22 13:46:36.004673 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:36.004384    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tjsf5" podUID="fd1bdec0-2890-4b8e-8be8-521df53174ac"
Jul 22 13:46:38.004434 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:38.004382    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sl64w"
Jul 22 13:46:38.004911 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:38.004535    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sl64w" podUID="a671fc06-4688-47cc-a538-79cddc136f82"
Jul 22 13:46:38.004980 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:38.004910    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2mjnn"
Jul 22 13:46:38.005034 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:38.005003    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2mjnn" podUID="f98c3223-5fb5-4366-98ba-2fe5d046a496"
Jul 22 13:46:38.005085 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:38.005051    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tjsf5"
Jul 22 13:46:38.005164 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:38.005133    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tjsf5" podUID="fd1bdec0-2890-4b8e-8be8-521df53174ac"
Jul 22 13:46:39.498271 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:39.498179    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f98c3223-5fb5-4366-98ba-2fe5d046a496-original-pull-secret\") pod \"global-pull-secret-syncer-2mjnn\" (UID: \"f98c3223-5fb5-4366-98ba-2fe5d046a496\") " pod="kube-system/global-pull-secret-syncer-2mjnn"
Jul 22 13:46:39.498792 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:39.498337    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 13:46:39.498792 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:39.498438    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f98c3223-5fb5-4366-98ba-2fe5d046a496-original-pull-secret podName:f98c3223-5fb5-4366-98ba-2fe5d046a496 nodeName:}" failed. No retries permitted until 2026-07-22 13:46:47.498397917 +0000 UTC m=+17.553174581 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f98c3223-5fb5-4366-98ba-2fe5d046a496-original-pull-secret") pod "global-pull-secret-syncer-2mjnn" (UID: "f98c3223-5fb5-4366-98ba-2fe5d046a496") : object "kube-system"/"original-pull-secret" not registered
Jul 22 13:46:39.599185 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:39.599074    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fd1bdec0-2890-4b8e-8be8-521df53174ac-metrics-certs\") pod \"network-metrics-daemon-tjsf5\" (UID: \"fd1bdec0-2890-4b8e-8be8-521df53174ac\") " pod="openshift-multus/network-metrics-daemon-tjsf5"
Jul 22 13:46:39.599368 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:39.599213    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 13:46:39.599368 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:39.599280    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd1bdec0-2890-4b8e-8be8-521df53174ac-metrics-certs podName:fd1bdec0-2890-4b8e-8be8-521df53174ac nodeName:}" failed. No retries permitted until 2026-07-22 13:46:47.59926131 +0000 UTC m=+17.654037969 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fd1bdec0-2890-4b8e-8be8-521df53174ac-metrics-certs") pod "network-metrics-daemon-tjsf5" (UID: "fd1bdec0-2890-4b8e-8be8-521df53174ac") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 13:46:39.699846 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:39.699747    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7vjg\" (UniqueName: \"kubernetes.io/projected/a671fc06-4688-47cc-a538-79cddc136f82-kube-api-access-k7vjg\") pod \"network-check-target-sl64w\" (UID: \"a671fc06-4688-47cc-a538-79cddc136f82\") " pod="openshift-network-diagnostics/network-check-target-sl64w"
Jul 22 13:46:39.700039 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:39.699933    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 13:46:39.700039 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:39.699953    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 13:46:39.700039 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:39.699965    2571 projected.go:196] Error preparing data for projected volume kube-api-access-k7vjg for pod openshift-network-diagnostics/network-check-target-sl64w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 13:46:39.700039 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:39.700027    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a671fc06-4688-47cc-a538-79cddc136f82-kube-api-access-k7vjg podName:a671fc06-4688-47cc-a538-79cddc136f82 nodeName:}" failed. No retries permitted until 2026-07-22 13:46:47.700008717 +0000 UTC m=+17.754785374 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-k7vjg" (UniqueName: "kubernetes.io/projected/a671fc06-4688-47cc-a538-79cddc136f82-kube-api-access-k7vjg") pod "network-check-target-sl64w" (UID: "a671fc06-4688-47cc-a538-79cddc136f82") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 13:46:40.003600 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:40.003565    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sl64w"
Jul 22 13:46:40.003801 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:40.003700    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sl64w" podUID="a671fc06-4688-47cc-a538-79cddc136f82"
Jul 22 13:46:40.003801 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:40.003777    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tjsf5"
Jul 22 13:46:40.003913 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:40.003854    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tjsf5" podUID="fd1bdec0-2890-4b8e-8be8-521df53174ac"
Jul 22 13:46:40.003913 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:40.003901    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2mjnn"
Jul 22 13:46:40.004015 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:40.003968    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2mjnn" podUID="f98c3223-5fb5-4366-98ba-2fe5d046a496"
Jul 22 13:46:42.003905 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:42.003816    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tjsf5"
Jul 22 13:46:42.004339 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:42.003816    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sl64w"
Jul 22 13:46:42.004339 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:42.003966    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tjsf5" podUID="fd1bdec0-2890-4b8e-8be8-521df53174ac"
Jul 22 13:46:42.004339 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:42.003835    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2mjnn"
Jul 22 13:46:42.004339 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:42.004032    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sl64w" podUID="a671fc06-4688-47cc-a538-79cddc136f82"
Jul 22 13:46:42.004339 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:42.004097    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2mjnn" podUID="f98c3223-5fb5-4366-98ba-2fe5d046a496"
Jul 22 13:46:44.003972 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:44.003938    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2mjnn"
Jul 22 13:46:44.003972 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:44.003981    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sl64w"
Jul 22 13:46:44.004520 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:44.003983    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tjsf5"
Jul 22 13:46:44.004520 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:44.004063    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2mjnn" podUID="f98c3223-5fb5-4366-98ba-2fe5d046a496"
Jul 22 13:46:44.004520 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:44.004159    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sl64w" podUID="a671fc06-4688-47cc-a538-79cddc136f82"
Jul 22 13:46:44.004520 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:44.004228    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tjsf5" podUID="fd1bdec0-2890-4b8e-8be8-521df53174ac"
Jul 22 13:46:46.004472 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:46.004431    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sl64w"
Jul 22 13:46:46.004472 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:46.004467    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2mjnn"
Jul 22 13:46:46.004961 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:46.004431    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tjsf5"
Jul 22 13:46:46.004961 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:46.004555    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sl64w" podUID="a671fc06-4688-47cc-a538-79cddc136f82"
Jul 22 13:46:46.004961 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:46.004654    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2mjnn" podUID="f98c3223-5fb5-4366-98ba-2fe5d046a496"
Jul 22 13:46:46.004961 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:46.004759    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tjsf5" podUID="fd1bdec0-2890-4b8e-8be8-521df53174ac"
Jul 22 13:46:47.559126 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:47.559079    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f98c3223-5fb5-4366-98ba-2fe5d046a496-original-pull-secret\") pod \"global-pull-secret-syncer-2mjnn\" (UID: \"f98c3223-5fb5-4366-98ba-2fe5d046a496\") " pod="kube-system/global-pull-secret-syncer-2mjnn"
Jul 22 13:46:47.559564 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:47.559251    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 13:46:47.559564 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:47.559347    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f98c3223-5fb5-4366-98ba-2fe5d046a496-original-pull-secret podName:f98c3223-5fb5-4366-98ba-2fe5d046a496 nodeName:}" failed. No retries permitted until 2026-07-22 13:47:03.559322289 +0000 UTC m=+33.614099000 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f98c3223-5fb5-4366-98ba-2fe5d046a496-original-pull-secret") pod "global-pull-secret-syncer-2mjnn" (UID: "f98c3223-5fb5-4366-98ba-2fe5d046a496") : object "kube-system"/"original-pull-secret" not registered
Jul 22 13:46:47.659701 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:47.659666    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fd1bdec0-2890-4b8e-8be8-521df53174ac-metrics-certs\") pod \"network-metrics-daemon-tjsf5\" (UID: \"fd1bdec0-2890-4b8e-8be8-521df53174ac\") " pod="openshift-multus/network-metrics-daemon-tjsf5"
Jul 22 13:46:47.659901 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:47.659845    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 13:46:47.659969 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:47.659928    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd1bdec0-2890-4b8e-8be8-521df53174ac-metrics-certs podName:fd1bdec0-2890-4b8e-8be8-521df53174ac nodeName:}" failed. No retries permitted until 2026-07-22 13:47:03.659905755 +0000 UTC m=+33.714682412 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fd1bdec0-2890-4b8e-8be8-521df53174ac-metrics-certs") pod "network-metrics-daemon-tjsf5" (UID: "fd1bdec0-2890-4b8e-8be8-521df53174ac") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 13:46:47.760507 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:47.760461    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7vjg\" (UniqueName: \"kubernetes.io/projected/a671fc06-4688-47cc-a538-79cddc136f82-kube-api-access-k7vjg\") pod \"network-check-target-sl64w\" (UID: \"a671fc06-4688-47cc-a538-79cddc136f82\") " pod="openshift-network-diagnostics/network-check-target-sl64w"
Jul 22 13:46:47.760703 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:47.760647    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 13:46:47.760703 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:47.760699    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 13:46:47.760811 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:47.760710    2571 projected.go:196] Error preparing data for projected volume kube-api-access-k7vjg for pod openshift-network-diagnostics/network-check-target-sl64w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 13:46:47.760811 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:47.760769    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a671fc06-4688-47cc-a538-79cddc136f82-kube-api-access-k7vjg podName:a671fc06-4688-47cc-a538-79cddc136f82 nodeName:}" failed. No retries permitted until 2026-07-22 13:47:03.760750968 +0000 UTC m=+33.815527622 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-k7vjg" (UniqueName: "kubernetes.io/projected/a671fc06-4688-47cc-a538-79cddc136f82-kube-api-access-k7vjg") pod "network-check-target-sl64w" (UID: "a671fc06-4688-47cc-a538-79cddc136f82") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 13:46:48.003723 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:48.003634    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sl64w"
Jul 22 13:46:48.003893 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:48.003648    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2mjnn"
Jul 22 13:46:48.003893 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:48.003780    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sl64w" podUID="a671fc06-4688-47cc-a538-79cddc136f82"
Jul 22 13:46:48.003893 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:48.003792    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tjsf5"
Jul 22 13:46:48.004045 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:48.003889    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2mjnn" podUID="f98c3223-5fb5-4366-98ba-2fe5d046a496"
Jul 22 13:46:48.004045 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:48.004004    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tjsf5" podUID="fd1bdec0-2890-4b8e-8be8-521df53174ac"
Jul 22 13:46:50.003881 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:50.003845    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2mjnn"
Jul 22 13:46:50.004307 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:50.003845    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tjsf5"
Jul 22 13:46:50.004307 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:50.003974    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2mjnn" podUID="f98c3223-5fb5-4366-98ba-2fe5d046a496"
Jul 22 13:46:50.004307 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:50.003845    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sl64w"
Jul 22 13:46:50.004307 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:50.004069    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tjsf5" podUID="fd1bdec0-2890-4b8e-8be8-521df53174ac"
Jul 22 13:46:50.004307 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:50.004107    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sl64w" podUID="a671fc06-4688-47cc-a538-79cddc136f82"
Jul 22 13:46:51.064868 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:51.064828    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-134.ec2.internal" event={"ID":"2fe22260834f3ba68797b548033e91dd","Type":"ContainerStarted","Data":"90c2c2338eeec3e22c7c079a44e55e0d601c6d94aee0a0d962959e83f4c690b6"}
Jul 22 13:46:51.108357 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:46:51.108332    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc26b8c7_376d_4d8c_ba98_ee3f2fe3fb6d.slice/crio-81562d5f8edef5db20a10efc34221db6e34615458316122bf63fd8a98e6317ca WatchSource:0}: Error finding container 81562d5f8edef5db20a10efc34221db6e34615458316122bf63fd8a98e6317ca: Status 404 returned error can't find the container with id 81562d5f8edef5db20a10efc34221db6e34615458316122bf63fd8a98e6317ca
Jul 22 13:46:52.004470 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:52.003984    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2mjnn"
Jul 22 13:46:52.004614 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:52.004031    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tjsf5"
Jul 22 13:46:52.004614 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:52.004546    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2mjnn" podUID="f98c3223-5fb5-4366-98ba-2fe5d046a496"
Jul 22 13:46:52.004614 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:52.004032    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sl64w"
Jul 22 13:46:52.004780 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:52.004632    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tjsf5" podUID="fd1bdec0-2890-4b8e-8be8-521df53174ac"
Jul 22 13:46:52.004780 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:52.004697    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sl64w" podUID="a671fc06-4688-47cc-a538-79cddc136f82"
Jul 22 13:46:52.071927 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:52.071694    2571 generic.go:356] "Generic (PLEG): container finished" podID="76bf4e1c-a08a-48d5-965c-19c62daf827b" containerID="2bbe2cab0beb09febbe6f3eeaa9bdee8a6b3315e216d8d43fc699d49b5eba0a8" exitCode=0
Jul 22 13:46:52.072653 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:52.071966    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fphwm" event={"ID":"76bf4e1c-a08a-48d5-965c-19c62daf827b","Type":"ContainerDied","Data":"2bbe2cab0beb09febbe6f3eeaa9bdee8a6b3315e216d8d43fc699d49b5eba0a8"}
Jul 22 13:46:52.074873 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:52.074848    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9b5t7" event={"ID":"2143f777-15e0-47a1-b828-8a1729e26771","Type":"ContainerStarted","Data":"bd31a397d062dc743cd8edd944da6702d9d4bcef12d32312374b9a64ce58e967"}
Jul 22 13:46:52.077933 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:52.077907    2571 generic.go:356] "Generic (PLEG): container finished" podID="1a12706c8812142983885d0dac594160" containerID="88003a2ccae91227695befb2ed1b286a517d64fa68d1773fa1645822d4260cef" exitCode=0
Jul 22 13:46:52.078045 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:52.077993    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-134.ec2.internal" event={"ID":"1a12706c8812142983885d0dac594160","Type":"ContainerDied","Data":"88003a2ccae91227695befb2ed1b286a517d64fa68d1773fa1645822d4260cef"}
Jul 22 13:46:52.080567 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:52.080491    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nqwc8" event={"ID":"fc26b8c7-376d-4d8c-ba98-ee3f2fe3fb6d","Type":"ContainerStarted","Data":"81562d5f8edef5db20a10efc34221db6e34615458316122bf63fd8a98e6317ca"}
Jul 22 13:46:52.082426 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:52.082382    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7njvq" event={"ID":"ca3f3ac1-a31f-42c8-927c-fca4c9c77f9d","Type":"ContainerStarted","Data":"23657384e55f98ab843fed8588c1994acd7cdb8f8d04a1a461d108497dc968a1"}
Jul 22 13:46:52.084471 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:52.084447    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fsx49" event={"ID":"0e646050-00d1-4798-9c5e-1b71fde65713","Type":"ContainerStarted","Data":"61795275b347e552e8eb618025d57dba294e2695ec683e91cc4e0dd084d46aa1"}
Jul 22 13:46:52.087757 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:52.087732    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzhtr" event={"ID":"d5dc46dc-6911-4a08-93ef-2a57a94bb374","Type":"ContainerStarted","Data":"fd2d1a55b4d240aec5bead7a4b5c05550cbe9752494067622d506edc40fb0f0b"}
Jul 22 13:46:52.097301 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:52.097274    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4" event={"ID":"d8ac7e3d-a217-40f0-9051-586f353ee7d5","Type":"ContainerStarted","Data":"eba1720e45d33c961dc5c2076c9e25a012ae0ead56e32bef1d110e9026818085"}
Jul 22 13:46:52.097393 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:52.097367    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4" event={"ID":"d8ac7e3d-a217-40f0-9051-586f353ee7d5","Type":"ContainerStarted","Data":"9541e42be0d3a9305df28e4ea49c7c092cbc1734cfa32f958eb3fc533665f406"}
Jul 22 13:46:52.097491 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:52.097399    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4" event={"ID":"d8ac7e3d-a217-40f0-9051-586f353ee7d5","Type":"ContainerStarted","Data":"68faaa40a5c9cf56bb93f7b805e99887d0e9ee0ef7c46de81cf39a8a5ff7625d"}
Jul 22 13:46:52.097491 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:52.097449    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4" event={"ID":"d8ac7e3d-a217-40f0-9051-586f353ee7d5","Type":"ContainerStarted","Data":"2737cb055b10aaac250960faff1f04cbc3935689742584d0f5f83b62c11ced57"}
Jul 22 13:46:52.097491 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:52.097477    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4" event={"ID":"d8ac7e3d-a217-40f0-9051-586f353ee7d5","Type":"ContainerStarted","Data":"a3f954e94a4a14836fe177ea3bcf3aba28e9dfb56c52d0d85adb08ca58e827de"}
Jul 22 13:46:52.099231 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:52.099208    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-t8btt" event={"ID":"8cc6486a-acc2-43e8-8909-bb52ed47fd7a","Type":"ContainerStarted","Data":"87895c805363136db3070df0ee0d869d02229514c429cc8713a44c1396c12b18"}
Jul 22 13:46:52.129749 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:52.129691    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-fsx49" podStartSLOduration=7.299105328 podStartE2EDuration="21.129665577s" totalImagesPullingTime="13.830560249s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 13:46:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:46:52.129112149 +0000 UTC m=+22.183888827" watchObservedRunningTime="2026-07-22 13:46:52.129665577 +0000 UTC m=+22.184442303"
Jul 22 13:46:52.185613 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:52.185555    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-7njvq" podStartSLOduration=7.409236417 podStartE2EDuration="21.185533191s" totalImagesPullingTime="13.776296774s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 13:46:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:46:52.152268025 +0000 UTC m=+22.207044703" watchObservedRunningTime="2026-07-22 13:46:52.185533191 +0000 UTC m=+22.240309869"
Jul 22 13:46:52.185791 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:52.185665    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-9b5t7" podStartSLOduration=2.638578798 podStartE2EDuration="21.185655654s" totalImagesPullingTime="18.547076856s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 13:46:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:46:52.184240885 +0000 UTC m=+22.239017563" watchObservedRunningTime="2026-07-22 13:46:52.185655654 +0000 UTC m=+22.240432336"
Jul 22 13:46:52.211123 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:52.211064    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-t8btt" podStartSLOduration=10.949055927 podStartE2EDuration="21.211043928s" totalImagesPullingTime="10.261988001s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:46:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:46:52.210768695 +0000 UTC m=+22.265545373" watchObservedRunningTime="2026-07-22 13:46:52.211043928 +0000 UTC m=+22.265820606"
Jul 22 13:46:52.854484 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:52.854451    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-t8btt"
Jul 22 13:46:52.855356 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:52.855119    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-t8btt"
Jul 22 13:46:53.105263 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:53.105156    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4" event={"ID":"d8ac7e3d-a217-40f0-9051-586f353ee7d5","Type":"ContainerStarted","Data":"8a83feb16dc7b0593d3d93c09260ee1e7f997416138006e278e9f9a59a1dfdbb"}
Jul 22 13:46:53.107707 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:53.107670    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-134.ec2.internal" event={"ID":"1a12706c8812142983885d0dac594160","Type":"ContainerStarted","Data":"b820728526f96980387df1aa3df9fe6eeb61a4f19af313910b0b65539757c403"}
Jul 22 13:46:53.109778 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:53.109744    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tmppm" event={"ID":"87152330-3c39-4ddc-be44-f3ef60380975","Type":"ContainerStarted","Data":"dac34b163535cbce83da330fb8b912c3b2e9d74876ed05884e5143422030be77"}
Jul 22 13:46:53.137565 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:53.137511    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-134.ec2.internal" podStartSLOduration=21.137496168 podStartE2EDuration="21.137496168s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 13:46:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:46:53.137205184 +0000 UTC m=+23.191981860" watchObservedRunningTime="2026-07-22 13:46:53.137496168 +0000 UTC m=+23.192272845"
Jul 22 13:46:53.154347 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:53.154289    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-tmppm" podStartSLOduration=3.357853504 podStartE2EDuration="22.154264092s" totalImagesPullingTime="18.796410588s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 13:46:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:46:53.153718472 +0000 UTC m=+23.208495147" watchObservedRunningTime="2026-07-22 13:46:53.154264092 +0000 UTC m=+23.209040770"
Jul 22 13:46:54.003862 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:54.003825    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2mjnn"
Jul 22 13:46:54.003862 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:54.003843    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tjsf5"
Jul 22 13:46:54.004141 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:54.003825    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sl64w"
Jul 22 13:46:54.004141 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:54.003957    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2mjnn" podUID="f98c3223-5fb5-4366-98ba-2fe5d046a496"
Jul 22 13:46:54.004141 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:54.004049    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sl64w" podUID="a671fc06-4688-47cc-a538-79cddc136f82"
Jul 22 13:46:54.004141 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:54.004134    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tjsf5" podUID="fd1bdec0-2890-4b8e-8be8-521df53174ac"
Jul 22 13:46:54.113613 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:54.113494    2571 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 22 13:46:54.204331 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:54.204264    2571 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 22 13:46:54.894922 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:54.894802    2571 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-22T13:46:54.204290381Z","UUID":"b9f60b63-9828-430a-8e53-5fa4d1070403","Handler":null,"Name":"","Endpoint":""}
Jul 22 13:46:54.896729 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:54.896661    2571 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 22 13:46:54.896729 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:54.896707    2571 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 22 13:46:55.117159 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:55.117119    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nqwc8" event={"ID":"fc26b8c7-376d-4d8c-ba98-ee3f2fe3fb6d","Type":"ContainerStarted","Data":"6cfe7f57b1366f22d2f8165738b8acc9b06a03b611c0eb3fe7c2d8270618008a"}
Jul 22 13:46:55.119079 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:55.119053    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzhtr" event={"ID":"d5dc46dc-6911-4a08-93ef-2a57a94bb374","Type":"ContainerStarted","Data":"10a6bdd38d7bf356c03ee406d6ec73d7373b880418a0b14480f3551f4e43ad23"}
Jul 22 13:46:55.122759 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:55.122728    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4" event={"ID":"d8ac7e3d-a217-40f0-9051-586f353ee7d5","Type":"ContainerStarted","Data":"808ed1c4cecf89118d217be0d3f81548a4e071776d073bcca0d4f83fea362071"}
Jul 22 13:46:55.124364 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:55.124338    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-134.ec2.internal" event={"ID":"2fe22260834f3ba68797b548033e91dd","Type":"ContainerStarted","Data":"0705ca35514b7e0fb1e5aa0a7dc49953fda95ad1f5b94104bebb9832335725e1"}
Jul 22 13:46:55.135079 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:55.135036    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-nqwc8" podStartSLOduration=21.203541685 podStartE2EDuration="24.135024784s" totalImagesPullingTime="2.931483099s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 13:46:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:46:55.135004696 +0000 UTC m=+25.189781384" watchObservedRunningTime="2026-07-22 13:46:55.135024784 +0000 UTC m=+25.189801461"
Jul 22 13:46:55.156341 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:55.156248    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-134.ec2.internal" podStartSLOduration=23.156231689 podStartE2EDuration="23.156231689s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 13:46:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:46:55.156158207 +0000 UTC m=+25.210934884" watchObservedRunningTime="2026-07-22 13:46:55.156231689 +0000 UTC m=+25.211008366"
Jul 22 13:46:56.004232 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:56.004191    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sl64w"
Jul 22 13:46:56.004232 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:56.004224    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2mjnn"
Jul 22 13:46:56.004543 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:56.004238    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tjsf5"
Jul 22 13:46:56.004543 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:56.004333    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sl64w" podUID="a671fc06-4688-47cc-a538-79cddc136f82"
Jul 22 13:46:56.004543 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:56.004482    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2mjnn" podUID="f98c3223-5fb5-4366-98ba-2fe5d046a496"
Jul 22 13:46:56.004720 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:56.004564    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tjsf5" podUID="fd1bdec0-2890-4b8e-8be8-521df53174ac"
Jul 22 13:46:57.132048 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:57.131792    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzhtr" event={"ID":"d5dc46dc-6911-4a08-93ef-2a57a94bb374","Type":"ContainerStarted","Data":"d0f7f82dcccf4a0d6f0fb0f882b2f0034ac6aac84df8b1232a1261f67e18a254"}
Jul 22 13:46:57.135206 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:57.135174    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4" event={"ID":"d8ac7e3d-a217-40f0-9051-586f353ee7d5","Type":"ContainerStarted","Data":"bc1b524d3c0d2a44376f65539784be69a54f1101e5b9c18075219ce90423465c"}
Jul 22 13:46:57.135435 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:57.135400    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4"
Jul 22 13:46:57.135527 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:57.135488    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4"
Jul 22 13:46:57.137184 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:57.137160    2571 generic.go:356] "Generic (PLEG): container finished" podID="76bf4e1c-a08a-48d5-965c-19c62daf827b" containerID="e9b91dd8c9efa34aaeb8ac736bffd32ded173cc234a183744872264b569f01a5" exitCode=0
Jul 22 13:46:57.137253 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:57.137210    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fphwm" event={"ID":"76bf4e1c-a08a-48d5-965c-19c62daf827b","Type":"ContainerDied","Data":"e9b91dd8c9efa34aaeb8ac736bffd32ded173cc234a183744872264b569f01a5"}
Jul 22 13:46:57.149849 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:57.149797    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzhtr" podStartSLOduration=7.399646214 podStartE2EDuration="26.149780806s" totalImagesPullingTime="18.750134592s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 13:46:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:46:57.149586667 +0000 UTC m=+27.204363343" watchObservedRunningTime="2026-07-22 13:46:57.149780806 +0000 UTC m=+27.204557484"
Jul 22 13:46:57.151554 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:57.151533    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4"
Jul 22 13:46:57.194241 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:57.194194    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4" podStartSLOduration=7.246462008 podStartE2EDuration="26.194179224s" totalImagesPullingTime="18.947717216s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 13:46:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:46:57.193354501 +0000 UTC m=+27.248131191" watchObservedRunningTime="2026-07-22 13:46:57.194179224 +0000 UTC m=+27.248955900"
Jul 22 13:46:58.003703 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:58.003620    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sl64w"
Jul 22 13:46:58.003703 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:58.003672    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tjsf5"
Jul 22 13:46:58.003933 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:58.003742    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sl64w" podUID="a671fc06-4688-47cc-a538-79cddc136f82"
Jul 22 13:46:58.003933 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:58.003672    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2mjnn"
Jul 22 13:46:58.003933 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:58.003787    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tjsf5" podUID="fd1bdec0-2890-4b8e-8be8-521df53174ac"
Jul 22 13:46:58.003933 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:58.003844    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2mjnn" podUID="f98c3223-5fb5-4366-98ba-2fe5d046a496"
Jul 22 13:46:58.140309 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:58.140276    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4"
Jul 22 13:46:58.155181 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:58.155157    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4"
Jul 22 13:46:58.732104 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:58.732023    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2mjnn"]
Jul 22 13:46:58.732283 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:58.732194    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2mjnn"
Jul 22 13:46:58.732322 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:58.732285    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2mjnn" podUID="f98c3223-5fb5-4366-98ba-2fe5d046a496"
Jul 22 13:46:58.734875 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:58.734812    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-sl64w"]
Jul 22 13:46:58.735020 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:58.735007    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sl64w"
Jul 22 13:46:58.735130 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:58.735103    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sl64w" podUID="a671fc06-4688-47cc-a538-79cddc136f82"
Jul 22 13:46:58.735491 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:58.735457    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tjsf5"]
Jul 22 13:46:58.735605 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:58.735566    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tjsf5"
Jul 22 13:46:58.735665 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:46:58.735648    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tjsf5" podUID="fd1bdec0-2890-4b8e-8be8-521df53174ac"
Jul 22 13:46:58.898145 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:58.898116    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-t8btt"
Jul 22 13:46:58.898320 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:58.898230    2571 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 22 13:46:58.898811 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:58.898784    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-t8btt"
Jul 22 13:46:59.144197 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:59.144114    2571 generic.go:356] "Generic (PLEG): container finished" podID="76bf4e1c-a08a-48d5-965c-19c62daf827b" containerID="0fd2b77b5dbe30cc1827b822a3b0316d211f36d7346e55fc246ffd00cf36653a" exitCode=0
Jul 22 13:46:59.144696 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:46:59.144196    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fphwm" event={"ID":"76bf4e1c-a08a-48d5-965c-19c62daf827b","Type":"ContainerDied","Data":"0fd2b77b5dbe30cc1827b822a3b0316d211f36d7346e55fc246ffd00cf36653a"}
Jul 22 13:47:00.004300 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:00.004256    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tjsf5"
Jul 22 13:47:00.004493 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:47:00.004371    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tjsf5" podUID="fd1bdec0-2890-4b8e-8be8-521df53174ac"
Jul 22 13:47:00.004493 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:00.004425    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2mjnn"
Jul 22 13:47:00.004591 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:47:00.004517    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2mjnn" podUID="f98c3223-5fb5-4366-98ba-2fe5d046a496"
Jul 22 13:47:01.004620 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:01.004585    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sl64w"
Jul 22 13:47:01.005073 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:47:01.004693    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sl64w" podUID="a671fc06-4688-47cc-a538-79cddc136f82"
Jul 22 13:47:01.150768 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:01.150678    2571 generic.go:356] "Generic (PLEG): container finished" podID="76bf4e1c-a08a-48d5-965c-19c62daf827b" containerID="34e0e0ccb4e7d50e9750a0b456cf9732880b7b51f5b82516f0d5ad6302d2f354" exitCode=0
Jul 22 13:47:01.150768 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:01.150723    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fphwm" event={"ID":"76bf4e1c-a08a-48d5-965c-19c62daf827b","Type":"ContainerDied","Data":"34e0e0ccb4e7d50e9750a0b456cf9732880b7b51f5b82516f0d5ad6302d2f354"}
Jul 22 13:47:01.679596 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:01.679568    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7njvq_ca3f3ac1-a31f-42c8-927c-fca4c9c77f9d/dns-node-resolver/0.log"
Jul 22 13:47:02.004276 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:02.004194    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tjsf5"
Jul 22 13:47:02.004276 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:02.004236    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2mjnn"
Jul 22 13:47:02.004546 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:47:02.004337    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tjsf5" podUID="fd1bdec0-2890-4b8e-8be8-521df53174ac"
Jul 22 13:47:02.004546 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:47:02.004494    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2mjnn" podUID="f98c3223-5fb5-4366-98ba-2fe5d046a496"
Jul 22 13:47:02.852558 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:02.852477    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nqwc8_fc26b8c7-376d-4d8c-ba98-ee3f2fe3fb6d/node-ca/0.log"
Jul 22 13:47:03.004175 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:03.004143    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sl64w"
Jul 22 13:47:03.004352 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:47:03.004261    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sl64w" podUID="a671fc06-4688-47cc-a538-79cddc136f82"
Jul 22 13:47:03.578733 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:03.578685    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f98c3223-5fb5-4366-98ba-2fe5d046a496-original-pull-secret\") pod \"global-pull-secret-syncer-2mjnn\" (UID: \"f98c3223-5fb5-4366-98ba-2fe5d046a496\") " pod="kube-system/global-pull-secret-syncer-2mjnn"
Jul 22 13:47:03.578915 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:47:03.578810    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 13:47:03.578915 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:47:03.578858    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f98c3223-5fb5-4366-98ba-2fe5d046a496-original-pull-secret podName:f98c3223-5fb5-4366-98ba-2fe5d046a496 nodeName:}" failed. No retries permitted until 2026-07-22 13:47:35.578845736 +0000 UTC m=+65.633622391 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f98c3223-5fb5-4366-98ba-2fe5d046a496-original-pull-secret") pod "global-pull-secret-syncer-2mjnn" (UID: "f98c3223-5fb5-4366-98ba-2fe5d046a496") : object "kube-system"/"original-pull-secret" not registered
Jul 22 13:47:03.679539 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:03.679504    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fd1bdec0-2890-4b8e-8be8-521df53174ac-metrics-certs\") pod \"network-metrics-daemon-tjsf5\" (UID: \"fd1bdec0-2890-4b8e-8be8-521df53174ac\") " pod="openshift-multus/network-metrics-daemon-tjsf5"
Jul 22 13:47:03.679734 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:47:03.679661    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 13:47:03.679734 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:47:03.679731    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd1bdec0-2890-4b8e-8be8-521df53174ac-metrics-certs podName:fd1bdec0-2890-4b8e-8be8-521df53174ac nodeName:}" failed. No retries permitted until 2026-07-22 13:47:35.679712352 +0000 UTC m=+65.734489025 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fd1bdec0-2890-4b8e-8be8-521df53174ac-metrics-certs") pod "network-metrics-daemon-tjsf5" (UID: "fd1bdec0-2890-4b8e-8be8-521df53174ac") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 13:47:03.779995 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:03.779952    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7vjg\" (UniqueName: \"kubernetes.io/projected/a671fc06-4688-47cc-a538-79cddc136f82-kube-api-access-k7vjg\") pod \"network-check-target-sl64w\" (UID: \"a671fc06-4688-47cc-a538-79cddc136f82\") " pod="openshift-network-diagnostics/network-check-target-sl64w"
Jul 22 13:47:03.780169 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:47:03.780102    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 13:47:03.780169 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:47:03.780133    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 13:47:03.780169 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:47:03.780146    2571 projected.go:196] Error preparing data for projected volume kube-api-access-k7vjg for pod openshift-network-diagnostics/network-check-target-sl64w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 13:47:03.780296 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:47:03.780228    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a671fc06-4688-47cc-a538-79cddc136f82-kube-api-access-k7vjg podName:a671fc06-4688-47cc-a538-79cddc136f82 nodeName:}" failed. No retries permitted until 2026-07-22 13:47:35.780212225 +0000 UTC m=+65.834988880 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-k7vjg" (UniqueName: "kubernetes.io/projected/a671fc06-4688-47cc-a538-79cddc136f82-kube-api-access-k7vjg") pod "network-check-target-sl64w" (UID: "a671fc06-4688-47cc-a538-79cddc136f82") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 13:47:04.004052 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:04.004010    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tjsf5"
Jul 22 13:47:04.004052 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:04.004049    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2mjnn"
Jul 22 13:47:04.004554 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:47:04.004166    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tjsf5" podUID="fd1bdec0-2890-4b8e-8be8-521df53174ac"
Jul 22 13:47:04.004554 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:47:04.004299    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2mjnn" podUID="f98c3223-5fb5-4366-98ba-2fe5d046a496"
Jul 22 13:47:04.276308 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:04.276232    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-134.ec2.internal" event="NodeReady"
Jul 22 13:47:04.276491 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:04.276393    2571 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 22 13:47:05.003843 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:05.003803    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sl64w"
Jul 22 13:47:05.006529 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:05.006494    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 22 13:47:05.006529 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:05.006518    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 22 13:47:05.006529 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:05.006532    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-l6npf\""
Jul 22 13:47:06.004107 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:06.003916    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tjsf5"
Jul 22 13:47:06.004308 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:06.003954    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2mjnn"
Jul 22 13:47:06.006616 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:06.006595    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 22 13:47:06.007190 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:06.007176    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 22 13:47:06.007239 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:06.007199    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-phx9h\""
Jul 22 13:47:06.165443 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:06.165394    2571 generic.go:356] "Generic (PLEG): container finished" podID="76bf4e1c-a08a-48d5-965c-19c62daf827b" containerID="9e79a369bf3fec460f96cf8005c61fb016ee284a55086d393fb26b92a3225ef1" exitCode=0
Jul 22 13:47:06.165443 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:06.165436    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fphwm" event={"ID":"76bf4e1c-a08a-48d5-965c-19c62daf827b","Type":"ContainerDied","Data":"9e79a369bf3fec460f96cf8005c61fb016ee284a55086d393fb26b92a3225ef1"}
Jul 22 13:47:07.171331 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:07.171304    2571 generic.go:356] "Generic (PLEG): container finished" podID="76bf4e1c-a08a-48d5-965c-19c62daf827b" containerID="06c74607f59b9db24ed234d00904ffa661d36de2a90f82a423b4446acdf5a5d6" exitCode=0
Jul 22 13:47:07.171780 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:07.171347    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fphwm" event={"ID":"76bf4e1c-a08a-48d5-965c-19c62daf827b","Type":"ContainerDied","Data":"06c74607f59b9db24ed234d00904ffa661d36de2a90f82a423b4446acdf5a5d6"}
Jul 22 13:47:08.178180 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:08.178146    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fphwm" event={"ID":"76bf4e1c-a08a-48d5-965c-19c62daf827b","Type":"ContainerStarted","Data":"22f5357ae60701eb8632fa6c69ac1310fd37ae4d64e2ba65a5a6d2391887ad20"}
Jul 22 13:47:08.203192 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:08.203141    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-fphwm" podStartSLOduration=8.00131972 podStartE2EDuration="37.203124438s" totalImagesPullingTime="29.201804718s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 13:46:31 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:47:08.202156575 +0000 UTC m=+38.256933291" watchObservedRunningTime="2026-07-22 13:47:08.203124438 +0000 UTC m=+38.257901115"
Jul 22 13:47:21.808602 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:21.808571    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-87d25"]
Jul 22 13:47:21.822060 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:21.822029    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-lxfbl"]
Jul 22 13:47:21.822208 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:21.822159    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-87d25"
Jul 22 13:47:21.825026 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:21.824863    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 22 13:47:21.825179 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:21.825115    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8vvhl\""
Jul 22 13:47:21.825179 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:21.825138    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 22 13:47:21.836094 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:21.836071    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-87d25"]
Jul 22 13:47:21.836211 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:21.836105    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lxfbl"]
Jul 22 13:47:21.836211 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:21.836179    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lxfbl"
Jul 22 13:47:21.837524 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:21.837502    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-5kzh9"]
Jul 22 13:47:21.838646 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:21.838624    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 22 13:47:21.838854 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:21.838833    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 22 13:47:21.838974 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:21.838916    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 22 13:47:21.839077 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:21.839064    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-n8c66\""
Jul 22 13:47:21.852320 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:21.852297    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5kzh9"
Jul 22 13:47:21.854503 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:21.854472    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5kzh9"]
Jul 22 13:47:21.854890 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:21.854871    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 22 13:47:21.855010 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:21.854988    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 22 13:47:21.855130 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:21.855009    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8lrzs\""
Jul 22 13:47:21.855130 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:21.854959    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 22 13:47:21.855311 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:21.855298    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 22 13:47:21.911234 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:21.911195    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c9b21c6d-4ef7-4362-9b59-54cba94ec969-metrics-tls\") pod \"dns-default-87d25\" (UID: \"c9b21c6d-4ef7-4362-9b59-54cba94ec969\") " pod="openshift-dns/dns-default-87d25"
Jul 22 13:47:21.911234 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:21.911235    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24czq\" (UniqueName: \"kubernetes.io/projected/c9b21c6d-4ef7-4362-9b59-54cba94ec969-kube-api-access-24czq\") pod \"dns-default-87d25\" (UID: \"c9b21c6d-4ef7-4362-9b59-54cba94ec969\") " pod="openshift-dns/dns-default-87d25"
Jul 22 13:47:21.911476 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:21.911305    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c9b21c6d-4ef7-4362-9b59-54cba94ec969-config-volume\") pod \"dns-default-87d25\" (UID: \"c9b21c6d-4ef7-4362-9b59-54cba94ec969\") " pod="openshift-dns/dns-default-87d25"
Jul 22 13:47:21.911476 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:21.911337    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9b21c6d-4ef7-4362-9b59-54cba94ec969-tmp-dir\") pod \"dns-default-87d25\" (UID: \"c9b21c6d-4ef7-4362-9b59-54cba94ec969\") " pod="openshift-dns/dns-default-87d25"
Jul 22 13:47:22.012297 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:22.012255    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c8e78e65-8e84-49f4-b376-e3d7576e4cfb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5kzh9\" (UID: \"c8e78e65-8e84-49f4-b376-e3d7576e4cfb\") " pod="openshift-insights/insights-runtime-extractor-5kzh9"
Jul 22 13:47:22.012297 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:22.012299    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2nsh\" (UniqueName: \"kubernetes.io/projected/c8e78e65-8e84-49f4-b376-e3d7576e4cfb-kube-api-access-r2nsh\") pod \"insights-runtime-extractor-5kzh9\" (UID: \"c8e78e65-8e84-49f4-b376-e3d7576e4cfb\") " pod="openshift-insights/insights-runtime-extractor-5kzh9"
Jul 22 13:47:22.012552 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:22.012321    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4c25882a-b837-4e4b-884c-be514d536810-cert\") pod \"ingress-canary-lxfbl\" (UID: \"4c25882a-b837-4e4b-884c-be514d536810\") " pod="openshift-ingress-canary/ingress-canary-lxfbl"
Jul 22 13:47:22.012552 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:22.012366    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c8e78e65-8e84-49f4-b376-e3d7576e4cfb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5kzh9\" (UID: \"c8e78e65-8e84-49f4-b376-e3d7576e4cfb\") " pod="openshift-insights/insights-runtime-extractor-5kzh9"
Jul 22 13:47:22.012552 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:22.012426    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c9b21c6d-4ef7-4362-9b59-54cba94ec969-metrics-tls\") pod \"dns-default-87d25\" (UID: \"c9b21c6d-4ef7-4362-9b59-54cba94ec969\") " pod="openshift-dns/dns-default-87d25"
Jul 22 13:47:22.012552 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:22.012459    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24czq\" (UniqueName: \"kubernetes.io/projected/c9b21c6d-4ef7-4362-9b59-54cba94ec969-kube-api-access-24czq\") pod \"dns-default-87d25\" (UID: \"c9b21c6d-4ef7-4362-9b59-54cba94ec969\") " pod="openshift-dns/dns-default-87d25"
Jul 22 13:47:22.012552 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:22.012477    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c8e78e65-8e84-49f4-b376-e3d7576e4cfb-crio-socket\") pod \"insights-runtime-extractor-5kzh9\" (UID: \"c8e78e65-8e84-49f4-b376-e3d7576e4cfb\") " pod="openshift-insights/insights-runtime-extractor-5kzh9"
Jul 22 13:47:22.012552 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:22.012512    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c8e78e65-8e84-49f4-b376-e3d7576e4cfb-data-volume\") pod \"insights-runtime-extractor-5kzh9\" (UID: \"c8e78e65-8e84-49f4-b376-e3d7576e4cfb\") " pod="openshift-insights/insights-runtime-extractor-5kzh9"
Jul 22 13:47:22.012552 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:22.012533    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lp59\" (UniqueName: \"kubernetes.io/projected/4c25882a-b837-4e4b-884c-be514d536810-kube-api-access-2lp59\") pod \"ingress-canary-lxfbl\" (UID: \"4c25882a-b837-4e4b-884c-be514d536810\") " pod="openshift-ingress-canary/ingress-canary-lxfbl"
Jul 22 13:47:22.012552 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:22.012555    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c9b21c6d-4ef7-4362-9b59-54cba94ec969-config-volume\") pod \"dns-default-87d25\" (UID: \"c9b21c6d-4ef7-4362-9b59-54cba94ec969\") " pod="openshift-dns/dns-default-87d25"
Jul 22 13:47:22.012898 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:22.012588    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9b21c6d-4ef7-4362-9b59-54cba94ec969-tmp-dir\") pod \"dns-default-87d25\" (UID: \"c9b21c6d-4ef7-4362-9b59-54cba94ec969\") " pod="openshift-dns/dns-default-87d25"
Jul 22 13:47:22.012898 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:22.012888    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9b21c6d-4ef7-4362-9b59-54cba94ec969-tmp-dir\") pod \"dns-default-87d25\" (UID: \"c9b21c6d-4ef7-4362-9b59-54cba94ec969\") " pod="openshift-dns/dns-default-87d25"
Jul 22 13:47:22.013081 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:22.013059    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c9b21c6d-4ef7-4362-9b59-54cba94ec969-config-volume\") pod \"dns-default-87d25\" (UID: \"c9b21c6d-4ef7-4362-9b59-54cba94ec969\") " pod="openshift-dns/dns-default-87d25"
Jul 22 13:47:22.016321 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:22.016302    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c9b21c6d-4ef7-4362-9b59-54cba94ec969-metrics-tls\") pod \"dns-default-87d25\" (UID: \"c9b21c6d-4ef7-4362-9b59-54cba94ec969\") " pod="openshift-dns/dns-default-87d25"
Jul 22 13:47:22.022446 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:22.022424    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24czq\" (UniqueName: \"kubernetes.io/projected/c9b21c6d-4ef7-4362-9b59-54cba94ec969-kube-api-access-24czq\") pod \"dns-default-87d25\" (UID: \"c9b21c6d-4ef7-4362-9b59-54cba94ec969\") " pod="openshift-dns/dns-default-87d25"
Jul 22 13:47:22.113481 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:22.113375    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4c25882a-b837-4e4b-884c-be514d536810-cert\") pod \"ingress-canary-lxfbl\" (UID: \"4c25882a-b837-4e4b-884c-be514d536810\") " pod="openshift-ingress-canary/ingress-canary-lxfbl"
Jul 22 13:47:22.113481 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:22.113442    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c8e78e65-8e84-49f4-b376-e3d7576e4cfb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5kzh9\" (UID: \"c8e78e65-8e84-49f4-b376-e3d7576e4cfb\") " pod="openshift-insights/insights-runtime-extractor-5kzh9"
Jul 22 13:47:22.113481 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:22.113476    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c8e78e65-8e84-49f4-b376-e3d7576e4cfb-crio-socket\") pod \"insights-runtime-extractor-5kzh9\" (UID: \"c8e78e65-8e84-49f4-b376-e3d7576e4cfb\") " pod="openshift-insights/insights-runtime-extractor-5kzh9"
Jul 22 13:47:22.113770 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:22.113525    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c8e78e65-8e84-49f4-b376-e3d7576e4cfb-data-volume\") pod \"insights-runtime-extractor-5kzh9\" (UID: \"c8e78e65-8e84-49f4-b376-e3d7576e4cfb\") " pod="openshift-insights/insights-runtime-extractor-5kzh9"
Jul 22 13:47:22.113770 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:22.113548    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lp59\" (UniqueName: \"kubernetes.io/projected/4c25882a-b837-4e4b-884c-be514d536810-kube-api-access-2lp59\") pod \"ingress-canary-lxfbl\" (UID: \"4c25882a-b837-4e4b-884c-be514d536810\") " pod="openshift-ingress-canary/ingress-canary-lxfbl"
Jul 22 13:47:22.113770 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:22.113707    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c8e78e65-8e84-49f4-b376-e3d7576e4cfb-crio-socket\") pod \"insights-runtime-extractor-5kzh9\" (UID: \"c8e78e65-8e84-49f4-b376-e3d7576e4cfb\") " pod="openshift-insights/insights-runtime-extractor-5kzh9"
Jul 22 13:47:22.113770 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:22.113725    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c8e78e65-8e84-49f4-b376-e3d7576e4cfb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5kzh9\" (UID: \"c8e78e65-8e84-49f4-b376-e3d7576e4cfb\") " pod="openshift-insights/insights-runtime-extractor-5kzh9"
Jul 22 13:47:22.113938 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:22.113769    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2nsh\" (UniqueName: \"kubernetes.io/projected/c8e78e65-8e84-49f4-b376-e3d7576e4cfb-kube-api-access-r2nsh\") pod \"insights-runtime-extractor-5kzh9\" (UID: \"c8e78e65-8e84-49f4-b376-e3d7576e4cfb\") " pod="openshift-insights/insights-runtime-extractor-5kzh9"
Jul 22 13:47:22.113938 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:22.113895    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c8e78e65-8e84-49f4-b376-e3d7576e4cfb-data-volume\") pod \"insights-runtime-extractor-5kzh9\" (UID: \"c8e78e65-8e84-49f4-b376-e3d7576e4cfb\") " pod="openshift-insights/insights-runtime-extractor-5kzh9"
Jul 22 13:47:22.114211 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:22.114192    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c8e78e65-8e84-49f4-b376-e3d7576e4cfb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5kzh9\" (UID: \"c8e78e65-8e84-49f4-b376-e3d7576e4cfb\") " pod="openshift-insights/insights-runtime-extractor-5kzh9"
Jul 22 13:47:22.115756 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:22.115725    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c8e78e65-8e84-49f4-b376-e3d7576e4cfb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5kzh9\" (UID: \"c8e78e65-8e84-49f4-b376-e3d7576e4cfb\") " pod="openshift-insights/insights-runtime-extractor-5kzh9"
Jul 22 13:47:22.116017 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:22.115998    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4c25882a-b837-4e4b-884c-be514d536810-cert\") pod \"ingress-canary-lxfbl\" (UID: \"4c25882a-b837-4e4b-884c-be514d536810\") " pod="openshift-ingress-canary/ingress-canary-lxfbl"
Jul 22 13:47:22.122477 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:22.122454    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lp59\" (UniqueName: \"kubernetes.io/projected/4c25882a-b837-4e4b-884c-be514d536810-kube-api-access-2lp59\") pod \"ingress-canary-lxfbl\" (UID: \"4c25882a-b837-4e4b-884c-be514d536810\") " pod="openshift-ingress-canary/ingress-canary-lxfbl"
Jul 22 13:47:22.122593 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:22.122498    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2nsh\" (UniqueName: \"kubernetes.io/projected/c8e78e65-8e84-49f4-b376-e3d7576e4cfb-kube-api-access-r2nsh\") pod \"insights-runtime-extractor-5kzh9\" (UID: \"c8e78e65-8e84-49f4-b376-e3d7576e4cfb\") " pod="openshift-insights/insights-runtime-extractor-5kzh9"
Jul 22 13:47:22.132352 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:22.132333    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-87d25"
Jul 22 13:47:22.144946 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:22.144925    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lxfbl"
Jul 22 13:47:22.161111 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:22.161086    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5kzh9"
Jul 22 13:47:22.355747 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:22.355714    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lxfbl"]
Jul 22 13:47:22.359004 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:47:22.358979    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c25882a_b837_4e4b_884c_be514d536810.slice/crio-3e950d6c9c33a1d1a0cfe9bf42b1e93ea7a304e65e93d9115629b647e23de088 WatchSource:0}: Error finding container 3e950d6c9c33a1d1a0cfe9bf42b1e93ea7a304e65e93d9115629b647e23de088: Status 404 returned error can't find the container with id 3e950d6c9c33a1d1a0cfe9bf42b1e93ea7a304e65e93d9115629b647e23de088
Jul 22 13:47:22.575059 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:22.575020    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-87d25"]
Jul 22 13:47:22.575678 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:22.575654    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5kzh9"]
Jul 22 13:47:22.576731 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:47:22.576703    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9b21c6d_4ef7_4362_9b59_54cba94ec969.slice/crio-e48b0e00a329ec2f27e61d2b228efcb24d3f34f642efe2a0e57d729cce72f8ed WatchSource:0}: Error finding container e48b0e00a329ec2f27e61d2b228efcb24d3f34f642efe2a0e57d729cce72f8ed: Status 404 returned error can't find the container with id e48b0e00a329ec2f27e61d2b228efcb24d3f34f642efe2a0e57d729cce72f8ed
Jul 22 13:47:22.577349 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:47:22.577280    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8e78e65_8e84_49f4_b376_e3d7576e4cfb.slice/crio-41ca132bd8a9a4760bcc75822317fbc74b2d87579f11e9a41ad92dfef5d8f912 WatchSource:0}: Error finding container 41ca132bd8a9a4760bcc75822317fbc74b2d87579f11e9a41ad92dfef5d8f912: Status 404 returned error can't find the container with id 41ca132bd8a9a4760bcc75822317fbc74b2d87579f11e9a41ad92dfef5d8f912
Jul 22 13:47:22.665340 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:22.665310    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-qtfwp"]
Jul 22 13:47:22.693968 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:22.693939    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-qtfwp"]
Jul 22 13:47:22.694149 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:22.694082    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-qtfwp"
Jul 22 13:47:22.696371 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:22.696350    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-h6nbz\""
Jul 22 13:47:22.696501 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:22.696373    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 22 13:47:22.696501 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:22.696350    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 22 13:47:22.820923 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:22.820888    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89pp2\" (UniqueName: \"kubernetes.io/projected/b39f28a3-7295-4632-a3f0-c0b8525cba01-kube-api-access-89pp2\") pod \"downloads-5bc67dcd46-qtfwp\" (UID: \"b39f28a3-7295-4632-a3f0-c0b8525cba01\") " pod="openshift-console/downloads-5bc67dcd46-qtfwp"
Jul 22 13:47:22.921787 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:22.921697    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89pp2\" (UniqueName: \"kubernetes.io/projected/b39f28a3-7295-4632-a3f0-c0b8525cba01-kube-api-access-89pp2\") pod \"downloads-5bc67dcd46-qtfwp\" (UID: \"b39f28a3-7295-4632-a3f0-c0b8525cba01\") " pod="openshift-console/downloads-5bc67dcd46-qtfwp"
Jul 22 13:47:22.929761 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:22.929729    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89pp2\" (UniqueName: \"kubernetes.io/projected/b39f28a3-7295-4632-a3f0-c0b8525cba01-kube-api-access-89pp2\") pod \"downloads-5bc67dcd46-qtfwp\" (UID: \"b39f28a3-7295-4632-a3f0-c0b8525cba01\") " pod="openshift-console/downloads-5bc67dcd46-qtfwp"
Jul 22 13:47:23.002938 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:23.002904    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-qtfwp"
Jul 22 13:47:23.162366 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:23.162316    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-qtfwp"]
Jul 22 13:47:23.166688 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:47:23.166656    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb39f28a3_7295_4632_a3f0_c0b8525cba01.slice/crio-04f26814c8ee1319ae0c88706ceb9331f1d374667acb4809a18bd00d97bb7660 WatchSource:0}: Error finding container 04f26814c8ee1319ae0c88706ceb9331f1d374667acb4809a18bd00d97bb7660: Status 404 returned error can't find the container with id 04f26814c8ee1319ae0c88706ceb9331f1d374667acb4809a18bd00d97bb7660
Jul 22 13:47:23.216885 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:23.216803    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-qtfwp" event={"ID":"b39f28a3-7295-4632-a3f0-c0b8525cba01","Type":"ContainerStarted","Data":"04f26814c8ee1319ae0c88706ceb9331f1d374667acb4809a18bd00d97bb7660"}
Jul 22 13:47:23.218335 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:23.218299    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lxfbl" event={"ID":"4c25882a-b837-4e4b-884c-be514d536810","Type":"ContainerStarted","Data":"3e950d6c9c33a1d1a0cfe9bf42b1e93ea7a304e65e93d9115629b647e23de088"}
Jul 22 13:47:23.220047 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:23.220013    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5kzh9" event={"ID":"c8e78e65-8e84-49f4-b376-e3d7576e4cfb","Type":"ContainerStarted","Data":"41ca132bd8a9a4760bcc75822317fbc74b2d87579f11e9a41ad92dfef5d8f912"}
Jul 22 13:47:23.221817 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:23.221788    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-87d25" event={"ID":"c9b21c6d-4ef7-4362-9b59-54cba94ec969","Type":"ContainerStarted","Data":"e48b0e00a329ec2f27e61d2b228efcb24d3f34f642efe2a0e57d729cce72f8ed"}
Jul 22 13:47:29.245434 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:29.245323    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-87d25" event={"ID":"c9b21c6d-4ef7-4362-9b59-54cba94ec969","Type":"ContainerStarted","Data":"434bb8ed0d89ebdcfd2ae0c3699c3dfb0c9ac06313cae60a8e739a1edc889b83"}
Jul 22 13:47:29.247711 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:29.247632    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lxfbl" event={"ID":"4c25882a-b837-4e4b-884c-be514d536810","Type":"ContainerStarted","Data":"da7993d09f8cb855e77bfec301feb697d9a8096345bbf6fcc5a0bb46e4a5cde2"}
Jul 22 13:47:30.172689 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:30.171417    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g9zr4"
Jul 22 13:47:30.213687 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:30.212578    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-lxfbl" podStartSLOduration=2.454605758 podStartE2EDuration="9.212314563s" totalImagesPullingTime="6.757708805s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:47:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:47:29.267879096 +0000 UTC m=+59.322655774" watchObservedRunningTime="2026-07-22 13:47:30.212314563 +0000 UTC m=+60.267091240"
Jul 22 13:47:30.255218 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:30.253611    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5kzh9" event={"ID":"c8e78e65-8e84-49f4-b376-e3d7576e4cfb","Type":"ContainerStarted","Data":"e6fba317f183bbdfe39b2e4b5907d8fc30561b26edad2de697f1f29b4b5dd417"}
Jul 22 13:47:30.257699 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:30.257613    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-87d25" event={"ID":"c9b21c6d-4ef7-4362-9b59-54cba94ec969","Type":"ContainerStarted","Data":"3cdb48cd8416820aa351dcb9adcd981f3d38f79416e388817fa06afb56dfd8c8"}
Jul 22 13:47:30.258486 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:30.258074    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-87d25"
Jul 22 13:47:30.441665 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:30.441468    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-87d25" podStartSLOduration=2.902119803 podStartE2EDuration="9.441444344s" totalImagesPullingTime="6.539324541s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:47:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:47:30.28379704 +0000 UTC m=+60.338573718" watchObservedRunningTime="2026-07-22 13:47:30.441444344 +0000 UTC m=+60.496221022"
Jul 22 13:47:30.442255 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:30.442226    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-2txv7"]
Jul 22 13:47:30.458488 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:30.458458    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-2txv7"]
Jul 22 13:47:30.458668 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:30.458617    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-2txv7"
Jul 22 13:47:30.462056 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:30.462030    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 22 13:47:30.463045 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:30.462304    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-22r7b\""
Jul 22 13:47:30.491355 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:30.491216    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/01a4e9d8-2df7-4ae4-b6ae-0960a2e30a4e-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-2txv7\" (UID: \"01a4e9d8-2df7-4ae4-b6ae-0960a2e30a4e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-2txv7"
Jul 22 13:47:30.592343 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:30.592304    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/01a4e9d8-2df7-4ae4-b6ae-0960a2e30a4e-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-2txv7\" (UID: \"01a4e9d8-2df7-4ae4-b6ae-0960a2e30a4e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-2txv7"
Jul 22 13:47:30.592547 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:47:30.592530    2571 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 22 13:47:30.592635 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:47:30.592611    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01a4e9d8-2df7-4ae4-b6ae-0960a2e30a4e-tls-certificates podName:01a4e9d8-2df7-4ae4-b6ae-0960a2e30a4e nodeName:}" failed. No retries permitted until 2026-07-22 13:47:31.092589842 +0000 UTC m=+61.147366511 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/01a4e9d8-2df7-4ae4-b6ae-0960a2e30a4e-tls-certificates") pod "prometheus-operator-admission-webhook-85574b5f49-2txv7" (UID: "01a4e9d8-2df7-4ae4-b6ae-0960a2e30a4e") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 22 13:47:31.095651 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:31.095612    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/01a4e9d8-2df7-4ae4-b6ae-0960a2e30a4e-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-2txv7\" (UID: \"01a4e9d8-2df7-4ae4-b6ae-0960a2e30a4e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-2txv7"
Jul 22 13:47:31.098576 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:31.098547    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/01a4e9d8-2df7-4ae4-b6ae-0960a2e30a4e-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-2txv7\" (UID: \"01a4e9d8-2df7-4ae4-b6ae-0960a2e30a4e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-2txv7"
Jul 22 13:47:31.374874 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:31.374785    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-22r7b\""
Jul 22 13:47:31.383734 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:31.383639    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-2txv7"
Jul 22 13:47:32.384253 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:32.384217    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7484dbf8d4-7h888"]
Jul 22 13:47:32.397656 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:32.397631    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7484dbf8d4-7h888"
Jul 22 13:47:32.397830 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:32.397757    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7484dbf8d4-7h888"]
Jul 22 13:47:32.400419 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:32.399971    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 22 13:47:32.400419 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:32.400026    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 22 13:47:32.400419 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:32.400025    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 22 13:47:32.400419 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:32.399971    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-lkhtn\""
Jul 22 13:47:32.400735 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:32.400480    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 22 13:47:32.400735 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:32.400631    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 22 13:47:32.406256 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:32.406217    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/12e5ca75-e395-4954-a751-256591b63cb4-oauth-serving-cert\") pod \"console-7484dbf8d4-7h888\" (UID: \"12e5ca75-e395-4954-a751-256591b63cb4\") " pod="openshift-console/console-7484dbf8d4-7h888"
Jul 22 13:47:32.406479 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:32.406444    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/12e5ca75-e395-4954-a751-256591b63cb4-console-serving-cert\") pod \"console-7484dbf8d4-7h888\" (UID: \"12e5ca75-e395-4954-a751-256591b63cb4\") " pod="openshift-console/console-7484dbf8d4-7h888"
Jul 22 13:47:32.406871 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:32.406562    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/12e5ca75-e395-4954-a751-256591b63cb4-service-ca\") pod \"console-7484dbf8d4-7h888\" (UID: \"12e5ca75-e395-4954-a751-256591b63cb4\") " pod="openshift-console/console-7484dbf8d4-7h888"
Jul 22 13:47:32.406871 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:32.406620    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsqc6\" (UniqueName: \"kubernetes.io/projected/12e5ca75-e395-4954-a751-256591b63cb4-kube-api-access-nsqc6\") pod \"console-7484dbf8d4-7h888\" (UID: \"12e5ca75-e395-4954-a751-256591b63cb4\") " pod="openshift-console/console-7484dbf8d4-7h888"
Jul 22 13:47:32.406871 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:32.406770    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/12e5ca75-e395-4954-a751-256591b63cb4-console-oauth-config\") pod \"console-7484dbf8d4-7h888\" (UID: \"12e5ca75-e395-4954-a751-256591b63cb4\") " pod="openshift-console/console-7484dbf8d4-7h888"
Jul 22 13:47:32.406871 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:32.406856    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/12e5ca75-e395-4954-a751-256591b63cb4-console-config\") pod \"console-7484dbf8d4-7h888\" (UID: \"12e5ca75-e395-4954-a751-256591b63cb4\") " pod="openshift-console/console-7484dbf8d4-7h888"
Jul 22 13:47:32.507384 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:32.507349    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/12e5ca75-e395-4954-a751-256591b63cb4-oauth-serving-cert\") pod \"console-7484dbf8d4-7h888\" (UID: \"12e5ca75-e395-4954-a751-256591b63cb4\") " pod="openshift-console/console-7484dbf8d4-7h888"
Jul 22 13:47:32.507384 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:32.507392    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/12e5ca75-e395-4954-a751-256591b63cb4-console-serving-cert\") pod \"console-7484dbf8d4-7h888\" (UID: \"12e5ca75-e395-4954-a751-256591b63cb4\") " pod="openshift-console/console-7484dbf8d4-7h888"
Jul 22 13:47:32.507634 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:32.507456    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/12e5ca75-e395-4954-a751-256591b63cb4-service-ca\") pod \"console-7484dbf8d4-7h888\" (UID: \"12e5ca75-e395-4954-a751-256591b63cb4\") " pod="openshift-console/console-7484dbf8d4-7h888"
Jul 22 13:47:32.507634 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:32.507485    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsqc6\" (UniqueName: \"kubernetes.io/projected/12e5ca75-e395-4954-a751-256591b63cb4-kube-api-access-nsqc6\") pod \"console-7484dbf8d4-7h888\" (UID: \"12e5ca75-e395-4954-a751-256591b63cb4\") " pod="openshift-console/console-7484dbf8d4-7h888"
Jul 22 13:47:32.507634 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:32.507564    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/12e5ca75-e395-4954-a751-256591b63cb4-console-oauth-config\") pod \"console-7484dbf8d4-7h888\" (UID: \"12e5ca75-e395-4954-a751-256591b63cb4\") " pod="openshift-console/console-7484dbf8d4-7h888"
Jul 22 13:47:32.507634 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:32.507614    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/12e5ca75-e395-4954-a751-256591b63cb4-console-config\") pod \"console-7484dbf8d4-7h888\" (UID: \"12e5ca75-e395-4954-a751-256591b63cb4\") " pod="openshift-console/console-7484dbf8d4-7h888"
Jul 22 13:47:32.508179 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:32.508152    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/12e5ca75-e395-4954-a751-256591b63cb4-oauth-serving-cert\") pod \"console-7484dbf8d4-7h888\" (UID: \"12e5ca75-e395-4954-a751-256591b63cb4\") " pod="openshift-console/console-7484dbf8d4-7h888"
Jul 22 13:47:32.508680 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:32.508652    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/12e5ca75-e395-4954-a751-256591b63cb4-service-ca\") pod \"console-7484dbf8d4-7h888\" (UID: \"12e5ca75-e395-4954-a751-256591b63cb4\") " pod="openshift-console/console-7484dbf8d4-7h888"
Jul 22 13:47:32.508942 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:32.508891    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/12e5ca75-e395-4954-a751-256591b63cb4-console-config\") pod \"console-7484dbf8d4-7h888\" (UID: \"12e5ca75-e395-4954-a751-256591b63cb4\") " pod="openshift-console/console-7484dbf8d4-7h888"
Jul 22 13:47:32.510530 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:32.510497    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/12e5ca75-e395-4954-a751-256591b63cb4-console-serving-cert\") pod \"console-7484dbf8d4-7h888\" (UID: \"12e5ca75-e395-4954-a751-256591b63cb4\") " pod="openshift-console/console-7484dbf8d4-7h888"
Jul 22 13:47:32.511007 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:32.510966    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/12e5ca75-e395-4954-a751-256591b63cb4-console-oauth-config\") pod \"console-7484dbf8d4-7h888\" (UID: \"12e5ca75-e395-4954-a751-256591b63cb4\") " pod="openshift-console/console-7484dbf8d4-7h888"
Jul 22 13:47:32.516968 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:32.516920    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsqc6\" (UniqueName: \"kubernetes.io/projected/12e5ca75-e395-4954-a751-256591b63cb4-kube-api-access-nsqc6\") pod \"console-7484dbf8d4-7h888\" (UID: \"12e5ca75-e395-4954-a751-256591b63cb4\") " pod="openshift-console/console-7484dbf8d4-7h888"
Jul 22 13:47:32.709835 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:32.709751    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7484dbf8d4-7h888"
Jul 22 13:47:33.413348 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:33.413305    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7484dbf8d4-7h888"]
Jul 22 13:47:33.416777 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:47:33.416747    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12e5ca75_e395_4954_a751_256591b63cb4.slice/crio-15897efeb94eb6a894b6674a827f62f9f3753716b0858b8ba32df5c023c3c4d4 WatchSource:0}: Error finding container 15897efeb94eb6a894b6674a827f62f9f3753716b0858b8ba32df5c023c3c4d4: Status 404 returned error can't find the container with id 15897efeb94eb6a894b6674a827f62f9f3753716b0858b8ba32df5c023c3c4d4
Jul 22 13:47:33.430867 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:33.430841    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-2txv7"]
Jul 22 13:47:33.434016 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:47:33.433989    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01a4e9d8_2df7_4ae4_b6ae_0960a2e30a4e.slice/crio-c98a0e580aed7925f2a6340fbef53f53a3b64e6041a4c1bb2570fd9861901886 WatchSource:0}: Error finding container c98a0e580aed7925f2a6340fbef53f53a3b64e6041a4c1bb2570fd9861901886: Status 404 returned error can't find the container with id c98a0e580aed7925f2a6340fbef53f53a3b64e6041a4c1bb2570fd9861901886
Jul 22 13:47:34.273874 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:34.273762    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5kzh9" event={"ID":"c8e78e65-8e84-49f4-b376-e3d7576e4cfb","Type":"ContainerStarted","Data":"fa234f516478203b9e6e211bdde1cbd03ef4c832d1504b7ed856f356828381aa"}
Jul 22 13:47:34.275662 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:34.275601    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-2txv7" event={"ID":"01a4e9d8-2df7-4ae4-b6ae-0960a2e30a4e","Type":"ContainerStarted","Data":"c98a0e580aed7925f2a6340fbef53f53a3b64e6041a4c1bb2570fd9861901886"}
Jul 22 13:47:34.277256 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:34.277202    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7484dbf8d4-7h888" event={"ID":"12e5ca75-e395-4954-a751-256591b63cb4","Type":"ContainerStarted","Data":"15897efeb94eb6a894b6674a827f62f9f3753716b0858b8ba32df5c023c3c4d4"}
Jul 22 13:47:35.283331 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:35.283290    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-2txv7" event={"ID":"01a4e9d8-2df7-4ae4-b6ae-0960a2e30a4e","Type":"ContainerStarted","Data":"ab5cd1900750d7041958eece93cf8fecc9e710ad72b8f79768ac4d898fd613bd"}
Jul 22 13:47:35.284074 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:35.284017    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-2txv7"
Jul 22 13:47:35.290281 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:35.290256    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-2txv7"
Jul 22 13:47:35.299716 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:35.299668    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-2txv7" podStartSLOduration=4.127148254 podStartE2EDuration="5.299652458s" totalImagesPullingTime="1.172504204s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:47:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:47:35.299035308 +0000 UTC m=+65.353811989" watchObservedRunningTime="2026-07-22 13:47:35.299652458 +0000 UTC m=+65.354429113"
Jul 22 13:47:35.523577 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:35.523360    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-s9795"]
Jul 22 13:47:35.526102 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:35.526068    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-s9795"
Jul 22 13:47:35.528617 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:35.528590    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 22 13:47:35.528937 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:35.528914    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 22 13:47:35.529056 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:35.528936    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 22 13:47:35.529056 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:35.529007    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 22 13:47:35.529154 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:35.529140    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 22 13:47:35.529207 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:35.529140    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-r8lxb\""
Jul 22 13:47:35.537654 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:35.537584    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-s9795"]
Jul 22 13:47:35.636117 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:35.635494    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f98c3223-5fb5-4366-98ba-2fe5d046a496-original-pull-secret\") pod \"global-pull-secret-syncer-2mjnn\" (UID: \"f98c3223-5fb5-4366-98ba-2fe5d046a496\") " pod="kube-system/global-pull-secret-syncer-2mjnn"
Jul 22 13:47:35.636117 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:35.635584    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/03c6e61c-b09c-4e49-8e27-350275208260-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-s9795\" (UID: \"03c6e61c-b09c-4e49-8e27-350275208260\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-s9795"
Jul 22 13:47:35.636117 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:35.635616    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/03c6e61c-b09c-4e49-8e27-350275208260-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-s9795\" (UID: \"03c6e61c-b09c-4e49-8e27-350275208260\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-s9795"
Jul 22 13:47:35.636117 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:35.635648    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rrjr\" (UniqueName: \"kubernetes.io/projected/03c6e61c-b09c-4e49-8e27-350275208260-kube-api-access-9rrjr\") pod \"prometheus-operator-5945b5cfd-s9795\" (UID: \"03c6e61c-b09c-4e49-8e27-350275208260\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-s9795"
Jul 22 13:47:35.636117 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:35.635700    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/03c6e61c-b09c-4e49-8e27-350275208260-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-s9795\" (UID: \"03c6e61c-b09c-4e49-8e27-350275208260\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-s9795"
Jul 22 13:47:35.638366 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:35.638186    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 22 13:47:35.649153 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:35.649119    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f98c3223-5fb5-4366-98ba-2fe5d046a496-original-pull-secret\") pod \"global-pull-secret-syncer-2mjnn\" (UID: \"f98c3223-5fb5-4366-98ba-2fe5d046a496\") " pod="kube-system/global-pull-secret-syncer-2mjnn"
Jul 22 13:47:35.718368 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:35.718298    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2mjnn"
Jul 22 13:47:35.736699 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:35.736663    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/03c6e61c-b09c-4e49-8e27-350275208260-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-s9795\" (UID: \"03c6e61c-b09c-4e49-8e27-350275208260\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-s9795"
Jul 22 13:47:35.736851 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:35.736740    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fd1bdec0-2890-4b8e-8be8-521df53174ac-metrics-certs\") pod \"network-metrics-daemon-tjsf5\" (UID: \"fd1bdec0-2890-4b8e-8be8-521df53174ac\") " pod="openshift-multus/network-metrics-daemon-tjsf5"
Jul 22 13:47:35.736851 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:35.736787    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/03c6e61c-b09c-4e49-8e27-350275208260-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-s9795\" (UID: \"03c6e61c-b09c-4e49-8e27-350275208260\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-s9795"
Jul 22 13:47:35.736851 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:35.736817    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/03c6e61c-b09c-4e49-8e27-350275208260-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-s9795\" (UID: \"03c6e61c-b09c-4e49-8e27-350275208260\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-s9795"
Jul 22 13:47:35.736851 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:35.736840    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rrjr\" (UniqueName: \"kubernetes.io/projected/03c6e61c-b09c-4e49-8e27-350275208260-kube-api-access-9rrjr\") pod \"prometheus-operator-5945b5cfd-s9795\" (UID: \"03c6e61c-b09c-4e49-8e27-350275208260\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-s9795"
Jul 22 13:47:35.737055 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:47:35.737027    2571 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 22 13:47:35.737107 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:47:35.737093    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03c6e61c-b09c-4e49-8e27-350275208260-prometheus-operator-tls podName:03c6e61c-b09c-4e49-8e27-350275208260 nodeName:}" failed. No retries permitted until 2026-07-22 13:47:36.237077904 +0000 UTC m=+66.291854558 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/03c6e61c-b09c-4e49-8e27-350275208260-prometheus-operator-tls") pod "prometheus-operator-5945b5cfd-s9795" (UID: "03c6e61c-b09c-4e49-8e27-350275208260") : secret "prometheus-operator-tls" not found
Jul 22 13:47:35.737953 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:35.737900    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/03c6e61c-b09c-4e49-8e27-350275208260-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-s9795\" (UID: \"03c6e61c-b09c-4e49-8e27-350275208260\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-s9795"
Jul 22 13:47:35.739298 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:35.739118    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 22 13:47:35.740183 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:35.740155    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/03c6e61c-b09c-4e49-8e27-350275208260-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-s9795\" (UID: \"03c6e61c-b09c-4e49-8e27-350275208260\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-s9795"
Jul 22 13:47:35.751950 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:35.751895    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rrjr\" (UniqueName: \"kubernetes.io/projected/03c6e61c-b09c-4e49-8e27-350275208260-kube-api-access-9rrjr\") pod \"prometheus-operator-5945b5cfd-s9795\" (UID: \"03c6e61c-b09c-4e49-8e27-350275208260\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-s9795"
Jul 22 13:47:35.752950 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:35.752924    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fd1bdec0-2890-4b8e-8be8-521df53174ac-metrics-certs\") pod \"network-metrics-daemon-tjsf5\" (UID: \"fd1bdec0-2890-4b8e-8be8-521df53174ac\") " pod="openshift-multus/network-metrics-daemon-tjsf5"
Jul 22 13:47:35.837657 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:35.837617    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7vjg\" (UniqueName: \"kubernetes.io/projected/a671fc06-4688-47cc-a538-79cddc136f82-kube-api-access-k7vjg\") pod \"network-check-target-sl64w\" (UID: \"a671fc06-4688-47cc-a538-79cddc136f82\") " pod="openshift-network-diagnostics/network-check-target-sl64w"
Jul 22 13:47:35.840016 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:35.839988    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 22 13:47:35.850624 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:35.850596    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 22 13:47:35.866208 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:35.866166    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7vjg\" (UniqueName: \"kubernetes.io/projected/a671fc06-4688-47cc-a538-79cddc136f82-kube-api-access-k7vjg\") pod \"network-check-target-sl64w\" (UID: \"a671fc06-4688-47cc-a538-79cddc136f82\") " pod="openshift-network-diagnostics/network-check-target-sl64w"
Jul 22 13:47:35.917153 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:35.917124    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-l6npf\""
Jul 22 13:47:35.925563 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:35.925531    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sl64w"
Jul 22 13:47:36.016636 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:36.016604    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-phx9h\""
Jul 22 13:47:36.024494 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:36.024463    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tjsf5"
Jul 22 13:47:36.241768 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:36.241684    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/03c6e61c-b09c-4e49-8e27-350275208260-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-s9795\" (UID: \"03c6e61c-b09c-4e49-8e27-350275208260\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-s9795"
Jul 22 13:47:36.244649 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:36.244619    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/03c6e61c-b09c-4e49-8e27-350275208260-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-s9795\" (UID: \"03c6e61c-b09c-4e49-8e27-350275208260\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-s9795"
Jul 22 13:47:36.441513 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:36.441473    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-s9795"
Jul 22 13:47:40.263860 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:40.263831    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-87d25"
Jul 22 13:47:40.563185 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:40.563156    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7c99b54b5b-lfhxt"]
Jul 22 13:47:40.568692 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:40.568664    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c99b54b5b-lfhxt"
Jul 22 13:47:40.577082 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:40.577056    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 22 13:47:40.577542 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:40.577509    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c99b54b5b-lfhxt"]
Jul 22 13:47:40.672740 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:40.672700    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bcd89420-cba5-4b2c-bdae-6e2e156fc787-console-oauth-config\") pod \"console-7c99b54b5b-lfhxt\" (UID: \"bcd89420-cba5-4b2c-bdae-6e2e156fc787\") " pod="openshift-console/console-7c99b54b5b-lfhxt"
Jul 22 13:47:40.672916 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:40.672752    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hp5s8\" (UniqueName: \"kubernetes.io/projected/bcd89420-cba5-4b2c-bdae-6e2e156fc787-kube-api-access-hp5s8\") pod \"console-7c99b54b5b-lfhxt\" (UID: \"bcd89420-cba5-4b2c-bdae-6e2e156fc787\") " pod="openshift-console/console-7c99b54b5b-lfhxt"
Jul 22 13:47:40.672916 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:40.672786    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bcd89420-cba5-4b2c-bdae-6e2e156fc787-service-ca\") pod \"console-7c99b54b5b-lfhxt\" (UID: \"bcd89420-cba5-4b2c-bdae-6e2e156fc787\") " pod="openshift-console/console-7c99b54b5b-lfhxt"
Jul 22 13:47:40.672916 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:40.672821    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bcd89420-cba5-4b2c-bdae-6e2e156fc787-oauth-serving-cert\") pod \"console-7c99b54b5b-lfhxt\" (UID: \"bcd89420-cba5-4b2c-bdae-6e2e156fc787\") " pod="openshift-console/console-7c99b54b5b-lfhxt"
Jul 22 13:47:40.672916 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:40.672840    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bcd89420-cba5-4b2c-bdae-6e2e156fc787-console-serving-cert\") pod \"console-7c99b54b5b-lfhxt\" (UID: \"bcd89420-cba5-4b2c-bdae-6e2e156fc787\") " pod="openshift-console/console-7c99b54b5b-lfhxt"
Jul 22 13:47:40.672916 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:40.672896    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bcd89420-cba5-4b2c-bdae-6e2e156fc787-console-config\") pod \"console-7c99b54b5b-lfhxt\" (UID: \"bcd89420-cba5-4b2c-bdae-6e2e156fc787\") " pod="openshift-console/console-7c99b54b5b-lfhxt"
Jul 22 13:47:40.672916 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:40.672911    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bcd89420-cba5-4b2c-bdae-6e2e156fc787-trusted-ca-bundle\") pod \"console-7c99b54b5b-lfhxt\" (UID: \"bcd89420-cba5-4b2c-bdae-6e2e156fc787\") " pod="openshift-console/console-7c99b54b5b-lfhxt"
Jul 22 13:47:40.773874 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:40.773831    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hp5s8\" (UniqueName: \"kubernetes.io/projected/bcd89420-cba5-4b2c-bdae-6e2e156fc787-kube-api-access-hp5s8\") pod \"console-7c99b54b5b-lfhxt\" (UID: \"bcd89420-cba5-4b2c-bdae-6e2e156fc787\") " pod="openshift-console/console-7c99b54b5b-lfhxt"
Jul 22 13:47:40.773874 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:40.773882    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bcd89420-cba5-4b2c-bdae-6e2e156fc787-service-ca\") pod \"console-7c99b54b5b-lfhxt\" (UID: \"bcd89420-cba5-4b2c-bdae-6e2e156fc787\") " pod="openshift-console/console-7c99b54b5b-lfhxt"
Jul 22 13:47:40.774128 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:40.773920    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bcd89420-cba5-4b2c-bdae-6e2e156fc787-oauth-serving-cert\") pod \"console-7c99b54b5b-lfhxt\" (UID: \"bcd89420-cba5-4b2c-bdae-6e2e156fc787\") " pod="openshift-console/console-7c99b54b5b-lfhxt"
Jul 22 13:47:40.774128 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:40.773941    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bcd89420-cba5-4b2c-bdae-6e2e156fc787-console-serving-cert\") pod \"console-7c99b54b5b-lfhxt\" (UID: \"bcd89420-cba5-4b2c-bdae-6e2e156fc787\") " pod="openshift-console/console-7c99b54b5b-lfhxt"
Jul 22 13:47:40.774128 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:40.773976    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bcd89420-cba5-4b2c-bdae-6e2e156fc787-console-config\") pod \"console-7c99b54b5b-lfhxt\" (UID: \"bcd89420-cba5-4b2c-bdae-6e2e156fc787\") " pod="openshift-console/console-7c99b54b5b-lfhxt"
Jul 22 13:47:40.774128 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:40.774000    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bcd89420-cba5-4b2c-bdae-6e2e156fc787-trusted-ca-bundle\") pod \"console-7c99b54b5b-lfhxt\" (UID: \"bcd89420-cba5-4b2c-bdae-6e2e156fc787\") " pod="openshift-console/console-7c99b54b5b-lfhxt"
Jul 22 13:47:40.774301 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:40.774251    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bcd89420-cba5-4b2c-bdae-6e2e156fc787-console-oauth-config\") pod \"console-7c99b54b5b-lfhxt\" (UID: \"bcd89420-cba5-4b2c-bdae-6e2e156fc787\") " pod="openshift-console/console-7c99b54b5b-lfhxt"
Jul 22 13:47:40.774851 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:40.774801    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bcd89420-cba5-4b2c-bdae-6e2e156fc787-service-ca\") pod \"console-7c99b54b5b-lfhxt\" (UID: \"bcd89420-cba5-4b2c-bdae-6e2e156fc787\") " pod="openshift-console/console-7c99b54b5b-lfhxt"
Jul 22 13:47:40.774977 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:40.774899    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bcd89420-cba5-4b2c-bdae-6e2e156fc787-console-config\") pod \"console-7c99b54b5b-lfhxt\" (UID: \"bcd89420-cba5-4b2c-bdae-6e2e156fc787\") " pod="openshift-console/console-7c99b54b5b-lfhxt"
Jul 22 13:47:40.774977 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:40.774899    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bcd89420-cba5-4b2c-bdae-6e2e156fc787-oauth-serving-cert\") pod \"console-7c99b54b5b-lfhxt\" (UID: \"bcd89420-cba5-4b2c-bdae-6e2e156fc787\") " pod="openshift-console/console-7c99b54b5b-lfhxt"
Jul 22 13:47:40.775119 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:40.775102    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bcd89420-cba5-4b2c-bdae-6e2e156fc787-trusted-ca-bundle\") pod \"console-7c99b54b5b-lfhxt\" (UID: \"bcd89420-cba5-4b2c-bdae-6e2e156fc787\") " pod="openshift-console/console-7c99b54b5b-lfhxt"
Jul 22 13:47:40.776812 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:40.776788    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bcd89420-cba5-4b2c-bdae-6e2e156fc787-console-serving-cert\") pod \"console-7c99b54b5b-lfhxt\" (UID: \"bcd89420-cba5-4b2c-bdae-6e2e156fc787\") " pod="openshift-console/console-7c99b54b5b-lfhxt"
Jul 22 13:47:40.777092 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:40.777069    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bcd89420-cba5-4b2c-bdae-6e2e156fc787-console-oauth-config\") pod \"console-7c99b54b5b-lfhxt\" (UID: \"bcd89420-cba5-4b2c-bdae-6e2e156fc787\") " pod="openshift-console/console-7c99b54b5b-lfhxt"
Jul 22 13:47:40.784518 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:40.784490    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hp5s8\" (UniqueName: \"kubernetes.io/projected/bcd89420-cba5-4b2c-bdae-6e2e156fc787-kube-api-access-hp5s8\") pod \"console-7c99b54b5b-lfhxt\" (UID: \"bcd89420-cba5-4b2c-bdae-6e2e156fc787\") " pod="openshift-console/console-7c99b54b5b-lfhxt"
Jul 22 13:47:40.880870 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:40.880778    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c99b54b5b-lfhxt"
Jul 22 13:47:46.331273 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:46.330492    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7484dbf8d4-7h888" event={"ID":"12e5ca75-e395-4954-a751-256591b63cb4","Type":"ContainerStarted","Data":"af39bcdd87f351ef5bd6aa122f901424be4b415d76d3c2e0e932ea51a7d734af"}
Jul 22 13:47:46.364045 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:46.363846    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-sl64w"]
Jul 22 13:47:46.371705 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:47:46.371653    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda671fc06_4688_47cc_a538_79cddc136f82.slice/crio-0cd8ef0e0cef2ec50161d6d852e857c8bf0f19ad0ac0dc1a9b1e5882a28c2f31 WatchSource:0}: Error finding container 0cd8ef0e0cef2ec50161d6d852e857c8bf0f19ad0ac0dc1a9b1e5882a28c2f31: Status 404 returned error can't find the container with id 0cd8ef0e0cef2ec50161d6d852e857c8bf0f19ad0ac0dc1a9b1e5882a28c2f31
Jul 22 13:47:46.425441 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:46.425272    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c99b54b5b-lfhxt"]
Jul 22 13:47:46.427803 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:47:46.427776    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcd89420_cba5_4b2c_bdae_6e2e156fc787.slice/crio-0600080f8c8cb7d33a4e6ef4590642a547f2f745ca114ea64a98efb2bd013179 WatchSource:0}: Error finding container 0600080f8c8cb7d33a4e6ef4590642a547f2f745ca114ea64a98efb2bd013179: Status 404 returned error can't find the container with id 0600080f8c8cb7d33a4e6ef4590642a547f2f745ca114ea64a98efb2bd013179
Jul 22 13:47:46.589089 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:46.588987    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tjsf5"]
Jul 22 13:47:46.589902 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:46.589876    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-s9795"]
Jul 22 13:47:46.590758 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:46.590738    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2mjnn"]
Jul 22 13:47:46.592414 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:47:46.592364    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03c6e61c_b09c_4e49_8e27_350275208260.slice/crio-53c5e6ddaa5a27a67b10ea163ac8150b6a84f0dd7546809f9302518d0c65b79d WatchSource:0}: Error finding container 53c5e6ddaa5a27a67b10ea163ac8150b6a84f0dd7546809f9302518d0c65b79d: Status 404 returned error can't find the container with id 53c5e6ddaa5a27a67b10ea163ac8150b6a84f0dd7546809f9302518d0c65b79d
Jul 22 13:47:46.593226 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:47:46.593149    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd1bdec0_2890_4b8e_8be8_521df53174ac.slice/crio-0a4e909b2bf27e5c8fe9b5d7787bebd87a627e23fef6c8605150a47fa9ae8524 WatchSource:0}: Error finding container 0a4e909b2bf27e5c8fe9b5d7787bebd87a627e23fef6c8605150a47fa9ae8524: Status 404 returned error can't find the container with id 0a4e909b2bf27e5c8fe9b5d7787bebd87a627e23fef6c8605150a47fa9ae8524
Jul 22 13:47:46.593832 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:47:46.593813    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf98c3223_5fb5_4366_98ba_2fe5d046a496.slice/crio-74b38776e409f68dda4092fd15b1dfee7960b81cf5723e236d791ec185033284 WatchSource:0}: Error finding container 74b38776e409f68dda4092fd15b1dfee7960b81cf5723e236d791ec185033284: Status 404 returned error can't find the container with id 74b38776e409f68dda4092fd15b1dfee7960b81cf5723e236d791ec185033284
Jul 22 13:47:47.338457 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:47.338339    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tjsf5" event={"ID":"fd1bdec0-2890-4b8e-8be8-521df53174ac","Type":"ContainerStarted","Data":"0a4e909b2bf27e5c8fe9b5d7787bebd87a627e23fef6c8605150a47fa9ae8524"}
Jul 22 13:47:47.340737 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:47.340660    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2mjnn" event={"ID":"f98c3223-5fb5-4366-98ba-2fe5d046a496","Type":"ContainerStarted","Data":"74b38776e409f68dda4092fd15b1dfee7960b81cf5723e236d791ec185033284"}
Jul 22 13:47:47.347933 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:47.347899    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-s9795" event={"ID":"03c6e61c-b09c-4e49-8e27-350275208260","Type":"ContainerStarted","Data":"53c5e6ddaa5a27a67b10ea163ac8150b6a84f0dd7546809f9302518d0c65b79d"}
Jul 22 13:47:47.353574 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:47.353032    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c99b54b5b-lfhxt" event={"ID":"bcd89420-cba5-4b2c-bdae-6e2e156fc787","Type":"ContainerStarted","Data":"587133384fcb9abf8f17061952eb81884eb7b741fc9b3bfb01060dbd31d63816"}
Jul 22 13:47:47.353574 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:47.353090    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c99b54b5b-lfhxt" event={"ID":"bcd89420-cba5-4b2c-bdae-6e2e156fc787","Type":"ContainerStarted","Data":"0600080f8c8cb7d33a4e6ef4590642a547f2f745ca114ea64a98efb2bd013179"}
Jul 22 13:47:47.358666 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:47.358428    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-qtfwp" event={"ID":"b39f28a3-7295-4632-a3f0-c0b8525cba01","Type":"ContainerStarted","Data":"73c1b5b791ac60f48d1bad0428648c5fa5ae37d5c2cc6a1d37f07d255c0d0dd5"}
Jul 22 13:47:47.359020 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:47.358975    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-qtfwp"
Jul 22 13:47:47.361316 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:47.361255    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-sl64w" event={"ID":"a671fc06-4688-47cc-a538-79cddc136f82","Type":"ContainerStarted","Data":"0cd8ef0e0cef2ec50161d6d852e857c8bf0f19ad0ac0dc1a9b1e5882a28c2f31"}
Jul 22 13:47:47.366470 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:47.366442    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5kzh9" event={"ID":"c8e78e65-8e84-49f4-b376-e3d7576e4cfb","Type":"ContainerStarted","Data":"1eef51af392634d4130267d4f011d4d04646c3a702b55adfe21e30868cc4296d"}
Jul 22 13:47:47.373335 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:47.373279    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-qtfwp"
Jul 22 13:47:47.374336 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:47.373710    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7c99b54b5b-lfhxt" podStartSLOduration=7.373692284 podStartE2EDuration="7.373692284s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:47:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:47:47.372879788 +0000 UTC m=+77.427656478" watchObservedRunningTime="2026-07-22 13:47:47.373692284 +0000 UTC m=+77.428468961"
Jul 22 13:47:47.425425 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:47.423942    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-5kzh9" podStartSLOduration=3.026328974 podStartE2EDuration="26.423918179s" totalImagesPullingTime="23.397589205s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 13:47:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:47:47.393133338 +0000 UTC m=+77.447910016" watchObservedRunningTime="2026-07-22 13:47:47.423918179 +0000 UTC m=+77.478694836"
Jul 22 13:47:47.449774 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:47.449573    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7484dbf8d4-7h888" podStartSLOduration=2.701245548 podStartE2EDuration="15.449552509s" totalImagesPullingTime="12.748306961s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:47:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:47:47.448741326 +0000 UTC m=+77.503518004" watchObservedRunningTime="2026-07-22 13:47:47.449552509 +0000 UTC m=+77.504329197"
Jul 22 13:47:47.450399 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:47.450090    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-qtfwp" podStartSLOduration=2.457210456 podStartE2EDuration="25.450074443s" totalImagesPullingTime="22.992863987s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:47:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:47:47.429238878 +0000 UTC m=+77.484015557" watchObservedRunningTime="2026-07-22 13:47:47.450074443 +0000 UTC m=+77.504851122"
Jul 22 13:47:50.881450 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:50.881363    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7c99b54b5b-lfhxt"
Jul 22 13:47:50.881450 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:50.881455    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7c99b54b5b-lfhxt"
Jul 22 13:47:50.892430 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:50.892308    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7c99b54b5b-lfhxt"
Jul 22 13:47:51.387157 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:51.387039    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tjsf5" event={"ID":"fd1bdec0-2890-4b8e-8be8-521df53174ac","Type":"ContainerStarted","Data":"ec2112aff41e0eb64b0b982b8484689b20c5b9f91f1015b8d75fa8e23d4c73b0"}
Jul 22 13:47:51.390036 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:51.389959    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-s9795" event={"ID":"03c6e61c-b09c-4e49-8e27-350275208260","Type":"ContainerStarted","Data":"417b32d2031aeab25f749319c76b7feba0023495a119fa23bb4aa74a3584b8f9"}
Jul 22 13:47:51.395254 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:51.395227    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7c99b54b5b-lfhxt"
Jul 22 13:47:51.444808 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:51.444762    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7484dbf8d4-7h888"]
Jul 22 13:47:52.710605 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:52.710476    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7484dbf8d4-7h888"
Jul 22 13:47:53.404138 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:53.404040    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-sl64w" event={"ID":"a671fc06-4688-47cc-a538-79cddc136f82","Type":"ContainerStarted","Data":"806ed880a71a26467bd13f06cd05b7af172b3becc4f0ff81205addfc2247ef49"}
Jul 22 13:47:53.404314 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:53.404144    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-sl64w"
Jul 22 13:47:53.406937 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:53.406902    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tjsf5" event={"ID":"fd1bdec0-2890-4b8e-8be8-521df53174ac","Type":"ContainerStarted","Data":"078afe7dbc5682d787469951b6747ffaced9a84c44dff22c85a6889bfec741da"}
Jul 22 13:47:53.408659 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:53.408626    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2mjnn" event={"ID":"f98c3223-5fb5-4366-98ba-2fe5d046a496","Type":"ContainerStarted","Data":"0ef7b5c0eb93df6a23f774b99a8f46e087bde83af8f255f1e52205c3e1f5ddbf"}
Jul 22 13:47:53.410894 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:53.410858    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-s9795" event={"ID":"03c6e61c-b09c-4e49-8e27-350275208260","Type":"ContainerStarted","Data":"89e418a41e23bbcbadc4cd77fe9dfd6c5cbbd9adf4337995815215919faaf49d"}
Jul 22 13:47:53.420822 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:53.420764    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-sl64w" podStartSLOduration=76.057005615 podStartE2EDuration="1m22.4207447s" totalImagesPullingTime="6.363739085s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:46:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:47:53.419753752 +0000 UTC m=+83.474530426" watchObservedRunningTime="2026-07-22 13:47:53.4207447 +0000 UTC m=+83.475521379"
Jul 22 13:47:53.436657 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:53.436593    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-tjsf5" podStartSLOduration=78.285095833 podStartE2EDuration="1m22.436569898s" totalImagesPullingTime="4.151474065s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:46:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:47:53.434919881 +0000 UTC m=+83.489696574" watchObservedRunningTime="2026-07-22 13:47:53.436569898 +0000 UTC m=+83.491346576"
Jul 22 13:47:53.450161 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:53.450093    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-2mjnn" podStartSLOduration=75.901022723 podStartE2EDuration="1m22.450075995s" totalImagesPullingTime="6.549053272s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 13:46:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:47:53.449890963 +0000 UTC m=+83.504667640" watchObservedRunningTime="2026-07-22 13:47:53.450075995 +0000 UTC m=+83.504852676"
Jul 22 13:47:53.468362 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:53.468304    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-s9795" podStartSLOduration=14.311419581 podStartE2EDuration="18.468284322s" totalImagesPullingTime="4.156864741s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:47:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:47:53.46803612 +0000 UTC m=+83.522812796" watchObservedRunningTime="2026-07-22 13:47:53.468284322 +0000 UTC m=+83.523060999"
Jul 22 13:47:54.860079 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:54.860040    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-4qzld"]
Jul 22 13:47:54.887932 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:54.887898    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-4qzld"]
Jul 22 13:47:54.888138 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:54.887952    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-nfm9n"]
Jul 22 13:47:54.888138 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:54.888052    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4qzld"
Jul 22 13:47:54.890195 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:54.890156    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 22 13:47:54.890195 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:54.890187    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 22 13:47:54.890386 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:54.890241    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-4sxxm\""
Jul 22 13:47:54.909868 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:54.909832    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5x2fw"]
Jul 22 13:47:54.910057 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:54.909959    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-nfm9n"
Jul 22 13:47:54.912048 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:54.912021    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 22 13:47:54.912234 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:54.912217    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 22 13:47:54.912310 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:54.912259    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-t9b9q\""
Jul 22 13:47:54.912564 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:54.912395    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 22 13:47:54.931062 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:54.931025    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-nfm9n"]
Jul 22 13:47:54.931255 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:54.931231    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5x2fw"
Jul 22 13:47:54.933636 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:54.933612    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 22 13:47:54.933790 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:54.933623    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 22 13:47:54.933910 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:54.933663    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 22 13:47:54.933910 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:54.933690    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-cmg6q\""
Jul 22 13:47:55.000338 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:55.000288    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e46d2550-e8cc-4cf9-95d8-e33f0a187d87-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-nfm9n\" (UID: \"e46d2550-e8cc-4cf9-95d8-e33f0a187d87\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-nfm9n"
Jul 22 13:47:55.000532 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:55.000354    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/503d6cac-907a-4386-88f6-be0aeab5f8c3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5x2fw\" (UID: \"503d6cac-907a-4386-88f6-be0aeab5f8c3\") " pod="openshift-monitoring/node-exporter-5x2fw"
Jul 22 13:47:55.000532 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:55.000384    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6003069e-d7f1-4ba5-a4aa-443d288f9a76-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-4qzld\" (UID: \"6003069e-d7f1-4ba5-a4aa-443d288f9a76\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4qzld"
Jul 22 13:47:55.000532 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:55.000426    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-248sx\" (UniqueName: \"kubernetes.io/projected/503d6cac-907a-4386-88f6-be0aeab5f8c3-kube-api-access-248sx\") pod \"node-exporter-5x2fw\" (UID: \"503d6cac-907a-4386-88f6-be0aeab5f8c3\") " pod="openshift-monitoring/node-exporter-5x2fw"
Jul 22 13:47:55.000532 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:55.000458    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/503d6cac-907a-4386-88f6-be0aeab5f8c3-node-exporter-wtmp\") pod \"node-exporter-5x2fw\" (UID: \"503d6cac-907a-4386-88f6-be0aeab5f8c3\") " pod="openshift-monitoring/node-exporter-5x2fw"
Jul 22 13:47:55.000532 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:55.000500    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/503d6cac-907a-4386-88f6-be0aeab5f8c3-root\") pod \"node-exporter-5x2fw\" (UID: \"503d6cac-907a-4386-88f6-be0aeab5f8c3\") " pod="openshift-monitoring/node-exporter-5x2fw"
Jul 22 13:47:55.000532 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:55.000529    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmv9l\" (UniqueName: \"kubernetes.io/projected/e46d2550-e8cc-4cf9-95d8-e33f0a187d87-kube-api-access-bmv9l\") pod \"kube-state-metrics-56c5594674-nfm9n\" (UID: \"e46d2550-e8cc-4cf9-95d8-e33f0a187d87\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-nfm9n"
Jul 22 13:47:55.000845 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:55.000553    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/503d6cac-907a-4386-88f6-be0aeab5f8c3-metrics-client-ca\") pod \"node-exporter-5x2fw\" (UID: \"503d6cac-907a-4386-88f6-be0aeab5f8c3\") " pod="openshift-monitoring/node-exporter-5x2fw"
Jul 22 13:47:55.000845 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:55.000579    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/503d6cac-907a-4386-88f6-be0aeab5f8c3-node-exporter-tls\") pod \"node-exporter-5x2fw\" (UID: \"503d6cac-907a-4386-88f6-be0aeab5f8c3\") " pod="openshift-monitoring/node-exporter-5x2fw"
Jul 22 13:47:55.000845 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:55.000608    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/503d6cac-907a-4386-88f6-be0aeab5f8c3-sys\") pod \"node-exporter-5x2fw\" (UID: \"503d6cac-907a-4386-88f6-be0aeab5f8c3\") " pod="openshift-monitoring/node-exporter-5x2fw"
Jul 22 13:47:55.000845 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:55.000684    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e46d2550-e8cc-4cf9-95d8-e33f0a187d87-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-nfm9n\" (UID: \"e46d2550-e8cc-4cf9-95d8-e33f0a187d87\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-nfm9n"
Jul 22 13:47:55.000845 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:55.000731    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/503d6cac-907a-4386-88f6-be0aeab5f8c3-node-exporter-accelerators-collector-config\") pod \"node-exporter-5x2fw\" (UID: \"503d6cac-907a-4386-88f6-be0aeab5f8c3\") " pod="openshift-monitoring/node-exporter-5x2fw"
Jul 22 13:47:55.000845 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:55.000777    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6003069e-d7f1-4ba5-a4aa-443d288f9a76-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-4qzld\" (UID: \"6003069e-d7f1-4ba5-a4aa-443d288f9a76\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4qzld"
Jul 22 13:47:55.000845 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:55.000802    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e46d2550-e8cc-4cf9-95d8-e33f0a187d87-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-nfm9n\" (UID: \"e46d2550-e8cc-4cf9-95d8-e33f0a187d87\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-nfm9n"
Jul 22 13:47:55.000845 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:55.000838    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68pqs\" (UniqueName: \"kubernetes.io/projected/6003069e-d7f1-4ba5-a4aa-443d288f9a76-kube-api-access-68pqs\") pod \"openshift-state-metrics-79f6958cdf-4qzld\" (UID: \"6003069e-d7f1-4ba5-a4aa-443d288f9a76\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4qzld"
Jul 22 13:47:55.001154 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:55.000872    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e46d2550-e8cc-4cf9-95d8-e33f0a187d87-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-nfm9n\" (UID: \"e46d2550-e8cc-4cf9-95d8-e33f0a187d87\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-nfm9n"
Jul 22 13:47:55.001154 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:55.000894    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/503d6cac-907a-4386-88f6-be0aeab5f8c3-node-exporter-textfile\") pod \"node-exporter-5x2fw\" (UID: \"503d6cac-907a-4386-88f6-be0aeab5f8c3\") " pod="openshift-monitoring/node-exporter-5x2fw"
Jul 22 13:47:55.001154 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:55.000947    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e46d2550-e8cc-4cf9-95d8-e33f0a187d87-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-nfm9n\" (UID: \"e46d2550-e8cc-4cf9-95d8-e33f0a187d87\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-nfm9n"
Jul 22 13:47:55.001154 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:55.000974    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6003069e-d7f1-4ba5-a4aa-443d288f9a76-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-4qzld\" (UID: \"6003069e-d7f1-4ba5-a4aa-443d288f9a76\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4qzld"
Jul 22 13:47:55.101961 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:55.101919    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e46d2550-e8cc-4cf9-95d8-e33f0a187d87-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-nfm9n\" (UID: \"e46d2550-e8cc-4cf9-95d8-e33f0a187d87\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-nfm9n"
Jul 22 13:47:55.102486 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:55.102453    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68pqs\" (UniqueName: \"kubernetes.io/projected/6003069e-d7f1-4ba5-a4aa-443d288f9a76-kube-api-access-68pqs\") pod \"openshift-state-metrics-79f6958cdf-4qzld\" (UID: \"6003069e-d7f1-4ba5-a4aa-443d288f9a76\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4qzld"
Jul 22 13:47:55.102829 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:55.102779    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e46d2550-e8cc-4cf9-95d8-e33f0a187d87-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-nfm9n\" (UID: \"e46d2550-e8cc-4cf9-95d8-e33f0a187d87\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-nfm9n"
Jul 22 13:47:55.102942 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:55.102843    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e46d2550-e8cc-4cf9-95d8-e33f0a187d87-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-nfm9n\" (UID: \"e46d2550-e8cc-4cf9-95d8-e33f0a187d87\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-nfm9n"
Jul 22 13:47:55.102942 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:55.102874    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/503d6cac-907a-4386-88f6-be0aeab5f8c3-node-exporter-textfile\") pod \"node-exporter-5x2fw\" (UID: \"503d6cac-907a-4386-88f6-be0aeab5f8c3\") " pod="openshift-monitoring/node-exporter-5x2fw"
Jul 22 13:47:55.102942 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:55.102910    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e46d2550-e8cc-4cf9-95d8-e33f0a187d87-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-nfm9n\" (UID: \"e46d2550-e8cc-4cf9-95d8-e33f0a187d87\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-nfm9n"
Jul 22 13:47:55.102942 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:55.102936    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6003069e-d7f1-4ba5-a4aa-443d288f9a76-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-4qzld\" (UID: \"6003069e-d7f1-4ba5-a4aa-443d288f9a76\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4qzld"
Jul 22 13:47:55.103146 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:55.102969    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e46d2550-e8cc-4cf9-95d8-e33f0a187d87-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-nfm9n\" (UID: \"e46d2550-e8cc-4cf9-95d8-e33f0a187d87\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-nfm9n"
Jul 22 13:47:55.103146 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:55.103003    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/503d6cac-907a-4386-88f6-be0aeab5f8c3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5x2fw\" (UID: \"503d6cac-907a-4386-88f6-be0aeab5f8c3\") " pod="openshift-monitoring/node-exporter-5x2fw"
Jul 22 13:47:55.103146 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:55.103038    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6003069e-d7f1-4ba5-a4aa-443d288f9a76-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-4qzld\" (UID: \"6003069e-d7f1-4ba5-a4aa-443d288f9a76\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4qzld"
Jul 22 13:47:55.103146 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:55.103062    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-248sx\" (UniqueName: \"kubernetes.io/projected/503d6cac-907a-4386-88f6-be0aeab5f8c3-kube-api-access-248sx\") pod \"node-exporter-5x2fw\" (UID: \"503d6cac-907a-4386-88f6-be0aeab5f8c3\") " pod="openshift-monitoring/node-exporter-5x2fw"
Jul 22 13:47:55.103146 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:55.103089    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/503d6cac-907a-4386-88f6-be0aeab5f8c3-node-exporter-wtmp\") pod \"node-exporter-5x2fw\" (UID: \"503d6cac-907a-4386-88f6-be0aeab5f8c3\") " pod="openshift-monitoring/node-exporter-5x2fw"
Jul 22 13:47:55.103146 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:55.103124    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/503d6cac-907a-4386-88f6-be0aeab5f8c3-root\") pod \"node-exporter-5x2fw\" (UID: \"503d6cac-907a-4386-88f6-be0aeab5f8c3\") " pod="openshift-monitoring/node-exporter-5x2fw"
Jul 22 13:47:55.103482 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:55.103153    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmv9l\" (UniqueName: \"kubernetes.io/projected/e46d2550-e8cc-4cf9-95d8-e33f0a187d87-kube-api-access-bmv9l\") pod \"kube-state-metrics-56c5594674-nfm9n\" (UID: \"e46d2550-e8cc-4cf9-95d8-e33f0a187d87\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-nfm9n"
Jul 22 13:47:55.103482 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:55.103178    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/503d6cac-907a-4386-88f6-be0aeab5f8c3-metrics-client-ca\") pod \"node-exporter-5x2fw\" (UID: \"503d6cac-907a-4386-88f6-be0aeab5f8c3\") " pod="openshift-monitoring/node-exporter-5x2fw"
Jul 22 13:47:55.103482 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:55.103205    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/503d6cac-907a-4386-88f6-be0aeab5f8c3-node-exporter-tls\") pod \"node-exporter-5x2fw\" (UID: \"503d6cac-907a-4386-88f6-be0aeab5f8c3\") " pod="openshift-monitoring/node-exporter-5x2fw"
Jul 22 13:47:55.103482 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:55.103236    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/503d6cac-907a-4386-88f6-be0aeab5f8c3-sys\") pod \"node-exporter-5x2fw\" (UID: \"503d6cac-907a-4386-88f6-be0aeab5f8c3\") " pod="openshift-monitoring/node-exporter-5x2fw"
Jul 22 13:47:55.103482 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:55.103246    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e46d2550-e8cc-4cf9-95d8-e33f0a187d87-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-nfm9n\" (UID: \"e46d2550-e8cc-4cf9-95d8-e33f0a187d87\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-nfm9n"
Jul 22 13:47:55.103482 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:55.103298    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e46d2550-e8cc-4cf9-95d8-e33f0a187d87-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-nfm9n\" (UID: \"e46d2550-e8cc-4cf9-95d8-e33f0a187d87\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-nfm9n"
Jul 22 13:47:55.103482 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:55.103312    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/503d6cac-907a-4386-88f6-be0aeab5f8c3-sys\") pod \"node-exporter-5x2fw\" (UID: \"503d6cac-907a-4386-88f6-be0aeab5f8c3\") " pod="openshift-monitoring/node-exporter-5x2fw"
Jul 22 13:47:55.103482 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:55.103327    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/503d6cac-907a-4386-88f6-be0aeab5f8c3-node-exporter-accelerators-collector-config\") pod \"node-exporter-5x2fw\" (UID: \"503d6cac-907a-4386-88f6-be0aeab5f8c3\") " pod="openshift-monitoring/node-exporter-5x2fw"
Jul 22 13:47:55.103482 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:55.103382    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6003069e-d7f1-4ba5-a4aa-443d288f9a76-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-4qzld\" (UID: \"6003069e-d7f1-4ba5-a4aa-443d288f9a76\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4qzld"
Jul 22 13:47:55.103942 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:55.103594    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/503d6cac-907a-4386-88f6-be0aeab5f8c3-node-exporter-wtmp\") pod \"node-exporter-5x2fw\" (UID: \"503d6cac-907a-4386-88f6-be0aeab5f8c3\") " pod="openshift-monitoring/node-exporter-5x2fw"
Jul 22 13:47:55.103942 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:55.103864    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/503d6cac-907a-4386-88f6-be0aeab5f8c3-root\") pod \"node-exporter-5x2fw\" (UID: \"503d6cac-907a-4386-88f6-be0aeab5f8c3\") " pod="openshift-monitoring/node-exporter-5x2fw"
Jul 22 13:47:55.104049 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:55.104026    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6003069e-d7f1-4ba5-a4aa-443d288f9a76-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-4qzld\" (UID: \"6003069e-d7f1-4ba5-a4aa-443d288f9a76\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4qzld"
Jul 22 13:47:55.104107 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:55.104065    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e46d2550-e8cc-4cf9-95d8-e33f0a187d87-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-nfm9n\" (UID: \"e46d2550-e8cc-4cf9-95d8-e33f0a187d87\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-nfm9n"
Jul 22 13:47:55.104158 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:47:55.104124    2571 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 22 13:47:55.104209 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:47:55.104195    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/503d6cac-907a-4386-88f6-be0aeab5f8c3-node-exporter-tls podName:503d6cac-907a-4386-88f6-be0aeab5f8c3 nodeName:}" failed. No retries permitted until 2026-07-22 13:47:55.60417551 +0000 UTC m=+85.658952168 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/503d6cac-907a-4386-88f6-be0aeab5f8c3-node-exporter-tls") pod "node-exporter-5x2fw" (UID: "503d6cac-907a-4386-88f6-be0aeab5f8c3") : secret "node-exporter-tls" not found
Jul 22 13:47:55.105041 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:47:55.104398    2571 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 22 13:47:55.105041 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:47:55.104491    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6003069e-d7f1-4ba5-a4aa-443d288f9a76-openshift-state-metrics-tls podName:6003069e-d7f1-4ba5-a4aa-443d288f9a76 nodeName:}" failed. No retries permitted until 2026-07-22 13:47:55.604474914 +0000 UTC m=+85.659251579 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/6003069e-d7f1-4ba5-a4aa-443d288f9a76-openshift-state-metrics-tls") pod "openshift-state-metrics-79f6958cdf-4qzld" (UID: "6003069e-d7f1-4ba5-a4aa-443d288f9a76") : secret "openshift-state-metrics-tls" not found
Jul 22 13:47:55.105041 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:55.104566    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/503d6cac-907a-4386-88f6-be0aeab5f8c3-metrics-client-ca\") pod \"node-exporter-5x2fw\" (UID: \"503d6cac-907a-4386-88f6-be0aeab5f8c3\") " pod="openshift-monitoring/node-exporter-5x2fw"
Jul 22 13:47:55.105041 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:55.104886    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/503d6cac-907a-4386-88f6-be0aeab5f8c3-node-exporter-accelerators-collector-config\") pod \"node-exporter-5x2fw\" (UID: \"503d6cac-907a-4386-88f6-be0aeab5f8c3\") " pod="openshift-monitoring/node-exporter-5x2fw"
Jul 22 13:47:55.105356 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:55.105070    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/503d6cac-907a-4386-88f6-be0aeab5f8c3-node-exporter-textfile\") pod \"node-exporter-5x2fw\" (UID: \"503d6cac-907a-4386-88f6-be0aeab5f8c3\") " pod="openshift-monitoring/node-exporter-5x2fw"
Jul 22 13:47:55.107244 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:55.107017    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6003069e-d7f1-4ba5-a4aa-443d288f9a76-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-4qzld\" (UID: \"6003069e-d7f1-4ba5-a4aa-443d288f9a76\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4qzld"
Jul 22 13:47:55.107244 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:55.107090    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e46d2550-e8cc-4cf9-95d8-e33f0a187d87-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-nfm9n\" (UID: \"e46d2550-e8cc-4cf9-95d8-e33f0a187d87\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-nfm9n"
Jul 22 13:47:55.108282 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:55.108243    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e46d2550-e8cc-4cf9-95d8-e33f0a187d87-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-nfm9n\" (UID: \"e46d2550-e8cc-4cf9-95d8-e33f0a187d87\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-nfm9n"
Jul 22 13:47:55.111471 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:55.111389    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/503d6cac-907a-4386-88f6-be0aeab5f8c3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5x2fw\" (UID: \"503d6cac-907a-4386-88f6-be0aeab5f8c3\") " pod="openshift-monitoring/node-exporter-5x2fw"
Jul 22 13:47:55.114291 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:55.114244    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-68pqs\" (UniqueName: \"kubernetes.io/projected/6003069e-d7f1-4ba5-a4aa-443d288f9a76-kube-api-access-68pqs\") pod \"openshift-state-metrics-79f6958cdf-4qzld\" (UID: \"6003069e-d7f1-4ba5-a4aa-443d288f9a76\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4qzld"
Jul 22 13:47:55.115706 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:55.115680    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmv9l\" (UniqueName: \"kubernetes.io/projected/e46d2550-e8cc-4cf9-95d8-e33f0a187d87-kube-api-access-bmv9l\") pod \"kube-state-metrics-56c5594674-nfm9n\" (UID: \"e46d2550-e8cc-4cf9-95d8-e33f0a187d87\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-nfm9n"
Jul 22 13:47:55.116635 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:55.116590    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-248sx\" (UniqueName: \"kubernetes.io/projected/503d6cac-907a-4386-88f6-be0aeab5f8c3-kube-api-access-248sx\") pod \"node-exporter-5x2fw\" (UID: \"503d6cac-907a-4386-88f6-be0aeab5f8c3\") " pod="openshift-monitoring/node-exporter-5x2fw"
Jul 22 13:47:55.220911 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:55.220869    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-nfm9n"
Jul 22 13:47:55.423583 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:55.423456    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-nfm9n"]
Jul 22 13:47:55.426845 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:47:55.426818    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode46d2550_e8cc_4cf9_95d8_e33f0a187d87.slice/crio-c6df0ba253f8036ed326e69254de1b511da51999cc6d26d25121cedb39d6d5ab WatchSource:0}: Error finding container c6df0ba253f8036ed326e69254de1b511da51999cc6d26d25121cedb39d6d5ab: Status 404 returned error can't find the container with id c6df0ba253f8036ed326e69254de1b511da51999cc6d26d25121cedb39d6d5ab
Jul 22 13:47:55.608050 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:55.608011    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6003069e-d7f1-4ba5-a4aa-443d288f9a76-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-4qzld\" (UID: \"6003069e-d7f1-4ba5-a4aa-443d288f9a76\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4qzld"
Jul 22 13:47:55.608223 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:55.608066    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/503d6cac-907a-4386-88f6-be0aeab5f8c3-node-exporter-tls\") pod \"node-exporter-5x2fw\" (UID: \"503d6cac-907a-4386-88f6-be0aeab5f8c3\") " pod="openshift-monitoring/node-exporter-5x2fw"
Jul 22 13:47:55.610499 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:55.610466    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/503d6cac-907a-4386-88f6-be0aeab5f8c3-node-exporter-tls\") pod \"node-exporter-5x2fw\" (UID: \"503d6cac-907a-4386-88f6-be0aeab5f8c3\") " pod="openshift-monitoring/node-exporter-5x2fw"
Jul 22 13:47:55.610632 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:55.610554    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6003069e-d7f1-4ba5-a4aa-443d288f9a76-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-4qzld\" (UID: \"6003069e-d7f1-4ba5-a4aa-443d288f9a76\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4qzld"
Jul 22 13:47:55.799551 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:55.799519    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4qzld"
Jul 22 13:47:55.843268 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:55.843244    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5x2fw"
Jul 22 13:47:55.875002 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:47:55.874974    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod503d6cac_907a_4386_88f6_be0aeab5f8c3.slice/crio-8cea99055224747035b9dbb196cfce1d1b43e923fc0f17e481be13d9a93387a9 WatchSource:0}: Error finding container 8cea99055224747035b9dbb196cfce1d1b43e923fc0f17e481be13d9a93387a9: Status 404 returned error can't find the container with id 8cea99055224747035b9dbb196cfce1d1b43e923fc0f17e481be13d9a93387a9
Jul 22 13:47:55.980360 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:55.980336    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-4qzld"]
Jul 22 13:47:55.982860 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:47:55.982830    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6003069e_d7f1_4ba5_a4aa_443d288f9a76.slice/crio-1680803e206f7b09e2860a77e68b353317f6ebd81deda9388d77f9dcd68123cd WatchSource:0}: Error finding container 1680803e206f7b09e2860a77e68b353317f6ebd81deda9388d77f9dcd68123cd: Status 404 returned error can't find the container with id 1680803e206f7b09e2860a77e68b353317f6ebd81deda9388d77f9dcd68123cd
Jul 22 13:47:56.002720 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:56.002687    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 22 13:47:56.028796 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:56.028772    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:47:56.031286 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:56.031259    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 22 13:47:56.031520 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:56.031495    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 22 13:47:56.031628 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:56.031541    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 22 13:47:56.031628 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:56.031572    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 22 13:47:56.031628 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:56.031615    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 22 13:47:56.031962 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:56.031922    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 22 13:47:56.031962 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:56.031933    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 22 13:47:56.032098 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:56.031989    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-rf4xk\""
Jul 22 13:47:56.032452 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:56.032184    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 22 13:47:56.032452 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:56.032262    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 22 13:47:56.032792 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:56.032772    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 22 13:47:56.112511 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:56.112484    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5692fe9d-1d5e-4fea-8247-61d0b79e88f6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:47:56.112650 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:56.112521    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5692fe9d-1d5e-4fea-8247-61d0b79e88f6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:47:56.112650 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:56.112537    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-web-config\") pod \"alertmanager-main-0\" (UID: \"5692fe9d-1d5e-4fea-8247-61d0b79e88f6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:47:56.112650 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:56.112557    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5692fe9d-1d5e-4fea-8247-61d0b79e88f6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:47:56.112809 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:56.112669    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5692fe9d-1d5e-4fea-8247-61d0b79e88f6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:47:56.112809 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:56.112719    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5692fe9d-1d5e-4fea-8247-61d0b79e88f6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:47:56.112809 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:56.112777    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5692fe9d-1d5e-4fea-8247-61d0b79e88f6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:47:56.112906 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:56.112820    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-config-volume\") pod \"alertmanager-main-0\" (UID: \"5692fe9d-1d5e-4fea-8247-61d0b79e88f6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:47:56.112906 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:56.112854    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-config-out\") pod \"alertmanager-main-0\" (UID: \"5692fe9d-1d5e-4fea-8247-61d0b79e88f6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:47:56.112906 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:56.112876    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5692fe9d-1d5e-4fea-8247-61d0b79e88f6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:47:56.113034 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:56.112903    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5692fe9d-1d5e-4fea-8247-61d0b79e88f6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:47:56.113034 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:56.112930    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5692fe9d-1d5e-4fea-8247-61d0b79e88f6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:47:56.113034 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:56.112960    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thrjt\" (UniqueName: \"kubernetes.io/projected/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-kube-api-access-thrjt\") pod \"alertmanager-main-0\" (UID: \"5692fe9d-1d5e-4fea-8247-61d0b79e88f6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:47:56.213666 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:56.213612    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5692fe9d-1d5e-4fea-8247-61d0b79e88f6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:47:56.213846 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:56.213676    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5692fe9d-1d5e-4fea-8247-61d0b79e88f6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:47:56.213846 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:56.213711    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5692fe9d-1d5e-4fea-8247-61d0b79e88f6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:47:56.213846 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:56.213759    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-config-volume\") pod \"alertmanager-main-0\" (UID: \"5692fe9d-1d5e-4fea-8247-61d0b79e88f6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:47:56.213846 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:56.213786    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-config-out\") pod \"alertmanager-main-0\" (UID: \"5692fe9d-1d5e-4fea-8247-61d0b79e88f6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:47:56.213846 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:56.213809    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5692fe9d-1d5e-4fea-8247-61d0b79e88f6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:47:56.213846 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:56.213830    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5692fe9d-1d5e-4fea-8247-61d0b79e88f6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:47:56.213846 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:56.213850    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5692fe9d-1d5e-4fea-8247-61d0b79e88f6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:47:56.214186 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:47:56.213879    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-alertmanager-trusted-ca-bundle podName:5692fe9d-1d5e-4fea-8247-61d0b79e88f6 nodeName:}" failed. No retries permitted until 2026-07-22 13:47:56.713853685 +0000 UTC m=+86.768630346 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "5692fe9d-1d5e-4fea-8247-61d0b79e88f6") : configmap references non-existent config key: ca-bundle.crt
Jul 22 13:47:56.214186 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:56.213928    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thrjt\" (UniqueName: \"kubernetes.io/projected/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-kube-api-access-thrjt\") pod \"alertmanager-main-0\" (UID: \"5692fe9d-1d5e-4fea-8247-61d0b79e88f6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:47:56.214186 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:56.213978    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5692fe9d-1d5e-4fea-8247-61d0b79e88f6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:47:56.214186 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:56.214014    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5692fe9d-1d5e-4fea-8247-61d0b79e88f6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:47:56.214186 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:56.214039    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-web-config\") pod \"alertmanager-main-0\" (UID: \"5692fe9d-1d5e-4fea-8247-61d0b79e88f6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:47:56.214186 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:56.214066    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5692fe9d-1d5e-4fea-8247-61d0b79e88f6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:47:56.215050 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:56.215027    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5692fe9d-1d5e-4fea-8247-61d0b79e88f6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:47:56.215858 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:56.215695    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5692fe9d-1d5e-4fea-8247-61d0b79e88f6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:47:56.217692 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:56.217666    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5692fe9d-1d5e-4fea-8247-61d0b79e88f6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:47:56.218372 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:56.218245    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-config-out\") pod \"alertmanager-main-0\" (UID: \"5692fe9d-1d5e-4fea-8247-61d0b79e88f6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:47:56.218482 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:56.218447    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5692fe9d-1d5e-4fea-8247-61d0b79e88f6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:47:56.218892 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:56.218843    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5692fe9d-1d5e-4fea-8247-61d0b79e88f6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:47:56.218892 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:56.218863    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5692fe9d-1d5e-4fea-8247-61d0b79e88f6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:47:56.219317 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:56.219291    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-config-volume\") pod \"alertmanager-main-0\" (UID: \"5692fe9d-1d5e-4fea-8247-61d0b79e88f6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:47:56.219929 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:56.219904    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-web-config\") pod \"alertmanager-main-0\" (UID: \"5692fe9d-1d5e-4fea-8247-61d0b79e88f6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:47:56.220547 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:56.220523    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5692fe9d-1d5e-4fea-8247-61d0b79e88f6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:47:56.220980 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:56.220953    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5692fe9d-1d5e-4fea-8247-61d0b79e88f6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:47:56.223583 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:56.223559    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thrjt\" (UniqueName: \"kubernetes.io/projected/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-kube-api-access-thrjt\") pod \"alertmanager-main-0\" (UID: \"5692fe9d-1d5e-4fea-8247-61d0b79e88f6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:47:56.425293 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:56.425199    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5x2fw" event={"ID":"503d6cac-907a-4386-88f6-be0aeab5f8c3","Type":"ContainerStarted","Data":"8cea99055224747035b9dbb196cfce1d1b43e923fc0f17e481be13d9a93387a9"}
Jul 22 13:47:56.427238 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:56.427209    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4qzld" event={"ID":"6003069e-d7f1-4ba5-a4aa-443d288f9a76","Type":"ContainerStarted","Data":"7e819012517705d7adbe0148a71802fbcc2f46ef4396a481f187a779b6b936f7"}
Jul 22 13:47:56.427364 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:56.427268    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4qzld" event={"ID":"6003069e-d7f1-4ba5-a4aa-443d288f9a76","Type":"ContainerStarted","Data":"477bc72634d2a67a3e3f981010722212c4de2b7d1b85110df579cb3cf099db9b"}
Jul 22 13:47:56.427364 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:56.427298    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4qzld" event={"ID":"6003069e-d7f1-4ba5-a4aa-443d288f9a76","Type":"ContainerStarted","Data":"1680803e206f7b09e2860a77e68b353317f6ebd81deda9388d77f9dcd68123cd"}
Jul 22 13:47:56.428473 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:56.428443    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-nfm9n" event={"ID":"e46d2550-e8cc-4cf9-95d8-e33f0a187d87","Type":"ContainerStarted","Data":"c6df0ba253f8036ed326e69254de1b511da51999cc6d26d25121cedb39d6d5ab"}
Jul 22 13:47:56.718915 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:56.718827    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5692fe9d-1d5e-4fea-8247-61d0b79e88f6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:47:56.719801 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:56.719776    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5692fe9d-1d5e-4fea-8247-61d0b79e88f6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:47:56.947981 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:56.947943    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:47:57.213830 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:57.213634    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 22 13:47:57.216313 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:47:57.216283    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5692fe9d_1d5e_4fea_8247_61d0b79e88f6.slice/crio-7865e9fc6edc32a28b2f6de00f64350a47d3ac72924abec415e025c102bf8876 WatchSource:0}: Error finding container 7865e9fc6edc32a28b2f6de00f64350a47d3ac72924abec415e025c102bf8876: Status 404 returned error can't find the container with id 7865e9fc6edc32a28b2f6de00f64350a47d3ac72924abec415e025c102bf8876
Jul 22 13:47:57.432900 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:57.432812    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5692fe9d-1d5e-4fea-8247-61d0b79e88f6","Type":"ContainerStarted","Data":"7865e9fc6edc32a28b2f6de00f64350a47d3ac72924abec415e025c102bf8876"}
Jul 22 13:47:57.894712 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:57.894619    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-f97895fff-4bg8g"]
Jul 22 13:47:57.909508 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:57.908986    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-f97895fff-4bg8g"
Jul 22 13:47:57.913004 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:57.912109    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-lpbd4\""
Jul 22 13:47:57.913004 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:57.912347    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 22 13:47:57.913004 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:57.912437    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-f97895fff-4bg8g"]
Jul 22 13:47:57.913004 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:57.912554    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 22 13:47:57.913004 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:57.912859    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 22 13:47:57.913004 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:57.912969    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 22 13:47:57.913398 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:57.913213    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-ke7au7jbdghi\""
Jul 22 13:47:57.913477 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:57.913430    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 22 13:47:58.033462 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:58.033354    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a0ef70c-bde8-4340-8e02-33261da5f404-metrics-client-ca\") pod \"thanos-querier-f97895fff-4bg8g\" (UID: \"3a0ef70c-bde8-4340-8e02-33261da5f404\") " pod="openshift-monitoring/thanos-querier-f97895fff-4bg8g"
Jul 22 13:47:58.033462 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:58.033432    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-httgh\" (UniqueName: \"kubernetes.io/projected/3a0ef70c-bde8-4340-8e02-33261da5f404-kube-api-access-httgh\") pod \"thanos-querier-f97895fff-4bg8g\" (UID: \"3a0ef70c-bde8-4340-8e02-33261da5f404\") " pod="openshift-monitoring/thanos-querier-f97895fff-4bg8g"
Jul 22 13:47:58.033944 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:58.033550    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3a0ef70c-bde8-4340-8e02-33261da5f404-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-f97895fff-4bg8g\" (UID: \"3a0ef70c-bde8-4340-8e02-33261da5f404\") " pod="openshift-monitoring/thanos-querier-f97895fff-4bg8g"
Jul 22 13:47:58.033944 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:58.033612    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3a0ef70c-bde8-4340-8e02-33261da5f404-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-f97895fff-4bg8g\" (UID: \"3a0ef70c-bde8-4340-8e02-33261da5f404\") " pod="openshift-monitoring/thanos-querier-f97895fff-4bg8g"
Jul 22 13:47:58.033944 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:58.033673    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3a0ef70c-bde8-4340-8e02-33261da5f404-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-f97895fff-4bg8g\" (UID: \"3a0ef70c-bde8-4340-8e02-33261da5f404\") " pod="openshift-monitoring/thanos-querier-f97895fff-4bg8g"
Jul 22 13:47:58.033944 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:58.033724    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3a0ef70c-bde8-4340-8e02-33261da5f404-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-f97895fff-4bg8g\" (UID: \"3a0ef70c-bde8-4340-8e02-33261da5f404\") " pod="openshift-monitoring/thanos-querier-f97895fff-4bg8g"
Jul 22 13:47:58.033944 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:58.033782    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3a0ef70c-bde8-4340-8e02-33261da5f404-secret-thanos-querier-tls\") pod \"thanos-querier-f97895fff-4bg8g\" (UID: \"3a0ef70c-bde8-4340-8e02-33261da5f404\") " pod="openshift-monitoring/thanos-querier-f97895fff-4bg8g"
Jul 22 13:47:58.033944 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:58.033819    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3a0ef70c-bde8-4340-8e02-33261da5f404-secret-grpc-tls\") pod \"thanos-querier-f97895fff-4bg8g\" (UID: \"3a0ef70c-bde8-4340-8e02-33261da5f404\") " pod="openshift-monitoring/thanos-querier-f97895fff-4bg8g"
Jul 22 13:47:58.134301 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:58.134263    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3a0ef70c-bde8-4340-8e02-33261da5f404-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-f97895fff-4bg8g\" (UID: \"3a0ef70c-bde8-4340-8e02-33261da5f404\") " pod="openshift-monitoring/thanos-querier-f97895fff-4bg8g"
Jul 22 13:47:58.134529 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:58.134319    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3a0ef70c-bde8-4340-8e02-33261da5f404-secret-thanos-querier-tls\") pod \"thanos-querier-f97895fff-4bg8g\" (UID: \"3a0ef70c-bde8-4340-8e02-33261da5f404\") " pod="openshift-monitoring/thanos-querier-f97895fff-4bg8g"
Jul 22 13:47:58.134529 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:58.134348    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3a0ef70c-bde8-4340-8e02-33261da5f404-secret-grpc-tls\") pod \"thanos-querier-f97895fff-4bg8g\" (UID: \"3a0ef70c-bde8-4340-8e02-33261da5f404\") " pod="openshift-monitoring/thanos-querier-f97895fff-4bg8g"
Jul 22 13:47:58.134529 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:58.134391    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a0ef70c-bde8-4340-8e02-33261da5f404-metrics-client-ca\") pod \"thanos-querier-f97895fff-4bg8g\" (UID: \"3a0ef70c-bde8-4340-8e02-33261da5f404\") " pod="openshift-monitoring/thanos-querier-f97895fff-4bg8g"
Jul 22 13:47:58.134529 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:58.134444    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-httgh\" (UniqueName: \"kubernetes.io/projected/3a0ef70c-bde8-4340-8e02-33261da5f404-kube-api-access-httgh\") pod \"thanos-querier-f97895fff-4bg8g\" (UID: \"3a0ef70c-bde8-4340-8e02-33261da5f404\") " pod="openshift-monitoring/thanos-querier-f97895fff-4bg8g"
Jul 22 13:47:58.134529 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:58.134496    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3a0ef70c-bde8-4340-8e02-33261da5f404-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-f97895fff-4bg8g\" (UID: \"3a0ef70c-bde8-4340-8e02-33261da5f404\") " pod="openshift-monitoring/thanos-querier-f97895fff-4bg8g"
Jul 22 13:47:58.134529 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:58.134526    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3a0ef70c-bde8-4340-8e02-33261da5f404-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-f97895fff-4bg8g\" (UID: \"3a0ef70c-bde8-4340-8e02-33261da5f404\") " pod="openshift-monitoring/thanos-querier-f97895fff-4bg8g"
Jul 22 13:47:58.134842 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:58.134566    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3a0ef70c-bde8-4340-8e02-33261da5f404-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-f97895fff-4bg8g\" (UID: \"3a0ef70c-bde8-4340-8e02-33261da5f404\") " pod="openshift-monitoring/thanos-querier-f97895fff-4bg8g"
Jul 22 13:47:58.135677 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:58.135623    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a0ef70c-bde8-4340-8e02-33261da5f404-metrics-client-ca\") pod \"thanos-querier-f97895fff-4bg8g\" (UID: \"3a0ef70c-bde8-4340-8e02-33261da5f404\") " pod="openshift-monitoring/thanos-querier-f97895fff-4bg8g"
Jul 22 13:47:58.137649 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:58.137615    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3a0ef70c-bde8-4340-8e02-33261da5f404-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-f97895fff-4bg8g\" (UID: \"3a0ef70c-bde8-4340-8e02-33261da5f404\") " pod="openshift-monitoring/thanos-querier-f97895fff-4bg8g"
Jul 22 13:47:58.138031 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:58.137957    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3a0ef70c-bde8-4340-8e02-33261da5f404-secret-grpc-tls\") pod \"thanos-querier-f97895fff-4bg8g\" (UID: \"3a0ef70c-bde8-4340-8e02-33261da5f404\") " pod="openshift-monitoring/thanos-querier-f97895fff-4bg8g"
Jul 22 13:47:58.138529 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:58.138485    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3a0ef70c-bde8-4340-8e02-33261da5f404-secret-thanos-querier-tls\") pod \"thanos-querier-f97895fff-4bg8g\" (UID: \"3a0ef70c-bde8-4340-8e02-33261da5f404\") " pod="openshift-monitoring/thanos-querier-f97895fff-4bg8g"
Jul 22 13:47:58.139362 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:58.139151    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3a0ef70c-bde8-4340-8e02-33261da5f404-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-f97895fff-4bg8g\" (UID: \"3a0ef70c-bde8-4340-8e02-33261da5f404\") " pod="openshift-monitoring/thanos-querier-f97895fff-4bg8g"
Jul 22 13:47:58.139362 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:58.139287    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3a0ef70c-bde8-4340-8e02-33261da5f404-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-f97895fff-4bg8g\" (UID: \"3a0ef70c-bde8-4340-8e02-33261da5f404\") " pod="openshift-monitoring/thanos-querier-f97895fff-4bg8g"
Jul 22 13:47:58.139548 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:58.139378    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3a0ef70c-bde8-4340-8e02-33261da5f404-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-f97895fff-4bg8g\" (UID: \"3a0ef70c-bde8-4340-8e02-33261da5f404\") " pod="openshift-monitoring/thanos-querier-f97895fff-4bg8g"
Jul 22 13:47:58.142867 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:58.142822    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-httgh\" (UniqueName: \"kubernetes.io/projected/3a0ef70c-bde8-4340-8e02-33261da5f404-kube-api-access-httgh\") pod \"thanos-querier-f97895fff-4bg8g\" (UID: \"3a0ef70c-bde8-4340-8e02-33261da5f404\") " pod="openshift-monitoring/thanos-querier-f97895fff-4bg8g"
Jul 22 13:47:58.224239 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:58.223933    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-f97895fff-4bg8g"
Jul 22 13:47:58.439134 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:58.439103    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-nfm9n" event={"ID":"e46d2550-e8cc-4cf9-95d8-e33f0a187d87","Type":"ContainerStarted","Data":"4e6b801e97fac11356f39780f9904fe6685301242fbeecfb83b3d71bec6201f6"}
Jul 22 13:47:58.439267 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:58.439183    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-nfm9n" event={"ID":"e46d2550-e8cc-4cf9-95d8-e33f0a187d87","Type":"ContainerStarted","Data":"85f6f892638fbf155dab6b35f96a504265eed153cf290f0d3212cbdbd24ee21a"}
Jul 22 13:47:58.574364 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:58.574168    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-f97895fff-4bg8g"]
Jul 22 13:47:58.576476 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:47:58.576451    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a0ef70c_bde8_4340_8e02_33261da5f404.slice/crio-8cee7f3fcc39f29d2060bb967bfa281048bd16f3e988031229c829d42484f74c WatchSource:0}: Error finding container 8cee7f3fcc39f29d2060bb967bfa281048bd16f3e988031229c829d42484f74c: Status 404 returned error can't find the container with id 8cee7f3fcc39f29d2060bb967bfa281048bd16f3e988031229c829d42484f74c
Jul 22 13:47:59.218080 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:59.218043    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5cc75bbc57-kzjfv"]
Jul 22 13:47:59.231079 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:59.231052    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5cc75bbc57-kzjfv"
Jul 22 13:47:59.235211 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:59.234790    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 22 13:47:59.235211 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:59.235052    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 22 13:47:59.235211 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:59.235096    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5cc75bbc57-kzjfv"]
Jul 22 13:47:59.235688 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:59.235667    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 22 13:47:59.235921 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:59.235906    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-3qslg5b07tt9d\""
Jul 22 13:47:59.236122 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:59.236107    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-hp7xq\""
Jul 22 13:47:59.237222 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:59.236280    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 22 13:47:59.345603 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:59.345576    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/32a4bdae-4f6e-4f69-a274-272029d112cb-secret-metrics-server-client-certs\") pod \"metrics-server-5cc75bbc57-kzjfv\" (UID: \"32a4bdae-4f6e-4f69-a274-272029d112cb\") " pod="openshift-monitoring/metrics-server-5cc75bbc57-kzjfv"
Jul 22 13:47:59.345736 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:59.345609    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/32a4bdae-4f6e-4f69-a274-272029d112cb-metrics-server-audit-profiles\") pod \"metrics-server-5cc75bbc57-kzjfv\" (UID: \"32a4bdae-4f6e-4f69-a274-272029d112cb\") " pod="openshift-monitoring/metrics-server-5cc75bbc57-kzjfv"
Jul 22 13:47:59.345736 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:59.345642    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/32a4bdae-4f6e-4f69-a274-272029d112cb-audit-log\") pod \"metrics-server-5cc75bbc57-kzjfv\" (UID: \"32a4bdae-4f6e-4f69-a274-272029d112cb\") " pod="openshift-monitoring/metrics-server-5cc75bbc57-kzjfv"
Jul 22 13:47:59.345736 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:59.345665    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32a4bdae-4f6e-4f69-a274-272029d112cb-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5cc75bbc57-kzjfv\" (UID: \"32a4bdae-4f6e-4f69-a274-272029d112cb\") " pod="openshift-monitoring/metrics-server-5cc75bbc57-kzjfv"
Jul 22 13:47:59.345736 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:59.345719    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfgt8\" (UniqueName: \"kubernetes.io/projected/32a4bdae-4f6e-4f69-a274-272029d112cb-kube-api-access-pfgt8\") pod \"metrics-server-5cc75bbc57-kzjfv\" (UID: \"32a4bdae-4f6e-4f69-a274-272029d112cb\") " pod="openshift-monitoring/metrics-server-5cc75bbc57-kzjfv"
Jul 22 13:47:59.345899 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:59.345763    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/32a4bdae-4f6e-4f69-a274-272029d112cb-client-ca-bundle\") pod \"metrics-server-5cc75bbc57-kzjfv\" (UID: \"32a4bdae-4f6e-4f69-a274-272029d112cb\") " pod="openshift-monitoring/metrics-server-5cc75bbc57-kzjfv"
Jul 22 13:47:59.345899 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:59.345805    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/32a4bdae-4f6e-4f69-a274-272029d112cb-secret-metrics-server-tls\") pod \"metrics-server-5cc75bbc57-kzjfv\" (UID: \"32a4bdae-4f6e-4f69-a274-272029d112cb\") " pod="openshift-monitoring/metrics-server-5cc75bbc57-kzjfv"
Jul 22 13:47:59.445585 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:59.445553    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4qzld" event={"ID":"6003069e-d7f1-4ba5-a4aa-443d288f9a76","Type":"ContainerStarted","Data":"d88d024da3c5084daca58d36a13e528f09c406cdcb08a75858f1b6dffb1b9433"}
Jul 22 13:47:59.446174 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:59.446143    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/32a4bdae-4f6e-4f69-a274-272029d112cb-secret-metrics-server-client-certs\") pod \"metrics-server-5cc75bbc57-kzjfv\" (UID: \"32a4bdae-4f6e-4f69-a274-272029d112cb\") " pod="openshift-monitoring/metrics-server-5cc75bbc57-kzjfv"
Jul 22 13:47:59.446299 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:59.446188    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/32a4bdae-4f6e-4f69-a274-272029d112cb-metrics-server-audit-profiles\") pod \"metrics-server-5cc75bbc57-kzjfv\" (UID: \"32a4bdae-4f6e-4f69-a274-272029d112cb\") " pod="openshift-monitoring/metrics-server-5cc75bbc57-kzjfv"
Jul 22 13:47:59.446299 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:59.446233    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/32a4bdae-4f6e-4f69-a274-272029d112cb-audit-log\") pod \"metrics-server-5cc75bbc57-kzjfv\" (UID: \"32a4bdae-4f6e-4f69-a274-272029d112cb\") " pod="openshift-monitoring/metrics-server-5cc75bbc57-kzjfv"
Jul 22 13:47:59.446299 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:59.446254    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32a4bdae-4f6e-4f69-a274-272029d112cb-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5cc75bbc57-kzjfv\" (UID: \"32a4bdae-4f6e-4f69-a274-272029d112cb\") " pod="openshift-monitoring/metrics-server-5cc75bbc57-kzjfv"
Jul 22 13:47:59.446299 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:59.446275    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfgt8\" (UniqueName: \"kubernetes.io/projected/32a4bdae-4f6e-4f69-a274-272029d112cb-kube-api-access-pfgt8\") pod \"metrics-server-5cc75bbc57-kzjfv\" (UID: \"32a4bdae-4f6e-4f69-a274-272029d112cb\") " pod="openshift-monitoring/metrics-server-5cc75bbc57-kzjfv"
Jul 22 13:47:59.446541 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:59.446321    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/32a4bdae-4f6e-4f69-a274-272029d112cb-client-ca-bundle\") pod \"metrics-server-5cc75bbc57-kzjfv\" (UID: \"32a4bdae-4f6e-4f69-a274-272029d112cb\") " pod="openshift-monitoring/metrics-server-5cc75bbc57-kzjfv"
Jul 22 13:47:59.446541 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:59.446371    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/32a4bdae-4f6e-4f69-a274-272029d112cb-secret-metrics-server-tls\") pod \"metrics-server-5cc75bbc57-kzjfv\" (UID: \"32a4bdae-4f6e-4f69-a274-272029d112cb\") " pod="openshift-monitoring/metrics-server-5cc75bbc57-kzjfv"
Jul 22 13:47:59.446778 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:59.446751    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/32a4bdae-4f6e-4f69-a274-272029d112cb-audit-log\") pod \"metrics-server-5cc75bbc57-kzjfv\" (UID: \"32a4bdae-4f6e-4f69-a274-272029d112cb\") " pod="openshift-monitoring/metrics-server-5cc75bbc57-kzjfv"
Jul 22 13:47:59.447322 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:59.447274    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32a4bdae-4f6e-4f69-a274-272029d112cb-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5cc75bbc57-kzjfv\" (UID: \"32a4bdae-4f6e-4f69-a274-272029d112cb\") " pod="openshift-monitoring/metrics-server-5cc75bbc57-kzjfv"
Jul 22 13:47:59.447322 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:59.447309    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/32a4bdae-4f6e-4f69-a274-272029d112cb-metrics-server-audit-profiles\") pod \"metrics-server-5cc75bbc57-kzjfv\" (UID: \"32a4bdae-4f6e-4f69-a274-272029d112cb\") " pod="openshift-monitoring/metrics-server-5cc75bbc57-kzjfv"
Jul 22 13:47:59.449203 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:59.449182    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/32a4bdae-4f6e-4f69-a274-272029d112cb-secret-metrics-server-client-certs\") pod \"metrics-server-5cc75bbc57-kzjfv\" (UID: \"32a4bdae-4f6e-4f69-a274-272029d112cb\") " pod="openshift-monitoring/metrics-server-5cc75bbc57-kzjfv"
Jul 22 13:47:59.449432 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:59.449390    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/32a4bdae-4f6e-4f69-a274-272029d112cb-secret-metrics-server-tls\") pod \"metrics-server-5cc75bbc57-kzjfv\" (UID: \"32a4bdae-4f6e-4f69-a274-272029d112cb\") " pod="openshift-monitoring/metrics-server-5cc75bbc57-kzjfv"
Jul 22 13:47:59.449515 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:59.449390    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/32a4bdae-4f6e-4f69-a274-272029d112cb-client-ca-bundle\") pod \"metrics-server-5cc75bbc57-kzjfv\" (UID: \"32a4bdae-4f6e-4f69-a274-272029d112cb\") " pod="openshift-monitoring/metrics-server-5cc75bbc57-kzjfv"
Jul 22 13:47:59.449576 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:59.449527    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-nfm9n" event={"ID":"e46d2550-e8cc-4cf9-95d8-e33f0a187d87","Type":"ContainerStarted","Data":"61c679ebe6eeffca3ee90ac2f05354459493c6608e8ab1894569985339d2ccaa"}
Jul 22 13:47:59.450919 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:59.450892    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f97895fff-4bg8g" event={"ID":"3a0ef70c-bde8-4340-8e02-33261da5f404","Type":"ContainerStarted","Data":"8cee7f3fcc39f29d2060bb967bfa281048bd16f3e988031229c829d42484f74c"}
Jul 22 13:47:59.452761 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:59.452735    2571 generic.go:356] "Generic (PLEG): container finished" podID="503d6cac-907a-4386-88f6-be0aeab5f8c3" containerID="b8965355fbb3b71976b73b845f554cf0d360e807e3319c83af0ae2cc53338736" exitCode=0
Jul 22 13:47:59.452866 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:59.452819    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5x2fw" event={"ID":"503d6cac-907a-4386-88f6-be0aeab5f8c3","Type":"ContainerDied","Data":"b8965355fbb3b71976b73b845f554cf0d360e807e3319c83af0ae2cc53338736"}
Jul 22 13:47:59.454252 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:59.454229    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfgt8\" (UniqueName: \"kubernetes.io/projected/32a4bdae-4f6e-4f69-a274-272029d112cb-kube-api-access-pfgt8\") pod \"metrics-server-5cc75bbc57-kzjfv\" (UID: \"32a4bdae-4f6e-4f69-a274-272029d112cb\") " pod="openshift-monitoring/metrics-server-5cc75bbc57-kzjfv"
Jul 22 13:47:59.454945 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:59.454921    2571 generic.go:356] "Generic (PLEG): container finished" podID="5692fe9d-1d5e-4fea-8247-61d0b79e88f6" containerID="2850bb5cb4df93521cfbe5c55b39d62e2b4ab8b503885a57732447bb98a671a7" exitCode=0
Jul 22 13:47:59.455043 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:59.454958    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5692fe9d-1d5e-4fea-8247-61d0b79e88f6","Type":"ContainerDied","Data":"2850bb5cb4df93521cfbe5c55b39d62e2b4ab8b503885a57732447bb98a671a7"}
Jul 22 13:47:59.465243 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:59.464840    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4qzld" podStartSLOduration=2.729844195 podStartE2EDuration="5.464821624s" totalImagesPullingTime="2.734977429s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:47:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:47:59.463321182 +0000 UTC m=+89.518097860" watchObservedRunningTime="2026-07-22 13:47:59.464821624 +0000 UTC m=+89.519598302"
Jul 22 13:47:59.481746 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:59.481348    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-nfm9n" podStartSLOduration=3.464814135 podStartE2EDuration="5.48132904s" totalImagesPullingTime="2.016514905s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:47:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:47:59.481026931 +0000 UTC m=+89.535803608" watchObservedRunningTime="2026-07-22 13:47:59.48132904 +0000 UTC m=+89.536105718"
Jul 22 13:47:59.544363 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:59.544326    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5cc75bbc57-kzjfv"
Jul 22 13:47:59.677330 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:59.677254    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m85wz"]
Jul 22 13:47:59.705148 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:59.704082    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-69d9bd5c94-w9rbl"]
Jul 22 13:47:59.705148 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:59.704190    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m85wz"
Jul 22 13:47:59.711205 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:59.710141    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 22 13:47:59.711205 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:59.710741    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-lpz65\""
Jul 22 13:47:59.718440 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:59.718393    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m85wz"]
Jul 22 13:47:59.718643 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:59.718622    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69d9bd5c94-w9rbl"]
Jul 22 13:47:59.718732 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:59.718655    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69d9bd5c94-w9rbl"
Jul 22 13:47:59.740790 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:59.740554    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5cc75bbc57-kzjfv"]
Jul 22 13:47:59.744885 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:47:59.744861    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32a4bdae_4f6e_4f69_a274_272029d112cb.slice/crio-a21a3d1fbd9b6b43fa07a4c1541bbcd57700b4224bc8d52f898a0a2fae676bb4 WatchSource:0}: Error finding container a21a3d1fbd9b6b43fa07a4c1541bbcd57700b4224bc8d52f898a0a2fae676bb4: Status 404 returned error can't find the container with id a21a3d1fbd9b6b43fa07a4c1541bbcd57700b4224bc8d52f898a0a2fae676bb4
Jul 22 13:47:59.851574 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:59.851532    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c234912c-7f1b-4872-9ad1-05994b967299-service-ca\") pod \"console-69d9bd5c94-w9rbl\" (UID: \"c234912c-7f1b-4872-9ad1-05994b967299\") " pod="openshift-console/console-69d9bd5c94-w9rbl"
Jul 22 13:47:59.851767 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:59.851597    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c234912c-7f1b-4872-9ad1-05994b967299-console-config\") pod \"console-69d9bd5c94-w9rbl\" (UID: \"c234912c-7f1b-4872-9ad1-05994b967299\") " pod="openshift-console/console-69d9bd5c94-w9rbl"
Jul 22 13:47:59.851767 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:59.851673    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nm984\" (UniqueName: \"kubernetes.io/projected/d18e428b-7e50-4856-accf-a11a1b24c9db-kube-api-access-nm984\") pod \"monitoring-plugin-7b7b7bc8bf-m85wz\" (UID: \"d18e428b-7e50-4856-accf-a11a1b24c9db\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m85wz"
Jul 22 13:47:59.851767 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:59.851746    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c234912c-7f1b-4872-9ad1-05994b967299-trusted-ca-bundle\") pod \"console-69d9bd5c94-w9rbl\" (UID: \"c234912c-7f1b-4872-9ad1-05994b967299\") " pod="openshift-console/console-69d9bd5c94-w9rbl"
Jul 22 13:47:59.851902 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:59.851782    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnfp8\" (UniqueName: \"kubernetes.io/projected/c234912c-7f1b-4872-9ad1-05994b967299-kube-api-access-gnfp8\") pod \"console-69d9bd5c94-w9rbl\" (UID: \"c234912c-7f1b-4872-9ad1-05994b967299\") " pod="openshift-console/console-69d9bd5c94-w9rbl"
Jul 22 13:47:59.851902 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:59.851824    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c234912c-7f1b-4872-9ad1-05994b967299-console-serving-cert\") pod \"console-69d9bd5c94-w9rbl\" (UID: \"c234912c-7f1b-4872-9ad1-05994b967299\") " pod="openshift-console/console-69d9bd5c94-w9rbl"
Jul 22 13:47:59.851902 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:59.851855    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c234912c-7f1b-4872-9ad1-05994b967299-oauth-serving-cert\") pod \"console-69d9bd5c94-w9rbl\" (UID: \"c234912c-7f1b-4872-9ad1-05994b967299\") " pod="openshift-console/console-69d9bd5c94-w9rbl"
Jul 22 13:47:59.851902 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:59.851879    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d18e428b-7e50-4856-accf-a11a1b24c9db-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-m85wz\" (UID: \"d18e428b-7e50-4856-accf-a11a1b24c9db\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m85wz"
Jul 22 13:47:59.852048 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:59.851963    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c234912c-7f1b-4872-9ad1-05994b967299-console-oauth-config\") pod \"console-69d9bd5c94-w9rbl\" (UID: \"c234912c-7f1b-4872-9ad1-05994b967299\") " pod="openshift-console/console-69d9bd5c94-w9rbl"
Jul 22 13:47:59.953208 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:59.953170    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c234912c-7f1b-4872-9ad1-05994b967299-console-serving-cert\") pod \"console-69d9bd5c94-w9rbl\" (UID: \"c234912c-7f1b-4872-9ad1-05994b967299\") " pod="openshift-console/console-69d9bd5c94-w9rbl"
Jul 22 13:47:59.953399 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:59.953216    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c234912c-7f1b-4872-9ad1-05994b967299-oauth-serving-cert\") pod \"console-69d9bd5c94-w9rbl\" (UID: \"c234912c-7f1b-4872-9ad1-05994b967299\") " pod="openshift-console/console-69d9bd5c94-w9rbl"
Jul 22 13:47:59.953399 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:59.953238    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d18e428b-7e50-4856-accf-a11a1b24c9db-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-m85wz\" (UID: \"d18e428b-7e50-4856-accf-a11a1b24c9db\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m85wz"
Jul 22 13:47:59.953399 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:59.953281    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c234912c-7f1b-4872-9ad1-05994b967299-console-oauth-config\") pod \"console-69d9bd5c94-w9rbl\" (UID: \"c234912c-7f1b-4872-9ad1-05994b967299\") " pod="openshift-console/console-69d9bd5c94-w9rbl"
Jul 22 13:47:59.953399 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:59.953322    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c234912c-7f1b-4872-9ad1-05994b967299-service-ca\") pod \"console-69d9bd5c94-w9rbl\" (UID: \"c234912c-7f1b-4872-9ad1-05994b967299\") " pod="openshift-console/console-69d9bd5c94-w9rbl"
Jul 22 13:47:59.953399 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:59.953362    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c234912c-7f1b-4872-9ad1-05994b967299-console-config\") pod \"console-69d9bd5c94-w9rbl\" (UID: \"c234912c-7f1b-4872-9ad1-05994b967299\") " pod="openshift-console/console-69d9bd5c94-w9rbl"
Jul 22 13:47:59.953399 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:59.953385    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nm984\" (UniqueName: \"kubernetes.io/projected/d18e428b-7e50-4856-accf-a11a1b24c9db-kube-api-access-nm984\") pod \"monitoring-plugin-7b7b7bc8bf-m85wz\" (UID: \"d18e428b-7e50-4856-accf-a11a1b24c9db\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m85wz"
Jul 22 13:47:59.953739 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:59.953453    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c234912c-7f1b-4872-9ad1-05994b967299-trusted-ca-bundle\") pod \"console-69d9bd5c94-w9rbl\" (UID: \"c234912c-7f1b-4872-9ad1-05994b967299\") " pod="openshift-console/console-69d9bd5c94-w9rbl"
Jul 22 13:47:59.953739 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:59.953488    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnfp8\" (UniqueName: \"kubernetes.io/projected/c234912c-7f1b-4872-9ad1-05994b967299-kube-api-access-gnfp8\") pod \"console-69d9bd5c94-w9rbl\" (UID: \"c234912c-7f1b-4872-9ad1-05994b967299\") " pod="openshift-console/console-69d9bd5c94-w9rbl"
Jul 22 13:47:59.954144 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:59.954066    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c234912c-7f1b-4872-9ad1-05994b967299-oauth-serving-cert\") pod \"console-69d9bd5c94-w9rbl\" (UID: \"c234912c-7f1b-4872-9ad1-05994b967299\") " pod="openshift-console/console-69d9bd5c94-w9rbl"
Jul 22 13:47:59.954144 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:59.954084    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c234912c-7f1b-4872-9ad1-05994b967299-service-ca\") pod \"console-69d9bd5c94-w9rbl\" (UID: \"c234912c-7f1b-4872-9ad1-05994b967299\") " pod="openshift-console/console-69d9bd5c94-w9rbl"
Jul 22 13:47:59.954324 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:59.954310    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c234912c-7f1b-4872-9ad1-05994b967299-console-config\") pod \"console-69d9bd5c94-w9rbl\" (UID: \"c234912c-7f1b-4872-9ad1-05994b967299\") " pod="openshift-console/console-69d9bd5c94-w9rbl"
Jul 22 13:47:59.954751 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:59.954728    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c234912c-7f1b-4872-9ad1-05994b967299-trusted-ca-bundle\") pod \"console-69d9bd5c94-w9rbl\" (UID: \"c234912c-7f1b-4872-9ad1-05994b967299\") " pod="openshift-console/console-69d9bd5c94-w9rbl"
Jul 22 13:47:59.956279 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:59.956251    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c234912c-7f1b-4872-9ad1-05994b967299-console-serving-cert\") pod \"console-69d9bd5c94-w9rbl\" (UID: \"c234912c-7f1b-4872-9ad1-05994b967299\") " pod="openshift-console/console-69d9bd5c94-w9rbl"
Jul 22 13:47:59.956378 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:59.956332    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c234912c-7f1b-4872-9ad1-05994b967299-console-oauth-config\") pod \"console-69d9bd5c94-w9rbl\" (UID: \"c234912c-7f1b-4872-9ad1-05994b967299\") " pod="openshift-console/console-69d9bd5c94-w9rbl"
Jul 22 13:47:59.956378 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:59.956357    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d18e428b-7e50-4856-accf-a11a1b24c9db-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-m85wz\" (UID: \"d18e428b-7e50-4856-accf-a11a1b24c9db\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m85wz"
Jul 22 13:47:59.962166 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:59.962139    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnfp8\" (UniqueName: \"kubernetes.io/projected/c234912c-7f1b-4872-9ad1-05994b967299-kube-api-access-gnfp8\") pod \"console-69d9bd5c94-w9rbl\" (UID: \"c234912c-7f1b-4872-9ad1-05994b967299\") " pod="openshift-console/console-69d9bd5c94-w9rbl"
Jul 22 13:47:59.962647 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:47:59.962626    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nm984\" (UniqueName: \"kubernetes.io/projected/d18e428b-7e50-4856-accf-a11a1b24c9db-kube-api-access-nm984\") pod \"monitoring-plugin-7b7b7bc8bf-m85wz\" (UID: \"d18e428b-7e50-4856-accf-a11a1b24c9db\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m85wz"
Jul 22 13:48:00.019324 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:00.019292    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m85wz"
Jul 22 13:48:00.029476 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:00.029443    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69d9bd5c94-w9rbl"
Jul 22 13:48:00.191187 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:00.191141    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m85wz"]
Jul 22 13:48:00.194730 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:48:00.194701    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd18e428b_7e50_4856_accf_a11a1b24c9db.slice/crio-7da2c7c344b278ccb65a16ff544712f4e855af762cde6a7131b8738e97699aae WatchSource:0}: Error finding container 7da2c7c344b278ccb65a16ff544712f4e855af762cde6a7131b8738e97699aae: Status 404 returned error can't find the container with id 7da2c7c344b278ccb65a16ff544712f4e855af762cde6a7131b8738e97699aae
Jul 22 13:48:00.229783 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:00.229752    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69d9bd5c94-w9rbl"]
Jul 22 13:48:00.463306 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:00.463215    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m85wz" event={"ID":"d18e428b-7e50-4856-accf-a11a1b24c9db","Type":"ContainerStarted","Data":"7da2c7c344b278ccb65a16ff544712f4e855af762cde6a7131b8738e97699aae"}
Jul 22 13:48:00.467451 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:00.467235    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5x2fw" event={"ID":"503d6cac-907a-4386-88f6-be0aeab5f8c3","Type":"ContainerStarted","Data":"22e4f5657a9fd9ecf807e2c4a4414b5ca3a57e7c98f1b552627536138704e2dd"}
Jul 22 13:48:00.467451 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:00.467300    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5x2fw" event={"ID":"503d6cac-907a-4386-88f6-be0aeab5f8c3","Type":"ContainerStarted","Data":"2e93dc61998f48a70438573ce9451ceaa877e34f989a7f9bcdf361cd50b9ec51"}
Jul 22 13:48:00.469700 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:00.469573    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5cc75bbc57-kzjfv" event={"ID":"32a4bdae-4f6e-4f69-a274-272029d112cb","Type":"ContainerStarted","Data":"a21a3d1fbd9b6b43fa07a4c1541bbcd57700b4224bc8d52f898a0a2fae676bb4"}
Jul 22 13:48:00.491916 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:00.491807    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5x2fw" podStartSLOduration=3.840230405 podStartE2EDuration="6.491785439s" totalImagesPullingTime="2.555756644s" totalInitContainerRuntime="95.79839ms" isStatefulPod=true podCreationTimestamp="2026-07-22 13:47:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:48:00.488887308 +0000 UTC m=+90.543663997" watchObservedRunningTime="2026-07-22 13:48:00.491785439 +0000 UTC m=+90.546562118"
Jul 22 13:48:01.156398 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.156360    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 13:48:01.176921 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.175799    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:48:01.180126 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.180095    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 22 13:48:01.180664 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.180636    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-5jb5aci2362is\""
Jul 22 13:48:01.181223 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.180890    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 22 13:48:01.181223 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.180933    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 22 13:48:01.181223 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.181032    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 22 13:48:01.181223 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.180945    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 22 13:48:01.181223 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.180900    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 22 13:48:01.181223 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.181035    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 22 13:48:01.181619 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.181288    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 22 13:48:01.181619 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.181488    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 22 13:48:01.181724 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.181657    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 22 13:48:01.183042 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.181871    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 22 13:48:01.183042 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.182307    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-2xdbj\""
Jul 22 13:48:01.183042 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.182849    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 22 13:48:01.185310 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.184589    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 22 13:48:01.185310 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.185269    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 13:48:01.188463 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.188441    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 22 13:48:01.268272 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.268241    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/20956ee1-7da1-4688-90e3-b93b318c4357-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:48:01.268754 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.268285    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/20956ee1-7da1-4688-90e3-b93b318c4357-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:48:01.268754 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.268321    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20956ee1-7da1-4688-90e3-b93b318c4357-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:48:01.268754 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.268352    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/20956ee1-7da1-4688-90e3-b93b318c4357-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:48:01.268754 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.268375    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/20956ee1-7da1-4688-90e3-b93b318c4357-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:48:01.268754 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.268494    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/20956ee1-7da1-4688-90e3-b93b318c4357-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:48:01.268754 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.268544    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/20956ee1-7da1-4688-90e3-b93b318c4357-web-config\") pod \"prometheus-k8s-0\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:48:01.268754 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.268597    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmwvp\" (UniqueName: \"kubernetes.io/projected/20956ee1-7da1-4688-90e3-b93b318c4357-kube-api-access-hmwvp\") pod \"prometheus-k8s-0\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:48:01.268754 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.268708    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/20956ee1-7da1-4688-90e3-b93b318c4357-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:48:01.268754 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.268741    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/20956ee1-7da1-4688-90e3-b93b318c4357-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:48:01.269208 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.268767    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/20956ee1-7da1-4688-90e3-b93b318c4357-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:48:01.269208 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.268834    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/20956ee1-7da1-4688-90e3-b93b318c4357-config-out\") pod \"prometheus-k8s-0\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:48:01.269208 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.268881    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20956ee1-7da1-4688-90e3-b93b318c4357-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:48:01.269208 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.268910    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/20956ee1-7da1-4688-90e3-b93b318c4357-config\") pod \"prometheus-k8s-0\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:48:01.269208 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.268935    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/20956ee1-7da1-4688-90e3-b93b318c4357-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:48:01.269208 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.268969    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/20956ee1-7da1-4688-90e3-b93b318c4357-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:48:01.269208 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.269067    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/20956ee1-7da1-4688-90e3-b93b318c4357-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:48:01.269208 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.269101    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/20956ee1-7da1-4688-90e3-b93b318c4357-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:48:01.269208 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.269129    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20956ee1-7da1-4688-90e3-b93b318c4357-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:48:01.269208 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.269173    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/20956ee1-7da1-4688-90e3-b93b318c4357-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:48:01.370121 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.370081    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/20956ee1-7da1-4688-90e3-b93b318c4357-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:48:01.370321 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.370134    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20956ee1-7da1-4688-90e3-b93b318c4357-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:48:01.370321 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.370170    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/20956ee1-7da1-4688-90e3-b93b318c4357-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:48:01.370321 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.370200    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/20956ee1-7da1-4688-90e3-b93b318c4357-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:48:01.370321 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.370239    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/20956ee1-7da1-4688-90e3-b93b318c4357-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:48:01.370321 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.370267    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/20956ee1-7da1-4688-90e3-b93b318c4357-web-config\") pod \"prometheus-k8s-0\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:48:01.370321 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.370293    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmwvp\" (UniqueName: \"kubernetes.io/projected/20956ee1-7da1-4688-90e3-b93b318c4357-kube-api-access-hmwvp\") pod \"prometheus-k8s-0\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:48:01.370687 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.370345    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/20956ee1-7da1-4688-90e3-b93b318c4357-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:48:01.370687 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.370372    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/20956ee1-7da1-4688-90e3-b93b318c4357-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:48:01.370687 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.370400    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/20956ee1-7da1-4688-90e3-b93b318c4357-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:48:01.370687 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.370462    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/20956ee1-7da1-4688-90e3-b93b318c4357-config-out\") pod \"prometheus-k8s-0\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:48:01.370687 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.370498    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20956ee1-7da1-4688-90e3-b93b318c4357-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:48:01.370687 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.370524    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/20956ee1-7da1-4688-90e3-b93b318c4357-config\") pod \"prometheus-k8s-0\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:48:01.370687 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.370548    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/20956ee1-7da1-4688-90e3-b93b318c4357-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:48:01.370687 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.370589    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/20956ee1-7da1-4688-90e3-b93b318c4357-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:48:01.370687 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.370625    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/20956ee1-7da1-4688-90e3-b93b318c4357-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:48:01.370687 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.370653    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/20956ee1-7da1-4688-90e3-b93b318c4357-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:48:01.370687 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.370677    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20956ee1-7da1-4688-90e3-b93b318c4357-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:48:01.371179 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.370711    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/20956ee1-7da1-4688-90e3-b93b318c4357-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:48:01.371179 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.370762    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/20956ee1-7da1-4688-90e3-b93b318c4357-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:48:01.371179 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.371087    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/20956ee1-7da1-4688-90e3-b93b318c4357-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:48:01.371315 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.371198    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/20956ee1-7da1-4688-90e3-b93b318c4357-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:48:01.371422 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.371376    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/20956ee1-7da1-4688-90e3-b93b318c4357-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:48:01.372337 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.371691    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/20956ee1-7da1-4688-90e3-b93b318c4357-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:48:01.373051 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.373026    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20956ee1-7da1-4688-90e3-b93b318c4357-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:48:01.374059 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.374033    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20956ee1-7da1-4688-90e3-b93b318c4357-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:48:01.374728 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.374510    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20956ee1-7da1-4688-90e3-b93b318c4357-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:48:01.375279 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.375235    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/20956ee1-7da1-4688-90e3-b93b318c4357-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:48:01.380134 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.380111    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/20956ee1-7da1-4688-90e3-b93b318c4357-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:48:01.380292 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.380111    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/20956ee1-7da1-4688-90e3-b93b318c4357-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:48:01.380705 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.380661    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/20956ee1-7da1-4688-90e3-b93b318c4357-config-out\") pod \"prometheus-k8s-0\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:48:01.381563 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.381523    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/20956ee1-7da1-4688-90e3-b93b318c4357-web-config\") pod \"prometheus-k8s-0\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:48:01.381813 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.381767    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/20956ee1-7da1-4688-90e3-b93b318c4357-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:48:01.381963 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.381942    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/20956ee1-7da1-4688-90e3-b93b318c4357-config\") pod \"prometheus-k8s-0\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:48:01.382081 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.382051    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/20956ee1-7da1-4688-90e3-b93b318c4357-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:48:01.382683 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.382639    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/20956ee1-7da1-4688-90e3-b93b318c4357-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:48:01.382776 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.382727    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/20956ee1-7da1-4688-90e3-b93b318c4357-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:48:01.382776 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.382755    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmwvp\" (UniqueName: \"kubernetes.io/projected/20956ee1-7da1-4688-90e3-b93b318c4357-kube-api-access-hmwvp\") pod \"prometheus-k8s-0\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:48:01.382886 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.382855    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/20956ee1-7da1-4688-90e3-b93b318c4357-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:48:01.384158 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.384137    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/20956ee1-7da1-4688-90e3-b93b318c4357-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:48:01.497151 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:01.497057    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:48:01.562440 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:48:01.562387    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc234912c_7f1b_4872_9ad1_05994b967299.slice/crio-80b605597f7f9f6443a58410fd8ea0d8e1bff21adaf3b81968967b1dfd28524e WatchSource:0}: Error finding container 80b605597f7f9f6443a58410fd8ea0d8e1bff21adaf3b81968967b1dfd28524e: Status 404 returned error can't find the container with id 80b605597f7f9f6443a58410fd8ea0d8e1bff21adaf3b81968967b1dfd28524e
Jul 22 13:48:02.481646 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:02.481606    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69d9bd5c94-w9rbl" event={"ID":"c234912c-7f1b-4872-9ad1-05994b967299","Type":"ContainerStarted","Data":"80b605597f7f9f6443a58410fd8ea0d8e1bff21adaf3b81968967b1dfd28524e"}
Jul 22 13:48:03.172668 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:03.172631    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 13:48:03.223684 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:48:03.223655    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20956ee1_7da1_4688_90e3_b93b318c4357.slice/crio-2dc66a9524c4ecee862af102fdd52085e88d38ad902aa3348178fc23bc22888b WatchSource:0}: Error finding container 2dc66a9524c4ecee862af102fdd52085e88d38ad902aa3348178fc23bc22888b: Status 404 returned error can't find the container with id 2dc66a9524c4ecee862af102fdd52085e88d38ad902aa3348178fc23bc22888b
Jul 22 13:48:03.494749 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:03.494715    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f97895fff-4bg8g" event={"ID":"3a0ef70c-bde8-4340-8e02-33261da5f404","Type":"ContainerStarted","Data":"7dd75f1dfa223b5dc9df9917f04987ceebb690e59f3aa5e5b72a3d90e2f0c864"}
Jul 22 13:48:03.496949 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:03.496897    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69d9bd5c94-w9rbl" event={"ID":"c234912c-7f1b-4872-9ad1-05994b967299","Type":"ContainerStarted","Data":"8b158c931a39c41f433d327ae6b330aa314f3a828090a149effc10e444b40c0b"}
Jul 22 13:48:03.499786 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:03.499708    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"20956ee1-7da1-4688-90e3-b93b318c4357","Type":"ContainerStarted","Data":"99a3b2bcedc6f4757f4f113566306a3e3acaf567cedfa1067d931d11151b6a10"}
Jul 22 13:48:03.499914 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:03.499788    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"20956ee1-7da1-4688-90e3-b93b318c4357","Type":"ContainerStarted","Data":"2dc66a9524c4ecee862af102fdd52085e88d38ad902aa3348178fc23bc22888b"}
Jul 22 13:48:03.502189 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:03.502135    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5cc75bbc57-kzjfv" event={"ID":"32a4bdae-4f6e-4f69-a274-272029d112cb","Type":"ContainerStarted","Data":"2b5166c45cd123854a23a9262bcccc208f41805f157bb82c203bfadf981d7747"}
Jul 22 13:48:03.504741 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:03.504519    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m85wz" event={"ID":"d18e428b-7e50-4856-accf-a11a1b24c9db","Type":"ContainerStarted","Data":"94634a6c0c2e5ad121969b486bf0a810572c90d27be3fc222199b7367ffb4b99"}
Jul 22 13:48:03.505133 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:03.505098    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m85wz"
Jul 22 13:48:03.510547 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:03.510526    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m85wz"
Jul 22 13:48:03.536220 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:03.535884    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-69d9bd5c94-w9rbl" podStartSLOduration=4.53586385 podStartE2EDuration="4.53586385s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:47:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:48:03.532820228 +0000 UTC m=+93.587596904" watchObservedRunningTime="2026-07-22 13:48:03.53586385 +0000 UTC m=+93.590640508"
Jul 22 13:48:03.554855 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:03.554801    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5cc75bbc57-kzjfv" podStartSLOduration=1.029270776 podStartE2EDuration="4.554780971s" totalImagesPullingTime="3.525510195s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:47:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:48:03.553878825 +0000 UTC m=+93.608655500" watchObservedRunningTime="2026-07-22 13:48:03.554780971 +0000 UTC m=+93.609557649"
Jul 22 13:48:03.575517 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:03.575453    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m85wz" podStartSLOduration=1.495954585 podStartE2EDuration="4.575430634s" totalImagesPullingTime="3.079476049s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:47:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:48:03.573872965 +0000 UTC m=+93.628649643" watchObservedRunningTime="2026-07-22 13:48:03.575430634 +0000 UTC m=+93.630207308"
Jul 22 13:48:04.512462 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:04.512371    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f97895fff-4bg8g" event={"ID":"3a0ef70c-bde8-4340-8e02-33261da5f404","Type":"ContainerStarted","Data":"381ff2e4cd852e74e484b29d5be36c6f98375e4109845e90efc44d6611bf8f08"}
Jul 22 13:48:04.512944 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:04.512473    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f97895fff-4bg8g" event={"ID":"3a0ef70c-bde8-4340-8e02-33261da5f404","Type":"ContainerStarted","Data":"34e96ccb1ec0840f1a0e8485950edd99288bfc409c573308ce37b3b9660994c8"}
Jul 22 13:48:04.516206 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:04.516173    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5692fe9d-1d5e-4fea-8247-61d0b79e88f6","Type":"ContainerStarted","Data":"028d545138c813aa0cd8d7d21a3de1f24c0f4492eea0bcf2cac4bfc76441feab"}
Jul 22 13:48:04.516348 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:04.516251    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5692fe9d-1d5e-4fea-8247-61d0b79e88f6","Type":"ContainerStarted","Data":"8344dd26a5cecf2ebad9da43cb308e2c8fa53d5065f71f921031613e03ede25d"}
Jul 22 13:48:04.516348 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:04.516291    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5692fe9d-1d5e-4fea-8247-61d0b79e88f6","Type":"ContainerStarted","Data":"fc6e1f905dfc9dd4f269e774c6f481afee991c444f33f74086a0a62d9f1b2dbb"}
Jul 22 13:48:04.516348 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:04.516330    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5692fe9d-1d5e-4fea-8247-61d0b79e88f6","Type":"ContainerStarted","Data":"553857d76c90bb037f2d7c8d1d03509c11ab39ed3a0467ff21c69af9c4a269b0"}
Jul 22 13:48:04.516519 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:04.516371    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5692fe9d-1d5e-4fea-8247-61d0b79e88f6","Type":"ContainerStarted","Data":"10c5b1658471ccd393ac7136c62da86ec1daf10ed64abe388aea4f8d60a9f321"}
Jul 22 13:48:04.517953 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:04.517915    2571 generic.go:356] "Generic (PLEG): container finished" podID="20956ee1-7da1-4688-90e3-b93b318c4357" containerID="99a3b2bcedc6f4757f4f113566306a3e3acaf567cedfa1067d931d11151b6a10" exitCode=0
Jul 22 13:48:04.518058 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:04.518012    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"20956ee1-7da1-4688-90e3-b93b318c4357","Type":"ContainerDied","Data":"99a3b2bcedc6f4757f4f113566306a3e3acaf567cedfa1067d931d11151b6a10"}
Jul 22 13:48:05.526777 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:05.526727    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f97895fff-4bg8g" event={"ID":"3a0ef70c-bde8-4340-8e02-33261da5f404","Type":"ContainerStarted","Data":"1191369d6ba4e325c1a206a0cf82d17e86f7cb129be59a3fe3a26dcb22828f16"}
Jul 22 13:48:05.531353 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:05.531290    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5692fe9d-1d5e-4fea-8247-61d0b79e88f6","Type":"ContainerStarted","Data":"8cb46de80cade145733ebbfa93a719ecd9a846077d8a8234bd322fa833b45b1d"}
Jul 22 13:48:05.561477 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:05.561394    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.253893834 podStartE2EDuration="10.561372036s" totalImagesPullingTime="7.286300705s" totalInitContainerRuntime="21.177497ms" isStatefulPod=false podCreationTimestamp="2026-07-22 13:47:55 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:48:05.561156702 +0000 UTC m=+95.615933379" watchObservedRunningTime="2026-07-22 13:48:05.561372036 +0000 UTC m=+95.616148716"
Jul 22 13:48:06.543761 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:06.543685    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f97895fff-4bg8g" event={"ID":"3a0ef70c-bde8-4340-8e02-33261da5f404","Type":"ContainerStarted","Data":"d9def33cf7d42010be70572ea1b085cc3bc1c5c4f80a716bb70ed1b573e0e9a7"}
Jul 22 13:48:06.544235 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:06.543777    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f97895fff-4bg8g" event={"ID":"3a0ef70c-bde8-4340-8e02-33261da5f404","Type":"ContainerStarted","Data":"40d51a74dc6122db9a13e226d2bb477b02d88eef4543461156fbea2faaf571fc"}
Jul 22 13:48:06.544235 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:06.544185    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-f97895fff-4bg8g"
Jul 22 13:48:06.571702 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:06.571635    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-f97895fff-4bg8g" podStartSLOduration=3.255969642 podStartE2EDuration="9.571613473s" totalImagesPullingTime="6.315643831s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:47:57 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:48:06.57108536 +0000 UTC m=+96.625862040" watchObservedRunningTime="2026-07-22 13:48:06.571613473 +0000 UTC m=+96.626390152"
Jul 22 13:48:08.556147 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:08.556113    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"20956ee1-7da1-4688-90e3-b93b318c4357","Type":"ContainerStarted","Data":"c302df155319cb9960f49175d0bccd9e0cd1599a921c5144a995bdab5497dcb7"}
Jul 22 13:48:09.563789 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:09.563758    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"20956ee1-7da1-4688-90e3-b93b318c4357","Type":"ContainerStarted","Data":"62a0d347082018aa45f06eba21c15cdc0d1e1508db61d011e930352b5399c39c"}
Jul 22 13:48:09.564300 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:09.563821    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"20956ee1-7da1-4688-90e3-b93b318c4357","Type":"ContainerStarted","Data":"309b7061a0868aa6ff576237a6fc86eb7152485c8425405dc2c558016e6c2438"}
Jul 22 13:48:09.564300 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:09.563848    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"20956ee1-7da1-4688-90e3-b93b318c4357","Type":"ContainerStarted","Data":"f6c4c10ab4315ad2cda2b23d71ba6c2a3802e92a85914ea7d798d14ec045c2fd"}
Jul 22 13:48:09.564300 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:09.563871    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"20956ee1-7da1-4688-90e3-b93b318c4357","Type":"ContainerStarted","Data":"a44cd7baceee2a5f67a7f4dbe16d908065d0bf3f7da00bc41e93c5d21beb92fa"}
Jul 22 13:48:09.564300 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:09.563908    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"20956ee1-7da1-4688-90e3-b93b318c4357","Type":"ContainerStarted","Data":"ad10c06389bcd191513944e3b41392b57a8dfcf662d1753345d5f8d56df6d2a7"}
Jul 22 13:48:09.594089 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:09.594037    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=4.66500741 podStartE2EDuration="8.594019608s" totalImagesPullingTime="3.90465134s" totalInitContainerRuntime="24.360858ms" isStatefulPod=false podCreationTimestamp="2026-07-22 13:48:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:48:09.591484668 +0000 UTC m=+99.646261345" watchObservedRunningTime="2026-07-22 13:48:09.594019608 +0000 UTC m=+99.648796284"
Jul 22 13:48:10.030591 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:10.030491    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-69d9bd5c94-w9rbl"
Jul 22 13:48:10.030591 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:10.030551    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-69d9bd5c94-w9rbl"
Jul 22 13:48:10.035399 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:10.035377    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-69d9bd5c94-w9rbl"
Jul 22 13:48:10.572010 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:10.571982    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-69d9bd5c94-w9rbl"
Jul 22 13:48:10.636283 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:10.636246    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c99b54b5b-lfhxt"]
Jul 22 13:48:11.477477 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:11.477448    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lxfbl_4c25882a-b837-4e4b-884c-be514d536810/serve-healthcheck-canary/0.log"
Jul 22 13:48:11.497186 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:11.497154    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:48:12.556352 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:12.556324    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-f97895fff-4bg8g"
Jul 22 13:48:16.473236 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:16.473175    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7484dbf8d4-7h888" podUID="12e5ca75-e395-4954-a751-256591b63cb4" containerName="console" containerID="cri-o://af39bcdd87f351ef5bd6aa122f901424be4b415d76d3c2e0e932ea51a7d734af" gracePeriod=15
Jul 22 13:48:16.596779 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:16.596751    2571 generic.go:356] "Generic (PLEG): container finished" podID="12e5ca75-e395-4954-a751-256591b63cb4" containerID="af39bcdd87f351ef5bd6aa122f901424be4b415d76d3c2e0e932ea51a7d734af" exitCode=0
Jul 22 13:48:16.596939 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:16.596812    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7484dbf8d4-7h888" event={"ID":"12e5ca75-e395-4954-a751-256591b63cb4","Type":"ContainerDied","Data":"af39bcdd87f351ef5bd6aa122f901424be4b415d76d3c2e0e932ea51a7d734af"}
Jul 22 13:48:16.766253 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:16.766210    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7484dbf8d4-7h888"
Jul 22 13:48:16.823384 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:16.823352    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/12e5ca75-e395-4954-a751-256591b63cb4-oauth-serving-cert\") pod \"12e5ca75-e395-4954-a751-256591b63cb4\" (UID: \"12e5ca75-e395-4954-a751-256591b63cb4\") "
Jul 22 13:48:16.823582 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:16.823436    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/12e5ca75-e395-4954-a751-256591b63cb4-console-oauth-config\") pod \"12e5ca75-e395-4954-a751-256591b63cb4\" (UID: \"12e5ca75-e395-4954-a751-256591b63cb4\") "
Jul 22 13:48:16.823582 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:16.823460    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/12e5ca75-e395-4954-a751-256591b63cb4-console-serving-cert\") pod \"12e5ca75-e395-4954-a751-256591b63cb4\" (UID: \"12e5ca75-e395-4954-a751-256591b63cb4\") "
Jul 22 13:48:16.823582 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:16.823492    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nsqc6\" (UniqueName: \"kubernetes.io/projected/12e5ca75-e395-4954-a751-256591b63cb4-kube-api-access-nsqc6\") pod \"12e5ca75-e395-4954-a751-256591b63cb4\" (UID: \"12e5ca75-e395-4954-a751-256591b63cb4\") "
Jul 22 13:48:16.823582 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:16.823525    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/12e5ca75-e395-4954-a751-256591b63cb4-service-ca\") pod \"12e5ca75-e395-4954-a751-256591b63cb4\" (UID: \"12e5ca75-e395-4954-a751-256591b63cb4\") "
Jul 22 13:48:16.823582 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:16.823562    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/12e5ca75-e395-4954-a751-256591b63cb4-console-config\") pod \"12e5ca75-e395-4954-a751-256591b63cb4\" (UID: \"12e5ca75-e395-4954-a751-256591b63cb4\") "
Jul 22 13:48:16.823954 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:16.823922    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12e5ca75-e395-4954-a751-256591b63cb4-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "12e5ca75-e395-4954-a751-256591b63cb4" (UID: "12e5ca75-e395-4954-a751-256591b63cb4"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 13:48:16.823954 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:16.823951    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12e5ca75-e395-4954-a751-256591b63cb4-console-config" (OuterVolumeSpecName: "console-config") pod "12e5ca75-e395-4954-a751-256591b63cb4" (UID: "12e5ca75-e395-4954-a751-256591b63cb4"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 13:48:16.824105 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:16.823976    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12e5ca75-e395-4954-a751-256591b63cb4-service-ca" (OuterVolumeSpecName: "service-ca") pod "12e5ca75-e395-4954-a751-256591b63cb4" (UID: "12e5ca75-e395-4954-a751-256591b63cb4"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 13:48:16.825964 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:16.825931    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12e5ca75-e395-4954-a751-256591b63cb4-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "12e5ca75-e395-4954-a751-256591b63cb4" (UID: "12e5ca75-e395-4954-a751-256591b63cb4"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 13:48:16.825964 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:16.825954    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12e5ca75-e395-4954-a751-256591b63cb4-kube-api-access-nsqc6" (OuterVolumeSpecName: "kube-api-access-nsqc6") pod "12e5ca75-e395-4954-a751-256591b63cb4" (UID: "12e5ca75-e395-4954-a751-256591b63cb4"). InnerVolumeSpecName "kube-api-access-nsqc6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 13:48:16.826084 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:16.825966    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12e5ca75-e395-4954-a751-256591b63cb4-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "12e5ca75-e395-4954-a751-256591b63cb4" (UID: "12e5ca75-e395-4954-a751-256591b63cb4"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 13:48:16.924570 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:16.924530    2571 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/12e5ca75-e395-4954-a751-256591b63cb4-oauth-serving-cert\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 13:48:16.924570 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:16.924561    2571 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/12e5ca75-e395-4954-a751-256591b63cb4-console-oauth-config\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 13:48:16.924570 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:16.924572    2571 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/12e5ca75-e395-4954-a751-256591b63cb4-console-serving-cert\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 13:48:16.924570 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:16.924581    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nsqc6\" (UniqueName: \"kubernetes.io/projected/12e5ca75-e395-4954-a751-256591b63cb4-kube-api-access-nsqc6\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 13:48:16.924833 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:16.924590    2571 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/12e5ca75-e395-4954-a751-256591b63cb4-service-ca\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 13:48:16.924833 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:16.924599    2571 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/12e5ca75-e395-4954-a751-256591b63cb4-console-config\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 13:48:17.602681 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:17.602644    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7484dbf8d4-7h888" event={"ID":"12e5ca75-e395-4954-a751-256591b63cb4","Type":"ContainerDied","Data":"15897efeb94eb6a894b6674a827f62f9f3753716b0858b8ba32df5c023c3c4d4"}
Jul 22 13:48:17.603116 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:17.602698    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7484dbf8d4-7h888"
Jul 22 13:48:17.603116 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:17.602720    2571 scope.go:117] "RemoveContainer" containerID="af39bcdd87f351ef5bd6aa122f901424be4b415d76d3c2e0e932ea51a7d734af"
Jul 22 13:48:17.618310 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:17.618282    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7484dbf8d4-7h888"]
Jul 22 13:48:17.623205 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:17.623182    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7484dbf8d4-7h888"]
Jul 22 13:48:19.009996 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:19.009955    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12e5ca75-e395-4954-a751-256591b63cb4" path="/var/lib/kubelet/pods/12e5ca75-e395-4954-a751-256591b63cb4/volumes"
Jul 22 13:48:19.545161 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:19.545128    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5cc75bbc57-kzjfv"
Jul 22 13:48:19.545338 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:19.545186    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5cc75bbc57-kzjfv"
Jul 22 13:48:24.418208 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:24.418175    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-sl64w"
Jul 22 13:48:35.660594 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:35.660516    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7c99b54b5b-lfhxt" podUID="bcd89420-cba5-4b2c-bdae-6e2e156fc787" containerName="console" containerID="cri-o://587133384fcb9abf8f17061952eb81884eb7b741fc9b3bfb01060dbd31d63816" gracePeriod=15
Jul 22 13:48:35.940581 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:35.940508    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c99b54b5b-lfhxt"
Jul 22 13:48:36.111952 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:36.111914    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bcd89420-cba5-4b2c-bdae-6e2e156fc787-service-ca\") pod \"bcd89420-cba5-4b2c-bdae-6e2e156fc787\" (UID: \"bcd89420-cba5-4b2c-bdae-6e2e156fc787\") "
Jul 22 13:48:36.111952 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:36.111954    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bcd89420-cba5-4b2c-bdae-6e2e156fc787-oauth-serving-cert\") pod \"bcd89420-cba5-4b2c-bdae-6e2e156fc787\" (UID: \"bcd89420-cba5-4b2c-bdae-6e2e156fc787\") "
Jul 22 13:48:36.112212 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:36.111983    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bcd89420-cba5-4b2c-bdae-6e2e156fc787-console-oauth-config\") pod \"bcd89420-cba5-4b2c-bdae-6e2e156fc787\" (UID: \"bcd89420-cba5-4b2c-bdae-6e2e156fc787\") "
Jul 22 13:48:36.112212 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:36.112020    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hp5s8\" (UniqueName: \"kubernetes.io/projected/bcd89420-cba5-4b2c-bdae-6e2e156fc787-kube-api-access-hp5s8\") pod \"bcd89420-cba5-4b2c-bdae-6e2e156fc787\" (UID: \"bcd89420-cba5-4b2c-bdae-6e2e156fc787\") "
Jul 22 13:48:36.112212 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:36.112051    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bcd89420-cba5-4b2c-bdae-6e2e156fc787-trusted-ca-bundle\") pod \"bcd89420-cba5-4b2c-bdae-6e2e156fc787\" (UID: \"bcd89420-cba5-4b2c-bdae-6e2e156fc787\") "
Jul 22 13:48:36.112212 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:36.112103    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bcd89420-cba5-4b2c-bdae-6e2e156fc787-console-config\") pod \"bcd89420-cba5-4b2c-bdae-6e2e156fc787\" (UID: \"bcd89420-cba5-4b2c-bdae-6e2e156fc787\") "
Jul 22 13:48:36.112468 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:36.112440    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bcd89420-cba5-4b2c-bdae-6e2e156fc787-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "bcd89420-cba5-4b2c-bdae-6e2e156fc787" (UID: "bcd89420-cba5-4b2c-bdae-6e2e156fc787"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 13:48:36.112468 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:36.112453    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bcd89420-cba5-4b2c-bdae-6e2e156fc787-service-ca" (OuterVolumeSpecName: "service-ca") pod "bcd89420-cba5-4b2c-bdae-6e2e156fc787" (UID: "bcd89420-cba5-4b2c-bdae-6e2e156fc787"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 13:48:36.112565 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:36.112523    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bcd89420-cba5-4b2c-bdae-6e2e156fc787-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "bcd89420-cba5-4b2c-bdae-6e2e156fc787" (UID: "bcd89420-cba5-4b2c-bdae-6e2e156fc787"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 13:48:36.112621 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:36.112574    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bcd89420-cba5-4b2c-bdae-6e2e156fc787-console-serving-cert\") pod \"bcd89420-cba5-4b2c-bdae-6e2e156fc787\" (UID: \"bcd89420-cba5-4b2c-bdae-6e2e156fc787\") "
Jul 22 13:48:36.112744 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:36.112712    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bcd89420-cba5-4b2c-bdae-6e2e156fc787-console-config" (OuterVolumeSpecName: "console-config") pod "bcd89420-cba5-4b2c-bdae-6e2e156fc787" (UID: "bcd89420-cba5-4b2c-bdae-6e2e156fc787"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 13:48:36.112871 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:36.112855    2571 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bcd89420-cba5-4b2c-bdae-6e2e156fc787-service-ca\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 13:48:36.112916 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:36.112880    2571 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bcd89420-cba5-4b2c-bdae-6e2e156fc787-oauth-serving-cert\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 13:48:36.112916 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:36.112895    2571 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bcd89420-cba5-4b2c-bdae-6e2e156fc787-trusted-ca-bundle\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 13:48:36.112916 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:36.112910    2571 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bcd89420-cba5-4b2c-bdae-6e2e156fc787-console-config\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 13:48:36.114398 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:36.114372    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bcd89420-cba5-4b2c-bdae-6e2e156fc787-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "bcd89420-cba5-4b2c-bdae-6e2e156fc787" (UID: "bcd89420-cba5-4b2c-bdae-6e2e156fc787"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 13:48:36.114482 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:36.114427    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bcd89420-cba5-4b2c-bdae-6e2e156fc787-kube-api-access-hp5s8" (OuterVolumeSpecName: "kube-api-access-hp5s8") pod "bcd89420-cba5-4b2c-bdae-6e2e156fc787" (UID: "bcd89420-cba5-4b2c-bdae-6e2e156fc787"). InnerVolumeSpecName "kube-api-access-hp5s8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 13:48:36.114565 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:36.114550    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bcd89420-cba5-4b2c-bdae-6e2e156fc787-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "bcd89420-cba5-4b2c-bdae-6e2e156fc787" (UID: "bcd89420-cba5-4b2c-bdae-6e2e156fc787"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 13:48:36.213831 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:36.213731    2571 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bcd89420-cba5-4b2c-bdae-6e2e156fc787-console-oauth-config\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 13:48:36.213831 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:36.213770    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hp5s8\" (UniqueName: \"kubernetes.io/projected/bcd89420-cba5-4b2c-bdae-6e2e156fc787-kube-api-access-hp5s8\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 13:48:36.213831 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:36.213784    2571 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bcd89420-cba5-4b2c-bdae-6e2e156fc787-console-serving-cert\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 13:48:36.694475 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:36.694444    2571 generic.go:356] "Generic (PLEG): container finished" podID="bcd89420-cba5-4b2c-bdae-6e2e156fc787" containerID="587133384fcb9abf8f17061952eb81884eb7b741fc9b3bfb01060dbd31d63816" exitCode=0
Jul 22 13:48:36.694934 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:36.694495    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c99b54b5b-lfhxt"
Jul 22 13:48:36.694934 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:36.694537    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c99b54b5b-lfhxt" event={"ID":"bcd89420-cba5-4b2c-bdae-6e2e156fc787","Type":"ContainerDied","Data":"587133384fcb9abf8f17061952eb81884eb7b741fc9b3bfb01060dbd31d63816"}
Jul 22 13:48:36.694934 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:36.694594    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c99b54b5b-lfhxt" event={"ID":"bcd89420-cba5-4b2c-bdae-6e2e156fc787","Type":"ContainerDied","Data":"0600080f8c8cb7d33a4e6ef4590642a547f2f745ca114ea64a98efb2bd013179"}
Jul 22 13:48:36.694934 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:36.694626    2571 scope.go:117] "RemoveContainer" containerID="587133384fcb9abf8f17061952eb81884eb7b741fc9b3bfb01060dbd31d63816"
Jul 22 13:48:36.703055 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:36.703040    2571 scope.go:117] "RemoveContainer" containerID="587133384fcb9abf8f17061952eb81884eb7b741fc9b3bfb01060dbd31d63816"
Jul 22 13:48:36.703353 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:48:36.703333    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"587133384fcb9abf8f17061952eb81884eb7b741fc9b3bfb01060dbd31d63816\": container with ID starting with 587133384fcb9abf8f17061952eb81884eb7b741fc9b3bfb01060dbd31d63816 not found: ID does not exist" containerID="587133384fcb9abf8f17061952eb81884eb7b741fc9b3bfb01060dbd31d63816"
Jul 22 13:48:36.703419 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:36.703362    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"587133384fcb9abf8f17061952eb81884eb7b741fc9b3bfb01060dbd31d63816"} err="failed to get container status \"587133384fcb9abf8f17061952eb81884eb7b741fc9b3bfb01060dbd31d63816\": rpc error: code = NotFound desc = could not find container \"587133384fcb9abf8f17061952eb81884eb7b741fc9b3bfb01060dbd31d63816\": container with ID starting with 587133384fcb9abf8f17061952eb81884eb7b741fc9b3bfb01060dbd31d63816 not found: ID does not exist"
Jul 22 13:48:36.715619 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:36.715594    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c99b54b5b-lfhxt"]
Jul 22 13:48:36.719828 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:36.719805    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7c99b54b5b-lfhxt"]
Jul 22 13:48:37.009316 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:37.009239    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bcd89420-cba5-4b2c-bdae-6e2e156fc787" path="/var/lib/kubelet/pods/bcd89420-cba5-4b2c-bdae-6e2e156fc787/volumes"
Jul 22 13:48:39.549860 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:39.549832    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5cc75bbc57-kzjfv"
Jul 22 13:48:39.553725 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:48:39.553700    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5cc75bbc57-kzjfv"
Jul 22 13:49:01.497613 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:01.497578    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:49:01.517446 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:01.517396    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:49:01.811563 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:01.811529    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:49:15.193564 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:15.193526    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 22 13:49:15.194105 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:15.193839    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5692fe9d-1d5e-4fea-8247-61d0b79e88f6" containerName="alertmanager" containerID="cri-o://10c5b1658471ccd393ac7136c62da86ec1daf10ed64abe388aea4f8d60a9f321" gracePeriod=120
Jul 22 13:49:15.194105 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:15.193896    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5692fe9d-1d5e-4fea-8247-61d0b79e88f6" containerName="kube-rbac-proxy-metric" containerID="cri-o://028d545138c813aa0cd8d7d21a3de1f24c0f4492eea0bcf2cac4bfc76441feab" gracePeriod=120
Jul 22 13:49:15.194105 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:15.193927    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5692fe9d-1d5e-4fea-8247-61d0b79e88f6" containerName="prom-label-proxy" containerID="cri-o://8cb46de80cade145733ebbfa93a719ecd9a846077d8a8234bd322fa833b45b1d" gracePeriod=120
Jul 22 13:49:15.194105 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:15.193966    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5692fe9d-1d5e-4fea-8247-61d0b79e88f6" containerName="kube-rbac-proxy-web" containerID="cri-o://fc6e1f905dfc9dd4f269e774c6f481afee991c444f33f74086a0a62d9f1b2dbb" gracePeriod=120
Jul 22 13:49:15.194105 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:15.193984    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5692fe9d-1d5e-4fea-8247-61d0b79e88f6" containerName="config-reloader" containerID="cri-o://553857d76c90bb037f2d7c8d1d03509c11ab39ed3a0467ff21c69af9c4a269b0" gracePeriod=120
Jul 22 13:49:15.194105 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:15.193984    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5692fe9d-1d5e-4fea-8247-61d0b79e88f6" containerName="kube-rbac-proxy" containerID="cri-o://8344dd26a5cecf2ebad9da43cb308e2c8fa53d5065f71f921031613e03ede25d" gracePeriod=120
Jul 22 13:49:15.862018 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:15.861984    2571 generic.go:356] "Generic (PLEG): container finished" podID="5692fe9d-1d5e-4fea-8247-61d0b79e88f6" containerID="8cb46de80cade145733ebbfa93a719ecd9a846077d8a8234bd322fa833b45b1d" exitCode=0
Jul 22 13:49:15.862018 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:15.862010    2571 generic.go:356] "Generic (PLEG): container finished" podID="5692fe9d-1d5e-4fea-8247-61d0b79e88f6" containerID="8344dd26a5cecf2ebad9da43cb308e2c8fa53d5065f71f921031613e03ede25d" exitCode=0
Jul 22 13:49:15.862018 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:15.862016    2571 generic.go:356] "Generic (PLEG): container finished" podID="5692fe9d-1d5e-4fea-8247-61d0b79e88f6" containerID="553857d76c90bb037f2d7c8d1d03509c11ab39ed3a0467ff21c69af9c4a269b0" exitCode=0
Jul 22 13:49:15.862018 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:15.862022    2571 generic.go:356] "Generic (PLEG): container finished" podID="5692fe9d-1d5e-4fea-8247-61d0b79e88f6" containerID="10c5b1658471ccd393ac7136c62da86ec1daf10ed64abe388aea4f8d60a9f321" exitCode=0
Jul 22 13:49:15.862279 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:15.862053    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5692fe9d-1d5e-4fea-8247-61d0b79e88f6","Type":"ContainerDied","Data":"8cb46de80cade145733ebbfa93a719ecd9a846077d8a8234bd322fa833b45b1d"}
Jul 22 13:49:15.862279 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:15.862116    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5692fe9d-1d5e-4fea-8247-61d0b79e88f6","Type":"ContainerDied","Data":"8344dd26a5cecf2ebad9da43cb308e2c8fa53d5065f71f921031613e03ede25d"}
Jul 22 13:49:15.862279 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:15.862144    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5692fe9d-1d5e-4fea-8247-61d0b79e88f6","Type":"ContainerDied","Data":"553857d76c90bb037f2d7c8d1d03509c11ab39ed3a0467ff21c69af9c4a269b0"}
Jul 22 13:49:15.862279 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:15.862168    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5692fe9d-1d5e-4fea-8247-61d0b79e88f6","Type":"ContainerDied","Data":"10c5b1658471ccd393ac7136c62da86ec1daf10ed64abe388aea4f8d60a9f321"}
Jul 22 13:49:16.437824 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.437799    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:49:16.578608 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.578576    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-metrics-client-ca\") pod \"5692fe9d-1d5e-4fea-8247-61d0b79e88f6\" (UID: \"5692fe9d-1d5e-4fea-8247-61d0b79e88f6\") "
Jul 22 13:49:16.578821 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.578632    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-config-out\") pod \"5692fe9d-1d5e-4fea-8247-61d0b79e88f6\" (UID: \"5692fe9d-1d5e-4fea-8247-61d0b79e88f6\") "
Jul 22 13:49:16.578821 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.578665    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"5692fe9d-1d5e-4fea-8247-61d0b79e88f6\" (UID: \"5692fe9d-1d5e-4fea-8247-61d0b79e88f6\") "
Jul 22 13:49:16.578821 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.578700    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-config-volume\") pod \"5692fe9d-1d5e-4fea-8247-61d0b79e88f6\" (UID: \"5692fe9d-1d5e-4fea-8247-61d0b79e88f6\") "
Jul 22 13:49:16.578821 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.578727    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-secret-alertmanager-main-tls\") pod \"5692fe9d-1d5e-4fea-8247-61d0b79e88f6\" (UID: \"5692fe9d-1d5e-4fea-8247-61d0b79e88f6\") "
Jul 22 13:49:16.578821 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.578748    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-web-config\") pod \"5692fe9d-1d5e-4fea-8247-61d0b79e88f6\" (UID: \"5692fe9d-1d5e-4fea-8247-61d0b79e88f6\") "
Jul 22 13:49:16.579095 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.578865    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-alertmanager-trusted-ca-bundle\") pod \"5692fe9d-1d5e-4fea-8247-61d0b79e88f6\" (UID: \"5692fe9d-1d5e-4fea-8247-61d0b79e88f6\") "
Jul 22 13:49:16.579095 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.578962    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-secret-alertmanager-kube-rbac-proxy-web\") pod \"5692fe9d-1d5e-4fea-8247-61d0b79e88f6\" (UID: \"5692fe9d-1d5e-4fea-8247-61d0b79e88f6\") "
Jul 22 13:49:16.579095 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.579006    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-tls-assets\") pod \"5692fe9d-1d5e-4fea-8247-61d0b79e88f6\" (UID: \"5692fe9d-1d5e-4fea-8247-61d0b79e88f6\") "
Jul 22 13:49:16.579095 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.579038    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-secret-alertmanager-kube-rbac-proxy\") pod \"5692fe9d-1d5e-4fea-8247-61d0b79e88f6\" (UID: \"5692fe9d-1d5e-4fea-8247-61d0b79e88f6\") "
Jul 22 13:49:16.579095 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.579043    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "5692fe9d-1d5e-4fea-8247-61d0b79e88f6" (UID: "5692fe9d-1d5e-4fea-8247-61d0b79e88f6"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 13:49:16.579095 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.579073    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-thrjt\" (UniqueName: \"kubernetes.io/projected/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-kube-api-access-thrjt\") pod \"5692fe9d-1d5e-4fea-8247-61d0b79e88f6\" (UID: \"5692fe9d-1d5e-4fea-8247-61d0b79e88f6\") "
Jul 22 13:49:16.579734 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.579706    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-cluster-tls-config\") pod \"5692fe9d-1d5e-4fea-8247-61d0b79e88f6\" (UID: \"5692fe9d-1d5e-4fea-8247-61d0b79e88f6\") "
Jul 22 13:49:16.579851 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.579751    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-alertmanager-main-db\") pod \"5692fe9d-1d5e-4fea-8247-61d0b79e88f6\" (UID: \"5692fe9d-1d5e-4fea-8247-61d0b79e88f6\") "
Jul 22 13:49:16.579851 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.579775    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "5692fe9d-1d5e-4fea-8247-61d0b79e88f6" (UID: "5692fe9d-1d5e-4fea-8247-61d0b79e88f6"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 13:49:16.580074 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.580052    2571 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-metrics-client-ca\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 13:49:16.580151 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.580081    2571 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 13:49:16.580206 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.580164    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "5692fe9d-1d5e-4fea-8247-61d0b79e88f6" (UID: "5692fe9d-1d5e-4fea-8247-61d0b79e88f6"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 13:49:16.582862 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.582806    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-config-volume" (OuterVolumeSpecName: "config-volume") pod "5692fe9d-1d5e-4fea-8247-61d0b79e88f6" (UID: "5692fe9d-1d5e-4fea-8247-61d0b79e88f6"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 13:49:16.582862 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.582823    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "5692fe9d-1d5e-4fea-8247-61d0b79e88f6" (UID: "5692fe9d-1d5e-4fea-8247-61d0b79e88f6"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 13:49:16.583028 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.582939    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-kube-api-access-thrjt" (OuterVolumeSpecName: "kube-api-access-thrjt") pod "5692fe9d-1d5e-4fea-8247-61d0b79e88f6" (UID: "5692fe9d-1d5e-4fea-8247-61d0b79e88f6"). InnerVolumeSpecName "kube-api-access-thrjt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 13:49:16.583028 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.582959    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "5692fe9d-1d5e-4fea-8247-61d0b79e88f6" (UID: "5692fe9d-1d5e-4fea-8247-61d0b79e88f6"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 13:49:16.583028 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.583000    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-config-out" (OuterVolumeSpecName: "config-out") pod "5692fe9d-1d5e-4fea-8247-61d0b79e88f6" (UID: "5692fe9d-1d5e-4fea-8247-61d0b79e88f6"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 13:49:16.583272 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.583239    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "5692fe9d-1d5e-4fea-8247-61d0b79e88f6" (UID: "5692fe9d-1d5e-4fea-8247-61d0b79e88f6"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 13:49:16.583398 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.583375    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "5692fe9d-1d5e-4fea-8247-61d0b79e88f6" (UID: "5692fe9d-1d5e-4fea-8247-61d0b79e88f6"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 13:49:16.583475 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.583392    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "5692fe9d-1d5e-4fea-8247-61d0b79e88f6" (UID: "5692fe9d-1d5e-4fea-8247-61d0b79e88f6"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 13:49:16.587048 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.587030    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "5692fe9d-1d5e-4fea-8247-61d0b79e88f6" (UID: "5692fe9d-1d5e-4fea-8247-61d0b79e88f6"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 13:49:16.593834 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.593814    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-web-config" (OuterVolumeSpecName: "web-config") pod "5692fe9d-1d5e-4fea-8247-61d0b79e88f6" (UID: "5692fe9d-1d5e-4fea-8247-61d0b79e88f6"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 13:49:16.680494 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.680457    2571 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-config-out\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 13:49:16.680494 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.680488    2571 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 13:49:16.680494 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.680498    2571 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-config-volume\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 13:49:16.680705 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.680507    2571 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-secret-alertmanager-main-tls\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 13:49:16.680705 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.680516    2571 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-web-config\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 13:49:16.680705 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.680525    2571 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 13:49:16.680705 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.680533    2571 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-tls-assets\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 13:49:16.680705 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.680542    2571 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 13:49:16.680705 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.680550    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-thrjt\" (UniqueName: \"kubernetes.io/projected/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-kube-api-access-thrjt\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 13:49:16.680705 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.680558    2571 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-cluster-tls-config\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 13:49:16.680705 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.680565    2571 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5692fe9d-1d5e-4fea-8247-61d0b79e88f6-alertmanager-main-db\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 13:49:16.868557 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.868460    2571 generic.go:356] "Generic (PLEG): container finished" podID="5692fe9d-1d5e-4fea-8247-61d0b79e88f6" containerID="028d545138c813aa0cd8d7d21a3de1f24c0f4492eea0bcf2cac4bfc76441feab" exitCode=0
Jul 22 13:49:16.868557 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.868492    2571 generic.go:356] "Generic (PLEG): container finished" podID="5692fe9d-1d5e-4fea-8247-61d0b79e88f6" containerID="fc6e1f905dfc9dd4f269e774c6f481afee991c444f33f74086a0a62d9f1b2dbb" exitCode=0
Jul 22 13:49:16.868557 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.868551    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:49:16.868767 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.868544    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5692fe9d-1d5e-4fea-8247-61d0b79e88f6","Type":"ContainerDied","Data":"028d545138c813aa0cd8d7d21a3de1f24c0f4492eea0bcf2cac4bfc76441feab"}
Jul 22 13:49:16.868767 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.868627    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5692fe9d-1d5e-4fea-8247-61d0b79e88f6","Type":"ContainerDied","Data":"fc6e1f905dfc9dd4f269e774c6f481afee991c444f33f74086a0a62d9f1b2dbb"}
Jul 22 13:49:16.868767 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.868656    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5692fe9d-1d5e-4fea-8247-61d0b79e88f6","Type":"ContainerDied","Data":"7865e9fc6edc32a28b2f6de00f64350a47d3ac72924abec415e025c102bf8876"}
Jul 22 13:49:16.868767 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.868701    2571 scope.go:117] "RemoveContainer" containerID="8cb46de80cade145733ebbfa93a719ecd9a846077d8a8234bd322fa833b45b1d"
Jul 22 13:49:16.878961 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.878914    2571 scope.go:117] "RemoveContainer" containerID="028d545138c813aa0cd8d7d21a3de1f24c0f4492eea0bcf2cac4bfc76441feab"
Jul 22 13:49:16.886602 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.886581    2571 scope.go:117] "RemoveContainer" containerID="8344dd26a5cecf2ebad9da43cb308e2c8fa53d5065f71f921031613e03ede25d"
Jul 22 13:49:16.893767 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.893749    2571 scope.go:117] "RemoveContainer" containerID="fc6e1f905dfc9dd4f269e774c6f481afee991c444f33f74086a0a62d9f1b2dbb"
Jul 22 13:49:16.900781 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.900764    2571 scope.go:117] "RemoveContainer" containerID="553857d76c90bb037f2d7c8d1d03509c11ab39ed3a0467ff21c69af9c4a269b0"
Jul 22 13:49:16.905466 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.905443    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 22 13:49:16.908912 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.908896    2571 scope.go:117] "RemoveContainer" containerID="10c5b1658471ccd393ac7136c62da86ec1daf10ed64abe388aea4f8d60a9f321"
Jul 22 13:49:16.915969 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.915945    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 22 13:49:16.916567 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.916548    2571 scope.go:117] "RemoveContainer" containerID="2850bb5cb4df93521cfbe5c55b39d62e2b4ab8b503885a57732447bb98a671a7"
Jul 22 13:49:16.923705 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.923688    2571 scope.go:117] "RemoveContainer" containerID="8cb46de80cade145733ebbfa93a719ecd9a846077d8a8234bd322fa833b45b1d"
Jul 22 13:49:16.923971 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:49:16.923949    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8cb46de80cade145733ebbfa93a719ecd9a846077d8a8234bd322fa833b45b1d\": container with ID starting with 8cb46de80cade145733ebbfa93a719ecd9a846077d8a8234bd322fa833b45b1d not found: ID does not exist" containerID="8cb46de80cade145733ebbfa93a719ecd9a846077d8a8234bd322fa833b45b1d"
Jul 22 13:49:16.924037 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.923984    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8cb46de80cade145733ebbfa93a719ecd9a846077d8a8234bd322fa833b45b1d"} err="failed to get container status \"8cb46de80cade145733ebbfa93a719ecd9a846077d8a8234bd322fa833b45b1d\": rpc error: code = NotFound desc = could not find container \"8cb46de80cade145733ebbfa93a719ecd9a846077d8a8234bd322fa833b45b1d\": container with ID starting with 8cb46de80cade145733ebbfa93a719ecd9a846077d8a8234bd322fa833b45b1d not found: ID does not exist"
Jul 22 13:49:16.924037 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.924013    2571 scope.go:117] "RemoveContainer" containerID="028d545138c813aa0cd8d7d21a3de1f24c0f4492eea0bcf2cac4bfc76441feab"
Jul 22 13:49:16.924275 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:49:16.924257    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"028d545138c813aa0cd8d7d21a3de1f24c0f4492eea0bcf2cac4bfc76441feab\": container with ID starting with 028d545138c813aa0cd8d7d21a3de1f24c0f4492eea0bcf2cac4bfc76441feab not found: ID does not exist" containerID="028d545138c813aa0cd8d7d21a3de1f24c0f4492eea0bcf2cac4bfc76441feab"
Jul 22 13:49:16.924313 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.924282    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"028d545138c813aa0cd8d7d21a3de1f24c0f4492eea0bcf2cac4bfc76441feab"} err="failed to get container status \"028d545138c813aa0cd8d7d21a3de1f24c0f4492eea0bcf2cac4bfc76441feab\": rpc error: code = NotFound desc = could not find container \"028d545138c813aa0cd8d7d21a3de1f24c0f4492eea0bcf2cac4bfc76441feab\": container with ID starting with 028d545138c813aa0cd8d7d21a3de1f24c0f4492eea0bcf2cac4bfc76441feab not found: ID does not exist"
Jul 22 13:49:16.924313 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.924300    2571 scope.go:117] "RemoveContainer" containerID="8344dd26a5cecf2ebad9da43cb308e2c8fa53d5065f71f921031613e03ede25d"
Jul 22 13:49:16.924513 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:49:16.924498    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8344dd26a5cecf2ebad9da43cb308e2c8fa53d5065f71f921031613e03ede25d\": container with ID starting with 8344dd26a5cecf2ebad9da43cb308e2c8fa53d5065f71f921031613e03ede25d not found: ID does not exist" containerID="8344dd26a5cecf2ebad9da43cb308e2c8fa53d5065f71f921031613e03ede25d"
Jul 22 13:49:16.924573 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.924515    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8344dd26a5cecf2ebad9da43cb308e2c8fa53d5065f71f921031613e03ede25d"} err="failed to get container status \"8344dd26a5cecf2ebad9da43cb308e2c8fa53d5065f71f921031613e03ede25d\": rpc error: code = NotFound desc = could not find container \"8344dd26a5cecf2ebad9da43cb308e2c8fa53d5065f71f921031613e03ede25d\": container with ID starting with 8344dd26a5cecf2ebad9da43cb308e2c8fa53d5065f71f921031613e03ede25d not found: ID does not exist"
Jul 22 13:49:16.924573 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.924527    2571 scope.go:117] "RemoveContainer" containerID="fc6e1f905dfc9dd4f269e774c6f481afee991c444f33f74086a0a62d9f1b2dbb"
Jul 22 13:49:16.924768 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:49:16.924748    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc6e1f905dfc9dd4f269e774c6f481afee991c444f33f74086a0a62d9f1b2dbb\": container with ID starting with fc6e1f905dfc9dd4f269e774c6f481afee991c444f33f74086a0a62d9f1b2dbb not found: ID does not exist" containerID="fc6e1f905dfc9dd4f269e774c6f481afee991c444f33f74086a0a62d9f1b2dbb"
Jul 22 13:49:16.924802 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.924774    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc6e1f905dfc9dd4f269e774c6f481afee991c444f33f74086a0a62d9f1b2dbb"} err="failed to get container status \"fc6e1f905dfc9dd4f269e774c6f481afee991c444f33f74086a0a62d9f1b2dbb\": rpc error: code = NotFound desc = could not find container \"fc6e1f905dfc9dd4f269e774c6f481afee991c444f33f74086a0a62d9f1b2dbb\": container with ID starting with fc6e1f905dfc9dd4f269e774c6f481afee991c444f33f74086a0a62d9f1b2dbb not found: ID does not exist"
Jul 22 13:49:16.924802 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.924790    2571 scope.go:117] "RemoveContainer" containerID="553857d76c90bb037f2d7c8d1d03509c11ab39ed3a0467ff21c69af9c4a269b0"
Jul 22 13:49:16.925024 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:49:16.925009    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"553857d76c90bb037f2d7c8d1d03509c11ab39ed3a0467ff21c69af9c4a269b0\": container with ID starting with 553857d76c90bb037f2d7c8d1d03509c11ab39ed3a0467ff21c69af9c4a269b0 not found: ID does not exist" containerID="553857d76c90bb037f2d7c8d1d03509c11ab39ed3a0467ff21c69af9c4a269b0"
Jul 22 13:49:16.925054 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.925028    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"553857d76c90bb037f2d7c8d1d03509c11ab39ed3a0467ff21c69af9c4a269b0"} err="failed to get container status \"553857d76c90bb037f2d7c8d1d03509c11ab39ed3a0467ff21c69af9c4a269b0\": rpc error: code = NotFound desc = could not find container \"553857d76c90bb037f2d7c8d1d03509c11ab39ed3a0467ff21c69af9c4a269b0\": container with ID starting with 553857d76c90bb037f2d7c8d1d03509c11ab39ed3a0467ff21c69af9c4a269b0 not found: ID does not exist"
Jul 22 13:49:16.925054 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.925041    2571 scope.go:117] "RemoveContainer" containerID="10c5b1658471ccd393ac7136c62da86ec1daf10ed64abe388aea4f8d60a9f321"
Jul 22 13:49:16.925270 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:49:16.925255    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10c5b1658471ccd393ac7136c62da86ec1daf10ed64abe388aea4f8d60a9f321\": container with ID starting with 10c5b1658471ccd393ac7136c62da86ec1daf10ed64abe388aea4f8d60a9f321 not found: ID does not exist" containerID="10c5b1658471ccd393ac7136c62da86ec1daf10ed64abe388aea4f8d60a9f321"
Jul 22 13:49:16.925305 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.925276    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10c5b1658471ccd393ac7136c62da86ec1daf10ed64abe388aea4f8d60a9f321"} err="failed to get container status \"10c5b1658471ccd393ac7136c62da86ec1daf10ed64abe388aea4f8d60a9f321\": rpc error: code = NotFound desc = could not find container \"10c5b1658471ccd393ac7136c62da86ec1daf10ed64abe388aea4f8d60a9f321\": container with ID starting with 10c5b1658471ccd393ac7136c62da86ec1daf10ed64abe388aea4f8d60a9f321 not found: ID does not exist"
Jul 22 13:49:16.925305 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.925291    2571 scope.go:117] "RemoveContainer" containerID="2850bb5cb4df93521cfbe5c55b39d62e2b4ab8b503885a57732447bb98a671a7"
Jul 22 13:49:16.925522 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:49:16.925505    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2850bb5cb4df93521cfbe5c55b39d62e2b4ab8b503885a57732447bb98a671a7\": container with ID starting with 2850bb5cb4df93521cfbe5c55b39d62e2b4ab8b503885a57732447bb98a671a7 not found: ID does not exist" containerID="2850bb5cb4df93521cfbe5c55b39d62e2b4ab8b503885a57732447bb98a671a7"
Jul 22 13:49:16.925567 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.925526    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2850bb5cb4df93521cfbe5c55b39d62e2b4ab8b503885a57732447bb98a671a7"} err="failed to get container status \"2850bb5cb4df93521cfbe5c55b39d62e2b4ab8b503885a57732447bb98a671a7\": rpc error: code = NotFound desc = could not find container \"2850bb5cb4df93521cfbe5c55b39d62e2b4ab8b503885a57732447bb98a671a7\": container with ID starting with 2850bb5cb4df93521cfbe5c55b39d62e2b4ab8b503885a57732447bb98a671a7 not found: ID does not exist"
Jul 22 13:49:16.925567 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.925539    2571 scope.go:117] "RemoveContainer" containerID="8cb46de80cade145733ebbfa93a719ecd9a846077d8a8234bd322fa833b45b1d"
Jul 22 13:49:16.925739 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.925722    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8cb46de80cade145733ebbfa93a719ecd9a846077d8a8234bd322fa833b45b1d"} err="failed to get container status \"8cb46de80cade145733ebbfa93a719ecd9a846077d8a8234bd322fa833b45b1d\": rpc error: code = NotFound desc = could not find container \"8cb46de80cade145733ebbfa93a719ecd9a846077d8a8234bd322fa833b45b1d\": container with ID starting with 8cb46de80cade145733ebbfa93a719ecd9a846077d8a8234bd322fa833b45b1d not found: ID does not exist"
Jul 22 13:49:16.925781 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.925740    2571 scope.go:117] "RemoveContainer" containerID="028d545138c813aa0cd8d7d21a3de1f24c0f4492eea0bcf2cac4bfc76441feab"
Jul 22 13:49:16.925929 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.925912    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"028d545138c813aa0cd8d7d21a3de1f24c0f4492eea0bcf2cac4bfc76441feab"} err="failed to get container status \"028d545138c813aa0cd8d7d21a3de1f24c0f4492eea0bcf2cac4bfc76441feab\": rpc error: code = NotFound desc = could not find container \"028d545138c813aa0cd8d7d21a3de1f24c0f4492eea0bcf2cac4bfc76441feab\": container with ID starting with 028d545138c813aa0cd8d7d21a3de1f24c0f4492eea0bcf2cac4bfc76441feab not found: ID does not exist"
Jul 22 13:49:16.925999 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.925931    2571 scope.go:117] "RemoveContainer" containerID="8344dd26a5cecf2ebad9da43cb308e2c8fa53d5065f71f921031613e03ede25d"
Jul 22 13:49:16.926167 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.926152    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8344dd26a5cecf2ebad9da43cb308e2c8fa53d5065f71f921031613e03ede25d"} err="failed to get container status \"8344dd26a5cecf2ebad9da43cb308e2c8fa53d5065f71f921031613e03ede25d\": rpc error: code = NotFound desc = could not find container \"8344dd26a5cecf2ebad9da43cb308e2c8fa53d5065f71f921031613e03ede25d\": container with ID starting with 8344dd26a5cecf2ebad9da43cb308e2c8fa53d5065f71f921031613e03ede25d not found: ID does not exist"
Jul 22 13:49:16.926213 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.926168    2571 scope.go:117] "RemoveContainer" containerID="fc6e1f905dfc9dd4f269e774c6f481afee991c444f33f74086a0a62d9f1b2dbb"
Jul 22 13:49:16.926359 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.926343    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc6e1f905dfc9dd4f269e774c6f481afee991c444f33f74086a0a62d9f1b2dbb"} err="failed to get container status \"fc6e1f905dfc9dd4f269e774c6f481afee991c444f33f74086a0a62d9f1b2dbb\": rpc error: code = NotFound desc = could not find container \"fc6e1f905dfc9dd4f269e774c6f481afee991c444f33f74086a0a62d9f1b2dbb\": container with ID starting with fc6e1f905dfc9dd4f269e774c6f481afee991c444f33f74086a0a62d9f1b2dbb not found: ID does not exist"
Jul 22 13:49:16.926396 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.926360    2571 scope.go:117] "RemoveContainer" containerID="553857d76c90bb037f2d7c8d1d03509c11ab39ed3a0467ff21c69af9c4a269b0"
Jul 22 13:49:16.926588 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.926572    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"553857d76c90bb037f2d7c8d1d03509c11ab39ed3a0467ff21c69af9c4a269b0"} err="failed to get container status \"553857d76c90bb037f2d7c8d1d03509c11ab39ed3a0467ff21c69af9c4a269b0\": rpc error: code = NotFound desc = could not find container \"553857d76c90bb037f2d7c8d1d03509c11ab39ed3a0467ff21c69af9c4a269b0\": container with ID starting with 553857d76c90bb037f2d7c8d1d03509c11ab39ed3a0467ff21c69af9c4a269b0 not found: ID does not exist"
Jul 22 13:49:16.926638 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.926588    2571 scope.go:117] "RemoveContainer" containerID="10c5b1658471ccd393ac7136c62da86ec1daf10ed64abe388aea4f8d60a9f321"
Jul 22 13:49:16.926776 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.926760    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10c5b1658471ccd393ac7136c62da86ec1daf10ed64abe388aea4f8d60a9f321"} err="failed to get container status \"10c5b1658471ccd393ac7136c62da86ec1daf10ed64abe388aea4f8d60a9f321\": rpc error: code = NotFound desc = could not find container \"10c5b1658471ccd393ac7136c62da86ec1daf10ed64abe388aea4f8d60a9f321\": container with ID starting with 10c5b1658471ccd393ac7136c62da86ec1daf10ed64abe388aea4f8d60a9f321 not found: ID does not exist"
Jul 22 13:49:16.926813 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.926777    2571 scope.go:117] "RemoveContainer" containerID="2850bb5cb4df93521cfbe5c55b39d62e2b4ab8b503885a57732447bb98a671a7"
Jul 22 13:49:16.926983 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.926959    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2850bb5cb4df93521cfbe5c55b39d62e2b4ab8b503885a57732447bb98a671a7"} err="failed to get container status \"2850bb5cb4df93521cfbe5c55b39d62e2b4ab8b503885a57732447bb98a671a7\": rpc error: code = NotFound desc = could not find container \"2850bb5cb4df93521cfbe5c55b39d62e2b4ab8b503885a57732447bb98a671a7\": container with ID starting with 2850bb5cb4df93521cfbe5c55b39d62e2b4ab8b503885a57732447bb98a671a7 not found: ID does not exist"
Jul 22 13:49:16.980207 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.980171    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 22 13:49:16.980510 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.980498    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5692fe9d-1d5e-4fea-8247-61d0b79e88f6" containerName="alertmanager"
Jul 22 13:49:16.980510 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.980512    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="5692fe9d-1d5e-4fea-8247-61d0b79e88f6" containerName="alertmanager"
Jul 22 13:49:16.980594 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.980520    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5692fe9d-1d5e-4fea-8247-61d0b79e88f6" containerName="init-config-reloader"
Jul 22 13:49:16.980594 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.980526    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="5692fe9d-1d5e-4fea-8247-61d0b79e88f6" containerName="init-config-reloader"
Jul 22 13:49:16.980594 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.980533    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5692fe9d-1d5e-4fea-8247-61d0b79e88f6" containerName="kube-rbac-proxy-web"
Jul 22 13:49:16.980594 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.980539    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="5692fe9d-1d5e-4fea-8247-61d0b79e88f6" containerName="kube-rbac-proxy-web"
Jul 22 13:49:16.980594 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.980555    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12e5ca75-e395-4954-a751-256591b63cb4" containerName="console"
Jul 22 13:49:16.980594 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.980560    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="12e5ca75-e395-4954-a751-256591b63cb4" containerName="console"
Jul 22 13:49:16.980594 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.980569    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5692fe9d-1d5e-4fea-8247-61d0b79e88f6" containerName="kube-rbac-proxy-metric"
Jul 22 13:49:16.980594 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.980574    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="5692fe9d-1d5e-4fea-8247-61d0b79e88f6" containerName="kube-rbac-proxy-metric"
Jul 22 13:49:16.980594 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.980582    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5692fe9d-1d5e-4fea-8247-61d0b79e88f6" containerName="kube-rbac-proxy"
Jul 22 13:49:16.980594 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.980587    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="5692fe9d-1d5e-4fea-8247-61d0b79e88f6" containerName="kube-rbac-proxy"
Jul 22 13:49:16.980594 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.980596    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcd89420-cba5-4b2c-bdae-6e2e156fc787" containerName="console"
Jul 22 13:49:16.980888 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.980602    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcd89420-cba5-4b2c-bdae-6e2e156fc787" containerName="console"
Jul 22 13:49:16.980888 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.980608    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5692fe9d-1d5e-4fea-8247-61d0b79e88f6" containerName="prom-label-proxy"
Jul 22 13:49:16.980888 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.980613    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="5692fe9d-1d5e-4fea-8247-61d0b79e88f6" containerName="prom-label-proxy"
Jul 22 13:49:16.980888 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.980620    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5692fe9d-1d5e-4fea-8247-61d0b79e88f6" containerName="config-reloader"
Jul 22 13:49:16.980888 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.980625    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="5692fe9d-1d5e-4fea-8247-61d0b79e88f6" containerName="config-reloader"
Jul 22 13:49:16.980888 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.980671    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="5692fe9d-1d5e-4fea-8247-61d0b79e88f6" containerName="kube-rbac-proxy-web"
Jul 22 13:49:16.980888 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.980680    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="5692fe9d-1d5e-4fea-8247-61d0b79e88f6" containerName="config-reloader"
Jul 22 13:49:16.980888 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.980686    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="5692fe9d-1d5e-4fea-8247-61d0b79e88f6" containerName="prom-label-proxy"
Jul 22 13:49:16.980888 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.980691    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="5692fe9d-1d5e-4fea-8247-61d0b79e88f6" containerName="alertmanager"
Jul 22 13:49:16.980888 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.980697    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="5692fe9d-1d5e-4fea-8247-61d0b79e88f6" containerName="kube-rbac-proxy"
Jul 22 13:49:16.980888 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.980703    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="bcd89420-cba5-4b2c-bdae-6e2e156fc787" containerName="console"
Jul 22 13:49:16.980888 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.980708    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="12e5ca75-e395-4954-a751-256591b63cb4" containerName="console"
Jul 22 13:49:16.980888 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.980713    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="5692fe9d-1d5e-4fea-8247-61d0b79e88f6" containerName="kube-rbac-proxy-metric"
Jul 22 13:49:16.984538 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.984515    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:49:16.988311 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.988286    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-rf4xk\""
Jul 22 13:49:16.988784 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.988764    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 22 13:49:16.988890 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.988870    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 22 13:49:16.988961 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.988944    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 22 13:49:16.989249 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.989233    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 22 13:49:16.989496 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.989482    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 22 13:49:16.989573 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.989494    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 22 13:49:16.989702 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.989689    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 22 13:49:16.990212 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.990198    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 22 13:49:16.995886 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:16.995865    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 22 13:49:17.005186 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:17.005156    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 22 13:49:17.013329 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:17.013303    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5692fe9d-1d5e-4fea-8247-61d0b79e88f6" path="/var/lib/kubelet/pods/5692fe9d-1d5e-4fea-8247-61d0b79e88f6/volumes"
Jul 22 13:49:17.084564 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:17.084522    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tz2n\" (UniqueName: \"kubernetes.io/projected/3a60900c-94b9-4f64-863e-03c5abf6e7af-kube-api-access-4tz2n\") pod \"alertmanager-main-0\" (UID: \"3a60900c-94b9-4f64-863e-03c5abf6e7af\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:49:17.084821 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:17.084801    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3a60900c-94b9-4f64-863e-03c5abf6e7af-config-out\") pod \"alertmanager-main-0\" (UID: \"3a60900c-94b9-4f64-863e-03c5abf6e7af\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:49:17.084927 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:17.084915    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3a60900c-94b9-4f64-863e-03c5abf6e7af-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3a60900c-94b9-4f64-863e-03c5abf6e7af\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:49:17.085034 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:17.085018    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3a60900c-94b9-4f64-863e-03c5abf6e7af-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3a60900c-94b9-4f64-863e-03c5abf6e7af\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:49:17.085125 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:17.085114    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3a60900c-94b9-4f64-863e-03c5abf6e7af-web-config\") pod \"alertmanager-main-0\" (UID: \"3a60900c-94b9-4f64-863e-03c5abf6e7af\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:49:17.085218 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:17.085206    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3a60900c-94b9-4f64-863e-03c5abf6e7af-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3a60900c-94b9-4f64-863e-03c5abf6e7af\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:49:17.085308 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:17.085294    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3a60900c-94b9-4f64-863e-03c5abf6e7af-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3a60900c-94b9-4f64-863e-03c5abf6e7af\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:49:17.085479 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:17.085464    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a60900c-94b9-4f64-863e-03c5abf6e7af-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3a60900c-94b9-4f64-863e-03c5abf6e7af\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:49:17.085615 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:17.085598    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3a60900c-94b9-4f64-863e-03c5abf6e7af-config-volume\") pod \"alertmanager-main-0\" (UID: \"3a60900c-94b9-4f64-863e-03c5abf6e7af\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:49:17.085704 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:17.085691    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3a60900c-94b9-4f64-863e-03c5abf6e7af-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3a60900c-94b9-4f64-863e-03c5abf6e7af\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:49:17.085792 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:17.085779    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3a60900c-94b9-4f64-863e-03c5abf6e7af-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3a60900c-94b9-4f64-863e-03c5abf6e7af\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:49:17.085872 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:17.085860    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3a60900c-94b9-4f64-863e-03c5abf6e7af-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3a60900c-94b9-4f64-863e-03c5abf6e7af\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:49:17.085968 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:17.085953    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a60900c-94b9-4f64-863e-03c5abf6e7af-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3a60900c-94b9-4f64-863e-03c5abf6e7af\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:49:17.187142 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:17.187053    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3a60900c-94b9-4f64-863e-03c5abf6e7af-config-volume\") pod \"alertmanager-main-0\" (UID: \"3a60900c-94b9-4f64-863e-03c5abf6e7af\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:49:17.187142 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:17.187087    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3a60900c-94b9-4f64-863e-03c5abf6e7af-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3a60900c-94b9-4f64-863e-03c5abf6e7af\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:49:17.187142 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:17.187109    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3a60900c-94b9-4f64-863e-03c5abf6e7af-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3a60900c-94b9-4f64-863e-03c5abf6e7af\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:49:17.187142 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:17.187126    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3a60900c-94b9-4f64-863e-03c5abf6e7af-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3a60900c-94b9-4f64-863e-03c5abf6e7af\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:49:17.187142 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:17.187143    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a60900c-94b9-4f64-863e-03c5abf6e7af-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3a60900c-94b9-4f64-863e-03c5abf6e7af\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:49:17.187550 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:17.187198    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tz2n\" (UniqueName: \"kubernetes.io/projected/3a60900c-94b9-4f64-863e-03c5abf6e7af-kube-api-access-4tz2n\") pod \"alertmanager-main-0\" (UID: \"3a60900c-94b9-4f64-863e-03c5abf6e7af\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:49:17.187550 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:17.187223    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3a60900c-94b9-4f64-863e-03c5abf6e7af-config-out\") pod \"alertmanager-main-0\" (UID: \"3a60900c-94b9-4f64-863e-03c5abf6e7af\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:49:17.187550 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:17.187267    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3a60900c-94b9-4f64-863e-03c5abf6e7af-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3a60900c-94b9-4f64-863e-03c5abf6e7af\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:49:17.187550 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:17.187299    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3a60900c-94b9-4f64-863e-03c5abf6e7af-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3a60900c-94b9-4f64-863e-03c5abf6e7af\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:49:17.187550 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:17.187328    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3a60900c-94b9-4f64-863e-03c5abf6e7af-web-config\") pod \"alertmanager-main-0\" (UID: \"3a60900c-94b9-4f64-863e-03c5abf6e7af\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:49:17.187550 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:17.187357    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3a60900c-94b9-4f64-863e-03c5abf6e7af-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3a60900c-94b9-4f64-863e-03c5abf6e7af\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:49:17.187550 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:17.187377    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3a60900c-94b9-4f64-863e-03c5abf6e7af-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3a60900c-94b9-4f64-863e-03c5abf6e7af\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:49:17.187550 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:17.187449    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a60900c-94b9-4f64-863e-03c5abf6e7af-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3a60900c-94b9-4f64-863e-03c5abf6e7af\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:49:17.188780 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:17.188751    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a60900c-94b9-4f64-863e-03c5abf6e7af-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3a60900c-94b9-4f64-863e-03c5abf6e7af\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:49:17.189010 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:17.188983    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a60900c-94b9-4f64-863e-03c5abf6e7af-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3a60900c-94b9-4f64-863e-03c5abf6e7af\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:49:17.189154 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:17.189133    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3a60900c-94b9-4f64-863e-03c5abf6e7af-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3a60900c-94b9-4f64-863e-03c5abf6e7af\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:49:17.190768 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:17.190722    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3a60900c-94b9-4f64-863e-03c5abf6e7af-config-out\") pod \"alertmanager-main-0\" (UID: \"3a60900c-94b9-4f64-863e-03c5abf6e7af\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:49:17.190864 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:17.190784    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3a60900c-94b9-4f64-863e-03c5abf6e7af-config-volume\") pod \"alertmanager-main-0\" (UID: \"3a60900c-94b9-4f64-863e-03c5abf6e7af\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:49:17.190864 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:17.190786    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3a60900c-94b9-4f64-863e-03c5abf6e7af-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3a60900c-94b9-4f64-863e-03c5abf6e7af\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:49:17.191002 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:17.190910    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3a60900c-94b9-4f64-863e-03c5abf6e7af-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3a60900c-94b9-4f64-863e-03c5abf6e7af\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:49:17.191088 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:17.191069    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3a60900c-94b9-4f64-863e-03c5abf6e7af-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3a60900c-94b9-4f64-863e-03c5abf6e7af\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:49:17.191131 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:17.191082    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3a60900c-94b9-4f64-863e-03c5abf6e7af-web-config\") pod \"alertmanager-main-0\" (UID: \"3a60900c-94b9-4f64-863e-03c5abf6e7af\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:49:17.191470 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:17.191453    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3a60900c-94b9-4f64-863e-03c5abf6e7af-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3a60900c-94b9-4f64-863e-03c5abf6e7af\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:49:17.192075 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:17.192059    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3a60900c-94b9-4f64-863e-03c5abf6e7af-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3a60900c-94b9-4f64-863e-03c5abf6e7af\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:49:17.192630 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:17.192611    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3a60900c-94b9-4f64-863e-03c5abf6e7af-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3a60900c-94b9-4f64-863e-03c5abf6e7af\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:49:17.198214 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:17.198195    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tz2n\" (UniqueName: \"kubernetes.io/projected/3a60900c-94b9-4f64-863e-03c5abf6e7af-kube-api-access-4tz2n\") pod \"alertmanager-main-0\" (UID: \"3a60900c-94b9-4f64-863e-03c5abf6e7af\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:49:17.295674 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:17.295633    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 22 13:49:17.438166 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:17.438077    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 22 13:49:17.440825 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:49:17.440793    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a60900c_94b9_4f64_863e_03c5abf6e7af.slice/crio-961f7b1250caa86c1ce29f7301441008f1ef66e6124606f877a5a971b6e7b236 WatchSource:0}: Error finding container 961f7b1250caa86c1ce29f7301441008f1ef66e6124606f877a5a971b6e7b236: Status 404 returned error can't find the container with id 961f7b1250caa86c1ce29f7301441008f1ef66e6124606f877a5a971b6e7b236
Jul 22 13:49:17.875394 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:17.875358    2571 generic.go:356] "Generic (PLEG): container finished" podID="3a60900c-94b9-4f64-863e-03c5abf6e7af" containerID="0233a914edbf75dbb5d069dfdf6f81aac475b635bed1c3eb538eba6d8287d48f" exitCode=0
Jul 22 13:49:17.875581 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:17.875458    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a60900c-94b9-4f64-863e-03c5abf6e7af","Type":"ContainerDied","Data":"0233a914edbf75dbb5d069dfdf6f81aac475b635bed1c3eb538eba6d8287d48f"}
Jul 22 13:49:17.875581 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:17.875528    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a60900c-94b9-4f64-863e-03c5abf6e7af","Type":"ContainerStarted","Data":"961f7b1250caa86c1ce29f7301441008f1ef66e6124606f877a5a971b6e7b236"}
Jul 22 13:49:18.883530 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:18.883493    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a60900c-94b9-4f64-863e-03c5abf6e7af","Type":"ContainerStarted","Data":"c41c9b715d0595f34b2cda78aaf371e8679efc0808b5893f2915edde09d34447"}
Jul 22 13:49:18.883899 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:18.883559    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a60900c-94b9-4f64-863e-03c5abf6e7af","Type":"ContainerStarted","Data":"620ff243777bad3ae881c4bdd60773bfc0cf07ea647dfad83a3eaa45f7c5b979"}
Jul 22 13:49:18.883899 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:18.883585    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a60900c-94b9-4f64-863e-03c5abf6e7af","Type":"ContainerStarted","Data":"6ac64233efaa390a5ef68531de288113a74e126f777d27e26461587ceeec5bb9"}
Jul 22 13:49:18.883899 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:18.883612    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a60900c-94b9-4f64-863e-03c5abf6e7af","Type":"ContainerStarted","Data":"cf3f1655bca3dd6c4623674b5ccf7ff92f5575ef8d159a2747341e745fbeb072"}
Jul 22 13:49:18.883899 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:18.883642    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a60900c-94b9-4f64-863e-03c5abf6e7af","Type":"ContainerStarted","Data":"df20ba0bad324c9575cc00e3219a342e017c4f7e96640c8eef661aa2b4f21ab7"}
Jul 22 13:49:18.883899 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:18.883666    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a60900c-94b9-4f64-863e-03c5abf6e7af","Type":"ContainerStarted","Data":"1e1cc37832f4c6edf564885814eea5443ba682559d5cee0a2872f82868237799"}
Jul 22 13:49:18.917902 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:18.917838    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.903041116 podStartE2EDuration="2.9178211s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.779984ms" isStatefulPod=false podCreationTimestamp="2026-07-22 13:49:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:49:18.915786853 +0000 UTC m=+168.970563530" watchObservedRunningTime="2026-07-22 13:49:18.9178211 +0000 UTC m=+168.972597776"
Jul 22 13:49:19.560031 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.559992    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 13:49:19.560439 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.560360    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="20956ee1-7da1-4688-90e3-b93b318c4357" containerName="prometheus" containerID="cri-o://c302df155319cb9960f49175d0bccd9e0cd1599a921c5144a995bdab5497dcb7" gracePeriod=600
Jul 22 13:49:19.560439 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.560375    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="20956ee1-7da1-4688-90e3-b93b318c4357" containerName="kube-rbac-proxy" containerID="cri-o://309b7061a0868aa6ff576237a6fc86eb7152485c8425405dc2c558016e6c2438" gracePeriod=600
Jul 22 13:49:19.560619 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.560441    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="20956ee1-7da1-4688-90e3-b93b318c4357" containerName="config-reloader" containerID="cri-o://ad10c06389bcd191513944e3b41392b57a8dfcf662d1753345d5f8d56df6d2a7" gracePeriod=600
Jul 22 13:49:19.560619 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.560456    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="20956ee1-7da1-4688-90e3-b93b318c4357" containerName="kube-rbac-proxy-thanos" containerID="cri-o://62a0d347082018aa45f06eba21c15cdc0d1e1508db61d011e930352b5399c39c" gracePeriod=600
Jul 22 13:49:19.560619 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.560436    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="20956ee1-7da1-4688-90e3-b93b318c4357" containerName="kube-rbac-proxy-web" containerID="cri-o://f6c4c10ab4315ad2cda2b23d71ba6c2a3802e92a85914ea7d798d14ec045c2fd" gracePeriod=600
Jul 22 13:49:19.561510 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.560817    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="20956ee1-7da1-4688-90e3-b93b318c4357" containerName="thanos-sidecar" containerID="cri-o://a44cd7baceee2a5f67a7f4dbe16d908065d0bf3f7da00bc41e93c5d21beb92fa" gracePeriod=600
Jul 22 13:49:19.813318 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.813251    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:49:19.891769 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.891737    2571 generic.go:356] "Generic (PLEG): container finished" podID="20956ee1-7da1-4688-90e3-b93b318c4357" containerID="62a0d347082018aa45f06eba21c15cdc0d1e1508db61d011e930352b5399c39c" exitCode=0
Jul 22 13:49:19.891769 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.891761    2571 generic.go:356] "Generic (PLEG): container finished" podID="20956ee1-7da1-4688-90e3-b93b318c4357" containerID="309b7061a0868aa6ff576237a6fc86eb7152485c8425405dc2c558016e6c2438" exitCode=0
Jul 22 13:49:19.891769 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.891768    2571 generic.go:356] "Generic (PLEG): container finished" podID="20956ee1-7da1-4688-90e3-b93b318c4357" containerID="f6c4c10ab4315ad2cda2b23d71ba6c2a3802e92a85914ea7d798d14ec045c2fd" exitCode=0
Jul 22 13:49:19.891769 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.891773    2571 generic.go:356] "Generic (PLEG): container finished" podID="20956ee1-7da1-4688-90e3-b93b318c4357" containerID="a44cd7baceee2a5f67a7f4dbe16d908065d0bf3f7da00bc41e93c5d21beb92fa" exitCode=0
Jul 22 13:49:19.891769 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.891779    2571 generic.go:356] "Generic (PLEG): container finished" podID="20956ee1-7da1-4688-90e3-b93b318c4357" containerID="ad10c06389bcd191513944e3b41392b57a8dfcf662d1753345d5f8d56df6d2a7" exitCode=0
Jul 22 13:49:19.892460 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.891784    2571 generic.go:356] "Generic (PLEG): container finished" podID="20956ee1-7da1-4688-90e3-b93b318c4357" containerID="c302df155319cb9960f49175d0bccd9e0cd1599a921c5144a995bdab5497dcb7" exitCode=0
Jul 22 13:49:19.892460 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.891815    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"20956ee1-7da1-4688-90e3-b93b318c4357","Type":"ContainerDied","Data":"62a0d347082018aa45f06eba21c15cdc0d1e1508db61d011e930352b5399c39c"}
Jul 22 13:49:19.892460 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.891842    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:49:19.892460 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.891883    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"20956ee1-7da1-4688-90e3-b93b318c4357","Type":"ContainerDied","Data":"309b7061a0868aa6ff576237a6fc86eb7152485c8425405dc2c558016e6c2438"}
Jul 22 13:49:19.892460 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.891913    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"20956ee1-7da1-4688-90e3-b93b318c4357","Type":"ContainerDied","Data":"f6c4c10ab4315ad2cda2b23d71ba6c2a3802e92a85914ea7d798d14ec045c2fd"}
Jul 22 13:49:19.892460 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.891938    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"20956ee1-7da1-4688-90e3-b93b318c4357","Type":"ContainerDied","Data":"a44cd7baceee2a5f67a7f4dbe16d908065d0bf3f7da00bc41e93c5d21beb92fa"}
Jul 22 13:49:19.892460 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.891964    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"20956ee1-7da1-4688-90e3-b93b318c4357","Type":"ContainerDied","Data":"ad10c06389bcd191513944e3b41392b57a8dfcf662d1753345d5f8d56df6d2a7"}
Jul 22 13:49:19.892460 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.891980    2571 scope.go:117] "RemoveContainer" containerID="62a0d347082018aa45f06eba21c15cdc0d1e1508db61d011e930352b5399c39c"
Jul 22 13:49:19.892460 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.891988    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"20956ee1-7da1-4688-90e3-b93b318c4357","Type":"ContainerDied","Data":"c302df155319cb9960f49175d0bccd9e0cd1599a921c5144a995bdab5497dcb7"}
Jul 22 13:49:19.892460 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.892013    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"20956ee1-7da1-4688-90e3-b93b318c4357","Type":"ContainerDied","Data":"2dc66a9524c4ecee862af102fdd52085e88d38ad902aa3348178fc23bc22888b"}
Jul 22 13:49:19.900392 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.900376    2571 scope.go:117] "RemoveContainer" containerID="309b7061a0868aa6ff576237a6fc86eb7152485c8425405dc2c558016e6c2438"
Jul 22 13:49:19.907775 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.907758    2571 scope.go:117] "RemoveContainer" containerID="f6c4c10ab4315ad2cda2b23d71ba6c2a3802e92a85914ea7d798d14ec045c2fd"
Jul 22 13:49:19.911945 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.911913    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/20956ee1-7da1-4688-90e3-b93b318c4357-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"20956ee1-7da1-4688-90e3-b93b318c4357\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") "
Jul 22 13:49:19.912054 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.911960    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hmwvp\" (UniqueName: \"kubernetes.io/projected/20956ee1-7da1-4688-90e3-b93b318c4357-kube-api-access-hmwvp\") pod \"20956ee1-7da1-4688-90e3-b93b318c4357\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") "
Jul 22 13:49:19.912054 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.911990    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/20956ee1-7da1-4688-90e3-b93b318c4357-configmap-metrics-client-ca\") pod \"20956ee1-7da1-4688-90e3-b93b318c4357\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") "
Jul 22 13:49:19.912054 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.912021    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20956ee1-7da1-4688-90e3-b93b318c4357-configmap-kubelet-serving-ca-bundle\") pod \"20956ee1-7da1-4688-90e3-b93b318c4357\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") "
Jul 22 13:49:19.912203 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.912061    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/20956ee1-7da1-4688-90e3-b93b318c4357-prometheus-k8s-db\") pod \"20956ee1-7da1-4688-90e3-b93b318c4357\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") "
Jul 22 13:49:19.912203 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.912109    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/20956ee1-7da1-4688-90e3-b93b318c4357-secret-prometheus-k8s-tls\") pod \"20956ee1-7da1-4688-90e3-b93b318c4357\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") "
Jul 22 13:49:19.912203 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.912137    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/20956ee1-7da1-4688-90e3-b93b318c4357-web-config\") pod \"20956ee1-7da1-4688-90e3-b93b318c4357\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") "
Jul 22 13:49:19.912617 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.912555    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/20956ee1-7da1-4688-90e3-b93b318c4357-secret-kube-rbac-proxy\") pod \"20956ee1-7da1-4688-90e3-b93b318c4357\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") "
Jul 22 13:49:19.912695 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.912434    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20956ee1-7da1-4688-90e3-b93b318c4357-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "20956ee1-7da1-4688-90e3-b93b318c4357" (UID: "20956ee1-7da1-4688-90e3-b93b318c4357"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 13:49:19.912695 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.912477    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20956ee1-7da1-4688-90e3-b93b318c4357-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "20956ee1-7da1-4688-90e3-b93b318c4357" (UID: "20956ee1-7da1-4688-90e3-b93b318c4357"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 13:49:19.912695 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.912616    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/20956ee1-7da1-4688-90e3-b93b318c4357-prometheus-k8s-rulefiles-2\") pod \"20956ee1-7da1-4688-90e3-b93b318c4357\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") "
Jul 22 13:49:19.912859 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.912696    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/20956ee1-7da1-4688-90e3-b93b318c4357-thanos-prometheus-http-client-file\") pod \"20956ee1-7da1-4688-90e3-b93b318c4357\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") "
Jul 22 13:49:19.912859 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.912734    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/20956ee1-7da1-4688-90e3-b93b318c4357-config-out\") pod \"20956ee1-7da1-4688-90e3-b93b318c4357\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") "
Jul 22 13:49:19.912859 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.912765    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/20956ee1-7da1-4688-90e3-b93b318c4357-prometheus-k8s-rulefiles-1\") pod \"20956ee1-7da1-4688-90e3-b93b318c4357\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") "
Jul 22 13:49:19.912859 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.912795    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/20956ee1-7da1-4688-90e3-b93b318c4357-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"20956ee1-7da1-4688-90e3-b93b318c4357\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") "
Jul 22 13:49:19.912859 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.912821    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/20956ee1-7da1-4688-90e3-b93b318c4357-tls-assets\") pod \"20956ee1-7da1-4688-90e3-b93b318c4357\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") "
Jul 22 13:49:19.912859 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.912851    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20956ee1-7da1-4688-90e3-b93b318c4357-configmap-serving-certs-ca-bundle\") pod \"20956ee1-7da1-4688-90e3-b93b318c4357\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") "
Jul 22 13:49:19.913130 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.912883    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/20956ee1-7da1-4688-90e3-b93b318c4357-secret-grpc-tls\") pod \"20956ee1-7da1-4688-90e3-b93b318c4357\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") "
Jul 22 13:49:19.913130 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.912930    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/20956ee1-7da1-4688-90e3-b93b318c4357-prometheus-k8s-rulefiles-0\") pod \"20956ee1-7da1-4688-90e3-b93b318c4357\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") "
Jul 22 13:49:19.913130 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.912938    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20956ee1-7da1-4688-90e3-b93b318c4357-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "20956ee1-7da1-4688-90e3-b93b318c4357" (UID: "20956ee1-7da1-4688-90e3-b93b318c4357"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 13:49:19.913130 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.912956    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20956ee1-7da1-4688-90e3-b93b318c4357-prometheus-trusted-ca-bundle\") pod \"20956ee1-7da1-4688-90e3-b93b318c4357\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") "
Jul 22 13:49:19.913360 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.913330    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20956ee1-7da1-4688-90e3-b93b318c4357-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "20956ee1-7da1-4688-90e3-b93b318c4357" (UID: "20956ee1-7da1-4688-90e3-b93b318c4357"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 13:49:19.914003 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.913972    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20956ee1-7da1-4688-90e3-b93b318c4357-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "20956ee1-7da1-4688-90e3-b93b318c4357" (UID: "20956ee1-7da1-4688-90e3-b93b318c4357"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 13:49:19.915092 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.914619    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/20956ee1-7da1-4688-90e3-b93b318c4357-config\") pod \"20956ee1-7da1-4688-90e3-b93b318c4357\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") "
Jul 22 13:49:19.915092 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.914668    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/20956ee1-7da1-4688-90e3-b93b318c4357-secret-metrics-client-certs\") pod \"20956ee1-7da1-4688-90e3-b93b318c4357\" (UID: \"20956ee1-7da1-4688-90e3-b93b318c4357\") "
Jul 22 13:49:19.915092 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.914750    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20956ee1-7da1-4688-90e3-b93b318c4357-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "20956ee1-7da1-4688-90e3-b93b318c4357" (UID: "20956ee1-7da1-4688-90e3-b93b318c4357"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 13:49:19.915092 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.914980    2571 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/20956ee1-7da1-4688-90e3-b93b318c4357-configmap-metrics-client-ca\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 13:49:19.915092 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.915000    2571 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20956ee1-7da1-4688-90e3-b93b318c4357-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 13:49:19.915092 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.915018    2571 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/20956ee1-7da1-4688-90e3-b93b318c4357-prometheus-k8s-db\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 13:49:19.915092 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.915031    2571 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/20956ee1-7da1-4688-90e3-b93b318c4357-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 13:49:19.915092 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.915044    2571 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/20956ee1-7da1-4688-90e3-b93b318c4357-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 13:49:19.915092 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.915059    2571 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20956ee1-7da1-4688-90e3-b93b318c4357-prometheus-trusted-ca-bundle\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 13:49:19.915610 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.915204    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20956ee1-7da1-4688-90e3-b93b318c4357-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "20956ee1-7da1-4688-90e3-b93b318c4357" (UID: "20956ee1-7da1-4688-90e3-b93b318c4357"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 13:49:19.915610 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.915274    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20956ee1-7da1-4688-90e3-b93b318c4357-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "20956ee1-7da1-4688-90e3-b93b318c4357" (UID: "20956ee1-7da1-4688-90e3-b93b318c4357"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 13:49:19.915610 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.915361    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20956ee1-7da1-4688-90e3-b93b318c4357-kube-api-access-hmwvp" (OuterVolumeSpecName: "kube-api-access-hmwvp") pod "20956ee1-7da1-4688-90e3-b93b318c4357" (UID: "20956ee1-7da1-4688-90e3-b93b318c4357"). InnerVolumeSpecName "kube-api-access-hmwvp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 13:49:19.916030 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.915996    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20956ee1-7da1-4688-90e3-b93b318c4357-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "20956ee1-7da1-4688-90e3-b93b318c4357" (UID: "20956ee1-7da1-4688-90e3-b93b318c4357"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 13:49:19.916030 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.916000    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20956ee1-7da1-4688-90e3-b93b318c4357-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "20956ee1-7da1-4688-90e3-b93b318c4357" (UID: "20956ee1-7da1-4688-90e3-b93b318c4357"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 13:49:19.916354 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.916329    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20956ee1-7da1-4688-90e3-b93b318c4357-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "20956ee1-7da1-4688-90e3-b93b318c4357" (UID: "20956ee1-7da1-4688-90e3-b93b318c4357"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 13:49:19.916702 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.916676    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20956ee1-7da1-4688-90e3-b93b318c4357-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "20956ee1-7da1-4688-90e3-b93b318c4357" (UID: "20956ee1-7da1-4688-90e3-b93b318c4357"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 13:49:19.916942 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.916924    2571 scope.go:117] "RemoveContainer" containerID="a44cd7baceee2a5f67a7f4dbe16d908065d0bf3f7da00bc41e93c5d21beb92fa"
Jul 22 13:49:19.917205 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.917182    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20956ee1-7da1-4688-90e3-b93b318c4357-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "20956ee1-7da1-4688-90e3-b93b318c4357" (UID: "20956ee1-7da1-4688-90e3-b93b318c4357"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 13:49:19.917798 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.917741    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20956ee1-7da1-4688-90e3-b93b318c4357-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "20956ee1-7da1-4688-90e3-b93b318c4357" (UID: "20956ee1-7da1-4688-90e3-b93b318c4357"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 13:49:19.917915 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.917807    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20956ee1-7da1-4688-90e3-b93b318c4357-config" (OuterVolumeSpecName: "config") pod "20956ee1-7da1-4688-90e3-b93b318c4357" (UID: "20956ee1-7da1-4688-90e3-b93b318c4357"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 13:49:19.917915 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.917895    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20956ee1-7da1-4688-90e3-b93b318c4357-config-out" (OuterVolumeSpecName: "config-out") pod "20956ee1-7da1-4688-90e3-b93b318c4357" (UID: "20956ee1-7da1-4688-90e3-b93b318c4357"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 13:49:19.918214 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.918183    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20956ee1-7da1-4688-90e3-b93b318c4357-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "20956ee1-7da1-4688-90e3-b93b318c4357" (UID: "20956ee1-7da1-4688-90e3-b93b318c4357"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 13:49:19.919394 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.919370    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20956ee1-7da1-4688-90e3-b93b318c4357-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "20956ee1-7da1-4688-90e3-b93b318c4357" (UID: "20956ee1-7da1-4688-90e3-b93b318c4357"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 13:49:19.924651 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.924628    2571 scope.go:117] "RemoveContainer" containerID="ad10c06389bcd191513944e3b41392b57a8dfcf662d1753345d5f8d56df6d2a7"
Jul 22 13:49:19.929104 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.929076    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20956ee1-7da1-4688-90e3-b93b318c4357-web-config" (OuterVolumeSpecName: "web-config") pod "20956ee1-7da1-4688-90e3-b93b318c4357" (UID: "20956ee1-7da1-4688-90e3-b93b318c4357"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 13:49:19.931917 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.931898    2571 scope.go:117] "RemoveContainer" containerID="c302df155319cb9960f49175d0bccd9e0cd1599a921c5144a995bdab5497dcb7"
Jul 22 13:49:19.939348 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.939329    2571 scope.go:117] "RemoveContainer" containerID="99a3b2bcedc6f4757f4f113566306a3e3acaf567cedfa1067d931d11151b6a10"
Jul 22 13:49:19.948145 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.948125    2571 scope.go:117] "RemoveContainer" containerID="62a0d347082018aa45f06eba21c15cdc0d1e1508db61d011e930352b5399c39c"
Jul 22 13:49:19.948631 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:49:19.948606    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62a0d347082018aa45f06eba21c15cdc0d1e1508db61d011e930352b5399c39c\": container with ID starting with 62a0d347082018aa45f06eba21c15cdc0d1e1508db61d011e930352b5399c39c not found: ID does not exist" containerID="62a0d347082018aa45f06eba21c15cdc0d1e1508db61d011e930352b5399c39c"
Jul 22 13:49:19.948712 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.948638    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62a0d347082018aa45f06eba21c15cdc0d1e1508db61d011e930352b5399c39c"} err="failed to get container status \"62a0d347082018aa45f06eba21c15cdc0d1e1508db61d011e930352b5399c39c\": rpc error: code = NotFound desc = could not find container \"62a0d347082018aa45f06eba21c15cdc0d1e1508db61d011e930352b5399c39c\": container with ID starting with 62a0d347082018aa45f06eba21c15cdc0d1e1508db61d011e930352b5399c39c not found: ID does not exist"
Jul 22 13:49:19.948712 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.948659    2571 scope.go:117] "RemoveContainer" containerID="309b7061a0868aa6ff576237a6fc86eb7152485c8425405dc2c558016e6c2438"
Jul 22 13:49:19.948954 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:49:19.948936    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"309b7061a0868aa6ff576237a6fc86eb7152485c8425405dc2c558016e6c2438\": container with ID starting with 309b7061a0868aa6ff576237a6fc86eb7152485c8425405dc2c558016e6c2438 not found: ID does not exist" containerID="309b7061a0868aa6ff576237a6fc86eb7152485c8425405dc2c558016e6c2438"
Jul 22 13:49:19.949010 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.948961    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"309b7061a0868aa6ff576237a6fc86eb7152485c8425405dc2c558016e6c2438"} err="failed to get container status \"309b7061a0868aa6ff576237a6fc86eb7152485c8425405dc2c558016e6c2438\": rpc error: code = NotFound desc = could not find container \"309b7061a0868aa6ff576237a6fc86eb7152485c8425405dc2c558016e6c2438\": container with ID starting with 309b7061a0868aa6ff576237a6fc86eb7152485c8425405dc2c558016e6c2438 not found: ID does not exist"
Jul 22 13:49:19.949010 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.948977    2571 scope.go:117] "RemoveContainer" containerID="f6c4c10ab4315ad2cda2b23d71ba6c2a3802e92a85914ea7d798d14ec045c2fd"
Jul 22 13:49:19.949226 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:49:19.949212    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6c4c10ab4315ad2cda2b23d71ba6c2a3802e92a85914ea7d798d14ec045c2fd\": container with ID starting with f6c4c10ab4315ad2cda2b23d71ba6c2a3802e92a85914ea7d798d14ec045c2fd not found: ID does not exist" containerID="f6c4c10ab4315ad2cda2b23d71ba6c2a3802e92a85914ea7d798d14ec045c2fd"
Jul 22 13:49:19.949266 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.949229    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6c4c10ab4315ad2cda2b23d71ba6c2a3802e92a85914ea7d798d14ec045c2fd"} err="failed to get container status \"f6c4c10ab4315ad2cda2b23d71ba6c2a3802e92a85914ea7d798d14ec045c2fd\": rpc error: code = NotFound desc = could not find container \"f6c4c10ab4315ad2cda2b23d71ba6c2a3802e92a85914ea7d798d14ec045c2fd\": container with ID starting with f6c4c10ab4315ad2cda2b23d71ba6c2a3802e92a85914ea7d798d14ec045c2fd not found: ID does not exist"
Jul 22 13:49:19.949266 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.949243    2571 scope.go:117] "RemoveContainer" containerID="a44cd7baceee2a5f67a7f4dbe16d908065d0bf3f7da00bc41e93c5d21beb92fa"
Jul 22 13:49:19.949489 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:49:19.949472    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a44cd7baceee2a5f67a7f4dbe16d908065d0bf3f7da00bc41e93c5d21beb92fa\": container with ID starting with a44cd7baceee2a5f67a7f4dbe16d908065d0bf3f7da00bc41e93c5d21beb92fa not found: ID does not exist" containerID="a44cd7baceee2a5f67a7f4dbe16d908065d0bf3f7da00bc41e93c5d21beb92fa"
Jul 22 13:49:19.949553 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.949493    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a44cd7baceee2a5f67a7f4dbe16d908065d0bf3f7da00bc41e93c5d21beb92fa"} err="failed to get container status \"a44cd7baceee2a5f67a7f4dbe16d908065d0bf3f7da00bc41e93c5d21beb92fa\": rpc error: code = NotFound desc = could not find container \"a44cd7baceee2a5f67a7f4dbe16d908065d0bf3f7da00bc41e93c5d21beb92fa\": container with ID starting with a44cd7baceee2a5f67a7f4dbe16d908065d0bf3f7da00bc41e93c5d21beb92fa not found: ID does not exist"
Jul 22 13:49:19.949553 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.949507    2571 scope.go:117] "RemoveContainer" containerID="ad10c06389bcd191513944e3b41392b57a8dfcf662d1753345d5f8d56df6d2a7"
Jul 22 13:49:19.949734 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:49:19.949718    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad10c06389bcd191513944e3b41392b57a8dfcf662d1753345d5f8d56df6d2a7\": container with ID starting with ad10c06389bcd191513944e3b41392b57a8dfcf662d1753345d5f8d56df6d2a7 not found: ID does not exist" containerID="ad10c06389bcd191513944e3b41392b57a8dfcf662d1753345d5f8d56df6d2a7"
Jul 22 13:49:19.949781 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.949737    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad10c06389bcd191513944e3b41392b57a8dfcf662d1753345d5f8d56df6d2a7"} err="failed to get container status \"ad10c06389bcd191513944e3b41392b57a8dfcf662d1753345d5f8d56df6d2a7\": rpc error: code = NotFound desc = could not find container \"ad10c06389bcd191513944e3b41392b57a8dfcf662d1753345d5f8d56df6d2a7\": container with ID starting with ad10c06389bcd191513944e3b41392b57a8dfcf662d1753345d5f8d56df6d2a7 not found: ID does not exist"
Jul 22 13:49:19.949781 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.949750    2571 scope.go:117] "RemoveContainer" containerID="c302df155319cb9960f49175d0bccd9e0cd1599a921c5144a995bdab5497dcb7"
Jul 22 13:49:19.949982 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:49:19.949967    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c302df155319cb9960f49175d0bccd9e0cd1599a921c5144a995bdab5497dcb7\": container with ID starting with c302df155319cb9960f49175d0bccd9e0cd1599a921c5144a995bdab5497dcb7 not found: ID does not exist" containerID="c302df155319cb9960f49175d0bccd9e0cd1599a921c5144a995bdab5497dcb7"
Jul 22 13:49:19.950074 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.949984    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c302df155319cb9960f49175d0bccd9e0cd1599a921c5144a995bdab5497dcb7"} err="failed to get container status \"c302df155319cb9960f49175d0bccd9e0cd1599a921c5144a995bdab5497dcb7\": rpc error: code = NotFound desc = could not find container \"c302df155319cb9960f49175d0bccd9e0cd1599a921c5144a995bdab5497dcb7\": container with ID starting with c302df155319cb9960f49175d0bccd9e0cd1599a921c5144a995bdab5497dcb7 not found: ID does not exist"
Jul 22 13:49:19.950074 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.949996    2571 scope.go:117] "RemoveContainer" containerID="99a3b2bcedc6f4757f4f113566306a3e3acaf567cedfa1067d931d11151b6a10"
Jul 22 13:49:19.950226 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:49:19.950209    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99a3b2bcedc6f4757f4f113566306a3e3acaf567cedfa1067d931d11151b6a10\": container with ID starting with 99a3b2bcedc6f4757f4f113566306a3e3acaf567cedfa1067d931d11151b6a10 not found: ID does not exist" containerID="99a3b2bcedc6f4757f4f113566306a3e3acaf567cedfa1067d931d11151b6a10"
Jul 22 13:49:19.950261 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.950230    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99a3b2bcedc6f4757f4f113566306a3e3acaf567cedfa1067d931d11151b6a10"} err="failed to get container status \"99a3b2bcedc6f4757f4f113566306a3e3acaf567cedfa1067d931d11151b6a10\": rpc error: code = NotFound desc = could not find container \"99a3b2bcedc6f4757f4f113566306a3e3acaf567cedfa1067d931d11151b6a10\": container with ID starting with 99a3b2bcedc6f4757f4f113566306a3e3acaf567cedfa1067d931d11151b6a10 not found: ID does not exist"
Jul 22 13:49:19.950261 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.950248    2571 scope.go:117] "RemoveContainer" containerID="62a0d347082018aa45f06eba21c15cdc0d1e1508db61d011e930352b5399c39c"
Jul 22 13:49:19.950479 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.950463    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62a0d347082018aa45f06eba21c15cdc0d1e1508db61d011e930352b5399c39c"} err="failed to get container status \"62a0d347082018aa45f06eba21c15cdc0d1e1508db61d011e930352b5399c39c\": rpc error: code = NotFound desc = could not find container \"62a0d347082018aa45f06eba21c15cdc0d1e1508db61d011e930352b5399c39c\": container with ID starting with 62a0d347082018aa45f06eba21c15cdc0d1e1508db61d011e930352b5399c39c not found: ID does not exist"
Jul 22 13:49:19.950520 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.950480    2571 scope.go:117] "RemoveContainer" containerID="309b7061a0868aa6ff576237a6fc86eb7152485c8425405dc2c558016e6c2438"
Jul 22 13:49:19.950699 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.950681    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"309b7061a0868aa6ff576237a6fc86eb7152485c8425405dc2c558016e6c2438"} err="failed to get container status \"309b7061a0868aa6ff576237a6fc86eb7152485c8425405dc2c558016e6c2438\": rpc error: code = NotFound desc = could not find container \"309b7061a0868aa6ff576237a6fc86eb7152485c8425405dc2c558016e6c2438\": container with ID starting with 309b7061a0868aa6ff576237a6fc86eb7152485c8425405dc2c558016e6c2438 not found: ID does not exist"
Jul 22 13:49:19.950743 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.950700    2571 scope.go:117] "RemoveContainer" containerID="f6c4c10ab4315ad2cda2b23d71ba6c2a3802e92a85914ea7d798d14ec045c2fd"
Jul 22 13:49:19.950985 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.950967    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6c4c10ab4315ad2cda2b23d71ba6c2a3802e92a85914ea7d798d14ec045c2fd"} err="failed to get container status \"f6c4c10ab4315ad2cda2b23d71ba6c2a3802e92a85914ea7d798d14ec045c2fd\": rpc error: code = NotFound desc = could not find container \"f6c4c10ab4315ad2cda2b23d71ba6c2a3802e92a85914ea7d798d14ec045c2fd\": container with ID starting with f6c4c10ab4315ad2cda2b23d71ba6c2a3802e92a85914ea7d798d14ec045c2fd not found: ID does not exist"
Jul 22 13:49:19.951047 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.950987    2571 scope.go:117] "RemoveContainer" containerID="a44cd7baceee2a5f67a7f4dbe16d908065d0bf3f7da00bc41e93c5d21beb92fa"
Jul 22 13:49:19.951288 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.951271    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a44cd7baceee2a5f67a7f4dbe16d908065d0bf3f7da00bc41e93c5d21beb92fa"} err="failed to get container status \"a44cd7baceee2a5f67a7f4dbe16d908065d0bf3f7da00bc41e93c5d21beb92fa\": rpc error: code = NotFound desc = could not find container \"a44cd7baceee2a5f67a7f4dbe16d908065d0bf3f7da00bc41e93c5d21beb92fa\": container with ID starting with a44cd7baceee2a5f67a7f4dbe16d908065d0bf3f7da00bc41e93c5d21beb92fa not found: ID does not exist"
Jul 22 13:49:19.951328 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.951289    2571 scope.go:117] "RemoveContainer" containerID="ad10c06389bcd191513944e3b41392b57a8dfcf662d1753345d5f8d56df6d2a7"
Jul 22 13:49:19.951537 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.951515    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad10c06389bcd191513944e3b41392b57a8dfcf662d1753345d5f8d56df6d2a7"} err="failed to get container status \"ad10c06389bcd191513944e3b41392b57a8dfcf662d1753345d5f8d56df6d2a7\": rpc error: code = NotFound desc = could not find container \"ad10c06389bcd191513944e3b41392b57a8dfcf662d1753345d5f8d56df6d2a7\": container with ID starting with ad10c06389bcd191513944e3b41392b57a8dfcf662d1753345d5f8d56df6d2a7 not found: ID does not exist"
Jul 22 13:49:19.951537 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.951537    2571 scope.go:117] "RemoveContainer" containerID="c302df155319cb9960f49175d0bccd9e0cd1599a921c5144a995bdab5497dcb7"
Jul 22 13:49:19.951748 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.951730    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c302df155319cb9960f49175d0bccd9e0cd1599a921c5144a995bdab5497dcb7"} err="failed to get container status \"c302df155319cb9960f49175d0bccd9e0cd1599a921c5144a995bdab5497dcb7\": rpc error: code = NotFound desc = could not find container \"c302df155319cb9960f49175d0bccd9e0cd1599a921c5144a995bdab5497dcb7\": container with ID starting with c302df155319cb9960f49175d0bccd9e0cd1599a921c5144a995bdab5497dcb7 not found: ID does not exist"
Jul 22 13:49:19.951849 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.951749    2571 scope.go:117] "RemoveContainer" containerID="99a3b2bcedc6f4757f4f113566306a3e3acaf567cedfa1067d931d11151b6a10"
Jul 22 13:49:19.951985 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.951967    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99a3b2bcedc6f4757f4f113566306a3e3acaf567cedfa1067d931d11151b6a10"} err="failed to get container status \"99a3b2bcedc6f4757f4f113566306a3e3acaf567cedfa1067d931d11151b6a10\": rpc error: code = NotFound desc = could not find container \"99a3b2bcedc6f4757f4f113566306a3e3acaf567cedfa1067d931d11151b6a10\": container with ID starting with 99a3b2bcedc6f4757f4f113566306a3e3acaf567cedfa1067d931d11151b6a10 not found: ID does not exist"
Jul 22 13:49:19.952028 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.951988    2571 scope.go:117] "RemoveContainer" containerID="62a0d347082018aa45f06eba21c15cdc0d1e1508db61d011e930352b5399c39c"
Jul 22 13:49:19.952207 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.952188    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62a0d347082018aa45f06eba21c15cdc0d1e1508db61d011e930352b5399c39c"} err="failed to get container status \"62a0d347082018aa45f06eba21c15cdc0d1e1508db61d011e930352b5399c39c\": rpc error: code = NotFound desc = could not find container \"62a0d347082018aa45f06eba21c15cdc0d1e1508db61d011e930352b5399c39c\": container with ID starting with 62a0d347082018aa45f06eba21c15cdc0d1e1508db61d011e930352b5399c39c not found: ID does not exist"
Jul 22 13:49:19.952274 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.952209    2571 scope.go:117] "RemoveContainer" containerID="309b7061a0868aa6ff576237a6fc86eb7152485c8425405dc2c558016e6c2438"
Jul 22 13:49:19.952444 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.952426    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"309b7061a0868aa6ff576237a6fc86eb7152485c8425405dc2c558016e6c2438"} err="failed to get container status \"309b7061a0868aa6ff576237a6fc86eb7152485c8425405dc2c558016e6c2438\": rpc error: code = NotFound desc = could not find container \"309b7061a0868aa6ff576237a6fc86eb7152485c8425405dc2c558016e6c2438\": container with ID starting with 309b7061a0868aa6ff576237a6fc86eb7152485c8425405dc2c558016e6c2438 not found: ID does not exist"
Jul 22 13:49:19.952498 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.952445    2571 scope.go:117] "RemoveContainer" containerID="f6c4c10ab4315ad2cda2b23d71ba6c2a3802e92a85914ea7d798d14ec045c2fd"
Jul 22 13:49:19.952666 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.952640    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6c4c10ab4315ad2cda2b23d71ba6c2a3802e92a85914ea7d798d14ec045c2fd"} err="failed to get container status \"f6c4c10ab4315ad2cda2b23d71ba6c2a3802e92a85914ea7d798d14ec045c2fd\": rpc error: code = NotFound desc = could not find container \"f6c4c10ab4315ad2cda2b23d71ba6c2a3802e92a85914ea7d798d14ec045c2fd\": container with ID starting with f6c4c10ab4315ad2cda2b23d71ba6c2a3802e92a85914ea7d798d14ec045c2fd not found: ID does not exist"
Jul 22 13:49:19.952666 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.952660    2571 scope.go:117] "RemoveContainer" containerID="a44cd7baceee2a5f67a7f4dbe16d908065d0bf3f7da00bc41e93c5d21beb92fa"
Jul 22 13:49:19.952850 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.952835    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a44cd7baceee2a5f67a7f4dbe16d908065d0bf3f7da00bc41e93c5d21beb92fa"} err="failed to get container status \"a44cd7baceee2a5f67a7f4dbe16d908065d0bf3f7da00bc41e93c5d21beb92fa\": rpc error: code = NotFound desc = could not find container \"a44cd7baceee2a5f67a7f4dbe16d908065d0bf3f7da00bc41e93c5d21beb92fa\": container with ID starting with a44cd7baceee2a5f67a7f4dbe16d908065d0bf3f7da00bc41e93c5d21beb92fa not found: ID does not exist"
Jul 22 13:49:19.952903 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.952850    2571 scope.go:117] "RemoveContainer" containerID="ad10c06389bcd191513944e3b41392b57a8dfcf662d1753345d5f8d56df6d2a7"
Jul 22 13:49:19.953032 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.953014    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad10c06389bcd191513944e3b41392b57a8dfcf662d1753345d5f8d56df6d2a7"} err="failed to get container status \"ad10c06389bcd191513944e3b41392b57a8dfcf662d1753345d5f8d56df6d2a7\": rpc error: code = NotFound desc = could not find container \"ad10c06389bcd191513944e3b41392b57a8dfcf662d1753345d5f8d56df6d2a7\": container with ID starting with ad10c06389bcd191513944e3b41392b57a8dfcf662d1753345d5f8d56df6d2a7 not found: ID does not exist"
Jul 22 13:49:19.953074 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.953032    2571 scope.go:117] "RemoveContainer" containerID="c302df155319cb9960f49175d0bccd9e0cd1599a921c5144a995bdab5497dcb7"
Jul 22 13:49:19.953225 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.953208    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c302df155319cb9960f49175d0bccd9e0cd1599a921c5144a995bdab5497dcb7"} err="failed to get container status \"c302df155319cb9960f49175d0bccd9e0cd1599a921c5144a995bdab5497dcb7\": rpc error: code = NotFound desc = could not find container \"c302df155319cb9960f49175d0bccd9e0cd1599a921c5144a995bdab5497dcb7\": container with ID starting with c302df155319cb9960f49175d0bccd9e0cd1599a921c5144a995bdab5497dcb7 not found: ID does not exist"
Jul 22 13:49:19.953277 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.953225    2571 scope.go:117] "RemoveContainer" containerID="99a3b2bcedc6f4757f4f113566306a3e3acaf567cedfa1067d931d11151b6a10"
Jul 22 13:49:19.953414 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.953388    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99a3b2bcedc6f4757f4f113566306a3e3acaf567cedfa1067d931d11151b6a10"} err="failed to get container status \"99a3b2bcedc6f4757f4f113566306a3e3acaf567cedfa1067d931d11151b6a10\": rpc error: code = NotFound desc = could not find container \"99a3b2bcedc6f4757f4f113566306a3e3acaf567cedfa1067d931d11151b6a10\": container with ID starting with 99a3b2bcedc6f4757f4f113566306a3e3acaf567cedfa1067d931d11151b6a10 not found: ID does not exist"
Jul 22 13:49:19.953468 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.953417    2571 scope.go:117] "RemoveContainer" containerID="62a0d347082018aa45f06eba21c15cdc0d1e1508db61d011e930352b5399c39c"
Jul 22 13:49:19.953618 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.953603    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62a0d347082018aa45f06eba21c15cdc0d1e1508db61d011e930352b5399c39c"} err="failed to get container status \"62a0d347082018aa45f06eba21c15cdc0d1e1508db61d011e930352b5399c39c\": rpc error: code = NotFound desc = could not find container \"62a0d347082018aa45f06eba21c15cdc0d1e1508db61d011e930352b5399c39c\": container with ID starting with 62a0d347082018aa45f06eba21c15cdc0d1e1508db61d011e930352b5399c39c not found: ID does not exist"
Jul 22 13:49:19.953671 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.953619    2571 scope.go:117] "RemoveContainer" containerID="309b7061a0868aa6ff576237a6fc86eb7152485c8425405dc2c558016e6c2438"
Jul 22 13:49:19.953809 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.953793    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"309b7061a0868aa6ff576237a6fc86eb7152485c8425405dc2c558016e6c2438"} err="failed to get container status \"309b7061a0868aa6ff576237a6fc86eb7152485c8425405dc2c558016e6c2438\": rpc error: code = NotFound desc = could not find container \"309b7061a0868aa6ff576237a6fc86eb7152485c8425405dc2c558016e6c2438\": container with ID starting with 309b7061a0868aa6ff576237a6fc86eb7152485c8425405dc2c558016e6c2438 not found: ID does not exist"
Jul 22 13:49:19.953849 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.953808    2571 scope.go:117] "RemoveContainer" containerID="f6c4c10ab4315ad2cda2b23d71ba6c2a3802e92a85914ea7d798d14ec045c2fd"
Jul 22 13:49:19.953977 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.953961    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6c4c10ab4315ad2cda2b23d71ba6c2a3802e92a85914ea7d798d14ec045c2fd"} err="failed to get container status \"f6c4c10ab4315ad2cda2b23d71ba6c2a3802e92a85914ea7d798d14ec045c2fd\": rpc error: code = NotFound desc = could not find container \"f6c4c10ab4315ad2cda2b23d71ba6c2a3802e92a85914ea7d798d14ec045c2fd\": container with ID starting with f6c4c10ab4315ad2cda2b23d71ba6c2a3802e92a85914ea7d798d14ec045c2fd not found: ID does not exist"
Jul 22 13:49:19.954016 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.953977    2571 scope.go:117] "RemoveContainer" containerID="a44cd7baceee2a5f67a7f4dbe16d908065d0bf3f7da00bc41e93c5d21beb92fa"
Jul 22 13:49:19.954157 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.954143    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a44cd7baceee2a5f67a7f4dbe16d908065d0bf3f7da00bc41e93c5d21beb92fa"} err="failed to get container status \"a44cd7baceee2a5f67a7f4dbe16d908065d0bf3f7da00bc41e93c5d21beb92fa\": rpc error: code = NotFound desc = could not find container \"a44cd7baceee2a5f67a7f4dbe16d908065d0bf3f7da00bc41e93c5d21beb92fa\": container with ID starting with a44cd7baceee2a5f67a7f4dbe16d908065d0bf3f7da00bc41e93c5d21beb92fa not found: ID does not exist"
Jul 22 13:49:19.954194 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.954157    2571 scope.go:117] "RemoveContainer" containerID="ad10c06389bcd191513944e3b41392b57a8dfcf662d1753345d5f8d56df6d2a7"
Jul 22 13:49:19.954379 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.954361    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad10c06389bcd191513944e3b41392b57a8dfcf662d1753345d5f8d56df6d2a7"} err="failed to get container status \"ad10c06389bcd191513944e3b41392b57a8dfcf662d1753345d5f8d56df6d2a7\": rpc error: code = NotFound desc = could not find container \"ad10c06389bcd191513944e3b41392b57a8dfcf662d1753345d5f8d56df6d2a7\": container with ID starting with ad10c06389bcd191513944e3b41392b57a8dfcf662d1753345d5f8d56df6d2a7 not found: ID does not exist"
Jul 22 13:49:19.954379 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.954379    2571 scope.go:117] "RemoveContainer" containerID="c302df155319cb9960f49175d0bccd9e0cd1599a921c5144a995bdab5497dcb7"
Jul 22 13:49:19.954593 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.954574    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c302df155319cb9960f49175d0bccd9e0cd1599a921c5144a995bdab5497dcb7"} err="failed to get container status \"c302df155319cb9960f49175d0bccd9e0cd1599a921c5144a995bdab5497dcb7\": rpc error: code = NotFound desc = could not find container \"c302df155319cb9960f49175d0bccd9e0cd1599a921c5144a995bdab5497dcb7\": container with ID starting with c302df155319cb9960f49175d0bccd9e0cd1599a921c5144a995bdab5497dcb7 not found: ID does not exist"
Jul 22 13:49:19.954637 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.954594    2571 scope.go:117] "RemoveContainer" containerID="99a3b2bcedc6f4757f4f113566306a3e3acaf567cedfa1067d931d11151b6a10"
Jul 22 13:49:19.954818 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.954801    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99a3b2bcedc6f4757f4f113566306a3e3acaf567cedfa1067d931d11151b6a10"} err="failed to get container status \"99a3b2bcedc6f4757f4f113566306a3e3acaf567cedfa1067d931d11151b6a10\": rpc error: code = NotFound desc = could not find container \"99a3b2bcedc6f4757f4f113566306a3e3acaf567cedfa1067d931d11151b6a10\": container with ID starting with 99a3b2bcedc6f4757f4f113566306a3e3acaf567cedfa1067d931d11151b6a10 not found: ID does not exist"
Jul 22 13:49:19.954871 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.954817    2571 scope.go:117] "RemoveContainer" containerID="62a0d347082018aa45f06eba21c15cdc0d1e1508db61d011e930352b5399c39c"
Jul 22 13:49:19.955015 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.954981    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62a0d347082018aa45f06eba21c15cdc0d1e1508db61d011e930352b5399c39c"} err="failed to get container status \"62a0d347082018aa45f06eba21c15cdc0d1e1508db61d011e930352b5399c39c\": rpc error: code = NotFound desc = could not find container \"62a0d347082018aa45f06eba21c15cdc0d1e1508db61d011e930352b5399c39c\": container with ID starting with 62a0d347082018aa45f06eba21c15cdc0d1e1508db61d011e930352b5399c39c not found: ID does not exist"
Jul 22 13:49:19.955015 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.954998    2571 scope.go:117] "RemoveContainer" containerID="309b7061a0868aa6ff576237a6fc86eb7152485c8425405dc2c558016e6c2438"
Jul 22 13:49:19.955193 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.955176    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"309b7061a0868aa6ff576237a6fc86eb7152485c8425405dc2c558016e6c2438"} err="failed to get container status \"309b7061a0868aa6ff576237a6fc86eb7152485c8425405dc2c558016e6c2438\": rpc error: code = NotFound desc = could not find container \"309b7061a0868aa6ff576237a6fc86eb7152485c8425405dc2c558016e6c2438\": container with ID starting with 309b7061a0868aa6ff576237a6fc86eb7152485c8425405dc2c558016e6c2438 not found: ID does not exist"
Jul 22 13:49:19.955235 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.955194    2571 scope.go:117] "RemoveContainer" containerID="f6c4c10ab4315ad2cda2b23d71ba6c2a3802e92a85914ea7d798d14ec045c2fd"
Jul 22 13:49:19.955381 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.955365    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6c4c10ab4315ad2cda2b23d71ba6c2a3802e92a85914ea7d798d14ec045c2fd"} err="failed to get container status \"f6c4c10ab4315ad2cda2b23d71ba6c2a3802e92a85914ea7d798d14ec045c2fd\": rpc error: code = NotFound desc = could not find container \"f6c4c10ab4315ad2cda2b23d71ba6c2a3802e92a85914ea7d798d14ec045c2fd\": container with ID starting with f6c4c10ab4315ad2cda2b23d71ba6c2a3802e92a85914ea7d798d14ec045c2fd not found: ID does not exist"
Jul 22 13:49:19.955435 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.955383    2571 scope.go:117] "RemoveContainer" containerID="a44cd7baceee2a5f67a7f4dbe16d908065d0bf3f7da00bc41e93c5d21beb92fa"
Jul 22 13:49:19.955586 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.955560    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a44cd7baceee2a5f67a7f4dbe16d908065d0bf3f7da00bc41e93c5d21beb92fa"} err="failed to get container status \"a44cd7baceee2a5f67a7f4dbe16d908065d0bf3f7da00bc41e93c5d21beb92fa\": rpc error: code = NotFound desc = could not find container \"a44cd7baceee2a5f67a7f4dbe16d908065d0bf3f7da00bc41e93c5d21beb92fa\": container with ID starting with a44cd7baceee2a5f67a7f4dbe16d908065d0bf3f7da00bc41e93c5d21beb92fa not found: ID does not exist"
Jul 22 13:49:19.955630 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.955587    2571 scope.go:117] "RemoveContainer" containerID="ad10c06389bcd191513944e3b41392b57a8dfcf662d1753345d5f8d56df6d2a7"
Jul 22 13:49:19.955807 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.955787    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad10c06389bcd191513944e3b41392b57a8dfcf662d1753345d5f8d56df6d2a7"} err="failed to get container status \"ad10c06389bcd191513944e3b41392b57a8dfcf662d1753345d5f8d56df6d2a7\": rpc error: code = NotFound desc = could not find container \"ad10c06389bcd191513944e3b41392b57a8dfcf662d1753345d5f8d56df6d2a7\": container with ID starting with ad10c06389bcd191513944e3b41392b57a8dfcf662d1753345d5f8d56df6d2a7 not found: ID does not exist"
Jul 22 13:49:19.955855 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.955808    2571 scope.go:117] "RemoveContainer" containerID="c302df155319cb9960f49175d0bccd9e0cd1599a921c5144a995bdab5497dcb7"
Jul 22 13:49:19.955999 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.955982    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c302df155319cb9960f49175d0bccd9e0cd1599a921c5144a995bdab5497dcb7"} err="failed to get container status \"c302df155319cb9960f49175d0bccd9e0cd1599a921c5144a995bdab5497dcb7\": rpc error: code = NotFound desc = could not find container \"c302df155319cb9960f49175d0bccd9e0cd1599a921c5144a995bdab5497dcb7\": container with ID starting with c302df155319cb9960f49175d0bccd9e0cd1599a921c5144a995bdab5497dcb7 not found: ID does not exist"
Jul 22 13:49:19.956047 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.955999    2571 scope.go:117] "RemoveContainer" containerID="99a3b2bcedc6f4757f4f113566306a3e3acaf567cedfa1067d931d11151b6a10"
Jul 22 13:49:19.956191 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.956176    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99a3b2bcedc6f4757f4f113566306a3e3acaf567cedfa1067d931d11151b6a10"} err="failed to get container status \"99a3b2bcedc6f4757f4f113566306a3e3acaf567cedfa1067d931d11151b6a10\": rpc error: code = NotFound desc = could not find container \"99a3b2bcedc6f4757f4f113566306a3e3acaf567cedfa1067d931d11151b6a10\": container with ID starting with 99a3b2bcedc6f4757f4f113566306a3e3acaf567cedfa1067d931d11151b6a10 not found: ID does not exist"
Jul 22 13:49:19.956246 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.956191    2571 scope.go:117] "RemoveContainer" containerID="62a0d347082018aa45f06eba21c15cdc0d1e1508db61d011e930352b5399c39c"
Jul 22 13:49:19.956468 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.956389    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62a0d347082018aa45f06eba21c15cdc0d1e1508db61d011e930352b5399c39c"} err="failed to get container status \"62a0d347082018aa45f06eba21c15cdc0d1e1508db61d011e930352b5399c39c\": rpc error: code = NotFound desc = could not find container \"62a0d347082018aa45f06eba21c15cdc0d1e1508db61d011e930352b5399c39c\": container with ID starting with 62a0d347082018aa45f06eba21c15cdc0d1e1508db61d011e930352b5399c39c not found: ID does not exist"
Jul 22 13:49:19.956527 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.956497    2571 scope.go:117] "RemoveContainer" containerID="309b7061a0868aa6ff576237a6fc86eb7152485c8425405dc2c558016e6c2438"
Jul 22 13:49:19.956726 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.956708    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"309b7061a0868aa6ff576237a6fc86eb7152485c8425405dc2c558016e6c2438"} err="failed to get container status \"309b7061a0868aa6ff576237a6fc86eb7152485c8425405dc2c558016e6c2438\": rpc error: code = NotFound desc = could not find container \"309b7061a0868aa6ff576237a6fc86eb7152485c8425405dc2c558016e6c2438\": container with ID starting with 309b7061a0868aa6ff576237a6fc86eb7152485c8425405dc2c558016e6c2438 not found: ID does not exist"
Jul 22 13:49:19.956768 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.956726    2571 scope.go:117] "RemoveContainer" containerID="f6c4c10ab4315ad2cda2b23d71ba6c2a3802e92a85914ea7d798d14ec045c2fd"
Jul 22 13:49:19.956946 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.956923    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6c4c10ab4315ad2cda2b23d71ba6c2a3802e92a85914ea7d798d14ec045c2fd"} err="failed to get container status \"f6c4c10ab4315ad2cda2b23d71ba6c2a3802e92a85914ea7d798d14ec045c2fd\": rpc error: code = NotFound desc = could not find container \"f6c4c10ab4315ad2cda2b23d71ba6c2a3802e92a85914ea7d798d14ec045c2fd\": container with ID starting with f6c4c10ab4315ad2cda2b23d71ba6c2a3802e92a85914ea7d798d14ec045c2fd not found: ID does not exist"
Jul 22 13:49:19.957001 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.956946    2571 scope.go:117] "RemoveContainer" containerID="a44cd7baceee2a5f67a7f4dbe16d908065d0bf3f7da00bc41e93c5d21beb92fa"
Jul 22 13:49:19.957154 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.957139    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a44cd7baceee2a5f67a7f4dbe16d908065d0bf3f7da00bc41e93c5d21beb92fa"} err="failed to get container status \"a44cd7baceee2a5f67a7f4dbe16d908065d0bf3f7da00bc41e93c5d21beb92fa\": rpc error: code = NotFound desc = could not find container \"a44cd7baceee2a5f67a7f4dbe16d908065d0bf3f7da00bc41e93c5d21beb92fa\": container with ID starting with a44cd7baceee2a5f67a7f4dbe16d908065d0bf3f7da00bc41e93c5d21beb92fa not found: ID does not exist"
Jul 22 13:49:19.957221 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.957155    2571 scope.go:117] "RemoveContainer" containerID="ad10c06389bcd191513944e3b41392b57a8dfcf662d1753345d5f8d56df6d2a7"
Jul 22 13:49:19.957345 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.957329    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad10c06389bcd191513944e3b41392b57a8dfcf662d1753345d5f8d56df6d2a7"} err="failed to get container status \"ad10c06389bcd191513944e3b41392b57a8dfcf662d1753345d5f8d56df6d2a7\": rpc error: code = NotFound desc = could not find container \"ad10c06389bcd191513944e3b41392b57a8dfcf662d1753345d5f8d56df6d2a7\": container with ID starting with ad10c06389bcd191513944e3b41392b57a8dfcf662d1753345d5f8d56df6d2a7 not found: ID does not exist"
Jul 22 13:49:19.957419 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.957346    2571 scope.go:117] "RemoveContainer" containerID="c302df155319cb9960f49175d0bccd9e0cd1599a921c5144a995bdab5497dcb7"
Jul 22 13:49:19.957591 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.957571    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c302df155319cb9960f49175d0bccd9e0cd1599a921c5144a995bdab5497dcb7"} err="failed to get container status \"c302df155319cb9960f49175d0bccd9e0cd1599a921c5144a995bdab5497dcb7\": rpc error: code = NotFound desc = could not find container \"c302df155319cb9960f49175d0bccd9e0cd1599a921c5144a995bdab5497dcb7\": container with ID starting with c302df155319cb9960f49175d0bccd9e0cd1599a921c5144a995bdab5497dcb7 not found: ID does not exist"
Jul 22 13:49:19.957660 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.957593    2571 scope.go:117] "RemoveContainer" containerID="99a3b2bcedc6f4757f4f113566306a3e3acaf567cedfa1067d931d11151b6a10"
Jul 22 13:49:19.957822 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:19.957804    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99a3b2bcedc6f4757f4f113566306a3e3acaf567cedfa1067d931d11151b6a10"} err="failed to get container status \"99a3b2bcedc6f4757f4f113566306a3e3acaf567cedfa1067d931d11151b6a10\": rpc error: code = NotFound desc = could not find container \"99a3b2bcedc6f4757f4f113566306a3e3acaf567cedfa1067d931d11151b6a10\": container with ID starting with 99a3b2bcedc6f4757f4f113566306a3e3acaf567cedfa1067d931d11151b6a10 not found: ID does not exist"
Jul 22 13:49:20.016478 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.016446    2571 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/20956ee1-7da1-4688-90e3-b93b318c4357-secret-prometheus-k8s-tls\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 13:49:20.016478 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.016475    2571 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/20956ee1-7da1-4688-90e3-b93b318c4357-web-config\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 13:49:20.016478 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.016484    2571 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/20956ee1-7da1-4688-90e3-b93b318c4357-secret-kube-rbac-proxy\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 13:49:20.016754 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.016493    2571 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/20956ee1-7da1-4688-90e3-b93b318c4357-thanos-prometheus-http-client-file\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 13:49:20.016754 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.016503    2571 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/20956ee1-7da1-4688-90e3-b93b318c4357-config-out\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 13:49:20.016754 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.016512    2571 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/20956ee1-7da1-4688-90e3-b93b318c4357-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 13:49:20.016754 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.016522    2571 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/20956ee1-7da1-4688-90e3-b93b318c4357-tls-assets\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 13:49:20.016754 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.016531    2571 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20956ee1-7da1-4688-90e3-b93b318c4357-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 13:49:20.016754 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.016539    2571 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/20956ee1-7da1-4688-90e3-b93b318c4357-secret-grpc-tls\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 13:49:20.016754 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.016547    2571 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/20956ee1-7da1-4688-90e3-b93b318c4357-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 13:49:20.016754 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.016555    2571 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/20956ee1-7da1-4688-90e3-b93b318c4357-config\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 13:49:20.016754 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.016564    2571 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/20956ee1-7da1-4688-90e3-b93b318c4357-secret-metrics-client-certs\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 13:49:20.016754 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.016573    2571 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/20956ee1-7da1-4688-90e3-b93b318c4357-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 13:49:20.016754 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.016582    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hmwvp\" (UniqueName: \"kubernetes.io/projected/20956ee1-7da1-4688-90e3-b93b318c4357-kube-api-access-hmwvp\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 13:49:20.217330 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.217293    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 13:49:20.222388 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.222359    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 13:49:20.247306 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.247269    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 13:49:20.247628 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.247613    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20956ee1-7da1-4688-90e3-b93b318c4357" containerName="kube-rbac-proxy-thanos"
Jul 22 13:49:20.247669 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.247629    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="20956ee1-7da1-4688-90e3-b93b318c4357" containerName="kube-rbac-proxy-thanos"
Jul 22 13:49:20.247669 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.247639    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20956ee1-7da1-4688-90e3-b93b318c4357" containerName="init-config-reloader"
Jul 22 13:49:20.247669 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.247645    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="20956ee1-7da1-4688-90e3-b93b318c4357" containerName="init-config-reloader"
Jul 22 13:49:20.247669 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.247656    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20956ee1-7da1-4688-90e3-b93b318c4357" containerName="prometheus"
Jul 22 13:49:20.247669 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.247662    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="20956ee1-7da1-4688-90e3-b93b318c4357" containerName="prometheus"
Jul 22 13:49:20.247669 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.247669    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20956ee1-7da1-4688-90e3-b93b318c4357" containerName="config-reloader"
Jul 22 13:49:20.247833 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.247676    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="20956ee1-7da1-4688-90e3-b93b318c4357" containerName="config-reloader"
Jul 22 13:49:20.247833 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.247691    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20956ee1-7da1-4688-90e3-b93b318c4357" containerName="kube-rbac-proxy-web"
Jul 22 13:49:20.247833 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.247697    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="20956ee1-7da1-4688-90e3-b93b318c4357" containerName="kube-rbac-proxy-web"
Jul 22 13:49:20.247833 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.247724    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20956ee1-7da1-4688-90e3-b93b318c4357" containerName="thanos-sidecar"
Jul 22 13:49:20.247833 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.247730    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="20956ee1-7da1-4688-90e3-b93b318c4357" containerName="thanos-sidecar"
Jul 22 13:49:20.247833 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.247737    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20956ee1-7da1-4688-90e3-b93b318c4357" containerName="kube-rbac-proxy"
Jul 22 13:49:20.247833 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.247741    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="20956ee1-7da1-4688-90e3-b93b318c4357" containerName="kube-rbac-proxy"
Jul 22 13:49:20.247833 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.247786    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="20956ee1-7da1-4688-90e3-b93b318c4357" containerName="kube-rbac-proxy"
Jul 22 13:49:20.247833 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.247793    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="20956ee1-7da1-4688-90e3-b93b318c4357" containerName="kube-rbac-proxy-thanos"
Jul 22 13:49:20.247833 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.247801    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="20956ee1-7da1-4688-90e3-b93b318c4357" containerName="config-reloader"
Jul 22 13:49:20.247833 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.247809    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="20956ee1-7da1-4688-90e3-b93b318c4357" containerName="kube-rbac-proxy-web"
Jul 22 13:49:20.247833 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.247816    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="20956ee1-7da1-4688-90e3-b93b318c4357" containerName="prometheus"
Jul 22 13:49:20.247833 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.247821    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="20956ee1-7da1-4688-90e3-b93b318c4357" containerName="thanos-sidecar"
Jul 22 13:49:20.251260 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.251243    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:49:20.253561 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.253381    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-2xdbj\""
Jul 22 13:49:20.253561 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.253393    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 22 13:49:20.253561 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.253445    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 22 13:49:20.253816 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.253634    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 22 13:49:20.253816 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.253703    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 22 13:49:20.253816 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.253805    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 22 13:49:20.253966 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.253933    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 22 13:49:20.253966 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.253961    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 22 13:49:20.254238 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.254093    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-5jb5aci2362is\""
Jul 22 13:49:20.254238 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.254105    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 22 13:49:20.254238 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.254139    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 22 13:49:20.254238 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.254139    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 22 13:49:20.254238 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.254140    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 22 13:49:20.254532 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.254502    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 22 13:49:20.257564 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.257397    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 22 13:49:20.261561 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.261539    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 22 13:49:20.266597 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.266572    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 13:49:20.420599 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.420556    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/871196a7-66d1-4412-9e0a-50782afa3418-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"871196a7-66d1-4412-9e0a-50782afa3418\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:49:20.420599 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.420606    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/871196a7-66d1-4412-9e0a-50782afa3418-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"871196a7-66d1-4412-9e0a-50782afa3418\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:49:20.420923 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.420627    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4p7vm\" (UniqueName: \"kubernetes.io/projected/871196a7-66d1-4412-9e0a-50782afa3418-kube-api-access-4p7vm\") pod \"prometheus-k8s-0\" (UID: \"871196a7-66d1-4412-9e0a-50782afa3418\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:49:20.420923 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.420708    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/871196a7-66d1-4412-9e0a-50782afa3418-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"871196a7-66d1-4412-9e0a-50782afa3418\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:49:20.420923 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.420742    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/871196a7-66d1-4412-9e0a-50782afa3418-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"871196a7-66d1-4412-9e0a-50782afa3418\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:49:20.420923 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.420762    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/871196a7-66d1-4412-9e0a-50782afa3418-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"871196a7-66d1-4412-9e0a-50782afa3418\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:49:20.420923 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.420780    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/871196a7-66d1-4412-9e0a-50782afa3418-web-config\") pod \"prometheus-k8s-0\" (UID: \"871196a7-66d1-4412-9e0a-50782afa3418\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:49:20.420923 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.420875    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/871196a7-66d1-4412-9e0a-50782afa3418-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"871196a7-66d1-4412-9e0a-50782afa3418\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:49:20.420923 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.420901    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/871196a7-66d1-4412-9e0a-50782afa3418-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"871196a7-66d1-4412-9e0a-50782afa3418\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:49:20.420923 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.420924    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/871196a7-66d1-4412-9e0a-50782afa3418-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"871196a7-66d1-4412-9e0a-50782afa3418\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:49:20.421210 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.420945    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/871196a7-66d1-4412-9e0a-50782afa3418-config-out\") pod \"prometheus-k8s-0\" (UID: \"871196a7-66d1-4412-9e0a-50782afa3418\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:49:20.421210 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.420963    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/871196a7-66d1-4412-9e0a-50782afa3418-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"871196a7-66d1-4412-9e0a-50782afa3418\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:49:20.421210 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.420985    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/871196a7-66d1-4412-9e0a-50782afa3418-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"871196a7-66d1-4412-9e0a-50782afa3418\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:49:20.421210 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.421008    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/871196a7-66d1-4412-9e0a-50782afa3418-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"871196a7-66d1-4412-9e0a-50782afa3418\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:49:20.421210 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.421033    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/871196a7-66d1-4412-9e0a-50782afa3418-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"871196a7-66d1-4412-9e0a-50782afa3418\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:49:20.421210 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.421072    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/871196a7-66d1-4412-9e0a-50782afa3418-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"871196a7-66d1-4412-9e0a-50782afa3418\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:49:20.421210 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.421096    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/871196a7-66d1-4412-9e0a-50782afa3418-config\") pod \"prometheus-k8s-0\" (UID: \"871196a7-66d1-4412-9e0a-50782afa3418\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:49:20.421210 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.421110    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/871196a7-66d1-4412-9e0a-50782afa3418-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"871196a7-66d1-4412-9e0a-50782afa3418\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:49:20.421210 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.421127    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/871196a7-66d1-4412-9e0a-50782afa3418-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"871196a7-66d1-4412-9e0a-50782afa3418\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:49:20.421210 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.421152    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/871196a7-66d1-4412-9e0a-50782afa3418-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"871196a7-66d1-4412-9e0a-50782afa3418\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:49:20.521985 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.521892    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/871196a7-66d1-4412-9e0a-50782afa3418-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"871196a7-66d1-4412-9e0a-50782afa3418\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:49:20.521985 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.521943    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/871196a7-66d1-4412-9e0a-50782afa3418-config\") pod \"prometheus-k8s-0\" (UID: \"871196a7-66d1-4412-9e0a-50782afa3418\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:49:20.522172 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.522005    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/871196a7-66d1-4412-9e0a-50782afa3418-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"871196a7-66d1-4412-9e0a-50782afa3418\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:49:20.522172 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.522038    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/871196a7-66d1-4412-9e0a-50782afa3418-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"871196a7-66d1-4412-9e0a-50782afa3418\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:49:20.522172 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.522063    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/871196a7-66d1-4412-9e0a-50782afa3418-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"871196a7-66d1-4412-9e0a-50782afa3418\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:49:20.522172 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.522081    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/871196a7-66d1-4412-9e0a-50782afa3418-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"871196a7-66d1-4412-9e0a-50782afa3418\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:49:20.522172 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.522107    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/871196a7-66d1-4412-9e0a-50782afa3418-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"871196a7-66d1-4412-9e0a-50782afa3418\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:49:20.522172 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.522122    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4p7vm\" (UniqueName: \"kubernetes.io/projected/871196a7-66d1-4412-9e0a-50782afa3418-kube-api-access-4p7vm\") pod \"prometheus-k8s-0\" (UID: \"871196a7-66d1-4412-9e0a-50782afa3418\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:49:20.522172 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.522149    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/871196a7-66d1-4412-9e0a-50782afa3418-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"871196a7-66d1-4412-9e0a-50782afa3418\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:49:20.522568 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.522177    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/871196a7-66d1-4412-9e0a-50782afa3418-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"871196a7-66d1-4412-9e0a-50782afa3418\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:49:20.522568 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.522207    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/871196a7-66d1-4412-9e0a-50782afa3418-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"871196a7-66d1-4412-9e0a-50782afa3418\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:49:20.522568 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.522240    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/871196a7-66d1-4412-9e0a-50782afa3418-web-config\") pod \"prometheus-k8s-0\" (UID: \"871196a7-66d1-4412-9e0a-50782afa3418\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:49:20.522568 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.522267    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/871196a7-66d1-4412-9e0a-50782afa3418-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"871196a7-66d1-4412-9e0a-50782afa3418\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:49:20.522568 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.522287    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/871196a7-66d1-4412-9e0a-50782afa3418-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"871196a7-66d1-4412-9e0a-50782afa3418\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:49:20.522568 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.522312    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/871196a7-66d1-4412-9e0a-50782afa3418-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"871196a7-66d1-4412-9e0a-50782afa3418\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:49:20.522568 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.522339    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/871196a7-66d1-4412-9e0a-50782afa3418-config-out\") pod \"prometheus-k8s-0\" (UID: \"871196a7-66d1-4412-9e0a-50782afa3418\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:49:20.522568 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.522360    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/871196a7-66d1-4412-9e0a-50782afa3418-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"871196a7-66d1-4412-9e0a-50782afa3418\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:49:20.522568 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.522401    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/871196a7-66d1-4412-9e0a-50782afa3418-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"871196a7-66d1-4412-9e0a-50782afa3418\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:49:20.522568 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.522479    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/871196a7-66d1-4412-9e0a-50782afa3418-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"871196a7-66d1-4412-9e0a-50782afa3418\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:49:20.522568 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.522507    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/871196a7-66d1-4412-9e0a-50782afa3418-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"871196a7-66d1-4412-9e0a-50782afa3418\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:49:20.523117 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.522821    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/871196a7-66d1-4412-9e0a-50782afa3418-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"871196a7-66d1-4412-9e0a-50782afa3418\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:49:20.523117 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.523067    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/871196a7-66d1-4412-9e0a-50782afa3418-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"871196a7-66d1-4412-9e0a-50782afa3418\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:49:20.523232 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.523170    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/871196a7-66d1-4412-9e0a-50782afa3418-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"871196a7-66d1-4412-9e0a-50782afa3418\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:49:20.525190 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.525162    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/871196a7-66d1-4412-9e0a-50782afa3418-config\") pod \"prometheus-k8s-0\" (UID: \"871196a7-66d1-4412-9e0a-50782afa3418\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:49:20.525190 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.525174    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/871196a7-66d1-4412-9e0a-50782afa3418-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"871196a7-66d1-4412-9e0a-50782afa3418\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:49:20.525386 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.525328    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/871196a7-66d1-4412-9e0a-50782afa3418-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"871196a7-66d1-4412-9e0a-50782afa3418\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:49:20.525473 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.525457    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/871196a7-66d1-4412-9e0a-50782afa3418-config-out\") pod \"prometheus-k8s-0\" (UID: \"871196a7-66d1-4412-9e0a-50782afa3418\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:49:20.525533 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.525495    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/871196a7-66d1-4412-9e0a-50782afa3418-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"871196a7-66d1-4412-9e0a-50782afa3418\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:49:20.525533 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.525504    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/871196a7-66d1-4412-9e0a-50782afa3418-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"871196a7-66d1-4412-9e0a-50782afa3418\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:49:20.526154 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.525817    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/871196a7-66d1-4412-9e0a-50782afa3418-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"871196a7-66d1-4412-9e0a-50782afa3418\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:49:20.526154 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.525815    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/871196a7-66d1-4412-9e0a-50782afa3418-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"871196a7-66d1-4412-9e0a-50782afa3418\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:49:20.526154 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.526093    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/871196a7-66d1-4412-9e0a-50782afa3418-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"871196a7-66d1-4412-9e0a-50782afa3418\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:49:20.526154 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.526111    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/871196a7-66d1-4412-9e0a-50782afa3418-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"871196a7-66d1-4412-9e0a-50782afa3418\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:49:20.526451 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.526316    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/871196a7-66d1-4412-9e0a-50782afa3418-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"871196a7-66d1-4412-9e0a-50782afa3418\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:49:20.526564 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.526539    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/871196a7-66d1-4412-9e0a-50782afa3418-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"871196a7-66d1-4412-9e0a-50782afa3418\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:49:20.527572 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.527552    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/871196a7-66d1-4412-9e0a-50782afa3418-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"871196a7-66d1-4412-9e0a-50782afa3418\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:49:20.528020 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.528000    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/871196a7-66d1-4412-9e0a-50782afa3418-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"871196a7-66d1-4412-9e0a-50782afa3418\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:49:20.528101 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.528044    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/871196a7-66d1-4412-9e0a-50782afa3418-web-config\") pod \"prometheus-k8s-0\" (UID: \"871196a7-66d1-4412-9e0a-50782afa3418\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:49:20.528376 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.528360    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/871196a7-66d1-4412-9e0a-50782afa3418-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"871196a7-66d1-4412-9e0a-50782afa3418\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:49:20.530781 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.530762    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4p7vm\" (UniqueName: \"kubernetes.io/projected/871196a7-66d1-4412-9e0a-50782afa3418-kube-api-access-4p7vm\") pod \"prometheus-k8s-0\" (UID: \"871196a7-66d1-4412-9e0a-50782afa3418\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:49:20.563869 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.563823    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:49:20.709161 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.706524    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 13:49:20.712908 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:49:20.712879    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod871196a7_66d1_4412_9e0a_50782afa3418.slice/crio-5344138d73b1ade849095ceacbf52fea650a0473676a4cab8af9248d66830d06 WatchSource:0}: Error finding container 5344138d73b1ade849095ceacbf52fea650a0473676a4cab8af9248d66830d06: Status 404 returned error can't find the container with id 5344138d73b1ade849095ceacbf52fea650a0473676a4cab8af9248d66830d06
Jul 22 13:49:20.898897 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.898861    2571 generic.go:356] "Generic (PLEG): container finished" podID="871196a7-66d1-4412-9e0a-50782afa3418" containerID="e98f4a144593cc2205106f94cb73accad89d787b618436de8c01954dce09e8d7" exitCode=0
Jul 22 13:49:20.899275 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.898915    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"871196a7-66d1-4412-9e0a-50782afa3418","Type":"ContainerDied","Data":"e98f4a144593cc2205106f94cb73accad89d787b618436de8c01954dce09e8d7"}
Jul 22 13:49:20.899275 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:20.898970    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"871196a7-66d1-4412-9e0a-50782afa3418","Type":"ContainerStarted","Data":"5344138d73b1ade849095ceacbf52fea650a0473676a4cab8af9248d66830d06"}
Jul 22 13:49:21.014131 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:21.014104    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20956ee1-7da1-4688-90e3-b93b318c4357" path="/var/lib/kubelet/pods/20956ee1-7da1-4688-90e3-b93b318c4357/volumes"
Jul 22 13:49:21.906871 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:21.906783    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"871196a7-66d1-4412-9e0a-50782afa3418","Type":"ContainerStarted","Data":"2778e3b9aba5c4f07473cc7b9fe1258d11d22964385e42e46a7086cb5c86059f"}
Jul 22 13:49:21.906871 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:21.906853    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"871196a7-66d1-4412-9e0a-50782afa3418","Type":"ContainerStarted","Data":"a143bbaea523b97d99313ddfce28e4e0d61a83283e1ef5d54c0b66b724eeebb6"}
Jul 22 13:49:21.907319 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:21.906884    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"871196a7-66d1-4412-9e0a-50782afa3418","Type":"ContainerStarted","Data":"7cd911ded074c60969b47d6effa2f0cfa5c8067f928ff5918f2ba3f62c871035"}
Jul 22 13:49:21.907319 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:21.906908    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"871196a7-66d1-4412-9e0a-50782afa3418","Type":"ContainerStarted","Data":"360befe9bae139cab00da7204e0b3764a804d56528b3b2b80961fbab1404125d"}
Jul 22 13:49:21.907319 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:21.906931    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"871196a7-66d1-4412-9e0a-50782afa3418","Type":"ContainerStarted","Data":"d9b6853d5d11f671abaef406ea9fdac041252df2c37a24a0ecee1b4fafa08276"}
Jul 22 13:49:21.907319 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:21.906955    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"871196a7-66d1-4412-9e0a-50782afa3418","Type":"ContainerStarted","Data":"622b18f5876a5534accf1f33322c4f9fa2ef1caf2ab230ce76bccecd95336e7c"}
Jul 22 13:49:21.938398 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:21.938328    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.921023107 podStartE2EDuration="1.938305955s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.282848ms" isStatefulPod=false podCreationTimestamp="2026-07-22 13:49:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:49:21.936150523 +0000 UTC m=+171.990927201" watchObservedRunningTime="2026-07-22 13:49:21.938305955 +0000 UTC m=+171.993082632"
Jul 22 13:49:24.406078 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:24.406043    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-99f96556f-skgtb"]
Jul 22 13:49:24.408299 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:24.408280    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-99f96556f-skgtb"
Jul 22 13:49:24.421346 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:24.421317    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-99f96556f-skgtb"]
Jul 22 13:49:24.560989 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:24.560945    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/74621e96-bc4b-4e5b-9b3c-143de94fb294-console-oauth-config\") pod \"console-99f96556f-skgtb\" (UID: \"74621e96-bc4b-4e5b-9b3c-143de94fb294\") " pod="openshift-console/console-99f96556f-skgtb"
Jul 22 13:49:24.561190 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:24.560999    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/74621e96-bc4b-4e5b-9b3c-143de94fb294-console-config\") pod \"console-99f96556f-skgtb\" (UID: \"74621e96-bc4b-4e5b-9b3c-143de94fb294\") " pod="openshift-console/console-99f96556f-skgtb"
Jul 22 13:49:24.561190 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:24.561123    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/74621e96-bc4b-4e5b-9b3c-143de94fb294-service-ca\") pod \"console-99f96556f-skgtb\" (UID: \"74621e96-bc4b-4e5b-9b3c-143de94fb294\") " pod="openshift-console/console-99f96556f-skgtb"
Jul 22 13:49:24.561190 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:24.561168    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/74621e96-bc4b-4e5b-9b3c-143de94fb294-console-serving-cert\") pod \"console-99f96556f-skgtb\" (UID: \"74621e96-bc4b-4e5b-9b3c-143de94fb294\") " pod="openshift-console/console-99f96556f-skgtb"
Jul 22 13:49:24.561352 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:24.561219    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcq7h\" (UniqueName: \"kubernetes.io/projected/74621e96-bc4b-4e5b-9b3c-143de94fb294-kube-api-access-dcq7h\") pod \"console-99f96556f-skgtb\" (UID: \"74621e96-bc4b-4e5b-9b3c-143de94fb294\") " pod="openshift-console/console-99f96556f-skgtb"
Jul 22 13:49:24.561352 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:24.561299    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74621e96-bc4b-4e5b-9b3c-143de94fb294-trusted-ca-bundle\") pod \"console-99f96556f-skgtb\" (UID: \"74621e96-bc4b-4e5b-9b3c-143de94fb294\") " pod="openshift-console/console-99f96556f-skgtb"
Jul 22 13:49:24.561477 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:24.561443    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/74621e96-bc4b-4e5b-9b3c-143de94fb294-oauth-serving-cert\") pod \"console-99f96556f-skgtb\" (UID: \"74621e96-bc4b-4e5b-9b3c-143de94fb294\") " pod="openshift-console/console-99f96556f-skgtb"
Jul 22 13:49:24.662880 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:24.662772    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/74621e96-bc4b-4e5b-9b3c-143de94fb294-console-oauth-config\") pod \"console-99f96556f-skgtb\" (UID: \"74621e96-bc4b-4e5b-9b3c-143de94fb294\") " pod="openshift-console/console-99f96556f-skgtb"
Jul 22 13:49:24.662880 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:24.662832    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/74621e96-bc4b-4e5b-9b3c-143de94fb294-console-config\") pod \"console-99f96556f-skgtb\" (UID: \"74621e96-bc4b-4e5b-9b3c-143de94fb294\") " pod="openshift-console/console-99f96556f-skgtb"
Jul 22 13:49:24.662880 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:24.662872    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/74621e96-bc4b-4e5b-9b3c-143de94fb294-service-ca\") pod \"console-99f96556f-skgtb\" (UID: \"74621e96-bc4b-4e5b-9b3c-143de94fb294\") " pod="openshift-console/console-99f96556f-skgtb"
Jul 22 13:49:24.663145 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:24.662903    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/74621e96-bc4b-4e5b-9b3c-143de94fb294-console-serving-cert\") pod \"console-99f96556f-skgtb\" (UID: \"74621e96-bc4b-4e5b-9b3c-143de94fb294\") " pod="openshift-console/console-99f96556f-skgtb"
Jul 22 13:49:24.663145 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:24.662949    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcq7h\" (UniqueName: \"kubernetes.io/projected/74621e96-bc4b-4e5b-9b3c-143de94fb294-kube-api-access-dcq7h\") pod \"console-99f96556f-skgtb\" (UID: \"74621e96-bc4b-4e5b-9b3c-143de94fb294\") " pod="openshift-console/console-99f96556f-skgtb"
Jul 22 13:49:24.663145 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:24.662979    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74621e96-bc4b-4e5b-9b3c-143de94fb294-trusted-ca-bundle\") pod \"console-99f96556f-skgtb\" (UID: \"74621e96-bc4b-4e5b-9b3c-143de94fb294\") " pod="openshift-console/console-99f96556f-skgtb"
Jul 22 13:49:24.663145 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:24.663056    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/74621e96-bc4b-4e5b-9b3c-143de94fb294-oauth-serving-cert\") pod \"console-99f96556f-skgtb\" (UID: \"74621e96-bc4b-4e5b-9b3c-143de94fb294\") " pod="openshift-console/console-99f96556f-skgtb"
Jul 22 13:49:24.663877 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:24.663846    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/74621e96-bc4b-4e5b-9b3c-143de94fb294-oauth-serving-cert\") pod \"console-99f96556f-skgtb\" (UID: \"74621e96-bc4b-4e5b-9b3c-143de94fb294\") " pod="openshift-console/console-99f96556f-skgtb"
Jul 22 13:49:24.664799 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:24.664768    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/74621e96-bc4b-4e5b-9b3c-143de94fb294-console-config\") pod \"console-99f96556f-skgtb\" (UID: \"74621e96-bc4b-4e5b-9b3c-143de94fb294\") " pod="openshift-console/console-99f96556f-skgtb"
Jul 22 13:49:24.664938 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:24.664918    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74621e96-bc4b-4e5b-9b3c-143de94fb294-trusted-ca-bundle\") pod \"console-99f96556f-skgtb\" (UID: \"74621e96-bc4b-4e5b-9b3c-143de94fb294\") " pod="openshift-console/console-99f96556f-skgtb"
Jul 22 13:49:24.664999 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:24.664952    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/74621e96-bc4b-4e5b-9b3c-143de94fb294-service-ca\") pod \"console-99f96556f-skgtb\" (UID: \"74621e96-bc4b-4e5b-9b3c-143de94fb294\") " pod="openshift-console/console-99f96556f-skgtb"
Jul 22 13:49:24.666384 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:24.666354    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/74621e96-bc4b-4e5b-9b3c-143de94fb294-console-oauth-config\") pod \"console-99f96556f-skgtb\" (UID: \"74621e96-bc4b-4e5b-9b3c-143de94fb294\") " pod="openshift-console/console-99f96556f-skgtb"
Jul 22 13:49:24.666604 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:24.666586    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/74621e96-bc4b-4e5b-9b3c-143de94fb294-console-serving-cert\") pod \"console-99f96556f-skgtb\" (UID: \"74621e96-bc4b-4e5b-9b3c-143de94fb294\") " pod="openshift-console/console-99f96556f-skgtb"
Jul 22 13:49:24.671675 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:24.671641    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcq7h\" (UniqueName: \"kubernetes.io/projected/74621e96-bc4b-4e5b-9b3c-143de94fb294-kube-api-access-dcq7h\") pod \"console-99f96556f-skgtb\" (UID: \"74621e96-bc4b-4e5b-9b3c-143de94fb294\") " pod="openshift-console/console-99f96556f-skgtb"
Jul 22 13:49:24.719422 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:24.719372    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-99f96556f-skgtb"
Jul 22 13:49:24.855701 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:24.855677    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-99f96556f-skgtb"]
Jul 22 13:49:24.858256 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:49:24.858228    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74621e96_bc4b_4e5b_9b3c_143de94fb294.slice/crio-9c20e81c542418cd70af94275f82eee16738654fd21e38e0a5022fa1f70116c0 WatchSource:0}: Error finding container 9c20e81c542418cd70af94275f82eee16738654fd21e38e0a5022fa1f70116c0: Status 404 returned error can't find the container with id 9c20e81c542418cd70af94275f82eee16738654fd21e38e0a5022fa1f70116c0
Jul 22 13:49:24.920873 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:24.920847    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-99f96556f-skgtb" event={"ID":"74621e96-bc4b-4e5b-9b3c-143de94fb294","Type":"ContainerStarted","Data":"9c20e81c542418cd70af94275f82eee16738654fd21e38e0a5022fa1f70116c0"}
Jul 22 13:49:25.564797 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:25.564743    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:49:25.926727 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:25.926643    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-99f96556f-skgtb" event={"ID":"74621e96-bc4b-4e5b-9b3c-143de94fb294","Type":"ContainerStarted","Data":"fe53205beb7517e3a8faa1f5befb7570a3972ae01e67efb80c7e4cb14f76e596"}
Jul 22 13:49:25.944223 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:25.944172    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-99f96556f-skgtb" podStartSLOduration=1.944153982 podStartE2EDuration="1.944153982s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:49:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:49:25.943243691 +0000 UTC m=+175.998020394" watchObservedRunningTime="2026-07-22 13:49:25.944153982 +0000 UTC m=+175.998930719"
Jul 22 13:49:34.720523 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:34.720487    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-99f96556f-skgtb"
Jul 22 13:49:34.720959 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:34.720546    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-99f96556f-skgtb"
Jul 22 13:49:34.725565 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:34.725541    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-99f96556f-skgtb"
Jul 22 13:49:34.967480 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:34.967456    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-99f96556f-skgtb"
Jul 22 13:49:35.023750 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:49:35.023660    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69d9bd5c94-w9rbl"]
Jul 22 13:50:00.050753 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:50:00.050688    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-69d9bd5c94-w9rbl" podUID="c234912c-7f1b-4872-9ad1-05994b967299" containerName="console" containerID="cri-o://8b158c931a39c41f433d327ae6b330aa314f3a828090a149effc10e444b40c0b" gracePeriod=15
Jul 22 13:50:00.303926 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:50:00.303859    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69d9bd5c94-w9rbl"
Jul 22 13:50:00.356804 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:50:00.356771    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c234912c-7f1b-4872-9ad1-05994b967299-service-ca\") pod \"c234912c-7f1b-4872-9ad1-05994b967299\" (UID: \"c234912c-7f1b-4872-9ad1-05994b967299\") "
Jul 22 13:50:00.356804 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:50:00.356807    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c234912c-7f1b-4872-9ad1-05994b967299-console-serving-cert\") pod \"c234912c-7f1b-4872-9ad1-05994b967299\" (UID: \"c234912c-7f1b-4872-9ad1-05994b967299\") "
Jul 22 13:50:00.357030 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:50:00.356840    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c234912c-7f1b-4872-9ad1-05994b967299-console-oauth-config\") pod \"c234912c-7f1b-4872-9ad1-05994b967299\" (UID: \"c234912c-7f1b-4872-9ad1-05994b967299\") "
Jul 22 13:50:00.357030 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:50:00.356860    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gnfp8\" (UniqueName: \"kubernetes.io/projected/c234912c-7f1b-4872-9ad1-05994b967299-kube-api-access-gnfp8\") pod \"c234912c-7f1b-4872-9ad1-05994b967299\" (UID: \"c234912c-7f1b-4872-9ad1-05994b967299\") "
Jul 22 13:50:00.357030 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:50:00.356881    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c234912c-7f1b-4872-9ad1-05994b967299-oauth-serving-cert\") pod \"c234912c-7f1b-4872-9ad1-05994b967299\" (UID: \"c234912c-7f1b-4872-9ad1-05994b967299\") "
Jul 22 13:50:00.357030 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:50:00.356949    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c234912c-7f1b-4872-9ad1-05994b967299-console-config\") pod \"c234912c-7f1b-4872-9ad1-05994b967299\" (UID: \"c234912c-7f1b-4872-9ad1-05994b967299\") "
Jul 22 13:50:00.357030 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:50:00.357012    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c234912c-7f1b-4872-9ad1-05994b967299-trusted-ca-bundle\") pod \"c234912c-7f1b-4872-9ad1-05994b967299\" (UID: \"c234912c-7f1b-4872-9ad1-05994b967299\") "
Jul 22 13:50:00.357612 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:50:00.357297    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c234912c-7f1b-4872-9ad1-05994b967299-service-ca" (OuterVolumeSpecName: "service-ca") pod "c234912c-7f1b-4872-9ad1-05994b967299" (UID: "c234912c-7f1b-4872-9ad1-05994b967299"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 13:50:00.357612 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:50:00.357494    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c234912c-7f1b-4872-9ad1-05994b967299-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c234912c-7f1b-4872-9ad1-05994b967299" (UID: "c234912c-7f1b-4872-9ad1-05994b967299"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 13:50:00.357612 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:50:00.357563    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c234912c-7f1b-4872-9ad1-05994b967299-console-config" (OuterVolumeSpecName: "console-config") pod "c234912c-7f1b-4872-9ad1-05994b967299" (UID: "c234912c-7f1b-4872-9ad1-05994b967299"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 13:50:00.357784 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:50:00.357647    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c234912c-7f1b-4872-9ad1-05994b967299-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c234912c-7f1b-4872-9ad1-05994b967299" (UID: "c234912c-7f1b-4872-9ad1-05994b967299"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 13:50:00.359042 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:50:00.359013    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c234912c-7f1b-4872-9ad1-05994b967299-kube-api-access-gnfp8" (OuterVolumeSpecName: "kube-api-access-gnfp8") pod "c234912c-7f1b-4872-9ad1-05994b967299" (UID: "c234912c-7f1b-4872-9ad1-05994b967299"). InnerVolumeSpecName "kube-api-access-gnfp8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 13:50:00.359103 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:50:00.359024    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c234912c-7f1b-4872-9ad1-05994b967299-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c234912c-7f1b-4872-9ad1-05994b967299" (UID: "c234912c-7f1b-4872-9ad1-05994b967299"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 13:50:00.359142 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:50:00.359095    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c234912c-7f1b-4872-9ad1-05994b967299-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c234912c-7f1b-4872-9ad1-05994b967299" (UID: "c234912c-7f1b-4872-9ad1-05994b967299"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 13:50:00.457941 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:50:00.457900    2571 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c234912c-7f1b-4872-9ad1-05994b967299-console-config\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 13:50:00.457941 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:50:00.457942    2571 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c234912c-7f1b-4872-9ad1-05994b967299-trusted-ca-bundle\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 13:50:00.457941 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:50:00.457952    2571 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c234912c-7f1b-4872-9ad1-05994b967299-service-ca\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 13:50:00.458173 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:50:00.457961    2571 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c234912c-7f1b-4872-9ad1-05994b967299-console-serving-cert\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 13:50:00.458173 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:50:00.457970    2571 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c234912c-7f1b-4872-9ad1-05994b967299-console-oauth-config\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 13:50:00.458173 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:50:00.457979    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gnfp8\" (UniqueName: \"kubernetes.io/projected/c234912c-7f1b-4872-9ad1-05994b967299-kube-api-access-gnfp8\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 13:50:00.458173 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:50:00.457987    2571 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c234912c-7f1b-4872-9ad1-05994b967299-oauth-serving-cert\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 13:50:01.068235 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:50:01.068197    2571 generic.go:356] "Generic (PLEG): container finished" podID="c234912c-7f1b-4872-9ad1-05994b967299" containerID="8b158c931a39c41f433d327ae6b330aa314f3a828090a149effc10e444b40c0b" exitCode=0
Jul 22 13:50:01.068656 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:50:01.068249    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69d9bd5c94-w9rbl"
Jul 22 13:50:01.068656 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:50:01.068279    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69d9bd5c94-w9rbl" event={"ID":"c234912c-7f1b-4872-9ad1-05994b967299","Type":"ContainerDied","Data":"8b158c931a39c41f433d327ae6b330aa314f3a828090a149effc10e444b40c0b"}
Jul 22 13:50:01.068656 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:50:01.068334    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69d9bd5c94-w9rbl" event={"ID":"c234912c-7f1b-4872-9ad1-05994b967299","Type":"ContainerDied","Data":"80b605597f7f9f6443a58410fd8ea0d8e1bff21adaf3b81968967b1dfd28524e"}
Jul 22 13:50:01.068656 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:50:01.068356    2571 scope.go:117] "RemoveContainer" containerID="8b158c931a39c41f433d327ae6b330aa314f3a828090a149effc10e444b40c0b"
Jul 22 13:50:01.076623 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:50:01.076610    2571 scope.go:117] "RemoveContainer" containerID="8b158c931a39c41f433d327ae6b330aa314f3a828090a149effc10e444b40c0b"
Jul 22 13:50:01.076885 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:50:01.076865    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b158c931a39c41f433d327ae6b330aa314f3a828090a149effc10e444b40c0b\": container with ID starting with 8b158c931a39c41f433d327ae6b330aa314f3a828090a149effc10e444b40c0b not found: ID does not exist" containerID="8b158c931a39c41f433d327ae6b330aa314f3a828090a149effc10e444b40c0b"
Jul 22 13:50:01.076930 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:50:01.076895    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b158c931a39c41f433d327ae6b330aa314f3a828090a149effc10e444b40c0b"} err="failed to get container status \"8b158c931a39c41f433d327ae6b330aa314f3a828090a149effc10e444b40c0b\": rpc error: code = NotFound desc = could not find container \"8b158c931a39c41f433d327ae6b330aa314f3a828090a149effc10e444b40c0b\": container with ID starting with 8b158c931a39c41f433d327ae6b330aa314f3a828090a149effc10e444b40c0b not found: ID does not exist"
Jul 22 13:50:01.085769 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:50:01.085740    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69d9bd5c94-w9rbl"]
Jul 22 13:50:01.091265 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:50:01.091240    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-69d9bd5c94-w9rbl"]
Jul 22 13:50:03.008663 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:50:03.008628    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c234912c-7f1b-4872-9ad1-05994b967299" path="/var/lib/kubelet/pods/c234912c-7f1b-4872-9ad1-05994b967299/volumes"
Jul 22 13:50:20.564896 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:50:20.564846    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:50:20.580959 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:50:20.580930    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:50:21.168055 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:50:21.168029    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 13:50:56.791989 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:50:56.791909    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5784f6d4b9-pbklw"]
Jul 22 13:50:56.792468 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:50:56.792235    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c234912c-7f1b-4872-9ad1-05994b967299" containerName="console"
Jul 22 13:50:56.792468 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:50:56.792245    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="c234912c-7f1b-4872-9ad1-05994b967299" containerName="console"
Jul 22 13:50:56.792468 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:50:56.792316    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="c234912c-7f1b-4872-9ad1-05994b967299" containerName="console"
Jul 22 13:50:56.795037 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:50:56.795013    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5784f6d4b9-pbklw"
Jul 22 13:50:56.806636 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:50:56.806608    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5784f6d4b9-pbklw"]
Jul 22 13:50:56.857064 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:50:56.857027    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4594751f-a0be-49e7-9464-75bf7110c62e-console-oauth-config\") pod \"console-5784f6d4b9-pbklw\" (UID: \"4594751f-a0be-49e7-9464-75bf7110c62e\") " pod="openshift-console/console-5784f6d4b9-pbklw"
Jul 22 13:50:56.857252 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:50:56.857072    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4594751f-a0be-49e7-9464-75bf7110c62e-console-config\") pod \"console-5784f6d4b9-pbklw\" (UID: \"4594751f-a0be-49e7-9464-75bf7110c62e\") " pod="openshift-console/console-5784f6d4b9-pbklw"
Jul 22 13:50:56.857252 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:50:56.857093    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4594751f-a0be-49e7-9464-75bf7110c62e-service-ca\") pod \"console-5784f6d4b9-pbklw\" (UID: \"4594751f-a0be-49e7-9464-75bf7110c62e\") " pod="openshift-console/console-5784f6d4b9-pbklw"
Jul 22 13:50:56.857252 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:50:56.857214    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4594751f-a0be-49e7-9464-75bf7110c62e-oauth-serving-cert\") pod \"console-5784f6d4b9-pbklw\" (UID: \"4594751f-a0be-49e7-9464-75bf7110c62e\") " pod="openshift-console/console-5784f6d4b9-pbklw"
Jul 22 13:50:56.857374 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:50:56.857274    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4594751f-a0be-49e7-9464-75bf7110c62e-console-serving-cert\") pod \"console-5784f6d4b9-pbklw\" (UID: \"4594751f-a0be-49e7-9464-75bf7110c62e\") " pod="openshift-console/console-5784f6d4b9-pbklw"
Jul 22 13:50:56.857374 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:50:56.857302    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjlwr\" (UniqueName: \"kubernetes.io/projected/4594751f-a0be-49e7-9464-75bf7110c62e-kube-api-access-rjlwr\") pod \"console-5784f6d4b9-pbklw\" (UID: \"4594751f-a0be-49e7-9464-75bf7110c62e\") " pod="openshift-console/console-5784f6d4b9-pbklw"
Jul 22 13:50:56.857374 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:50:56.857324    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4594751f-a0be-49e7-9464-75bf7110c62e-trusted-ca-bundle\") pod \"console-5784f6d4b9-pbklw\" (UID: \"4594751f-a0be-49e7-9464-75bf7110c62e\") " pod="openshift-console/console-5784f6d4b9-pbklw"
Jul 22 13:50:56.957770 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:50:56.957736    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4594751f-a0be-49e7-9464-75bf7110c62e-console-serving-cert\") pod \"console-5784f6d4b9-pbklw\" (UID: \"4594751f-a0be-49e7-9464-75bf7110c62e\") " pod="openshift-console/console-5784f6d4b9-pbklw"
Jul 22 13:50:56.957770 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:50:56.957785    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjlwr\" (UniqueName: \"kubernetes.io/projected/4594751f-a0be-49e7-9464-75bf7110c62e-kube-api-access-rjlwr\") pod \"console-5784f6d4b9-pbklw\" (UID: \"4594751f-a0be-49e7-9464-75bf7110c62e\") " pod="openshift-console/console-5784f6d4b9-pbklw"
Jul 22 13:50:56.958032 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:50:56.957905    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4594751f-a0be-49e7-9464-75bf7110c62e-trusted-ca-bundle\") pod \"console-5784f6d4b9-pbklw\" (UID: \"4594751f-a0be-49e7-9464-75bf7110c62e\") " pod="openshift-console/console-5784f6d4b9-pbklw"
Jul 22 13:50:56.958032 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:50:56.957974    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4594751f-a0be-49e7-9464-75bf7110c62e-console-oauth-config\") pod \"console-5784f6d4b9-pbklw\" (UID: \"4594751f-a0be-49e7-9464-75bf7110c62e\") " pod="openshift-console/console-5784f6d4b9-pbklw"
Jul 22 13:50:56.958032 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:50:56.958017    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4594751f-a0be-49e7-9464-75bf7110c62e-console-config\") pod \"console-5784f6d4b9-pbklw\" (UID: \"4594751f-a0be-49e7-9464-75bf7110c62e\") " pod="openshift-console/console-5784f6d4b9-pbklw"
Jul 22 13:50:56.958214 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:50:56.958040    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4594751f-a0be-49e7-9464-75bf7110c62e-service-ca\") pod \"console-5784f6d4b9-pbklw\" (UID: \"4594751f-a0be-49e7-9464-75bf7110c62e\") " pod="openshift-console/console-5784f6d4b9-pbklw"
Jul 22 13:50:56.958214 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:50:56.958107    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4594751f-a0be-49e7-9464-75bf7110c62e-oauth-serving-cert\") pod \"console-5784f6d4b9-pbklw\" (UID: \"4594751f-a0be-49e7-9464-75bf7110c62e\") " pod="openshift-console/console-5784f6d4b9-pbklw"
Jul 22 13:50:56.958721 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:50:56.958698    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4594751f-a0be-49e7-9464-75bf7110c62e-console-config\") pod \"console-5784f6d4b9-pbklw\" (UID: \"4594751f-a0be-49e7-9464-75bf7110c62e\") " pod="openshift-console/console-5784f6d4b9-pbklw"
Jul 22 13:50:56.958870 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:50:56.958808    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4594751f-a0be-49e7-9464-75bf7110c62e-service-ca\") pod \"console-5784f6d4b9-pbklw\" (UID: \"4594751f-a0be-49e7-9464-75bf7110c62e\") " pod="openshift-console/console-5784f6d4b9-pbklw"
Jul 22 13:50:56.958870 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:50:56.958848    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4594751f-a0be-49e7-9464-75bf7110c62e-trusted-ca-bundle\") pod \"console-5784f6d4b9-pbklw\" (UID: \"4594751f-a0be-49e7-9464-75bf7110c62e\") " pod="openshift-console/console-5784f6d4b9-pbklw"
Jul 22 13:50:56.958990 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:50:56.958880    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4594751f-a0be-49e7-9464-75bf7110c62e-oauth-serving-cert\") pod \"console-5784f6d4b9-pbklw\" (UID: \"4594751f-a0be-49e7-9464-75bf7110c62e\") " pod="openshift-console/console-5784f6d4b9-pbklw"
Jul 22 13:50:56.960394 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:50:56.960366    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4594751f-a0be-49e7-9464-75bf7110c62e-console-serving-cert\") pod \"console-5784f6d4b9-pbklw\" (UID: \"4594751f-a0be-49e7-9464-75bf7110c62e\") " pod="openshift-console/console-5784f6d4b9-pbklw"
Jul 22 13:50:56.960493 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:50:56.960426    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4594751f-a0be-49e7-9464-75bf7110c62e-console-oauth-config\") pod \"console-5784f6d4b9-pbklw\" (UID: \"4594751f-a0be-49e7-9464-75bf7110c62e\") " pod="openshift-console/console-5784f6d4b9-pbklw"
Jul 22 13:50:56.968452 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:50:56.968431    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjlwr\" (UniqueName: \"kubernetes.io/projected/4594751f-a0be-49e7-9464-75bf7110c62e-kube-api-access-rjlwr\") pod \"console-5784f6d4b9-pbklw\" (UID: \"4594751f-a0be-49e7-9464-75bf7110c62e\") " pod="openshift-console/console-5784f6d4b9-pbklw"
Jul 22 13:50:57.104498 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:50:57.104460    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5784f6d4b9-pbklw"
Jul 22 13:50:57.240373 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:50:57.240340    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5784f6d4b9-pbklw"]
Jul 22 13:50:57.242911 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:50:57.242883    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4594751f_a0be_49e7_9464_75bf7110c62e.slice/crio-a15d3fa70b9a426ea80de2c610363ceb15056c5a3f42f19cf95902185027d3eb WatchSource:0}: Error finding container a15d3fa70b9a426ea80de2c610363ceb15056c5a3f42f19cf95902185027d3eb: Status 404 returned error can't find the container with id a15d3fa70b9a426ea80de2c610363ceb15056c5a3f42f19cf95902185027d3eb
Jul 22 13:50:57.295664 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:50:57.295635    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5784f6d4b9-pbklw" event={"ID":"4594751f-a0be-49e7-9464-75bf7110c62e","Type":"ContainerStarted","Data":"a15d3fa70b9a426ea80de2c610363ceb15056c5a3f42f19cf95902185027d3eb"}
Jul 22 13:50:58.300793 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:50:58.300756    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5784f6d4b9-pbklw" event={"ID":"4594751f-a0be-49e7-9464-75bf7110c62e","Type":"ContainerStarted","Data":"98449d77fe04160e1b152020710e372b830216f0ab81f56db5a4a9139a0bb648"}
Jul 22 13:50:58.320297 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:50:58.320243    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5784f6d4b9-pbklw" podStartSLOduration=2.32022426 podStartE2EDuration="2.32022426s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:50:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:50:58.318620019 +0000 UTC m=+268.373396710" watchObservedRunningTime="2026-07-22 13:50:58.32022426 +0000 UTC m=+268.375000937"
Jul 22 13:51:07.104793 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:51:07.104756    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5784f6d4b9-pbklw"
Jul 22 13:51:07.105382 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:51:07.104822    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5784f6d4b9-pbklw"
Jul 22 13:51:07.109537 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:51:07.109514    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5784f6d4b9-pbklw"
Jul 22 13:51:07.341672 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:51:07.341647    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5784f6d4b9-pbklw"
Jul 22 13:51:07.386320 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:51:07.386240    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-99f96556f-skgtb"]
Jul 22 13:51:30.840788 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:51:30.840761    2571 kubelet.go:1648] "Image garbage collection succeeded"
Jul 22 13:51:32.407359 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:51:32.407289    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-99f96556f-skgtb" podUID="74621e96-bc4b-4e5b-9b3c-143de94fb294" containerName="console" containerID="cri-o://fe53205beb7517e3a8faa1f5befb7570a3972ae01e67efb80c7e4cb14f76e596" gracePeriod=15
Jul 22 13:51:32.651254 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:51:32.651228    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-99f96556f-skgtb"
Jul 22 13:51:32.769707 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:51:32.769616    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/74621e96-bc4b-4e5b-9b3c-143de94fb294-console-oauth-config\") pod \"74621e96-bc4b-4e5b-9b3c-143de94fb294\" (UID: \"74621e96-bc4b-4e5b-9b3c-143de94fb294\") "
Jul 22 13:51:32.769707 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:51:32.769652    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74621e96-bc4b-4e5b-9b3c-143de94fb294-trusted-ca-bundle\") pod \"74621e96-bc4b-4e5b-9b3c-143de94fb294\" (UID: \"74621e96-bc4b-4e5b-9b3c-143de94fb294\") "
Jul 22 13:51:32.769948 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:51:32.769723    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/74621e96-bc4b-4e5b-9b3c-143de94fb294-console-serving-cert\") pod \"74621e96-bc4b-4e5b-9b3c-143de94fb294\" (UID: \"74621e96-bc4b-4e5b-9b3c-143de94fb294\") "
Jul 22 13:51:32.769948 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:51:32.769754    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/74621e96-bc4b-4e5b-9b3c-143de94fb294-service-ca\") pod \"74621e96-bc4b-4e5b-9b3c-143de94fb294\" (UID: \"74621e96-bc4b-4e5b-9b3c-143de94fb294\") "
Jul 22 13:51:32.769948 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:51:32.769780    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dcq7h\" (UniqueName: \"kubernetes.io/projected/74621e96-bc4b-4e5b-9b3c-143de94fb294-kube-api-access-dcq7h\") pod \"74621e96-bc4b-4e5b-9b3c-143de94fb294\" (UID: \"74621e96-bc4b-4e5b-9b3c-143de94fb294\") "
Jul 22 13:51:32.769948 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:51:32.769807    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/74621e96-bc4b-4e5b-9b3c-143de94fb294-console-config\") pod \"74621e96-bc4b-4e5b-9b3c-143de94fb294\" (UID: \"74621e96-bc4b-4e5b-9b3c-143de94fb294\") "
Jul 22 13:51:32.769948 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:51:32.769836    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/74621e96-bc4b-4e5b-9b3c-143de94fb294-oauth-serving-cert\") pod \"74621e96-bc4b-4e5b-9b3c-143de94fb294\" (UID: \"74621e96-bc4b-4e5b-9b3c-143de94fb294\") "
Jul 22 13:51:32.770346 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:51:32.770311    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74621e96-bc4b-4e5b-9b3c-143de94fb294-console-config" (OuterVolumeSpecName: "console-config") pod "74621e96-bc4b-4e5b-9b3c-143de94fb294" (UID: "74621e96-bc4b-4e5b-9b3c-143de94fb294"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 13:51:32.770346 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:51:32.770326    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74621e96-bc4b-4e5b-9b3c-143de94fb294-service-ca" (OuterVolumeSpecName: "service-ca") pod "74621e96-bc4b-4e5b-9b3c-143de94fb294" (UID: "74621e96-bc4b-4e5b-9b3c-143de94fb294"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 13:51:32.770535 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:51:32.770344    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74621e96-bc4b-4e5b-9b3c-143de94fb294-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "74621e96-bc4b-4e5b-9b3c-143de94fb294" (UID: "74621e96-bc4b-4e5b-9b3c-143de94fb294"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 13:51:32.770535 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:51:32.770316    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74621e96-bc4b-4e5b-9b3c-143de94fb294-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "74621e96-bc4b-4e5b-9b3c-143de94fb294" (UID: "74621e96-bc4b-4e5b-9b3c-143de94fb294"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 13:51:32.772051 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:51:32.772028    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74621e96-bc4b-4e5b-9b3c-143de94fb294-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "74621e96-bc4b-4e5b-9b3c-143de94fb294" (UID: "74621e96-bc4b-4e5b-9b3c-143de94fb294"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 13:51:32.772310 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:51:32.772290    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74621e96-bc4b-4e5b-9b3c-143de94fb294-kube-api-access-dcq7h" (OuterVolumeSpecName: "kube-api-access-dcq7h") pod "74621e96-bc4b-4e5b-9b3c-143de94fb294" (UID: "74621e96-bc4b-4e5b-9b3c-143de94fb294"). InnerVolumeSpecName "kube-api-access-dcq7h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 13:51:32.772358 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:51:32.772301    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74621e96-bc4b-4e5b-9b3c-143de94fb294-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "74621e96-bc4b-4e5b-9b3c-143de94fb294" (UID: "74621e96-bc4b-4e5b-9b3c-143de94fb294"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 13:51:32.871345 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:51:32.871300    2571 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/74621e96-bc4b-4e5b-9b3c-143de94fb294-oauth-serving-cert\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 13:51:32.871345 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:51:32.871336    2571 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/74621e96-bc4b-4e5b-9b3c-143de94fb294-console-oauth-config\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 13:51:32.871345 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:51:32.871345    2571 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74621e96-bc4b-4e5b-9b3c-143de94fb294-trusted-ca-bundle\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 13:51:32.871345 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:51:32.871354    2571 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/74621e96-bc4b-4e5b-9b3c-143de94fb294-console-serving-cert\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 13:51:32.871640 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:51:32.871363    2571 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/74621e96-bc4b-4e5b-9b3c-143de94fb294-service-ca\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 13:51:32.871640 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:51:32.871372    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dcq7h\" (UniqueName: \"kubernetes.io/projected/74621e96-bc4b-4e5b-9b3c-143de94fb294-kube-api-access-dcq7h\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 13:51:32.871640 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:51:32.871381    2571 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/74621e96-bc4b-4e5b-9b3c-143de94fb294-console-config\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 13:51:33.440901 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:51:33.440864    2571 generic.go:356] "Generic (PLEG): container finished" podID="74621e96-bc4b-4e5b-9b3c-143de94fb294" containerID="fe53205beb7517e3a8faa1f5befb7570a3972ae01e67efb80c7e4cb14f76e596" exitCode=0
Jul 22 13:51:33.441349 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:51:33.440901    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-99f96556f-skgtb" event={"ID":"74621e96-bc4b-4e5b-9b3c-143de94fb294","Type":"ContainerDied","Data":"fe53205beb7517e3a8faa1f5befb7570a3972ae01e67efb80c7e4cb14f76e596"}
Jul 22 13:51:33.441349 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:51:33.440917    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-99f96556f-skgtb"
Jul 22 13:51:33.441349 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:51:33.440954    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-99f96556f-skgtb" event={"ID":"74621e96-bc4b-4e5b-9b3c-143de94fb294","Type":"ContainerDied","Data":"9c20e81c542418cd70af94275f82eee16738654fd21e38e0a5022fa1f70116c0"}
Jul 22 13:51:33.441349 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:51:33.440974    2571 scope.go:117] "RemoveContainer" containerID="fe53205beb7517e3a8faa1f5befb7570a3972ae01e67efb80c7e4cb14f76e596"
Jul 22 13:51:33.449161 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:51:33.449142    2571 scope.go:117] "RemoveContainer" containerID="fe53205beb7517e3a8faa1f5befb7570a3972ae01e67efb80c7e4cb14f76e596"
Jul 22 13:51:33.449449 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:51:33.449428    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe53205beb7517e3a8faa1f5befb7570a3972ae01e67efb80c7e4cb14f76e596\": container with ID starting with fe53205beb7517e3a8faa1f5befb7570a3972ae01e67efb80c7e4cb14f76e596 not found: ID does not exist" containerID="fe53205beb7517e3a8faa1f5befb7570a3972ae01e67efb80c7e4cb14f76e596"
Jul 22 13:51:33.449508 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:51:33.449458    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe53205beb7517e3a8faa1f5befb7570a3972ae01e67efb80c7e4cb14f76e596"} err="failed to get container status \"fe53205beb7517e3a8faa1f5befb7570a3972ae01e67efb80c7e4cb14f76e596\": rpc error: code = NotFound desc = could not find container \"fe53205beb7517e3a8faa1f5befb7570a3972ae01e67efb80c7e4cb14f76e596\": container with ID starting with fe53205beb7517e3a8faa1f5befb7570a3972ae01e67efb80c7e4cb14f76e596 not found: ID does not exist"
Jul 22 13:51:33.457466 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:51:33.457439    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-99f96556f-skgtb"]
Jul 22 13:51:33.461803 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:51:33.461780    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-99f96556f-skgtb"]
Jul 22 13:51:35.009003 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:51:35.008968    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74621e96-bc4b-4e5b-9b3c-143de94fb294" path="/var/lib/kubelet/pods/74621e96-bc4b-4e5b-9b3c-143de94fb294/volumes"
Jul 22 13:51:44.413646 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:51:44.413609    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-gfxtg"]
Jul 22 13:51:44.414092 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:51:44.413957    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74621e96-bc4b-4e5b-9b3c-143de94fb294" containerName="console"
Jul 22 13:51:44.414092 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:51:44.413967    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="74621e96-bc4b-4e5b-9b3c-143de94fb294" containerName="console"
Jul 22 13:51:44.414092 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:51:44.414040    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="74621e96-bc4b-4e5b-9b3c-143de94fb294" containerName="console"
Jul 22 13:51:44.418379 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:51:44.418358    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-gfxtg"
Jul 22 13:51:44.420472 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:51:44.420448    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 22 13:51:44.421039 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:51:44.421019    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 22 13:51:44.421143 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:51:44.421023    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-dh74x\""
Jul 22 13:51:44.425048 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:51:44.425024    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-gfxtg"]
Jul 22 13:51:44.476008 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:51:44.475971    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8skc9\" (UniqueName: \"kubernetes.io/projected/b32e9177-e35a-4b3a-b9bd-01207ddcbbdc-kube-api-access-8skc9\") pod \"cert-manager-webhook-6486ffd997-gfxtg\" (UID: \"b32e9177-e35a-4b3a-b9bd-01207ddcbbdc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gfxtg"
Jul 22 13:51:44.476191 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:51:44.476028    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b32e9177-e35a-4b3a-b9bd-01207ddcbbdc-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-gfxtg\" (UID: \"b32e9177-e35a-4b3a-b9bd-01207ddcbbdc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gfxtg"
Jul 22 13:51:44.576868 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:51:44.576833    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8skc9\" (UniqueName: \"kubernetes.io/projected/b32e9177-e35a-4b3a-b9bd-01207ddcbbdc-kube-api-access-8skc9\") pod \"cert-manager-webhook-6486ffd997-gfxtg\" (UID: \"b32e9177-e35a-4b3a-b9bd-01207ddcbbdc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gfxtg"
Jul 22 13:51:44.576868 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:51:44.576881    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b32e9177-e35a-4b3a-b9bd-01207ddcbbdc-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-gfxtg\" (UID: \"b32e9177-e35a-4b3a-b9bd-01207ddcbbdc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gfxtg"
Jul 22 13:51:44.589399 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:51:44.589370    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b32e9177-e35a-4b3a-b9bd-01207ddcbbdc-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-gfxtg\" (UID: \"b32e9177-e35a-4b3a-b9bd-01207ddcbbdc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gfxtg"
Jul 22 13:51:44.589681 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:51:44.589659    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8skc9\" (UniqueName: \"kubernetes.io/projected/b32e9177-e35a-4b3a-b9bd-01207ddcbbdc-kube-api-access-8skc9\") pod \"cert-manager-webhook-6486ffd997-gfxtg\" (UID: \"b32e9177-e35a-4b3a-b9bd-01207ddcbbdc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gfxtg"
Jul 22 13:51:44.740679 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:51:44.740573    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-gfxtg"
Jul 22 13:51:44.881245 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:51:44.881218    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-gfxtg"]
Jul 22 13:51:44.883381 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:51:44.883354    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb32e9177_e35a_4b3a_b9bd_01207ddcbbdc.slice/crio-e7c6a8e442ffe0727c6d14c0e8d2f6d2ac94bdd61b8196593f11879e4a887c52 WatchSource:0}: Error finding container e7c6a8e442ffe0727c6d14c0e8d2f6d2ac94bdd61b8196593f11879e4a887c52: Status 404 returned error can't find the container with id e7c6a8e442ffe0727c6d14c0e8d2f6d2ac94bdd61b8196593f11879e4a887c52
Jul 22 13:51:44.885496 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:51:44.885478    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 13:51:45.492478 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:51:45.492442    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-gfxtg" event={"ID":"b32e9177-e35a-4b3a-b9bd-01207ddcbbdc","Type":"ContainerStarted","Data":"e7c6a8e442ffe0727c6d14c0e8d2f6d2ac94bdd61b8196593f11879e4a887c52"}
Jul 22 13:51:48.507231 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:51:48.507193    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-gfxtg" event={"ID":"b32e9177-e35a-4b3a-b9bd-01207ddcbbdc","Type":"ContainerStarted","Data":"28fd1719298e5e447e2fb6abbe13ab28ca11bb04e5ec1b502ee3937fe5ee62c6"}
Jul 22 13:51:48.507642 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:51:48.507241    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-gfxtg"
Jul 22 13:51:48.529206 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:51:48.529092    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-gfxtg" podStartSLOduration=1.5016542959999999 podStartE2EDuration="4.529070863s" totalImagesPullingTime="3.027416567s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:51:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:51:48.526084145 +0000 UTC m=+318.580860823" watchObservedRunningTime="2026-07-22 13:51:48.529070863 +0000 UTC m=+318.583847537"
Jul 22 13:51:54.514087 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:51:54.514046    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-gfxtg"
Jul 22 13:52:02.256692 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:02.256653    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-bwjk2"]
Jul 22 13:52:02.260164 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:02.260140    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-bwjk2"
Jul 22 13:52:02.261898 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:02.261876    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-hk58q\""
Jul 22 13:52:02.267790 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:02.267764    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-bwjk2"]
Jul 22 13:52:02.341246 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:02.341212    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d29fdc11-34a9-4192-ba16-3aa5110ce799-bound-sa-token\") pod \"cert-manager-55b4d954d5-bwjk2\" (UID: \"d29fdc11-34a9-4192-ba16-3aa5110ce799\") " pod="cert-manager/cert-manager-55b4d954d5-bwjk2"
Jul 22 13:52:02.341246 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:02.341258    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glctb\" (UniqueName: \"kubernetes.io/projected/d29fdc11-34a9-4192-ba16-3aa5110ce799-kube-api-access-glctb\") pod \"cert-manager-55b4d954d5-bwjk2\" (UID: \"d29fdc11-34a9-4192-ba16-3aa5110ce799\") " pod="cert-manager/cert-manager-55b4d954d5-bwjk2"
Jul 22 13:52:02.442609 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:02.442564    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d29fdc11-34a9-4192-ba16-3aa5110ce799-bound-sa-token\") pod \"cert-manager-55b4d954d5-bwjk2\" (UID: \"d29fdc11-34a9-4192-ba16-3aa5110ce799\") " pod="cert-manager/cert-manager-55b4d954d5-bwjk2"
Jul 22 13:52:02.442780 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:02.442617    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glctb\" (UniqueName: \"kubernetes.io/projected/d29fdc11-34a9-4192-ba16-3aa5110ce799-kube-api-access-glctb\") pod \"cert-manager-55b4d954d5-bwjk2\" (UID: \"d29fdc11-34a9-4192-ba16-3aa5110ce799\") " pod="cert-manager/cert-manager-55b4d954d5-bwjk2"
Jul 22 13:52:02.450461 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:02.450416    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d29fdc11-34a9-4192-ba16-3aa5110ce799-bound-sa-token\") pod \"cert-manager-55b4d954d5-bwjk2\" (UID: \"d29fdc11-34a9-4192-ba16-3aa5110ce799\") " pod="cert-manager/cert-manager-55b4d954d5-bwjk2"
Jul 22 13:52:02.450461 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:02.450447    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-glctb\" (UniqueName: \"kubernetes.io/projected/d29fdc11-34a9-4192-ba16-3aa5110ce799-kube-api-access-glctb\") pod \"cert-manager-55b4d954d5-bwjk2\" (UID: \"d29fdc11-34a9-4192-ba16-3aa5110ce799\") " pod="cert-manager/cert-manager-55b4d954d5-bwjk2"
Jul 22 13:52:02.570247 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:02.570215    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-bwjk2"
Jul 22 13:52:02.699920 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:02.699885    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-bwjk2"]
Jul 22 13:52:02.702864 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:52:02.702836    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd29fdc11_34a9_4192_ba16_3aa5110ce799.slice/crio-a70bcebb33d64e2f157b495a11cf7cf7f43cb4d40833c41beb445c44d0ed70d4 WatchSource:0}: Error finding container a70bcebb33d64e2f157b495a11cf7cf7f43cb4d40833c41beb445c44d0ed70d4: Status 404 returned error can't find the container with id a70bcebb33d64e2f157b495a11cf7cf7f43cb4d40833c41beb445c44d0ed70d4
Jul 22 13:52:03.570571 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:03.570533    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-bwjk2" event={"ID":"d29fdc11-34a9-4192-ba16-3aa5110ce799","Type":"ContainerStarted","Data":"3801b4e3696072f409e0de62fca4d3b81f99e2aabba119ff3a0a727921912833"}
Jul 22 13:52:03.570968 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:03.570580    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-bwjk2" event={"ID":"d29fdc11-34a9-4192-ba16-3aa5110ce799","Type":"ContainerStarted","Data":"a70bcebb33d64e2f157b495a11cf7cf7f43cb4d40833c41beb445c44d0ed70d4"}
Jul 22 13:52:03.589175 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:03.589126    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-bwjk2" podStartSLOduration=1.589112437 podStartE2EDuration="1.589112437s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:52:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:52:03.587347995 +0000 UTC m=+333.642124696" watchObservedRunningTime="2026-07-22 13:52:03.589112437 +0000 UTC m=+333.643889114"
Jul 22 13:52:14.595272 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:14.595230    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-65657c6f45-mtkf6"]
Jul 22 13:52:14.599240 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:14.599215    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-65657c6f45-mtkf6"
Jul 22 13:52:14.601483 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:14.601454    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 22 13:52:14.601623 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:14.601548    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-n778k\""
Jul 22 13:52:14.601623 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:14.601549    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 22 13:52:14.601779 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:14.601761    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 22 13:52:14.601844 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:14.601767    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 22 13:52:14.617613 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:14.617585    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-65657c6f45-mtkf6"]
Jul 22 13:52:14.645797 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:14.645762    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/528a3944-350d-4dff-a282-f1d19603ce58-apiservice-cert\") pod \"opendatahub-operator-controller-manager-65657c6f45-mtkf6\" (UID: \"528a3944-350d-4dff-a282-f1d19603ce58\") " pod="opendatahub/opendatahub-operator-controller-manager-65657c6f45-mtkf6"
Jul 22 13:52:14.645797 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:14.645803    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/528a3944-350d-4dff-a282-f1d19603ce58-tmp\") pod \"opendatahub-operator-controller-manager-65657c6f45-mtkf6\" (UID: \"528a3944-350d-4dff-a282-f1d19603ce58\") " pod="opendatahub/opendatahub-operator-controller-manager-65657c6f45-mtkf6"
Jul 22 13:52:14.646010 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:14.645826    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/528a3944-350d-4dff-a282-f1d19603ce58-webhook-cert\") pod \"opendatahub-operator-controller-manager-65657c6f45-mtkf6\" (UID: \"528a3944-350d-4dff-a282-f1d19603ce58\") " pod="opendatahub/opendatahub-operator-controller-manager-65657c6f45-mtkf6"
Jul 22 13:52:14.646010 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:14.645904    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzv6z\" (UniqueName: \"kubernetes.io/projected/528a3944-350d-4dff-a282-f1d19603ce58-kube-api-access-vzv6z\") pod \"opendatahub-operator-controller-manager-65657c6f45-mtkf6\" (UID: \"528a3944-350d-4dff-a282-f1d19603ce58\") " pod="opendatahub/opendatahub-operator-controller-manager-65657c6f45-mtkf6"
Jul 22 13:52:14.646010 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:14.645969    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/528a3944-350d-4dff-a282-f1d19603ce58-manifests\") pod \"opendatahub-operator-controller-manager-65657c6f45-mtkf6\" (UID: \"528a3944-350d-4dff-a282-f1d19603ce58\") " pod="opendatahub/opendatahub-operator-controller-manager-65657c6f45-mtkf6"
Jul 22 13:52:14.747362 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:14.747322    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/528a3944-350d-4dff-a282-f1d19603ce58-apiservice-cert\") pod \"opendatahub-operator-controller-manager-65657c6f45-mtkf6\" (UID: \"528a3944-350d-4dff-a282-f1d19603ce58\") " pod="opendatahub/opendatahub-operator-controller-manager-65657c6f45-mtkf6"
Jul 22 13:52:14.747362 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:14.747366    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/528a3944-350d-4dff-a282-f1d19603ce58-tmp\") pod \"opendatahub-operator-controller-manager-65657c6f45-mtkf6\" (UID: \"528a3944-350d-4dff-a282-f1d19603ce58\") " pod="opendatahub/opendatahub-operator-controller-manager-65657c6f45-mtkf6"
Jul 22 13:52:14.747630 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:14.747392    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/528a3944-350d-4dff-a282-f1d19603ce58-webhook-cert\") pod \"opendatahub-operator-controller-manager-65657c6f45-mtkf6\" (UID: \"528a3944-350d-4dff-a282-f1d19603ce58\") " pod="opendatahub/opendatahub-operator-controller-manager-65657c6f45-mtkf6"
Jul 22 13:52:14.747630 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:14.747511    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzv6z\" (UniqueName: \"kubernetes.io/projected/528a3944-350d-4dff-a282-f1d19603ce58-kube-api-access-vzv6z\") pod \"opendatahub-operator-controller-manager-65657c6f45-mtkf6\" (UID: \"528a3944-350d-4dff-a282-f1d19603ce58\") " pod="opendatahub/opendatahub-operator-controller-manager-65657c6f45-mtkf6"
Jul 22 13:52:14.747630 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:14.747569    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/528a3944-350d-4dff-a282-f1d19603ce58-manifests\") pod \"opendatahub-operator-controller-manager-65657c6f45-mtkf6\" (UID: \"528a3944-350d-4dff-a282-f1d19603ce58\") " pod="opendatahub/opendatahub-operator-controller-manager-65657c6f45-mtkf6"
Jul 22 13:52:14.747954 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:14.747935    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/528a3944-350d-4dff-a282-f1d19603ce58-manifests\") pod \"opendatahub-operator-controller-manager-65657c6f45-mtkf6\" (UID: \"528a3944-350d-4dff-a282-f1d19603ce58\") " pod="opendatahub/opendatahub-operator-controller-manager-65657c6f45-mtkf6"
Jul 22 13:52:14.749756 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:14.749731    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/528a3944-350d-4dff-a282-f1d19603ce58-tmp\") pod \"opendatahub-operator-controller-manager-65657c6f45-mtkf6\" (UID: \"528a3944-350d-4dff-a282-f1d19603ce58\") " pod="opendatahub/opendatahub-operator-controller-manager-65657c6f45-mtkf6"
Jul 22 13:52:14.749930 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:14.749915    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/528a3944-350d-4dff-a282-f1d19603ce58-apiservice-cert\") pod \"opendatahub-operator-controller-manager-65657c6f45-mtkf6\" (UID: \"528a3944-350d-4dff-a282-f1d19603ce58\") " pod="opendatahub/opendatahub-operator-controller-manager-65657c6f45-mtkf6"
Jul 22 13:52:14.749969 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:14.749940    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/528a3944-350d-4dff-a282-f1d19603ce58-webhook-cert\") pod \"opendatahub-operator-controller-manager-65657c6f45-mtkf6\" (UID: \"528a3944-350d-4dff-a282-f1d19603ce58\") " pod="opendatahub/opendatahub-operator-controller-manager-65657c6f45-mtkf6"
Jul 22 13:52:14.758488 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:14.758461    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzv6z\" (UniqueName: \"kubernetes.io/projected/528a3944-350d-4dff-a282-f1d19603ce58-kube-api-access-vzv6z\") pod \"opendatahub-operator-controller-manager-65657c6f45-mtkf6\" (UID: \"528a3944-350d-4dff-a282-f1d19603ce58\") " pod="opendatahub/opendatahub-operator-controller-manager-65657c6f45-mtkf6"
Jul 22 13:52:14.910546 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:14.910457    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-65657c6f45-mtkf6"
Jul 22 13:52:15.058830 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:15.058806    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-65657c6f45-mtkf6"]
Jul 22 13:52:15.061715 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:52:15.061688    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod528a3944_350d_4dff_a282_f1d19603ce58.slice/crio-1e4745a703987afe0800126d14cd136c1c6a9577fbb481a2697fe9785147b4a9 WatchSource:0}: Error finding container 1e4745a703987afe0800126d14cd136c1c6a9577fbb481a2697fe9785147b4a9: Status 404 returned error can't find the container with id 1e4745a703987afe0800126d14cd136c1c6a9577fbb481a2697fe9785147b4a9
Jul 22 13:52:15.631459 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:15.631400    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65657c6f45-mtkf6" event={"ID":"528a3944-350d-4dff-a282-f1d19603ce58","Type":"ContainerStarted","Data":"1e4745a703987afe0800126d14cd136c1c6a9577fbb481a2697fe9785147b4a9"}
Jul 22 13:52:18.647977 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:18.647941    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65657c6f45-mtkf6" event={"ID":"528a3944-350d-4dff-a282-f1d19603ce58","Type":"ContainerStarted","Data":"db4e7c45f24fede7c49ad7d0cf056545497e99fcbc3106c5726cab9617a2372a"}
Jul 22 13:52:19.654071 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:19.654035    2571 generic.go:356] "Generic (PLEG): container finished" podID="528a3944-350d-4dff-a282-f1d19603ce58" containerID="db4e7c45f24fede7c49ad7d0cf056545497e99fcbc3106c5726cab9617a2372a" exitCode=0
Jul 22 13:52:19.654503 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:19.654115    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65657c6f45-mtkf6" event={"ID":"528a3944-350d-4dff-a282-f1d19603ce58","Type":"ContainerDied","Data":"db4e7c45f24fede7c49ad7d0cf056545497e99fcbc3106c5726cab9617a2372a"}
Jul 22 13:52:20.660781 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:20.660689    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65657c6f45-mtkf6" event={"ID":"528a3944-350d-4dff-a282-f1d19603ce58","Type":"ContainerStarted","Data":"ae47c3c62f5eba419dcb36741889642eebff37dd8b9d17a6977257fed6509bb2"}
Jul 22 13:52:20.661134 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:20.660789    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-65657c6f45-mtkf6"
Jul 22 13:52:20.684204 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:20.684126    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-65657c6f45-mtkf6" podStartSLOduration=1.8502107840000002 podStartE2EDuration="6.684102258s" totalImagesPullingTime="3.667304928s" totalInitContainerRuntime="1.166586546s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:52:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:52:20.680896908 +0000 UTC m=+350.735673611" watchObservedRunningTime="2026-07-22 13:52:20.684102258 +0000 UTC m=+350.738878938"
Jul 22 13:52:31.668048 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:31.668019    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-65657c6f45-mtkf6"
Jul 22 13:52:38.279546 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:38.279509    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-85c77b7bd5-2xbhr"]
Jul 22 13:52:38.288400 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:38.288370    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-85c77b7bd5-2xbhr"
Jul 22 13:52:38.290907 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:38.290882    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 22 13:52:38.291875 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:38.291856    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 22 13:52:38.291997 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:38.291963    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 22 13:52:38.292185 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:38.292170    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 22 13:52:38.292257 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:38.292199    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 22 13:52:38.295102 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:38.295077    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-gdw7h\""
Jul 22 13:52:38.296595 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:38.296567    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-85c77b7bd5-2xbhr"]
Jul 22 13:52:38.378383 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:38.378347    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/16981286-7314-462c-9c73-fc4e7833cd35-manager-config\") pod \"lws-controller-manager-85c77b7bd5-2xbhr\" (UID: \"16981286-7314-462c-9c73-fc4e7833cd35\") " pod="openshift-lws-operator/lws-controller-manager-85c77b7bd5-2xbhr"
Jul 22 13:52:38.378596 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:38.378434    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwcnt\" (UniqueName: \"kubernetes.io/projected/16981286-7314-462c-9c73-fc4e7833cd35-kube-api-access-nwcnt\") pod \"lws-controller-manager-85c77b7bd5-2xbhr\" (UID: \"16981286-7314-462c-9c73-fc4e7833cd35\") " pod="openshift-lws-operator/lws-controller-manager-85c77b7bd5-2xbhr"
Jul 22 13:52:38.378596 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:38.378484    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/16981286-7314-462c-9c73-fc4e7833cd35-metrics-cert\") pod \"lws-controller-manager-85c77b7bd5-2xbhr\" (UID: \"16981286-7314-462c-9c73-fc4e7833cd35\") " pod="openshift-lws-operator/lws-controller-manager-85c77b7bd5-2xbhr"
Jul 22 13:52:38.378596 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:38.378554    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/16981286-7314-462c-9c73-fc4e7833cd35-cert\") pod \"lws-controller-manager-85c77b7bd5-2xbhr\" (UID: \"16981286-7314-462c-9c73-fc4e7833cd35\") " pod="openshift-lws-operator/lws-controller-manager-85c77b7bd5-2xbhr"
Jul 22 13:52:38.479791 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:38.479754    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/16981286-7314-462c-9c73-fc4e7833cd35-manager-config\") pod \"lws-controller-manager-85c77b7bd5-2xbhr\" (UID: \"16981286-7314-462c-9c73-fc4e7833cd35\") " pod="openshift-lws-operator/lws-controller-manager-85c77b7bd5-2xbhr"
Jul 22 13:52:38.479962 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:38.479809    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwcnt\" (UniqueName: \"kubernetes.io/projected/16981286-7314-462c-9c73-fc4e7833cd35-kube-api-access-nwcnt\") pod \"lws-controller-manager-85c77b7bd5-2xbhr\" (UID: \"16981286-7314-462c-9c73-fc4e7833cd35\") " pod="openshift-lws-operator/lws-controller-manager-85c77b7bd5-2xbhr"
Jul 22 13:52:38.479962 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:38.479848    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/16981286-7314-462c-9c73-fc4e7833cd35-metrics-cert\") pod \"lws-controller-manager-85c77b7bd5-2xbhr\" (UID: \"16981286-7314-462c-9c73-fc4e7833cd35\") " pod="openshift-lws-operator/lws-controller-manager-85c77b7bd5-2xbhr"
Jul 22 13:52:38.479962 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:38.479880    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/16981286-7314-462c-9c73-fc4e7833cd35-cert\") pod \"lws-controller-manager-85c77b7bd5-2xbhr\" (UID: \"16981286-7314-462c-9c73-fc4e7833cd35\") " pod="openshift-lws-operator/lws-controller-manager-85c77b7bd5-2xbhr"
Jul 22 13:52:38.480580 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:38.480553    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/16981286-7314-462c-9c73-fc4e7833cd35-manager-config\") pod \"lws-controller-manager-85c77b7bd5-2xbhr\" (UID: \"16981286-7314-462c-9c73-fc4e7833cd35\") " pod="openshift-lws-operator/lws-controller-manager-85c77b7bd5-2xbhr"
Jul 22 13:52:38.482428 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:38.482391    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/16981286-7314-462c-9c73-fc4e7833cd35-metrics-cert\") pod \"lws-controller-manager-85c77b7bd5-2xbhr\" (UID: \"16981286-7314-462c-9c73-fc4e7833cd35\") " pod="openshift-lws-operator/lws-controller-manager-85c77b7bd5-2xbhr"
Jul 22 13:52:38.482548 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:38.482464    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/16981286-7314-462c-9c73-fc4e7833cd35-cert\") pod \"lws-controller-manager-85c77b7bd5-2xbhr\" (UID: \"16981286-7314-462c-9c73-fc4e7833cd35\") " pod="openshift-lws-operator/lws-controller-manager-85c77b7bd5-2xbhr"
Jul 22 13:52:38.488798 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:38.488763    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwcnt\" (UniqueName: \"kubernetes.io/projected/16981286-7314-462c-9c73-fc4e7833cd35-kube-api-access-nwcnt\") pod \"lws-controller-manager-85c77b7bd5-2xbhr\" (UID: \"16981286-7314-462c-9c73-fc4e7833cd35\") " pod="openshift-lws-operator/lws-controller-manager-85c77b7bd5-2xbhr"
Jul 22 13:52:38.598901 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:38.598854    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-85c77b7bd5-2xbhr"
Jul 22 13:52:38.734769 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:38.734742    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-85c77b7bd5-2xbhr"]
Jul 22 13:52:38.737275 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:52:38.737248    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16981286_7314_462c_9c73_fc4e7833cd35.slice/crio-c7560814e6d8908e89a285dda9cad953d562e0d5505866e16d0a64ca2be57d67 WatchSource:0}: Error finding container c7560814e6d8908e89a285dda9cad953d562e0d5505866e16d0a64ca2be57d67: Status 404 returned error can't find the container with id c7560814e6d8908e89a285dda9cad953d562e0d5505866e16d0a64ca2be57d67
Jul 22 13:52:38.746076 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:38.746048    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-85c77b7bd5-2xbhr" event={"ID":"16981286-7314-462c-9c73-fc4e7833cd35","Type":"ContainerStarted","Data":"c7560814e6d8908e89a285dda9cad953d562e0d5505866e16d0a64ca2be57d67"}
Jul 22 13:52:41.762787 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:41.762692    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-85c77b7bd5-2xbhr" event={"ID":"16981286-7314-462c-9c73-fc4e7833cd35","Type":"ContainerStarted","Data":"3c7e2478b6f47dfed5dc8d02a2103cbc449df8b46272c15bf72ab09f0855d877"}
Jul 22 13:52:41.762787 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:41.762760    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-85c77b7bd5-2xbhr"
Jul 22 13:52:44.455973 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:44.455906    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-85c77b7bd5-2xbhr" podStartSLOduration=3.7286638 podStartE2EDuration="6.455887721s" totalImagesPullingTime="2.727223921s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:52:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:52:41.781823991 +0000 UTC m=+371.836600669" watchObservedRunningTime="2026-07-22 13:52:44.455887721 +0000 UTC m=+374.510664398"
Jul 22 13:52:44.456505 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:44.456033    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6cd5b47b7c-22b2j"]
Jul 22 13:52:44.459740 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:44.459714    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6cd5b47b7c-22b2j"
Jul 22 13:52:44.461828 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:44.461802    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 22 13:52:44.461952 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:44.461844    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 22 13:52:44.462490 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:44.462471    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 22 13:52:44.462579 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:44.462475    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-2qglk\""
Jul 22 13:52:44.462635 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:44.462615    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 22 13:52:44.471233 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:44.471207    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6cd5b47b7c-22b2j"]
Jul 22 13:52:44.639863 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:44.639822    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa75070f-78a1-42ae-966a-a489d3a50117-tls-certs\") pod \"kube-auth-proxy-6cd5b47b7c-22b2j\" (UID: \"aa75070f-78a1-42ae-966a-a489d3a50117\") " pod="openshift-ingress/kube-auth-proxy-6cd5b47b7c-22b2j"
Jul 22 13:52:44.640049 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:44.639938    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fln6\" (UniqueName: \"kubernetes.io/projected/aa75070f-78a1-42ae-966a-a489d3a50117-kube-api-access-2fln6\") pod \"kube-auth-proxy-6cd5b47b7c-22b2j\" (UID: \"aa75070f-78a1-42ae-966a-a489d3a50117\") " pod="openshift-ingress/kube-auth-proxy-6cd5b47b7c-22b2j"
Jul 22 13:52:44.640049 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:44.639983    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aa75070f-78a1-42ae-966a-a489d3a50117-tmp\") pod \"kube-auth-proxy-6cd5b47b7c-22b2j\" (UID: \"aa75070f-78a1-42ae-966a-a489d3a50117\") " pod="openshift-ingress/kube-auth-proxy-6cd5b47b7c-22b2j"
Jul 22 13:52:44.740647 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:44.740486    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fln6\" (UniqueName: \"kubernetes.io/projected/aa75070f-78a1-42ae-966a-a489d3a50117-kube-api-access-2fln6\") pod \"kube-auth-proxy-6cd5b47b7c-22b2j\" (UID: \"aa75070f-78a1-42ae-966a-a489d3a50117\") " pod="openshift-ingress/kube-auth-proxy-6cd5b47b7c-22b2j"
Jul 22 13:52:44.740647 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:44.740535    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aa75070f-78a1-42ae-966a-a489d3a50117-tmp\") pod \"kube-auth-proxy-6cd5b47b7c-22b2j\" (UID: \"aa75070f-78a1-42ae-966a-a489d3a50117\") " pod="openshift-ingress/kube-auth-proxy-6cd5b47b7c-22b2j"
Jul 22 13:52:44.740647 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:44.740580    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa75070f-78a1-42ae-966a-a489d3a50117-tls-certs\") pod \"kube-auth-proxy-6cd5b47b7c-22b2j\" (UID: \"aa75070f-78a1-42ae-966a-a489d3a50117\") " pod="openshift-ingress/kube-auth-proxy-6cd5b47b7c-22b2j"
Jul 22 13:52:44.742944 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:44.742919    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aa75070f-78a1-42ae-966a-a489d3a50117-tmp\") pod \"kube-auth-proxy-6cd5b47b7c-22b2j\" (UID: \"aa75070f-78a1-42ae-966a-a489d3a50117\") " pod="openshift-ingress/kube-auth-proxy-6cd5b47b7c-22b2j"
Jul 22 13:52:44.743264 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:44.743243    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa75070f-78a1-42ae-966a-a489d3a50117-tls-certs\") pod \"kube-auth-proxy-6cd5b47b7c-22b2j\" (UID: \"aa75070f-78a1-42ae-966a-a489d3a50117\") " pod="openshift-ingress/kube-auth-proxy-6cd5b47b7c-22b2j"
Jul 22 13:52:44.748359 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:44.748338    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fln6\" (UniqueName: \"kubernetes.io/projected/aa75070f-78a1-42ae-966a-a489d3a50117-kube-api-access-2fln6\") pod \"kube-auth-proxy-6cd5b47b7c-22b2j\" (UID: \"aa75070f-78a1-42ae-966a-a489d3a50117\") " pod="openshift-ingress/kube-auth-proxy-6cd5b47b7c-22b2j"
Jul 22 13:52:44.770084 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:44.770051    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6cd5b47b7c-22b2j"
Jul 22 13:52:44.904705 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:44.904679    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6cd5b47b7c-22b2j"]
Jul 22 13:52:44.906757 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:52:44.906723    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa75070f_78a1_42ae_966a_a489d3a50117.slice/crio-12aec7459da2634bd5edcec54d20e5113d873256a3336c2d6a48af6c86002d6d WatchSource:0}: Error finding container 12aec7459da2634bd5edcec54d20e5113d873256a3336c2d6a48af6c86002d6d: Status 404 returned error can't find the container with id 12aec7459da2634bd5edcec54d20e5113d873256a3336c2d6a48af6c86002d6d
Jul 22 13:52:45.782840 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:45.782800    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6cd5b47b7c-22b2j" event={"ID":"aa75070f-78a1-42ae-966a-a489d3a50117","Type":"ContainerStarted","Data":"12aec7459da2634bd5edcec54d20e5113d873256a3336c2d6a48af6c86002d6d"}
Jul 22 13:52:47.794954 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:47.794862    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6cd5b47b7c-22b2j" event={"ID":"aa75070f-78a1-42ae-966a-a489d3a50117","Type":"ContainerStarted","Data":"2a48d09cbdf2cdbfe47dfcdbfcd9863b9f8502093c1f042df67596144d81437a"}
Jul 22 13:52:47.812003 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:47.811952    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6cd5b47b7c-22b2j" podStartSLOduration=1.298695982 podStartE2EDuration="3.811936096s" totalImagesPullingTime="2.513240114s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:52:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:52:47.810509222 +0000 UTC m=+377.865285901" watchObservedRunningTime="2026-07-22 13:52:47.811936096 +0000 UTC m=+377.866712771"
Jul 22 13:52:52.769296 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:52:52.769263    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-85c77b7bd5-2xbhr"
Jul 22 13:54:20.728211 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:54:20.728176    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-mxjl8"]
Jul 22 13:54:20.731632 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:54:20.731612    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mxjl8"
Jul 22 13:54:20.733706 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:54:20.733679    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 22 13:54:20.733835 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:54:20.733678    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 22 13:54:20.733835 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:54:20.733680    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 22 13:54:20.733835 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:54:20.733688    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 22 13:54:20.734237 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:54:20.734223    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-grkm9\""
Jul 22 13:54:20.741860 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:54:20.741835    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-mxjl8"]
Jul 22 13:54:20.817235 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:54:20.817197    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kc2mw\" (UniqueName: \"kubernetes.io/projected/239b7f6e-7911-44e9-ad38-18ff81c82793-kube-api-access-kc2mw\") pod \"kuadrant-console-plugin-66b5774985-mxjl8\" (UID: \"239b7f6e-7911-44e9-ad38-18ff81c82793\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mxjl8"
Jul 22 13:54:20.817235 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:54:20.817239    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/239b7f6e-7911-44e9-ad38-18ff81c82793-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-mxjl8\" (UID: \"239b7f6e-7911-44e9-ad38-18ff81c82793\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mxjl8"
Jul 22 13:54:20.817493 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:54:20.817373    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/239b7f6e-7911-44e9-ad38-18ff81c82793-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-mxjl8\" (UID: \"239b7f6e-7911-44e9-ad38-18ff81c82793\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mxjl8"
Jul 22 13:54:20.918531 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:54:20.918497    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/239b7f6e-7911-44e9-ad38-18ff81c82793-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-mxjl8\" (UID: \"239b7f6e-7911-44e9-ad38-18ff81c82793\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mxjl8"
Jul 22 13:54:20.918704 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:54:20.918611    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/239b7f6e-7911-44e9-ad38-18ff81c82793-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-mxjl8\" (UID: \"239b7f6e-7911-44e9-ad38-18ff81c82793\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mxjl8"
Jul 22 13:54:20.918704 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:54:20.918680    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kc2mw\" (UniqueName: \"kubernetes.io/projected/239b7f6e-7911-44e9-ad38-18ff81c82793-kube-api-access-kc2mw\") pod \"kuadrant-console-plugin-66b5774985-mxjl8\" (UID: \"239b7f6e-7911-44e9-ad38-18ff81c82793\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mxjl8"
Jul 22 13:54:20.919298 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:54:20.919279    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/239b7f6e-7911-44e9-ad38-18ff81c82793-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-mxjl8\" (UID: \"239b7f6e-7911-44e9-ad38-18ff81c82793\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mxjl8"
Jul 22 13:54:20.921103 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:54:20.921080    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/239b7f6e-7911-44e9-ad38-18ff81c82793-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-mxjl8\" (UID: \"239b7f6e-7911-44e9-ad38-18ff81c82793\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mxjl8"
Jul 22 13:54:20.929755 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:54:20.929729    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kc2mw\" (UniqueName: \"kubernetes.io/projected/239b7f6e-7911-44e9-ad38-18ff81c82793-kube-api-access-kc2mw\") pod \"kuadrant-console-plugin-66b5774985-mxjl8\" (UID: \"239b7f6e-7911-44e9-ad38-18ff81c82793\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mxjl8"
Jul 22 13:54:21.042261 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:54:21.042179    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mxjl8"
Jul 22 13:54:21.182711 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:54:21.182679    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-mxjl8"]
Jul 22 13:54:21.185816 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:54:21.185788    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod239b7f6e_7911_44e9_ad38_18ff81c82793.slice/crio-efc14de3ee6fd0c0aea17e4b52ec9a75371f4f961d467ef99d7e4cecfa0eb9f7 WatchSource:0}: Error finding container efc14de3ee6fd0c0aea17e4b52ec9a75371f4f961d467ef99d7e4cecfa0eb9f7: Status 404 returned error can't find the container with id efc14de3ee6fd0c0aea17e4b52ec9a75371f4f961d467ef99d7e4cecfa0eb9f7
Jul 22 13:54:21.221566 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:54:21.221524    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mxjl8" event={"ID":"239b7f6e-7911-44e9-ad38-18ff81c82793","Type":"ContainerStarted","Data":"efc14de3ee6fd0c0aea17e4b52ec9a75371f4f961d467ef99d7e4cecfa0eb9f7"}
Jul 22 13:54:30.739707 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:54:30.739662    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-89r7s"]
Jul 22 13:54:30.760365 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:54:30.760326    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-89r7s"]
Jul 22 13:54:30.760569 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:54:30.760465    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-89r7s"
Jul 22 13:54:30.763803 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:54:30.763782    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-hcrqc\""
Jul 22 13:54:30.816853 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:54:30.816817    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9tf9\" (UniqueName: \"kubernetes.io/projected/ddd162f4-067b-438e-9689-02a27bad9f85-kube-api-access-s9tf9\") pod \"kuadrant-operator-controller-manager-55467d9f7-89r7s\" (UID: \"ddd162f4-067b-438e-9689-02a27bad9f85\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-89r7s"
Jul 22 13:54:30.817041 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:54:30.816961    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ddd162f4-067b-438e-9689-02a27bad9f85-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-89r7s\" (UID: \"ddd162f4-067b-438e-9689-02a27bad9f85\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-89r7s"
Jul 22 13:54:30.917977 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:54:30.917935    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ddd162f4-067b-438e-9689-02a27bad9f85-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-89r7s\" (UID: \"ddd162f4-067b-438e-9689-02a27bad9f85\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-89r7s"
Jul 22 13:54:30.918172 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:54:30.918004    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9tf9\" (UniqueName: \"kubernetes.io/projected/ddd162f4-067b-438e-9689-02a27bad9f85-kube-api-access-s9tf9\") pod \"kuadrant-operator-controller-manager-55467d9f7-89r7s\" (UID: \"ddd162f4-067b-438e-9689-02a27bad9f85\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-89r7s"
Jul 22 13:54:30.918399 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:54:30.918368    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ddd162f4-067b-438e-9689-02a27bad9f85-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-89r7s\" (UID: \"ddd162f4-067b-438e-9689-02a27bad9f85\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-89r7s"
Jul 22 13:54:30.929668 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:54:30.929636    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-89r7s"]
Jul 22 13:54:30.930043 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:54:30.930019    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-s9tf9], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-89r7s" podUID="ddd162f4-067b-438e-9689-02a27bad9f85"
Jul 22 13:54:30.930868 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:54:30.930844    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9tf9\" (UniqueName: \"kubernetes.io/projected/ddd162f4-067b-438e-9689-02a27bad9f85-kube-api-access-s9tf9\") pod \"kuadrant-operator-controller-manager-55467d9f7-89r7s\" (UID: \"ddd162f4-067b-438e-9689-02a27bad9f85\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-89r7s"
Jul 22 13:54:30.952166 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:54:30.952134    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-89r7s"]
Jul 22 13:54:30.956792 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:54:30.956765    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-89r7s"]
Jul 22 13:54:31.277062 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:54:31.277033    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-89r7s"
Jul 22 13:54:31.290183 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:54:31.290155    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-89r7s"
Jul 22 13:54:31.292137 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:54:31.292102    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-89r7s\" is forbidden: User \"system:node:ip-10-0-129-134.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-134.ec2.internal' and this object" podUID="ddd162f4-067b-438e-9689-02a27bad9f85" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-89r7s"
Jul 22 13:54:31.423600 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:54:31.423563    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s9tf9\" (UniqueName: \"kubernetes.io/projected/ddd162f4-067b-438e-9689-02a27bad9f85-kube-api-access-s9tf9\") pod \"ddd162f4-067b-438e-9689-02a27bad9f85\" (UID: \"ddd162f4-067b-438e-9689-02a27bad9f85\") "
Jul 22 13:54:31.423795 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:54:31.423633    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ddd162f4-067b-438e-9689-02a27bad9f85-extensions-socket-volume\") pod \"ddd162f4-067b-438e-9689-02a27bad9f85\" (UID: \"ddd162f4-067b-438e-9689-02a27bad9f85\") "
Jul 22 13:54:31.423982 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:54:31.423954    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddd162f4-067b-438e-9689-02a27bad9f85-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ddd162f4-067b-438e-9689-02a27bad9f85" (UID: "ddd162f4-067b-438e-9689-02a27bad9f85"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 13:54:31.425988 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:54:31.425956    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddd162f4-067b-438e-9689-02a27bad9f85-kube-api-access-s9tf9" (OuterVolumeSpecName: "kube-api-access-s9tf9") pod "ddd162f4-067b-438e-9689-02a27bad9f85" (UID: "ddd162f4-067b-438e-9689-02a27bad9f85"). InnerVolumeSpecName "kube-api-access-s9tf9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 13:54:31.524394 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:54:31.524359    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s9tf9\" (UniqueName: \"kubernetes.io/projected/ddd162f4-067b-438e-9689-02a27bad9f85-kube-api-access-s9tf9\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 13:54:31.524394 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:54:31.524387    2571 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ddd162f4-067b-438e-9689-02a27bad9f85-extensions-socket-volume\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 13:54:32.282091 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:54:32.282044    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-89r7s"
Jul 22 13:54:32.283986 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:54:32.283952    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-89r7s\" is forbidden: User \"system:node:ip-10-0-129-134.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-134.ec2.internal' and this object" podUID="ddd162f4-067b-438e-9689-02a27bad9f85" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-89r7s"
Jul 22 13:54:32.290927 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:54:32.290890    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-89r7s\" is forbidden: User \"system:node:ip-10-0-129-134.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-134.ec2.internal' and this object" podUID="ddd162f4-067b-438e-9689-02a27bad9f85" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-89r7s"
Jul 22 13:54:33.010455 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:54:33.010400    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ddd162f4-067b-438e-9689-02a27bad9f85" path="/var/lib/kubelet/pods/ddd162f4-067b-438e-9689-02a27bad9f85/volumes"
Jul 22 13:54:45.360329 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:54:45.360295    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mxjl8" event={"ID":"239b7f6e-7911-44e9-ad38-18ff81c82793","Type":"ContainerStarted","Data":"9620cb35b16f045a7a0c56f729f70eeacc5cc380ad0d336eb6b82ccb78c16f31"}
Jul 22 13:54:45.418580 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:54:45.418522    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mxjl8" podStartSLOduration=2.239688584 podStartE2EDuration="25.418505012s" totalImagesPullingTime="23.178816428s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:54:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:54:45.417144059 +0000 UTC m=+495.471920736" watchObservedRunningTime="2026-07-22 13:54:45.418505012 +0000 UTC m=+495.473281689"
Jul 22 13:54:54.377219 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:54:54.377183    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-86b5568d9b-ssrgk"]
Jul 22 13:54:54.379538 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:54:54.379521    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86b5568d9b-ssrgk"
Jul 22 13:54:54.390028 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:54:54.390004    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86b5568d9b-ssrgk"]
Jul 22 13:54:54.453221 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:54:54.453184    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bd80c2db-b18a-4eb5-9ec8-e00e6d720712-oauth-serving-cert\") pod \"console-86b5568d9b-ssrgk\" (UID: \"bd80c2db-b18a-4eb5-9ec8-e00e6d720712\") " pod="openshift-console/console-86b5568d9b-ssrgk"
Jul 22 13:54:54.453221 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:54:54.453226    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bd80c2db-b18a-4eb5-9ec8-e00e6d720712-console-config\") pod \"console-86b5568d9b-ssrgk\" (UID: \"bd80c2db-b18a-4eb5-9ec8-e00e6d720712\") " pod="openshift-console/console-86b5568d9b-ssrgk"
Jul 22 13:54:54.453495 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:54:54.453296    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bd80c2db-b18a-4eb5-9ec8-e00e6d720712-service-ca\") pod \"console-86b5568d9b-ssrgk\" (UID: \"bd80c2db-b18a-4eb5-9ec8-e00e6d720712\") " pod="openshift-console/console-86b5568d9b-ssrgk"
Jul 22 13:54:54.453495 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:54:54.453366    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bd80c2db-b18a-4eb5-9ec8-e00e6d720712-console-oauth-config\") pod \"console-86b5568d9b-ssrgk\" (UID: \"bd80c2db-b18a-4eb5-9ec8-e00e6d720712\") " pod="openshift-console/console-86b5568d9b-ssrgk"
Jul 22 13:54:54.453495 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:54:54.453388    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bd80c2db-b18a-4eb5-9ec8-e00e6d720712-console-serving-cert\") pod \"console-86b5568d9b-ssrgk\" (UID: \"bd80c2db-b18a-4eb5-9ec8-e00e6d720712\") " pod="openshift-console/console-86b5568d9b-ssrgk"
Jul 22 13:54:54.453495 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:54:54.453456    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfk7z\" (UniqueName: \"kubernetes.io/projected/bd80c2db-b18a-4eb5-9ec8-e00e6d720712-kube-api-access-mfk7z\") pod \"console-86b5568d9b-ssrgk\" (UID: \"bd80c2db-b18a-4eb5-9ec8-e00e6d720712\") " pod="openshift-console/console-86b5568d9b-ssrgk"
Jul 22 13:54:54.453709 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:54:54.453516    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd80c2db-b18a-4eb5-9ec8-e00e6d720712-trusted-ca-bundle\") pod \"console-86b5568d9b-ssrgk\" (UID: \"bd80c2db-b18a-4eb5-9ec8-e00e6d720712\") " pod="openshift-console/console-86b5568d9b-ssrgk"
Jul 22 13:54:54.554006 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:54:54.553963    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bd80c2db-b18a-4eb5-9ec8-e00e6d720712-console-oauth-config\") pod \"console-86b5568d9b-ssrgk\" (UID: \"bd80c2db-b18a-4eb5-9ec8-e00e6d720712\") " pod="openshift-console/console-86b5568d9b-ssrgk"
Jul 22 13:54:54.554006 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:54:54.554004    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bd80c2db-b18a-4eb5-9ec8-e00e6d720712-console-serving-cert\") pod \"console-86b5568d9b-ssrgk\" (UID: \"bd80c2db-b18a-4eb5-9ec8-e00e6d720712\") " pod="openshift-console/console-86b5568d9b-ssrgk"
Jul 22 13:54:54.554275 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:54:54.554026    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfk7z\" (UniqueName: \"kubernetes.io/projected/bd80c2db-b18a-4eb5-9ec8-e00e6d720712-kube-api-access-mfk7z\") pod \"console-86b5568d9b-ssrgk\" (UID: \"bd80c2db-b18a-4eb5-9ec8-e00e6d720712\") " pod="openshift-console/console-86b5568d9b-ssrgk"
Jul 22 13:54:54.554275 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:54:54.554163    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd80c2db-b18a-4eb5-9ec8-e00e6d720712-trusted-ca-bundle\") pod \"console-86b5568d9b-ssrgk\" (UID: \"bd80c2db-b18a-4eb5-9ec8-e00e6d720712\") " pod="openshift-console/console-86b5568d9b-ssrgk"
Jul 22 13:54:54.554275 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:54:54.554254    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bd80c2db-b18a-4eb5-9ec8-e00e6d720712-oauth-serving-cert\") pod \"console-86b5568d9b-ssrgk\" (UID: \"bd80c2db-b18a-4eb5-9ec8-e00e6d720712\") " pod="openshift-console/console-86b5568d9b-ssrgk"
Jul 22 13:54:54.554465 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:54:54.554293    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bd80c2db-b18a-4eb5-9ec8-e00e6d720712-console-config\") pod \"console-86b5568d9b-ssrgk\" (UID: \"bd80c2db-b18a-4eb5-9ec8-e00e6d720712\") " pod="openshift-console/console-86b5568d9b-ssrgk"
Jul 22 13:54:54.554465 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:54:54.554344    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bd80c2db-b18a-4eb5-9ec8-e00e6d720712-service-ca\") pod \"console-86b5568d9b-ssrgk\" (UID: \"bd80c2db-b18a-4eb5-9ec8-e00e6d720712\") " pod="openshift-console/console-86b5568d9b-ssrgk"
Jul 22 13:54:54.554989 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:54:54.554963    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bd80c2db-b18a-4eb5-9ec8-e00e6d720712-oauth-serving-cert\") pod \"console-86b5568d9b-ssrgk\" (UID: \"bd80c2db-b18a-4eb5-9ec8-e00e6d720712\") " pod="openshift-console/console-86b5568d9b-ssrgk"
Jul 22 13:54:54.555114 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:54:54.555071    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bd80c2db-b18a-4eb5-9ec8-e00e6d720712-service-ca\") pod \"console-86b5568d9b-ssrgk\" (UID: \"bd80c2db-b18a-4eb5-9ec8-e00e6d720712\") " pod="openshift-console/console-86b5568d9b-ssrgk"
Jul 22 13:54:54.555114 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:54:54.555097    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd80c2db-b18a-4eb5-9ec8-e00e6d720712-trusted-ca-bundle\") pod \"console-86b5568d9b-ssrgk\" (UID: \"bd80c2db-b18a-4eb5-9ec8-e00e6d720712\") " pod="openshift-console/console-86b5568d9b-ssrgk"
Jul 22 13:54:54.555228 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:54:54.555118    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bd80c2db-b18a-4eb5-9ec8-e00e6d720712-console-config\") pod \"console-86b5568d9b-ssrgk\" (UID: \"bd80c2db-b18a-4eb5-9ec8-e00e6d720712\") " pod="openshift-console/console-86b5568d9b-ssrgk"
Jul 22 13:54:54.556790 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:54:54.556761    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bd80c2db-b18a-4eb5-9ec8-e00e6d720712-console-oauth-config\") pod \"console-86b5568d9b-ssrgk\" (UID: \"bd80c2db-b18a-4eb5-9ec8-e00e6d720712\") " pod="openshift-console/console-86b5568d9b-ssrgk"
Jul 22 13:54:54.556895 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:54:54.556840    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bd80c2db-b18a-4eb5-9ec8-e00e6d720712-console-serving-cert\") pod \"console-86b5568d9b-ssrgk\" (UID: \"bd80c2db-b18a-4eb5-9ec8-e00e6d720712\") " pod="openshift-console/console-86b5568d9b-ssrgk"
Jul 22 13:54:54.565944 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:54:54.565925    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfk7z\" (UniqueName: \"kubernetes.io/projected/bd80c2db-b18a-4eb5-9ec8-e00e6d720712-kube-api-access-mfk7z\") pod \"console-86b5568d9b-ssrgk\" (UID: \"bd80c2db-b18a-4eb5-9ec8-e00e6d720712\") " pod="openshift-console/console-86b5568d9b-ssrgk"
Jul 22 13:54:54.689376 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:54:54.689278    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86b5568d9b-ssrgk"
Jul 22 13:54:54.835022 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:54:54.834996    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86b5568d9b-ssrgk"]
Jul 22 13:54:54.837889 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:54:54.837863    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd80c2db_b18a_4eb5_9ec8_e00e6d720712.slice/crio-5fbf08fbfdb172c08053e2432d68480c8f7341a513c116dabf8fc0543a6a171b WatchSource:0}: Error finding container 5fbf08fbfdb172c08053e2432d68480c8f7341a513c116dabf8fc0543a6a171b: Status 404 returned error can't find the container with id 5fbf08fbfdb172c08053e2432d68480c8f7341a513c116dabf8fc0543a6a171b
Jul 22 13:54:55.407786 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:54:55.407746    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86b5568d9b-ssrgk" event={"ID":"bd80c2db-b18a-4eb5-9ec8-e00e6d720712","Type":"ContainerStarted","Data":"5ca3733b2e722a0d5e872c6ffaa9ee04678077373f3723310d6860618119a9e9"}
Jul 22 13:54:55.408177 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:54:55.407802    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86b5568d9b-ssrgk" event={"ID":"bd80c2db-b18a-4eb5-9ec8-e00e6d720712","Type":"ContainerStarted","Data":"5fbf08fbfdb172c08053e2432d68480c8f7341a513c116dabf8fc0543a6a171b"}
Jul 22 13:54:55.427770 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:54:55.427719    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-86b5568d9b-ssrgk" podStartSLOduration=1.427702301 podStartE2EDuration="1.427702301s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:54:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:54:55.426380491 +0000 UTC m=+505.481157168" watchObservedRunningTime="2026-07-22 13:54:55.427702301 +0000 UTC m=+505.482478978"
Jul 22 13:55:04.690365 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:55:04.690320    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-86b5568d9b-ssrgk"
Jul 22 13:55:04.691051 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:55:04.690385    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-86b5568d9b-ssrgk"
Jul 22 13:55:04.694983 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:55:04.694961    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-86b5568d9b-ssrgk"
Jul 22 13:55:05.459986 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:55:05.459955    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-86b5568d9b-ssrgk"
Jul 22 13:55:05.514281 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:55:05.514237    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5784f6d4b9-pbklw"]
Jul 22 13:55:06.397866 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:55:06.397828    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 13:55:06.400205 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:55:06.400188    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"
Jul 22 13:55:06.402192 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:55:06.402169    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 22 13:55:06.409668 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:55:06.409644    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 13:55:06.441712 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:55:06.441678    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 13:55:06.465695 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:55:06.465665    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftwxc\" (UniqueName: \"kubernetes.io/projected/d0663eea-3652-4fa6-ae21-5bae8d48a352-kube-api-access-ftwxc\") pod \"limitador-limitador-54d6d988d5-jdlnr\" (UID: \"d0663eea-3652-4fa6-ae21-5bae8d48a352\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"
Jul 22 13:55:06.465867 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:55:06.465794    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d0663eea-3652-4fa6-ae21-5bae8d48a352-config-file\") pod \"limitador-limitador-54d6d988d5-jdlnr\" (UID: \"d0663eea-3652-4fa6-ae21-5bae8d48a352\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"
Jul 22 13:55:06.566682 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:55:06.566582    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftwxc\" (UniqueName: \"kubernetes.io/projected/d0663eea-3652-4fa6-ae21-5bae8d48a352-kube-api-access-ftwxc\") pod \"limitador-limitador-54d6d988d5-jdlnr\" (UID: \"d0663eea-3652-4fa6-ae21-5bae8d48a352\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"
Jul 22 13:55:06.567021 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:55:06.566989    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d0663eea-3652-4fa6-ae21-5bae8d48a352-config-file\") pod \"limitador-limitador-54d6d988d5-jdlnr\" (UID: \"d0663eea-3652-4fa6-ae21-5bae8d48a352\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"
Jul 22 13:55:06.567658 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:55:06.567638    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d0663eea-3652-4fa6-ae21-5bae8d48a352-config-file\") pod \"limitador-limitador-54d6d988d5-jdlnr\" (UID: \"d0663eea-3652-4fa6-ae21-5bae8d48a352\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"
Jul 22 13:55:06.574428 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:55:06.574394    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftwxc\" (UniqueName: \"kubernetes.io/projected/d0663eea-3652-4fa6-ae21-5bae8d48a352-kube-api-access-ftwxc\") pod \"limitador-limitador-54d6d988d5-jdlnr\" (UID: \"d0663eea-3652-4fa6-ae21-5bae8d48a352\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"
Jul 22 13:55:06.711460 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:55:06.711347    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"
Jul 22 13:55:06.843501 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:55:06.843472    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 13:55:06.845939 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:55:06.845914    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0663eea_3652_4fa6_ae21_5bae8d48a352.slice/crio-e3641fc596b1054cae7cadc79f11319399cd622697e7010dc75d256b683a0893 WatchSource:0}: Error finding container e3641fc596b1054cae7cadc79f11319399cd622697e7010dc75d256b683a0893: Status 404 returned error can't find the container with id e3641fc596b1054cae7cadc79f11319399cd622697e7010dc75d256b683a0893
Jul 22 13:55:07.466382 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:55:07.466350    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-jdlnr" event={"ID":"d0663eea-3652-4fa6-ae21-5bae8d48a352","Type":"ContainerStarted","Data":"e3641fc596b1054cae7cadc79f11319399cd622697e7010dc75d256b683a0893"}
Jul 22 13:55:10.493249 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:55:10.493212    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-jdlnr" event={"ID":"d0663eea-3652-4fa6-ae21-5bae8d48a352","Type":"ContainerStarted","Data":"82f48865f97001b0565b3dbf676e54044276ad8670063a2a4c961b4cf3eb53b1"}
Jul 22 13:55:10.493668 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:55:10.493386    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"
Jul 22 13:55:10.511792 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:55:10.511742    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-jdlnr" podStartSLOduration=1.6735287639999998 podStartE2EDuration="4.511726387s" totalImagesPullingTime="2.838197623s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:55:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:55:10.509819154 +0000 UTC m=+520.564595841" watchObservedRunningTime="2026-07-22 13:55:10.511726387 +0000 UTC m=+520.566503063"
Jul 22 13:55:21.499563 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:55:21.499526    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"
Jul 22 13:55:30.537279 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:55:30.537182    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5784f6d4b9-pbklw" podUID="4594751f-a0be-49e7-9464-75bf7110c62e" containerName="console" containerID="cri-o://98449d77fe04160e1b152020710e372b830216f0ab81f56db5a4a9139a0bb648" gracePeriod=15
Jul 22 13:55:30.793778 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:55:30.793699    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5784f6d4b9-pbklw"
Jul 22 13:55:30.800989 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:55:30.800968    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4594751f-a0be-49e7-9464-75bf7110c62e-oauth-serving-cert\") pod \"4594751f-a0be-49e7-9464-75bf7110c62e\" (UID: \"4594751f-a0be-49e7-9464-75bf7110c62e\") "
Jul 22 13:55:30.801111 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:55:30.801025    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4594751f-a0be-49e7-9464-75bf7110c62e-trusted-ca-bundle\") pod \"4594751f-a0be-49e7-9464-75bf7110c62e\" (UID: \"4594751f-a0be-49e7-9464-75bf7110c62e\") "
Jul 22 13:55:30.801111 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:55:30.801051    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4594751f-a0be-49e7-9464-75bf7110c62e-console-oauth-config\") pod \"4594751f-a0be-49e7-9464-75bf7110c62e\" (UID: \"4594751f-a0be-49e7-9464-75bf7110c62e\") "
Jul 22 13:55:30.801111 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:55:30.801084    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4594751f-a0be-49e7-9464-75bf7110c62e-console-config\") pod \"4594751f-a0be-49e7-9464-75bf7110c62e\" (UID: \"4594751f-a0be-49e7-9464-75bf7110c62e\") "
Jul 22 13:55:30.801111 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:55:30.801110    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rjlwr\" (UniqueName: \"kubernetes.io/projected/4594751f-a0be-49e7-9464-75bf7110c62e-kube-api-access-rjlwr\") pod \"4594751f-a0be-49e7-9464-75bf7110c62e\" (UID: \"4594751f-a0be-49e7-9464-75bf7110c62e\") "
Jul 22 13:55:30.801315 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:55:30.801128    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4594751f-a0be-49e7-9464-75bf7110c62e-service-ca\") pod \"4594751f-a0be-49e7-9464-75bf7110c62e\" (UID: \"4594751f-a0be-49e7-9464-75bf7110c62e\") "
Jul 22 13:55:30.801315 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:55:30.801200    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4594751f-a0be-49e7-9464-75bf7110c62e-console-serving-cert\") pod \"4594751f-a0be-49e7-9464-75bf7110c62e\" (UID: \"4594751f-a0be-49e7-9464-75bf7110c62e\") "
Jul 22 13:55:30.801442 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:55:30.801379    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4594751f-a0be-49e7-9464-75bf7110c62e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4594751f-a0be-49e7-9464-75bf7110c62e" (UID: "4594751f-a0be-49e7-9464-75bf7110c62e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 13:55:30.801563 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:55:30.801538    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4594751f-a0be-49e7-9464-75bf7110c62e-console-config" (OuterVolumeSpecName: "console-config") pod "4594751f-a0be-49e7-9464-75bf7110c62e" (UID: "4594751f-a0be-49e7-9464-75bf7110c62e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 13:55:30.801690 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:55:30.801663    2571 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4594751f-a0be-49e7-9464-75bf7110c62e-oauth-serving-cert\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 13:55:30.801690 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:55:30.801548    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4594751f-a0be-49e7-9464-75bf7110c62e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4594751f-a0be-49e7-9464-75bf7110c62e" (UID: "4594751f-a0be-49e7-9464-75bf7110c62e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 13:55:30.801690 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:55:30.801568    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4594751f-a0be-49e7-9464-75bf7110c62e-service-ca" (OuterVolumeSpecName: "service-ca") pod "4594751f-a0be-49e7-9464-75bf7110c62e" (UID: "4594751f-a0be-49e7-9464-75bf7110c62e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 13:55:30.803363 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:55:30.803331    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4594751f-a0be-49e7-9464-75bf7110c62e-kube-api-access-rjlwr" (OuterVolumeSpecName: "kube-api-access-rjlwr") pod "4594751f-a0be-49e7-9464-75bf7110c62e" (UID: "4594751f-a0be-49e7-9464-75bf7110c62e"). InnerVolumeSpecName "kube-api-access-rjlwr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 13:55:30.803363 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:55:30.803349    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4594751f-a0be-49e7-9464-75bf7110c62e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4594751f-a0be-49e7-9464-75bf7110c62e" (UID: "4594751f-a0be-49e7-9464-75bf7110c62e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 13:55:30.803551 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:55:30.803334    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4594751f-a0be-49e7-9464-75bf7110c62e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4594751f-a0be-49e7-9464-75bf7110c62e" (UID: "4594751f-a0be-49e7-9464-75bf7110c62e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 13:55:30.902981 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:55:30.902951    2571 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4594751f-a0be-49e7-9464-75bf7110c62e-console-oauth-config\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 13:55:30.902981 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:55:30.902977    2571 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4594751f-a0be-49e7-9464-75bf7110c62e-console-config\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 13:55:30.902981 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:55:30.902986    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rjlwr\" (UniqueName: \"kubernetes.io/projected/4594751f-a0be-49e7-9464-75bf7110c62e-kube-api-access-rjlwr\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 13:55:30.903204 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:55:30.902996    2571 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4594751f-a0be-49e7-9464-75bf7110c62e-service-ca\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 13:55:30.903204 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:55:30.903005    2571 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4594751f-a0be-49e7-9464-75bf7110c62e-console-serving-cert\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 13:55:30.903204 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:55:30.903013    2571 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4594751f-a0be-49e7-9464-75bf7110c62e-trusted-ca-bundle\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 13:55:31.594083 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:55:31.594052    2571 generic.go:356] "Generic (PLEG): container finished" podID="4594751f-a0be-49e7-9464-75bf7110c62e" containerID="98449d77fe04160e1b152020710e372b830216f0ab81f56db5a4a9139a0bb648" exitCode=0
Jul 22 13:55:31.594529 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:55:31.594097    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5784f6d4b9-pbklw"
Jul 22 13:55:31.594529 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:55:31.594102    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5784f6d4b9-pbklw" event={"ID":"4594751f-a0be-49e7-9464-75bf7110c62e","Type":"ContainerDied","Data":"98449d77fe04160e1b152020710e372b830216f0ab81f56db5a4a9139a0bb648"}
Jul 22 13:55:31.594529 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:55:31.594140    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5784f6d4b9-pbklw" event={"ID":"4594751f-a0be-49e7-9464-75bf7110c62e","Type":"ContainerDied","Data":"a15d3fa70b9a426ea80de2c610363ceb15056c5a3f42f19cf95902185027d3eb"}
Jul 22 13:55:31.594529 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:55:31.594159    2571 scope.go:117] "RemoveContainer" containerID="98449d77fe04160e1b152020710e372b830216f0ab81f56db5a4a9139a0bb648"
Jul 22 13:55:31.602801 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:55:31.602784    2571 scope.go:117] "RemoveContainer" containerID="98449d77fe04160e1b152020710e372b830216f0ab81f56db5a4a9139a0bb648"
Jul 22 13:55:31.603058 ip-10-0-129-134 kubenswrapper[2571]: E0722 13:55:31.603038    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98449d77fe04160e1b152020710e372b830216f0ab81f56db5a4a9139a0bb648\": container with ID starting with 98449d77fe04160e1b152020710e372b830216f0ab81f56db5a4a9139a0bb648 not found: ID does not exist" containerID="98449d77fe04160e1b152020710e372b830216f0ab81f56db5a4a9139a0bb648"
Jul 22 13:55:31.603101 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:55:31.603065    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98449d77fe04160e1b152020710e372b830216f0ab81f56db5a4a9139a0bb648"} err="failed to get container status \"98449d77fe04160e1b152020710e372b830216f0ab81f56db5a4a9139a0bb648\": rpc error: code = NotFound desc = could not find container \"98449d77fe04160e1b152020710e372b830216f0ab81f56db5a4a9139a0bb648\": container with ID starting with 98449d77fe04160e1b152020710e372b830216f0ab81f56db5a4a9139a0bb648 not found: ID does not exist"
Jul 22 13:55:31.614827 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:55:31.614796    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5784f6d4b9-pbklw"]
Jul 22 13:55:31.619430 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:55:31.619394    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5784f6d4b9-pbklw"]
Jul 22 13:55:33.009712 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:55:33.009677    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4594751f-a0be-49e7-9464-75bf7110c62e" path="/var/lib/kubelet/pods/4594751f-a0be-49e7-9464-75bf7110c62e/volumes"
Jul 22 13:56:23.349160 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:56:23.349123    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 13:56:48.159161 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:56:48.159127    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8n7k4"]
Jul 22 13:56:48.161590 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:56:48.159572    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4594751f-a0be-49e7-9464-75bf7110c62e" containerName="console"
Jul 22 13:56:48.161590 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:56:48.159587    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="4594751f-a0be-49e7-9464-75bf7110c62e" containerName="console"
Jul 22 13:56:48.161590 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:56:48.159668    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="4594751f-a0be-49e7-9464-75bf7110c62e" containerName="console"
Jul 22 13:56:48.162665 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:56:48.162645    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8n7k4"
Jul 22 13:56:48.164727 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:56:48.164707    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-s6zft\""
Jul 22 13:56:48.165217 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:56:48.165202    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 22 13:56:48.165274 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:56:48.165228    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 22 13:56:48.165356 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:56:48.165343    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 22 13:56:48.175383 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:56:48.175362    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8n7k4"]
Jul 22 13:56:48.308266 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:56:48.308229    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/355939bd-e62c-4392-8d02-d0a34c6d7f87-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8n7k4\" (UID: \"355939bd-e62c-4392-8d02-d0a34c6d7f87\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8n7k4"
Jul 22 13:56:48.308266 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:56:48.308273    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/355939bd-e62c-4392-8d02-d0a34c6d7f87-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8n7k4\" (UID: \"355939bd-e62c-4392-8d02-d0a34c6d7f87\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8n7k4"
Jul 22 13:56:48.308659 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:56:48.308454    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/355939bd-e62c-4392-8d02-d0a34c6d7f87-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8n7k4\" (UID: \"355939bd-e62c-4392-8d02-d0a34c6d7f87\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8n7k4"
Jul 22 13:56:48.308659 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:56:48.308500    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/355939bd-e62c-4392-8d02-d0a34c6d7f87-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8n7k4\" (UID: \"355939bd-e62c-4392-8d02-d0a34c6d7f87\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8n7k4"
Jul 22 13:56:48.308659 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:56:48.308532    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/355939bd-e62c-4392-8d02-d0a34c6d7f87-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8n7k4\" (UID: \"355939bd-e62c-4392-8d02-d0a34c6d7f87\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8n7k4"
Jul 22 13:56:48.308659 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:56:48.308564    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xz8jt\" (UniqueName: \"kubernetes.io/projected/355939bd-e62c-4392-8d02-d0a34c6d7f87-kube-api-access-xz8jt\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8n7k4\" (UID: \"355939bd-e62c-4392-8d02-d0a34c6d7f87\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8n7k4"
Jul 22 13:56:48.409432 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:56:48.409315    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/355939bd-e62c-4392-8d02-d0a34c6d7f87-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8n7k4\" (UID: \"355939bd-e62c-4392-8d02-d0a34c6d7f87\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8n7k4"
Jul 22 13:56:48.409432 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:56:48.409361    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/355939bd-e62c-4392-8d02-d0a34c6d7f87-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8n7k4\" (UID: \"355939bd-e62c-4392-8d02-d0a34c6d7f87\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8n7k4"
Jul 22 13:56:48.409432 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:56:48.409376    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/355939bd-e62c-4392-8d02-d0a34c6d7f87-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8n7k4\" (UID: \"355939bd-e62c-4392-8d02-d0a34c6d7f87\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8n7k4"
Jul 22 13:56:48.409432 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:56:48.409399    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xz8jt\" (UniqueName: \"kubernetes.io/projected/355939bd-e62c-4392-8d02-d0a34c6d7f87-kube-api-access-xz8jt\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8n7k4\" (UID: \"355939bd-e62c-4392-8d02-d0a34c6d7f87\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8n7k4"
Jul 22 13:56:48.409775 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:56:48.409455    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/355939bd-e62c-4392-8d02-d0a34c6d7f87-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8n7k4\" (UID: \"355939bd-e62c-4392-8d02-d0a34c6d7f87\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8n7k4"
Jul 22 13:56:48.409775 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:56:48.409476    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/355939bd-e62c-4392-8d02-d0a34c6d7f87-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8n7k4\" (UID: \"355939bd-e62c-4392-8d02-d0a34c6d7f87\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8n7k4"
Jul 22 13:56:48.409864 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:56:48.409777    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/355939bd-e62c-4392-8d02-d0a34c6d7f87-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8n7k4\" (UID: \"355939bd-e62c-4392-8d02-d0a34c6d7f87\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8n7k4"
Jul 22 13:56:48.409864 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:56:48.409854    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/355939bd-e62c-4392-8d02-d0a34c6d7f87-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8n7k4\" (UID: \"355939bd-e62c-4392-8d02-d0a34c6d7f87\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8n7k4"
Jul 22 13:56:48.409930 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:56:48.409898    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/355939bd-e62c-4392-8d02-d0a34c6d7f87-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8n7k4\" (UID: \"355939bd-e62c-4392-8d02-d0a34c6d7f87\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8n7k4"
Jul 22 13:56:48.411766 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:56:48.411748    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/355939bd-e62c-4392-8d02-d0a34c6d7f87-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8n7k4\" (UID: \"355939bd-e62c-4392-8d02-d0a34c6d7f87\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8n7k4"
Jul 22 13:56:48.411881 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:56:48.411865    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/355939bd-e62c-4392-8d02-d0a34c6d7f87-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8n7k4\" (UID: \"355939bd-e62c-4392-8d02-d0a34c6d7f87\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8n7k4"
Jul 22 13:56:48.418801 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:56:48.418779    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xz8jt\" (UniqueName: \"kubernetes.io/projected/355939bd-e62c-4392-8d02-d0a34c6d7f87-kube-api-access-xz8jt\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8n7k4\" (UID: \"355939bd-e62c-4392-8d02-d0a34c6d7f87\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8n7k4"
Jul 22 13:56:48.472460 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:56:48.472391    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8n7k4"
Jul 22 13:56:48.586577 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:56:48.586542    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 13:56:48.609195 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:56:48.609160    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8n7k4"]
Jul 22 13:56:48.612512 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:56:48.612482    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod355939bd_e62c_4392_8d02_d0a34c6d7f87.slice/crio-4ee39e90bf040a48d78fbf75f75b04b469daa0913ff48486c79289e1b5324fff WatchSource:0}: Error finding container 4ee39e90bf040a48d78fbf75f75b04b469daa0913ff48486c79289e1b5324fff: Status 404 returned error can't find the container with id 4ee39e90bf040a48d78fbf75f75b04b469daa0913ff48486c79289e1b5324fff
Jul 22 13:56:48.613773 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:56:48.613753    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 13:56:48.959757 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:56:48.959726    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8n7k4" event={"ID":"355939bd-e62c-4392-8d02-d0a34c6d7f87","Type":"ContainerStarted","Data":"4ee39e90bf040a48d78fbf75f75b04b469daa0913ff48486c79289e1b5324fff"}
Jul 22 13:56:50.971368 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:56:50.971334    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8n7k4" event={"ID":"355939bd-e62c-4392-8d02-d0a34c6d7f87","Type":"ContainerStarted","Data":"bbb4ac57f23d6a1a29bde60f4c150b2cac0e56f38f26d2b6353a8885d4b39f45"}
Jul 22 13:56:50.989795 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:56:50.989745    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8n7k4" podStartSLOduration=1.610186402 podStartE2EDuration="2.989728063s" totalImagesPullingTime="1.379541661s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:56:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:56:50.988104596 +0000 UTC m=+621.042881275" watchObservedRunningTime="2026-07-22 13:56:50.989728063 +0000 UTC m=+621.044504739"
Jul 22 13:56:55.091436 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:56:55.091323    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 13:56:58.472944 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:56:58.472906    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8n7k4"
Jul 22 13:56:58.473358 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:56:58.472972    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8n7k4"
Jul 22 13:56:58.485746 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:56:58.485720    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8n7k4"
Jul 22 13:56:59.019582 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:56:59.019554    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8n7k4"
Jul 22 13:57:11.876452 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:57:11.874144    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 13:57:21.967479 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:57:21.967439    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 13:57:29.371277 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:57:29.371241    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-gcpnm"]
Jul 22 13:57:29.373642 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:57:29.373625    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gcpnm"
Jul 22 13:57:29.375631 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:57:29.375606    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 22 13:57:29.385327 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:57:29.385301    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-gcpnm"]
Jul 22 13:57:29.496589 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:57:29.496549    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/919ba490-d3ce-4933-98c9-9b1d369e196a-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gcpnm\" (UID: \"919ba490-d3ce-4933-98c9-9b1d369e196a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gcpnm"
Jul 22 13:57:29.496589 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:57:29.496588    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/919ba490-d3ce-4933-98c9-9b1d369e196a-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gcpnm\" (UID: \"919ba490-d3ce-4933-98c9-9b1d369e196a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gcpnm"
Jul 22 13:57:29.496826 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:57:29.496607    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cp49q\" (UniqueName: \"kubernetes.io/projected/919ba490-d3ce-4933-98c9-9b1d369e196a-kube-api-access-cp49q\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gcpnm\" (UID: \"919ba490-d3ce-4933-98c9-9b1d369e196a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gcpnm"
Jul 22 13:57:29.496826 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:57:29.496707    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/919ba490-d3ce-4933-98c9-9b1d369e196a-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gcpnm\" (UID: \"919ba490-d3ce-4933-98c9-9b1d369e196a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gcpnm"
Jul 22 13:57:29.496826 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:57:29.496744    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/919ba490-d3ce-4933-98c9-9b1d369e196a-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gcpnm\" (UID: \"919ba490-d3ce-4933-98c9-9b1d369e196a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gcpnm"
Jul 22 13:57:29.496826 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:57:29.496800    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/919ba490-d3ce-4933-98c9-9b1d369e196a-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gcpnm\" (UID: \"919ba490-d3ce-4933-98c9-9b1d369e196a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gcpnm"
Jul 22 13:57:29.598233 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:57:29.598189    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/919ba490-d3ce-4933-98c9-9b1d369e196a-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gcpnm\" (UID: \"919ba490-d3ce-4933-98c9-9b1d369e196a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gcpnm"
Jul 22 13:57:29.598233 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:57:29.598230    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/919ba490-d3ce-4933-98c9-9b1d369e196a-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gcpnm\" (UID: \"919ba490-d3ce-4933-98c9-9b1d369e196a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gcpnm"
Jul 22 13:57:29.598548 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:57:29.598247    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cp49q\" (UniqueName: \"kubernetes.io/projected/919ba490-d3ce-4933-98c9-9b1d369e196a-kube-api-access-cp49q\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gcpnm\" (UID: \"919ba490-d3ce-4933-98c9-9b1d369e196a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gcpnm"
Jul 22 13:57:29.598548 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:57:29.598366    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/919ba490-d3ce-4933-98c9-9b1d369e196a-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gcpnm\" (UID: \"919ba490-d3ce-4933-98c9-9b1d369e196a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gcpnm"
Jul 22 13:57:29.598548 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:57:29.598423    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/919ba490-d3ce-4933-98c9-9b1d369e196a-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gcpnm\" (UID: \"919ba490-d3ce-4933-98c9-9b1d369e196a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gcpnm"
Jul 22 13:57:29.598548 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:57:29.598535    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/919ba490-d3ce-4933-98c9-9b1d369e196a-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gcpnm\" (UID: \"919ba490-d3ce-4933-98c9-9b1d369e196a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gcpnm"
Jul 22 13:57:29.598822 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:57:29.598760    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/919ba490-d3ce-4933-98c9-9b1d369e196a-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gcpnm\" (UID: \"919ba490-d3ce-4933-98c9-9b1d369e196a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gcpnm"
Jul 22 13:57:29.598822 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:57:29.598799    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/919ba490-d3ce-4933-98c9-9b1d369e196a-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gcpnm\" (UID: \"919ba490-d3ce-4933-98c9-9b1d369e196a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gcpnm"
Jul 22 13:57:29.598892 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:57:29.598831    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/919ba490-d3ce-4933-98c9-9b1d369e196a-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gcpnm\" (UID: \"919ba490-d3ce-4933-98c9-9b1d369e196a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gcpnm"
Jul 22 13:57:29.600448 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:57:29.600422    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/919ba490-d3ce-4933-98c9-9b1d369e196a-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gcpnm\" (UID: \"919ba490-d3ce-4933-98c9-9b1d369e196a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gcpnm"
Jul 22 13:57:29.600813 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:57:29.600796    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/919ba490-d3ce-4933-98c9-9b1d369e196a-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gcpnm\" (UID: \"919ba490-d3ce-4933-98c9-9b1d369e196a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gcpnm"
Jul 22 13:57:29.607756 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:57:29.607728    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cp49q\" (UniqueName: \"kubernetes.io/projected/919ba490-d3ce-4933-98c9-9b1d369e196a-kube-api-access-cp49q\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gcpnm\" (UID: \"919ba490-d3ce-4933-98c9-9b1d369e196a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gcpnm"
Jul 22 13:57:29.684375 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:57:29.684286    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gcpnm"
Jul 22 13:57:29.827285 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:57:29.827258    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-gcpnm"]
Jul 22 13:57:29.829303 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:57:29.829266    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod919ba490_d3ce_4933_98c9_9b1d369e196a.slice/crio-3e393418594c2256bc6ba0eeb177488125e47b3de26b56d1893788afc12e99a9 WatchSource:0}: Error finding container 3e393418594c2256bc6ba0eeb177488125e47b3de26b56d1893788afc12e99a9: Status 404 returned error can't find the container with id 3e393418594c2256bc6ba0eeb177488125e47b3de26b56d1893788afc12e99a9
Jul 22 13:57:30.158790 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:57:30.158755    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gcpnm" event={"ID":"919ba490-d3ce-4933-98c9-9b1d369e196a","Type":"ContainerStarted","Data":"3e393418594c2256bc6ba0eeb177488125e47b3de26b56d1893788afc12e99a9"}
Jul 22 13:57:31.165006 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:57:31.164970    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gcpnm" event={"ID":"919ba490-d3ce-4933-98c9-9b1d369e196a","Type":"ContainerStarted","Data":"4a79f1ce80cf9cc36833439c7f96ff9f92834c10ddc05d7bf3a65f2cd4c2150d"}
Jul 22 13:57:31.189971 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:57:31.189912    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gcpnm" podStartSLOduration=1.84707527 podStartE2EDuration="2.189898069s" totalImagesPullingTime="342.822799ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:57:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:57:31.188782607 +0000 UTC m=+661.243559288" watchObservedRunningTime="2026-07-22 13:57:31.189898069 +0000 UTC m=+661.244674746"
Jul 22 13:57:31.567128 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:57:31.567092    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 13:57:32.068316 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:57:32.068283    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-hswq6"]
Jul 22 13:57:32.070611 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:57:32.070589    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-hswq6"
Jul 22 13:57:32.072673 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:57:32.072654    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 22 13:57:32.087114 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:57:32.087085    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-hswq6"]
Jul 22 13:57:32.226340 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:57:32.226300    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97bd4461-4fa4-4582-8115-8c39e665cbcf-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-hswq6\" (UID: \"97bd4461-4fa4-4582-8115-8c39e665cbcf\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-hswq6"
Jul 22 13:57:32.226340 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:57:32.226340    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/97bd4461-4fa4-4582-8115-8c39e665cbcf-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-hswq6\" (UID: \"97bd4461-4fa4-4582-8115-8c39e665cbcf\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-hswq6"
Jul 22 13:57:32.226862 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:57:32.226363    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/97bd4461-4fa4-4582-8115-8c39e665cbcf-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-hswq6\" (UID: \"97bd4461-4fa4-4582-8115-8c39e665cbcf\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-hswq6"
Jul 22 13:57:32.226862 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:57:32.226499    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/97bd4461-4fa4-4582-8115-8c39e665cbcf-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-hswq6\" (UID: \"97bd4461-4fa4-4582-8115-8c39e665cbcf\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-hswq6"
Jul 22 13:57:32.226862 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:57:32.226530    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97bd4461-4fa4-4582-8115-8c39e665cbcf-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-hswq6\" (UID: \"97bd4461-4fa4-4582-8115-8c39e665cbcf\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-hswq6"
Jul 22 13:57:32.226862 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:57:32.226674    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txp4t\" (UniqueName: \"kubernetes.io/projected/97bd4461-4fa4-4582-8115-8c39e665cbcf-kube-api-access-txp4t\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-hswq6\" (UID: \"97bd4461-4fa4-4582-8115-8c39e665cbcf\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-hswq6"
Jul 22 13:57:32.327904 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:57:32.327803    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txp4t\" (UniqueName: \"kubernetes.io/projected/97bd4461-4fa4-4582-8115-8c39e665cbcf-kube-api-access-txp4t\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-hswq6\" (UID: \"97bd4461-4fa4-4582-8115-8c39e665cbcf\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-hswq6"
Jul 22 13:57:32.327904 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:57:32.327851    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97bd4461-4fa4-4582-8115-8c39e665cbcf-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-hswq6\" (UID: \"97bd4461-4fa4-4582-8115-8c39e665cbcf\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-hswq6"
Jul 22 13:57:32.327904 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:57:32.327872    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/97bd4461-4fa4-4582-8115-8c39e665cbcf-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-hswq6\" (UID: \"97bd4461-4fa4-4582-8115-8c39e665cbcf\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-hswq6"
Jul 22 13:57:32.327904 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:57:32.327894    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/97bd4461-4fa4-4582-8115-8c39e665cbcf-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-hswq6\" (UID: \"97bd4461-4fa4-4582-8115-8c39e665cbcf\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-hswq6"
Jul 22 13:57:32.328243 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:57:32.327942    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/97bd4461-4fa4-4582-8115-8c39e665cbcf-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-hswq6\" (UID: \"97bd4461-4fa4-4582-8115-8c39e665cbcf\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-hswq6"
Jul 22 13:57:32.328243 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:57:32.327958    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97bd4461-4fa4-4582-8115-8c39e665cbcf-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-hswq6\" (UID: \"97bd4461-4fa4-4582-8115-8c39e665cbcf\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-hswq6"
Jul 22 13:57:32.328385 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:57:32.328359    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/97bd4461-4fa4-4582-8115-8c39e665cbcf-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-hswq6\" (UID: \"97bd4461-4fa4-4582-8115-8c39e665cbcf\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-hswq6"
Jul 22 13:57:32.328475 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:57:32.328385    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97bd4461-4fa4-4582-8115-8c39e665cbcf-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-hswq6\" (UID: \"97bd4461-4fa4-4582-8115-8c39e665cbcf\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-hswq6"
Jul 22 13:57:32.328475 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:57:32.328449    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/97bd4461-4fa4-4582-8115-8c39e665cbcf-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-hswq6\" (UID: \"97bd4461-4fa4-4582-8115-8c39e665cbcf\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-hswq6"
Jul 22 13:57:32.330160 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:57:32.330143    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/97bd4461-4fa4-4582-8115-8c39e665cbcf-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-hswq6\" (UID: \"97bd4461-4fa4-4582-8115-8c39e665cbcf\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-hswq6"
Jul 22 13:57:32.330585 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:57:32.330566    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97bd4461-4fa4-4582-8115-8c39e665cbcf-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-hswq6\" (UID: \"97bd4461-4fa4-4582-8115-8c39e665cbcf\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-hswq6"
Jul 22 13:57:32.347613 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:57:32.347582    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txp4t\" (UniqueName: \"kubernetes.io/projected/97bd4461-4fa4-4582-8115-8c39e665cbcf-kube-api-access-txp4t\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-hswq6\" (UID: \"97bd4461-4fa4-4582-8115-8c39e665cbcf\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-hswq6"
Jul 22 13:57:32.379928 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:57:32.379864    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-hswq6"
Jul 22 13:57:32.516894 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:57:32.516862    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-hswq6"]
Jul 22 13:57:32.519343 ip-10-0-129-134 kubenswrapper[2571]: W0722 13:57:32.519312    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod97bd4461_4fa4_4582_8115_8c39e665cbcf.slice/crio-19287ee35eebbc528a2c4d7ef762e172bb90c760921e057864139617bcaf75e9 WatchSource:0}: Error finding container 19287ee35eebbc528a2c4d7ef762e172bb90c760921e057864139617bcaf75e9: Status 404 returned error can't find the container with id 19287ee35eebbc528a2c4d7ef762e172bb90c760921e057864139617bcaf75e9
Jul 22 13:57:33.175340 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:57:33.175296    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-hswq6" event={"ID":"97bd4461-4fa4-4582-8115-8c39e665cbcf","Type":"ContainerStarted","Data":"c8a4e4a5c92a2078558ce1d3f18f4b9854f7bebdde238d49211c2a41e41c1730"}
Jul 22 13:57:33.175340 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:57:33.175346    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-hswq6" event={"ID":"97bd4461-4fa4-4582-8115-8c39e665cbcf","Type":"ContainerStarted","Data":"19287ee35eebbc528a2c4d7ef762e172bb90c760921e057864139617bcaf75e9"}
Jul 22 13:57:33.202157 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:57:33.202096    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-hswq6" podStartSLOduration=1.014319312 podStartE2EDuration="1.202075684s" totalImagesPullingTime="187.756372ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:57:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:57:33.201944377 +0000 UTC m=+663.256721056" watchObservedRunningTime="2026-07-22 13:57:33.202075684 +0000 UTC m=+663.256852361"
Jul 22 13:57:39.684441 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:57:39.684380    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gcpnm"
Jul 22 13:57:39.684870 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:57:39.684478    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gcpnm"
Jul 22 13:57:39.697271 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:57:39.697247    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gcpnm"
Jul 22 13:57:40.220984 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:57:40.220952    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gcpnm"
Jul 22 13:57:42.267422 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:57:42.267373    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 13:57:42.381057 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:57:42.381012    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-hswq6"
Jul 22 13:57:42.381057 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:57:42.381070    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-hswq6"
Jul 22 13:57:42.393498 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:57:42.393470    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-hswq6"
Jul 22 13:57:43.235569 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:57:43.235539    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-hswq6"
Jul 22 13:59:21.069989 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:59:21.069952    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 13:59:31.064157 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:59:31.064117    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 13:59:41.462728 ip-10-0-129-134 kubenswrapper[2571]: I0722 13:59:41.462691    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:01:30.161590 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:01:30.161511    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:01:39.112466 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:01:39.112431    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:01:49.958981 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:01:49.958942    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:02:09.859425 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:02:09.859366    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:02:19.054922 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:02:19.054884    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:02:27.559394 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:02:27.559355    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:02:35.657603 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:02:35.657569    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:02:46.953859 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:02:46.953823    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:02:56.074882 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:02:56.074801    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:03:07.760604 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:03:07.760564    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:03:16.972520 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:03:16.972483    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:03:40.373204 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:03:40.373160    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:03:49.852177 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:03:49.852138    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:04:13.358211 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:04:13.358175    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:04:23.063583 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:04:23.063500    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:04:34.560879 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:04:34.560837    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:04:44.673648 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:04:44.673612    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:04:55.257866 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:04:55.257831    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:05:04.279080 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:05:04.279047    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:05:13.664054 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:05:13.664016    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:05:22.460800 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:05:22.460764    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:07:11.987204 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:07:11.987162    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:07:21.269757 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:07:21.269725    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:07:33.659203 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:07:33.659119    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:07:45.863039 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:07:45.863003    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:07:55.264751 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:07:55.264717    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:08:06.978337 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:08:06.978301    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:08:15.970633 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:08:15.970598    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:08:25.759173 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:08:25.759134    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:08:37.966705 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:08:37.966672    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:08:46.670131 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:08:46.670089    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:08:57.474227 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:08:57.474128    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:09:21.256798 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:09:21.256759    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:09:28.774847 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:09:28.774808    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:09:39.673997 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:09:39.673957    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-f7610c3b-kserve-7d8649f4c9-w8p5k"]
Jul 22 14:09:39.677317 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:09:39.677294    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-f7610c3b-kserve-7d8649f4c9-w8p5k"
Jul 22 14:09:39.679806 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:09:39.679780    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-f7610c3b-kserve-self-signed-certs\""
Jul 22 14:09:39.699314 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:09:39.699277    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-f7610c3b-kserve-7d8649f4c9-w8p5k"]
Jul 22 14:09:39.742788 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:09:39.742755    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d3de3d8-a616-4cb2-8957-75477a525b1b-tmp-dir\") pod \"e2e-same-id-a-f7610c3b-kserve-7d8649f4c9-w8p5k\" (UID: \"9d3de3d8-a616-4cb2-8957-75477a525b1b\") " pod="llm/e2e-same-id-a-f7610c3b-kserve-7d8649f4c9-w8p5k"
Jul 22 14:09:39.742980 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:09:39.742834    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tjr7\" (UniqueName: \"kubernetes.io/projected/9d3de3d8-a616-4cb2-8957-75477a525b1b-kube-api-access-4tjr7\") pod \"e2e-same-id-a-f7610c3b-kserve-7d8649f4c9-w8p5k\" (UID: \"9d3de3d8-a616-4cb2-8957-75477a525b1b\") " pod="llm/e2e-same-id-a-f7610c3b-kserve-7d8649f4c9-w8p5k"
Jul 22 14:09:39.742980 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:09:39.742916    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9d3de3d8-a616-4cb2-8957-75477a525b1b-home\") pod \"e2e-same-id-a-f7610c3b-kserve-7d8649f4c9-w8p5k\" (UID: \"9d3de3d8-a616-4cb2-8957-75477a525b1b\") " pod="llm/e2e-same-id-a-f7610c3b-kserve-7d8649f4c9-w8p5k"
Jul 22 14:09:39.742980 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:09:39.742966    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d3de3d8-a616-4cb2-8957-75477a525b1b-model-cache\") pod \"e2e-same-id-a-f7610c3b-kserve-7d8649f4c9-w8p5k\" (UID: \"9d3de3d8-a616-4cb2-8957-75477a525b1b\") " pod="llm/e2e-same-id-a-f7610c3b-kserve-7d8649f4c9-w8p5k"
Jul 22 14:09:39.743104 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:09:39.742983    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d3de3d8-a616-4cb2-8957-75477a525b1b-dshm\") pod \"e2e-same-id-a-f7610c3b-kserve-7d8649f4c9-w8p5k\" (UID: \"9d3de3d8-a616-4cb2-8957-75477a525b1b\") " pod="llm/e2e-same-id-a-f7610c3b-kserve-7d8649f4c9-w8p5k"
Jul 22 14:09:39.743104 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:09:39.743054    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d3de3d8-a616-4cb2-8957-75477a525b1b-tls-certs\") pod \"e2e-same-id-a-f7610c3b-kserve-7d8649f4c9-w8p5k\" (UID: \"9d3de3d8-a616-4cb2-8957-75477a525b1b\") " pod="llm/e2e-same-id-a-f7610c3b-kserve-7d8649f4c9-w8p5k"
Jul 22 14:09:39.844296 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:09:39.844253    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d3de3d8-a616-4cb2-8957-75477a525b1b-tls-certs\") pod \"e2e-same-id-a-f7610c3b-kserve-7d8649f4c9-w8p5k\" (UID: \"9d3de3d8-a616-4cb2-8957-75477a525b1b\") " pod="llm/e2e-same-id-a-f7610c3b-kserve-7d8649f4c9-w8p5k"
Jul 22 14:09:39.844296 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:09:39.844303    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d3de3d8-a616-4cb2-8957-75477a525b1b-tmp-dir\") pod \"e2e-same-id-a-f7610c3b-kserve-7d8649f4c9-w8p5k\" (UID: \"9d3de3d8-a616-4cb2-8957-75477a525b1b\") " pod="llm/e2e-same-id-a-f7610c3b-kserve-7d8649f4c9-w8p5k"
Jul 22 14:09:39.844661 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:09:39.844354    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tjr7\" (UniqueName: \"kubernetes.io/projected/9d3de3d8-a616-4cb2-8957-75477a525b1b-kube-api-access-4tjr7\") pod \"e2e-same-id-a-f7610c3b-kserve-7d8649f4c9-w8p5k\" (UID: \"9d3de3d8-a616-4cb2-8957-75477a525b1b\") " pod="llm/e2e-same-id-a-f7610c3b-kserve-7d8649f4c9-w8p5k"
Jul 22 14:09:39.844661 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:09:39.844391    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9d3de3d8-a616-4cb2-8957-75477a525b1b-home\") pod \"e2e-same-id-a-f7610c3b-kserve-7d8649f4c9-w8p5k\" (UID: \"9d3de3d8-a616-4cb2-8957-75477a525b1b\") " pod="llm/e2e-same-id-a-f7610c3b-kserve-7d8649f4c9-w8p5k"
Jul 22 14:09:39.844661 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:09:39.844575    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d3de3d8-a616-4cb2-8957-75477a525b1b-model-cache\") pod \"e2e-same-id-a-f7610c3b-kserve-7d8649f4c9-w8p5k\" (UID: \"9d3de3d8-a616-4cb2-8957-75477a525b1b\") " pod="llm/e2e-same-id-a-f7610c3b-kserve-7d8649f4c9-w8p5k"
Jul 22 14:09:39.844661 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:09:39.844622    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d3de3d8-a616-4cb2-8957-75477a525b1b-dshm\") pod \"e2e-same-id-a-f7610c3b-kserve-7d8649f4c9-w8p5k\" (UID: \"9d3de3d8-a616-4cb2-8957-75477a525b1b\") " pod="llm/e2e-same-id-a-f7610c3b-kserve-7d8649f4c9-w8p5k"
Jul 22 14:09:39.844856 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:09:39.844835    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9d3de3d8-a616-4cb2-8957-75477a525b1b-home\") pod \"e2e-same-id-a-f7610c3b-kserve-7d8649f4c9-w8p5k\" (UID: \"9d3de3d8-a616-4cb2-8957-75477a525b1b\") " pod="llm/e2e-same-id-a-f7610c3b-kserve-7d8649f4c9-w8p5k"
Jul 22 14:09:39.844897 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:09:39.844868    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d3de3d8-a616-4cb2-8957-75477a525b1b-tmp-dir\") pod \"e2e-same-id-a-f7610c3b-kserve-7d8649f4c9-w8p5k\" (UID: \"9d3de3d8-a616-4cb2-8957-75477a525b1b\") " pod="llm/e2e-same-id-a-f7610c3b-kserve-7d8649f4c9-w8p5k"
Jul 22 14:09:39.844934 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:09:39.844897    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d3de3d8-a616-4cb2-8957-75477a525b1b-model-cache\") pod \"e2e-same-id-a-f7610c3b-kserve-7d8649f4c9-w8p5k\" (UID: \"9d3de3d8-a616-4cb2-8957-75477a525b1b\") " pod="llm/e2e-same-id-a-f7610c3b-kserve-7d8649f4c9-w8p5k"
Jul 22 14:09:39.846798 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:09:39.846770    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d3de3d8-a616-4cb2-8957-75477a525b1b-dshm\") pod \"e2e-same-id-a-f7610c3b-kserve-7d8649f4c9-w8p5k\" (UID: \"9d3de3d8-a616-4cb2-8957-75477a525b1b\") " pod="llm/e2e-same-id-a-f7610c3b-kserve-7d8649f4c9-w8p5k"
Jul 22 14:09:39.846947 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:09:39.846930    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d3de3d8-a616-4cb2-8957-75477a525b1b-tls-certs\") pod \"e2e-same-id-a-f7610c3b-kserve-7d8649f4c9-w8p5k\" (UID: \"9d3de3d8-a616-4cb2-8957-75477a525b1b\") " pod="llm/e2e-same-id-a-f7610c3b-kserve-7d8649f4c9-w8p5k"
Jul 22 14:09:39.855154 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:09:39.855135    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tjr7\" (UniqueName: \"kubernetes.io/projected/9d3de3d8-a616-4cb2-8957-75477a525b1b-kube-api-access-4tjr7\") pod \"e2e-same-id-a-f7610c3b-kserve-7d8649f4c9-w8p5k\" (UID: \"9d3de3d8-a616-4cb2-8957-75477a525b1b\") " pod="llm/e2e-same-id-a-f7610c3b-kserve-7d8649f4c9-w8p5k"
Jul 22 14:09:39.991472 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:09:39.991364    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-f7610c3b-kserve-7d8649f4c9-w8p5k"
Jul 22 14:09:40.129675 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:09:40.129455    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-f7610c3b-kserve-7d8649f4c9-w8p5k"]
Jul 22 14:09:40.132743 ip-10-0-129-134 kubenswrapper[2571]: W0722 14:09:40.132711    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9d3de3d8_a616_4cb2_8957_75477a525b1b.slice/crio-f40901744231b61e8d7095b8b9c6996f31fa68e672951ff1f3e8d0861ed2f8fb WatchSource:0}: Error finding container f40901744231b61e8d7095b8b9c6996f31fa68e672951ff1f3e8d0861ed2f8fb: Status 404 returned error can't find the container with id f40901744231b61e8d7095b8b9c6996f31fa68e672951ff1f3e8d0861ed2f8fb
Jul 22 14:09:40.705307 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:09:40.705274    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-f7610c3b-kserve-7d8649f4c9-w8p5k" event={"ID":"9d3de3d8-a616-4cb2-8957-75477a525b1b","Type":"ContainerStarted","Data":"a2b8ed131d4b4820211c05ec28e485657f2c3f560d1a19c2df97a7492e85dad2"}
Jul 22 14:09:40.705307 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:09:40.705314    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-f7610c3b-kserve-7d8649f4c9-w8p5k" event={"ID":"9d3de3d8-a616-4cb2-8957-75477a525b1b","Type":"ContainerStarted","Data":"f40901744231b61e8d7095b8b9c6996f31fa68e672951ff1f3e8d0861ed2f8fb"}
Jul 22 14:09:40.721977 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:09:40.721921    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-f7610c3b-kserve-7d8649f4c9-w8p5k" podStartSLOduration=1.7219009029999999 podStartE2EDuration="1.721900903s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 14:09:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 14:09:40.72084994 +0000 UTC m=+1390.775626617" watchObservedRunningTime="2026-07-22 14:09:40.721900903 +0000 UTC m=+1390.776677583"
Jul 22 14:09:42.360760 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:09:42.360722    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:09:49.992481 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:09:49.992376    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-f7610c3b-kserve-7d8649f4c9-w8p5k"
Jul 22 14:09:49.992481 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:09:49.992452    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-f7610c3b-kserve-7d8649f4c9-w8p5k"
Jul 22 14:09:50.005008 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:09:50.004975    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-f7610c3b-kserve-7d8649f4c9-w8p5k"
Jul 22 14:09:50.362381 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:09:50.362339    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-f7610c3b-kserve-67c74fb595-bhhrh"]
Jul 22 14:09:50.366146 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:09:50.366125    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-f7610c3b-kserve-67c74fb595-bhhrh"
Jul 22 14:09:50.368230 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:09:50.368202    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-f7610c3b-kserve-self-signed-certs\""
Jul 22 14:09:50.386790 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:09:50.386760    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-f7610c3b-kserve-67c74fb595-bhhrh"]
Jul 22 14:09:50.444975 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:09:50.444935    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07fdbd15-ac15-4f09-8c1d-37fd33ac0de0-tmp-dir\") pod \"e2e-same-id-b-f7610c3b-kserve-67c74fb595-bhhrh\" (UID: \"07fdbd15-ac15-4f09-8c1d-37fd33ac0de0\") " pod="llm/e2e-same-id-b-f7610c3b-kserve-67c74fb595-bhhrh"
Jul 22 14:09:50.445177 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:09:50.445007    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/07fdbd15-ac15-4f09-8c1d-37fd33ac0de0-home\") pod \"e2e-same-id-b-f7610c3b-kserve-67c74fb595-bhhrh\" (UID: \"07fdbd15-ac15-4f09-8c1d-37fd33ac0de0\") " pod="llm/e2e-same-id-b-f7610c3b-kserve-67c74fb595-bhhrh"
Jul 22 14:09:50.445177 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:09:50.445075    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/07fdbd15-ac15-4f09-8c1d-37fd33ac0de0-dshm\") pod \"e2e-same-id-b-f7610c3b-kserve-67c74fb595-bhhrh\" (UID: \"07fdbd15-ac15-4f09-8c1d-37fd33ac0de0\") " pod="llm/e2e-same-id-b-f7610c3b-kserve-67c74fb595-bhhrh"
Jul 22 14:09:50.445177 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:09:50.445113    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/07fdbd15-ac15-4f09-8c1d-37fd33ac0de0-model-cache\") pod \"e2e-same-id-b-f7610c3b-kserve-67c74fb595-bhhrh\" (UID: \"07fdbd15-ac15-4f09-8c1d-37fd33ac0de0\") " pod="llm/e2e-same-id-b-f7610c3b-kserve-67c74fb595-bhhrh"
Jul 22 14:09:50.445338 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:09:50.445178    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2skqp\" (UniqueName: \"kubernetes.io/projected/07fdbd15-ac15-4f09-8c1d-37fd33ac0de0-kube-api-access-2skqp\") pod \"e2e-same-id-b-f7610c3b-kserve-67c74fb595-bhhrh\" (UID: \"07fdbd15-ac15-4f09-8c1d-37fd33ac0de0\") " pod="llm/e2e-same-id-b-f7610c3b-kserve-67c74fb595-bhhrh"
Jul 22 14:09:50.445338 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:09:50.445219    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07fdbd15-ac15-4f09-8c1d-37fd33ac0de0-tls-certs\") pod \"e2e-same-id-b-f7610c3b-kserve-67c74fb595-bhhrh\" (UID: \"07fdbd15-ac15-4f09-8c1d-37fd33ac0de0\") " pod="llm/e2e-same-id-b-f7610c3b-kserve-67c74fb595-bhhrh"
Jul 22 14:09:50.546589 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:09:50.546552    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2skqp\" (UniqueName: \"kubernetes.io/projected/07fdbd15-ac15-4f09-8c1d-37fd33ac0de0-kube-api-access-2skqp\") pod \"e2e-same-id-b-f7610c3b-kserve-67c74fb595-bhhrh\" (UID: \"07fdbd15-ac15-4f09-8c1d-37fd33ac0de0\") " pod="llm/e2e-same-id-b-f7610c3b-kserve-67c74fb595-bhhrh"
Jul 22 14:09:50.546770 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:09:50.546605    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07fdbd15-ac15-4f09-8c1d-37fd33ac0de0-tls-certs\") pod \"e2e-same-id-b-f7610c3b-kserve-67c74fb595-bhhrh\" (UID: \"07fdbd15-ac15-4f09-8c1d-37fd33ac0de0\") " pod="llm/e2e-same-id-b-f7610c3b-kserve-67c74fb595-bhhrh"
Jul 22 14:09:50.546770 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:09:50.546653    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07fdbd15-ac15-4f09-8c1d-37fd33ac0de0-tmp-dir\") pod \"e2e-same-id-b-f7610c3b-kserve-67c74fb595-bhhrh\" (UID: \"07fdbd15-ac15-4f09-8c1d-37fd33ac0de0\") " pod="llm/e2e-same-id-b-f7610c3b-kserve-67c74fb595-bhhrh"
Jul 22 14:09:50.546770 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:09:50.546694    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/07fdbd15-ac15-4f09-8c1d-37fd33ac0de0-home\") pod \"e2e-same-id-b-f7610c3b-kserve-67c74fb595-bhhrh\" (UID: \"07fdbd15-ac15-4f09-8c1d-37fd33ac0de0\") " pod="llm/e2e-same-id-b-f7610c3b-kserve-67c74fb595-bhhrh"
Jul 22 14:09:50.546770 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:09:50.546729    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/07fdbd15-ac15-4f09-8c1d-37fd33ac0de0-dshm\") pod \"e2e-same-id-b-f7610c3b-kserve-67c74fb595-bhhrh\" (UID: \"07fdbd15-ac15-4f09-8c1d-37fd33ac0de0\") " pod="llm/e2e-same-id-b-f7610c3b-kserve-67c74fb595-bhhrh"
Jul 22 14:09:50.546770 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:09:50.546757    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/07fdbd15-ac15-4f09-8c1d-37fd33ac0de0-model-cache\") pod \"e2e-same-id-b-f7610c3b-kserve-67c74fb595-bhhrh\" (UID: \"07fdbd15-ac15-4f09-8c1d-37fd33ac0de0\") " pod="llm/e2e-same-id-b-f7610c3b-kserve-67c74fb595-bhhrh"
Jul 22 14:09:50.547164 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:09:50.547133    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07fdbd15-ac15-4f09-8c1d-37fd33ac0de0-tmp-dir\") pod \"e2e-same-id-b-f7610c3b-kserve-67c74fb595-bhhrh\" (UID: \"07fdbd15-ac15-4f09-8c1d-37fd33ac0de0\") " pod="llm/e2e-same-id-b-f7610c3b-kserve-67c74fb595-bhhrh"
Jul 22 14:09:50.547164 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:09:50.547150    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/07fdbd15-ac15-4f09-8c1d-37fd33ac0de0-home\") pod \"e2e-same-id-b-f7610c3b-kserve-67c74fb595-bhhrh\" (UID: \"07fdbd15-ac15-4f09-8c1d-37fd33ac0de0\") " pod="llm/e2e-same-id-b-f7610c3b-kserve-67c74fb595-bhhrh"
Jul 22 14:09:50.547292 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:09:50.547201    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/07fdbd15-ac15-4f09-8c1d-37fd33ac0de0-model-cache\") pod \"e2e-same-id-b-f7610c3b-kserve-67c74fb595-bhhrh\" (UID: \"07fdbd15-ac15-4f09-8c1d-37fd33ac0de0\") " pod="llm/e2e-same-id-b-f7610c3b-kserve-67c74fb595-bhhrh"
Jul 22 14:09:50.549079 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:09:50.549054    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/07fdbd15-ac15-4f09-8c1d-37fd33ac0de0-dshm\") pod \"e2e-same-id-b-f7610c3b-kserve-67c74fb595-bhhrh\" (UID: \"07fdbd15-ac15-4f09-8c1d-37fd33ac0de0\") " pod="llm/e2e-same-id-b-f7610c3b-kserve-67c74fb595-bhhrh"
Jul 22 14:09:50.549251 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:09:50.549231    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07fdbd15-ac15-4f09-8c1d-37fd33ac0de0-tls-certs\") pod \"e2e-same-id-b-f7610c3b-kserve-67c74fb595-bhhrh\" (UID: \"07fdbd15-ac15-4f09-8c1d-37fd33ac0de0\") " pod="llm/e2e-same-id-b-f7610c3b-kserve-67c74fb595-bhhrh"
Jul 22 14:09:50.554350 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:09:50.554329    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2skqp\" (UniqueName: \"kubernetes.io/projected/07fdbd15-ac15-4f09-8c1d-37fd33ac0de0-kube-api-access-2skqp\") pod \"e2e-same-id-b-f7610c3b-kserve-67c74fb595-bhhrh\" (UID: \"07fdbd15-ac15-4f09-8c1d-37fd33ac0de0\") " pod="llm/e2e-same-id-b-f7610c3b-kserve-67c74fb595-bhhrh"
Jul 22 14:09:50.676090 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:09:50.675985    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-f7610c3b-kserve-67c74fb595-bhhrh"
Jul 22 14:09:50.770331 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:09:50.770299    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-f7610c3b-kserve-7d8649f4c9-w8p5k"
Jul 22 14:09:50.825654 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:09:50.825594    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-f7610c3b-kserve-67c74fb595-bhhrh"]
Jul 22 14:09:50.828159 ip-10-0-129-134 kubenswrapper[2571]: W0722 14:09:50.828134    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod07fdbd15_ac15_4f09_8c1d_37fd33ac0de0.slice/crio-29581c6ed7494b772259662942102c6bf2e450da7a75b983dd5471be507d2b8d WatchSource:0}: Error finding container 29581c6ed7494b772259662942102c6bf2e450da7a75b983dd5471be507d2b8d: Status 404 returned error can't find the container with id 29581c6ed7494b772259662942102c6bf2e450da7a75b983dd5471be507d2b8d
Jul 22 14:09:51.763463 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:09:51.763391    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-f7610c3b-kserve-67c74fb595-bhhrh" event={"ID":"07fdbd15-ac15-4f09-8c1d-37fd33ac0de0","Type":"ContainerStarted","Data":"f26299a6ebbaf51a95fcb55578e37d669565a286e4fc9c11a59993daaf0d8e94"}
Jul 22 14:09:51.763992 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:09:51.763476    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-f7610c3b-kserve-67c74fb595-bhhrh" event={"ID":"07fdbd15-ac15-4f09-8c1d-37fd33ac0de0","Type":"ContainerStarted","Data":"29581c6ed7494b772259662942102c6bf2e450da7a75b983dd5471be507d2b8d"}
Jul 22 14:09:51.781873 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:09:51.781813    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-f7610c3b-kserve-67c74fb595-bhhrh" podStartSLOduration=1.781794246 podStartE2EDuration="1.781794246s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 14:09:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 14:09:51.78122198 +0000 UTC m=+1401.835998657" watchObservedRunningTime="2026-07-22 14:09:51.781794246 +0000 UTC m=+1401.836570923"
Jul 22 14:09:56.762534 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:09:56.762502    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:10:00.676798 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:10:00.676762    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-f7610c3b-kserve-67c74fb595-bhhrh"
Jul 22 14:10:00.677298 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:10:00.676814    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-f7610c3b-kserve-67c74fb595-bhhrh"
Jul 22 14:10:00.689723 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:10:00.689691    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-f7610c3b-kserve-67c74fb595-bhhrh"
Jul 22 14:10:00.826061 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:10:00.826035    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-f7610c3b-kserve-67c74fb595-bhhrh"
Jul 22 14:10:11.451333 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:10:11.451296    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-f7610c3b-kserve-7d8649f4c9-w8p5k"]
Jul 22 14:10:13.042596 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:10:13.042561    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-f7610c3b-kserve-67c74fb595-bhhrh"]
Jul 22 14:10:15.254933 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:10:15.254895    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:10:26.472434 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:10:26.472327    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-f7610c3b-kserve-7d8649f4c9-w8p5k" podUID="9d3de3d8-a616-4cb2-8957-75477a525b1b" containerName="main" containerID="cri-o://a2b8ed131d4b4820211c05ec28e485657f2c3f560d1a19c2df97a7492e85dad2" gracePeriod=45
Jul 22 14:10:26.723746 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:10:26.723678    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-f7610c3b-kserve-7d8649f4c9-w8p5k"
Jul 22 14:10:26.791972 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:10:26.791942    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d3de3d8-a616-4cb2-8957-75477a525b1b-tmp-dir\") pod \"9d3de3d8-a616-4cb2-8957-75477a525b1b\" (UID: \"9d3de3d8-a616-4cb2-8957-75477a525b1b\") "
Jul 22 14:10:26.792149 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:10:26.792021    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d3de3d8-a616-4cb2-8957-75477a525b1b-model-cache\") pod \"9d3de3d8-a616-4cb2-8957-75477a525b1b\" (UID: \"9d3de3d8-a616-4cb2-8957-75477a525b1b\") "
Jul 22 14:10:26.792149 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:10:26.792071    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9d3de3d8-a616-4cb2-8957-75477a525b1b-home\") pod \"9d3de3d8-a616-4cb2-8957-75477a525b1b\" (UID: \"9d3de3d8-a616-4cb2-8957-75477a525b1b\") "
Jul 22 14:10:26.792149 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:10:26.792100    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d3de3d8-a616-4cb2-8957-75477a525b1b-dshm\") pod \"9d3de3d8-a616-4cb2-8957-75477a525b1b\" (UID: \"9d3de3d8-a616-4cb2-8957-75477a525b1b\") "
Jul 22 14:10:26.792149 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:10:26.792144    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4tjr7\" (UniqueName: \"kubernetes.io/projected/9d3de3d8-a616-4cb2-8957-75477a525b1b-kube-api-access-4tjr7\") pod \"9d3de3d8-a616-4cb2-8957-75477a525b1b\" (UID: \"9d3de3d8-a616-4cb2-8957-75477a525b1b\") "
Jul 22 14:10:26.792365 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:10:26.792171    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d3de3d8-a616-4cb2-8957-75477a525b1b-tls-certs\") pod \"9d3de3d8-a616-4cb2-8957-75477a525b1b\" (UID: \"9d3de3d8-a616-4cb2-8957-75477a525b1b\") "
Jul 22 14:10:26.792365 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:10:26.792229    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d3de3d8-a616-4cb2-8957-75477a525b1b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9d3de3d8-a616-4cb2-8957-75477a525b1b" (UID: "9d3de3d8-a616-4cb2-8957-75477a525b1b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 14:10:26.792365 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:10:26.792311    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d3de3d8-a616-4cb2-8957-75477a525b1b-model-cache" (OuterVolumeSpecName: "model-cache") pod "9d3de3d8-a616-4cb2-8957-75477a525b1b" (UID: "9d3de3d8-a616-4cb2-8957-75477a525b1b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 14:10:26.792365 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:10:26.792327    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d3de3d8-a616-4cb2-8957-75477a525b1b-home" (OuterVolumeSpecName: "home") pod "9d3de3d8-a616-4cb2-8957-75477a525b1b" (UID: "9d3de3d8-a616-4cb2-8957-75477a525b1b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 14:10:26.792594 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:10:26.792550    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9d3de3d8-a616-4cb2-8957-75477a525b1b-home\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 14:10:26.792594 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:10:26.792576    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d3de3d8-a616-4cb2-8957-75477a525b1b-tmp-dir\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 14:10:26.792594 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:10:26.792590    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d3de3d8-a616-4cb2-8957-75477a525b1b-model-cache\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 14:10:26.794435 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:10:26.794394    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d3de3d8-a616-4cb2-8957-75477a525b1b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9d3de3d8-a616-4cb2-8957-75477a525b1b" (UID: "9d3de3d8-a616-4cb2-8957-75477a525b1b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 14:10:26.794555 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:10:26.794462    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d3de3d8-a616-4cb2-8957-75477a525b1b-dshm" (OuterVolumeSpecName: "dshm") pod "9d3de3d8-a616-4cb2-8957-75477a525b1b" (UID: "9d3de3d8-a616-4cb2-8957-75477a525b1b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 14:10:26.794555 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:10:26.794482    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d3de3d8-a616-4cb2-8957-75477a525b1b-kube-api-access-4tjr7" (OuterVolumeSpecName: "kube-api-access-4tjr7") pod "9d3de3d8-a616-4cb2-8957-75477a525b1b" (UID: "9d3de3d8-a616-4cb2-8957-75477a525b1b"). InnerVolumeSpecName "kube-api-access-4tjr7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 14:10:26.893732 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:10:26.893697    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d3de3d8-a616-4cb2-8957-75477a525b1b-dshm\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 14:10:26.893732 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:10:26.893726    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4tjr7\" (UniqueName: \"kubernetes.io/projected/9d3de3d8-a616-4cb2-8957-75477a525b1b-kube-api-access-4tjr7\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 14:10:26.893732 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:10:26.893736    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d3de3d8-a616-4cb2-8957-75477a525b1b-tls-certs\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 14:10:26.946007 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:10:26.945971    2571 generic.go:356] "Generic (PLEG): container finished" podID="9d3de3d8-a616-4cb2-8957-75477a525b1b" containerID="a2b8ed131d4b4820211c05ec28e485657f2c3f560d1a19c2df97a7492e85dad2" exitCode=0
Jul 22 14:10:26.946175 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:10:26.946015    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-f7610c3b-kserve-7d8649f4c9-w8p5k"
Jul 22 14:10:26.946175 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:10:26.946060    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-f7610c3b-kserve-7d8649f4c9-w8p5k" event={"ID":"9d3de3d8-a616-4cb2-8957-75477a525b1b","Type":"ContainerDied","Data":"a2b8ed131d4b4820211c05ec28e485657f2c3f560d1a19c2df97a7492e85dad2"}
Jul 22 14:10:26.946175 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:10:26.946110    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-f7610c3b-kserve-7d8649f4c9-w8p5k" event={"ID":"9d3de3d8-a616-4cb2-8957-75477a525b1b","Type":"ContainerDied","Data":"f40901744231b61e8d7095b8b9c6996f31fa68e672951ff1f3e8d0861ed2f8fb"}
Jul 22 14:10:26.946175 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:10:26.946127    2571 scope.go:117] "RemoveContainer" containerID="a2b8ed131d4b4820211c05ec28e485657f2c3f560d1a19c2df97a7492e85dad2"
Jul 22 14:10:26.955704 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:10:26.955686    2571 scope.go:117] "RemoveContainer" containerID="a2b8ed131d4b4820211c05ec28e485657f2c3f560d1a19c2df97a7492e85dad2"
Jul 22 14:10:26.957276 ip-10-0-129-134 kubenswrapper[2571]: E0722 14:10:26.956145    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2b8ed131d4b4820211c05ec28e485657f2c3f560d1a19c2df97a7492e85dad2\": container with ID starting with a2b8ed131d4b4820211c05ec28e485657f2c3f560d1a19c2df97a7492e85dad2 not found: ID does not exist" containerID="a2b8ed131d4b4820211c05ec28e485657f2c3f560d1a19c2df97a7492e85dad2"
Jul 22 14:10:26.957276 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:10:26.956182    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2b8ed131d4b4820211c05ec28e485657f2c3f560d1a19c2df97a7492e85dad2"} err="failed to get container status \"a2b8ed131d4b4820211c05ec28e485657f2c3f560d1a19c2df97a7492e85dad2\": rpc error: code = NotFound desc = could not find container \"a2b8ed131d4b4820211c05ec28e485657f2c3f560d1a19c2df97a7492e85dad2\": container with ID starting with a2b8ed131d4b4820211c05ec28e485657f2c3f560d1a19c2df97a7492e85dad2 not found: ID does not exist"
Jul 22 14:10:26.970717 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:10:26.970688    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-f7610c3b-kserve-7d8649f4c9-w8p5k"]
Jul 22 14:10:26.976056 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:10:26.975984    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-f7610c3b-kserve-7d8649f4c9-w8p5k"]
Jul 22 14:10:27.011120 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:10:27.011087    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d3de3d8-a616-4cb2-8957-75477a525b1b" path="/var/lib/kubelet/pods/9d3de3d8-a616-4cb2-8957-75477a525b1b/volumes"
Jul 22 14:10:28.063007 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:10:28.062960    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-f7610c3b-kserve-67c74fb595-bhhrh" podUID="07fdbd15-ac15-4f09-8c1d-37fd33ac0de0" containerName="main" containerID="cri-o://f26299a6ebbaf51a95fcb55578e37d669565a286e4fc9c11a59993daaf0d8e94" gracePeriod=45
Jul 22 14:10:28.312184 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:10:28.312152    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-f7610c3b-kserve-67c74fb595-bhhrh"
Jul 22 14:10:28.356656 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:10:28.356557    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:10:28.410262 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:10:28.410226    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/07fdbd15-ac15-4f09-8c1d-37fd33ac0de0-home\") pod \"07fdbd15-ac15-4f09-8c1d-37fd33ac0de0\" (UID: \"07fdbd15-ac15-4f09-8c1d-37fd33ac0de0\") "
Jul 22 14:10:28.410526 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:10:28.410277    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/07fdbd15-ac15-4f09-8c1d-37fd33ac0de0-model-cache\") pod \"07fdbd15-ac15-4f09-8c1d-37fd33ac0de0\" (UID: \"07fdbd15-ac15-4f09-8c1d-37fd33ac0de0\") "
Jul 22 14:10:28.410526 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:10:28.410344    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2skqp\" (UniqueName: \"kubernetes.io/projected/07fdbd15-ac15-4f09-8c1d-37fd33ac0de0-kube-api-access-2skqp\") pod \"07fdbd15-ac15-4f09-8c1d-37fd33ac0de0\" (UID: \"07fdbd15-ac15-4f09-8c1d-37fd33ac0de0\") "
Jul 22 14:10:28.410526 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:10:28.410366    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07fdbd15-ac15-4f09-8c1d-37fd33ac0de0-tmp-dir\") pod \"07fdbd15-ac15-4f09-8c1d-37fd33ac0de0\" (UID: \"07fdbd15-ac15-4f09-8c1d-37fd33ac0de0\") "
Jul 22 14:10:28.410526 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:10:28.410394    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07fdbd15-ac15-4f09-8c1d-37fd33ac0de0-tls-certs\") pod \"07fdbd15-ac15-4f09-8c1d-37fd33ac0de0\" (UID: \"07fdbd15-ac15-4f09-8c1d-37fd33ac0de0\") "
Jul 22 14:10:28.410526 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:10:28.410463    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/07fdbd15-ac15-4f09-8c1d-37fd33ac0de0-dshm\") pod \"07fdbd15-ac15-4f09-8c1d-37fd33ac0de0\" (UID: \"07fdbd15-ac15-4f09-8c1d-37fd33ac0de0\") "
Jul 22 14:10:28.410776 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:10:28.410523    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07fdbd15-ac15-4f09-8c1d-37fd33ac0de0-home" (OuterVolumeSpecName: "home") pod "07fdbd15-ac15-4f09-8c1d-37fd33ac0de0" (UID: "07fdbd15-ac15-4f09-8c1d-37fd33ac0de0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 14:10:28.410776 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:10:28.410645    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07fdbd15-ac15-4f09-8c1d-37fd33ac0de0-model-cache" (OuterVolumeSpecName: "model-cache") pod "07fdbd15-ac15-4f09-8c1d-37fd33ac0de0" (UID: "07fdbd15-ac15-4f09-8c1d-37fd33ac0de0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 14:10:28.410776 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:10:28.410654    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07fdbd15-ac15-4f09-8c1d-37fd33ac0de0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "07fdbd15-ac15-4f09-8c1d-37fd33ac0de0" (UID: "07fdbd15-ac15-4f09-8c1d-37fd33ac0de0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 14:10:28.410945 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:10:28.410889    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/07fdbd15-ac15-4f09-8c1d-37fd33ac0de0-home\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 14:10:28.410945 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:10:28.410905    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/07fdbd15-ac15-4f09-8c1d-37fd33ac0de0-model-cache\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 14:10:28.410945 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:10:28.410919    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07fdbd15-ac15-4f09-8c1d-37fd33ac0de0-tmp-dir\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 14:10:28.412740 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:10:28.412712    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07fdbd15-ac15-4f09-8c1d-37fd33ac0de0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "07fdbd15-ac15-4f09-8c1d-37fd33ac0de0" (UID: "07fdbd15-ac15-4f09-8c1d-37fd33ac0de0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 14:10:28.412845 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:10:28.412777    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07fdbd15-ac15-4f09-8c1d-37fd33ac0de0-kube-api-access-2skqp" (OuterVolumeSpecName: "kube-api-access-2skqp") pod "07fdbd15-ac15-4f09-8c1d-37fd33ac0de0" (UID: "07fdbd15-ac15-4f09-8c1d-37fd33ac0de0"). InnerVolumeSpecName "kube-api-access-2skqp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 14:10:28.412890 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:10:28.412875    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07fdbd15-ac15-4f09-8c1d-37fd33ac0de0-dshm" (OuterVolumeSpecName: "dshm") pod "07fdbd15-ac15-4f09-8c1d-37fd33ac0de0" (UID: "07fdbd15-ac15-4f09-8c1d-37fd33ac0de0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 14:10:28.511454 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:10:28.511385    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2skqp\" (UniqueName: \"kubernetes.io/projected/07fdbd15-ac15-4f09-8c1d-37fd33ac0de0-kube-api-access-2skqp\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 14:10:28.511454 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:10:28.511449    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07fdbd15-ac15-4f09-8c1d-37fd33ac0de0-tls-certs\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 14:10:28.511454 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:10:28.511461    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/07fdbd15-ac15-4f09-8c1d-37fd33ac0de0-dshm\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 14:10:28.958552 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:10:28.958514    2571 generic.go:356] "Generic (PLEG): container finished" podID="07fdbd15-ac15-4f09-8c1d-37fd33ac0de0" containerID="f26299a6ebbaf51a95fcb55578e37d669565a286e4fc9c11a59993daaf0d8e94" exitCode=0
Jul 22 14:10:28.958552 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:10:28.958554    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-f7610c3b-kserve-67c74fb595-bhhrh"
Jul 22 14:10:28.958790 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:10:28.958594    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-f7610c3b-kserve-67c74fb595-bhhrh" event={"ID":"07fdbd15-ac15-4f09-8c1d-37fd33ac0de0","Type":"ContainerDied","Data":"f26299a6ebbaf51a95fcb55578e37d669565a286e4fc9c11a59993daaf0d8e94"}
Jul 22 14:10:28.958790 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:10:28.958646    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-f7610c3b-kserve-67c74fb595-bhhrh" event={"ID":"07fdbd15-ac15-4f09-8c1d-37fd33ac0de0","Type":"ContainerDied","Data":"29581c6ed7494b772259662942102c6bf2e450da7a75b983dd5471be507d2b8d"}
Jul 22 14:10:28.958790 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:10:28.958664    2571 scope.go:117] "RemoveContainer" containerID="f26299a6ebbaf51a95fcb55578e37d669565a286e4fc9c11a59993daaf0d8e94"
Jul 22 14:10:28.968013 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:10:28.967995    2571 scope.go:117] "RemoveContainer" containerID="f26299a6ebbaf51a95fcb55578e37d669565a286e4fc9c11a59993daaf0d8e94"
Jul 22 14:10:28.968314 ip-10-0-129-134 kubenswrapper[2571]: E0722 14:10:28.968297    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f26299a6ebbaf51a95fcb55578e37d669565a286e4fc9c11a59993daaf0d8e94\": container with ID starting with f26299a6ebbaf51a95fcb55578e37d669565a286e4fc9c11a59993daaf0d8e94 not found: ID does not exist" containerID="f26299a6ebbaf51a95fcb55578e37d669565a286e4fc9c11a59993daaf0d8e94"
Jul 22 14:10:28.968379 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:10:28.968325    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f26299a6ebbaf51a95fcb55578e37d669565a286e4fc9c11a59993daaf0d8e94"} err="failed to get container status \"f26299a6ebbaf51a95fcb55578e37d669565a286e4fc9c11a59993daaf0d8e94\": rpc error: code = NotFound desc = could not find container \"f26299a6ebbaf51a95fcb55578e37d669565a286e4fc9c11a59993daaf0d8e94\": container with ID starting with f26299a6ebbaf51a95fcb55578e37d669565a286e4fc9c11a59993daaf0d8e94 not found: ID does not exist"
Jul 22 14:10:28.980099 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:10:28.980067    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-f7610c3b-kserve-67c74fb595-bhhrh"]
Jul 22 14:10:28.983754 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:10:28.983731    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-f7610c3b-kserve-67c74fb595-bhhrh"]
Jul 22 14:10:29.010363 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:10:29.010331    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07fdbd15-ac15-4f09-8c1d-37fd33ac0de0" path="/var/lib/kubelet/pods/07fdbd15-ac15-4f09-8c1d-37fd33ac0de0/volumes"
Jul 22 14:10:35.170992 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:10:35.170961    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:10:51.255798 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:10:51.255764    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:11:00.255166 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:11:00.255120    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:11:09.571005 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:11:09.570966    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:11:17.192695 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:11:17.192654    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:11:28.281290 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:11:28.281257    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:11:37.663016 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:11:37.662978    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:11:51.359328 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:11:51.359288    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:12:00.571705 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:12:00.571618    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:12:10.663384 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:12:10.663347    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:12:22.664543 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:12:22.664505    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:12:35.658882 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:12:35.658846    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:12:49.065113 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:12:49.065070    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:13:05.666721 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:13:05.666687    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:13:16.769322 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:13:16.769287    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:13:26.179154 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:13:26.179077    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:13:48.170214 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:13:48.170173    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:13:58.660135 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:13:58.660098    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:14:34.977435 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:14:34.977388    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:14:47.458195 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:14:47.458159    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:15:18.561189 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:15:18.561154    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:15:31.361603 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:15:31.361561    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:16:02.771641 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:16:02.771601    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:16:14.967039 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:16:14.966998    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:16:46.973600 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:16:46.973563    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:18:13.376487 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:18:13.376452    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:18:25.567551 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:18:25.567520    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:18:35.679856 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:18:35.679820    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:18:55.563919 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:18:55.563877    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:19:31.159107 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:19:31.159023    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:19:34.655555 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:19:34.655523    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-54c01305/e2e-lifecycle-model-54c01305-kserve-6cc9467c9f-m2kr8"]
Jul 22 14:19:34.655933 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:19:34.655903    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d3de3d8-a616-4cb2-8957-75477a525b1b" containerName="main"
Jul 22 14:19:34.655933 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:19:34.655913    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d3de3d8-a616-4cb2-8957-75477a525b1b" containerName="main"
Jul 22 14:19:34.655933 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:19:34.655932    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07fdbd15-ac15-4f09-8c1d-37fd33ac0de0" containerName="main"
Jul 22 14:19:34.656036 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:19:34.655938    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="07fdbd15-ac15-4f09-8c1d-37fd33ac0de0" containerName="main"
Jul 22 14:19:34.656770 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:19:34.656746    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="07fdbd15-ac15-4f09-8c1d-37fd33ac0de0" containerName="main"
Jul 22 14:19:34.656957 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:19:34.656943    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d3de3d8-a616-4cb2-8957-75477a525b1b" containerName="main"
Jul 22 14:19:34.664001 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:19:34.663977    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-54c01305/e2e-lifecycle-model-54c01305-kserve-6cc9467c9f-m2kr8"
Jul 22 14:19:34.666187 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:19:34.666168    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-54c01305\"/\"openshift-service-ca.crt\""
Jul 22 14:19:34.666768 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:19:34.666748    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-54c01305\"/\"default-dockercfg-k5qdr\""
Jul 22 14:19:34.666768 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:19:34.666764    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-54c01305\"/\"kube-root-ca.crt\""
Jul 22 14:19:34.666880 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:19:34.666828    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-54c01305\"/\"e2e-lifecycle-model-54c01305-kserve-self-signed-certs\""
Jul 22 14:19:34.669964 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:19:34.669942    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-54c01305/e2e-lifecycle-model-54c01305-kserve-6cc9467c9f-m2kr8"]
Jul 22 14:19:34.741283 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:19:34.741243    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sffb\" (UniqueName: \"kubernetes.io/projected/18231361-6db3-4170-8433-febbcb662534-kube-api-access-8sffb\") pod \"e2e-lifecycle-model-54c01305-kserve-6cc9467c9f-m2kr8\" (UID: \"18231361-6db3-4170-8433-febbcb662534\") " pod="ai-tenant-e2e-mt-54c01305/e2e-lifecycle-model-54c01305-kserve-6cc9467c9f-m2kr8"
Jul 22 14:19:34.741512 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:19:34.741309    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/18231361-6db3-4170-8433-febbcb662534-dshm\") pod \"e2e-lifecycle-model-54c01305-kserve-6cc9467c9f-m2kr8\" (UID: \"18231361-6db3-4170-8433-febbcb662534\") " pod="ai-tenant-e2e-mt-54c01305/e2e-lifecycle-model-54c01305-kserve-6cc9467c9f-m2kr8"
Jul 22 14:19:34.741512 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:19:34.741379    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18231361-6db3-4170-8433-febbcb662534-tls-certs\") pod \"e2e-lifecycle-model-54c01305-kserve-6cc9467c9f-m2kr8\" (UID: \"18231361-6db3-4170-8433-febbcb662534\") " pod="ai-tenant-e2e-mt-54c01305/e2e-lifecycle-model-54c01305-kserve-6cc9467c9f-m2kr8"
Jul 22 14:19:34.741512 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:19:34.741456    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/18231361-6db3-4170-8433-febbcb662534-home\") pod \"e2e-lifecycle-model-54c01305-kserve-6cc9467c9f-m2kr8\" (UID: \"18231361-6db3-4170-8433-febbcb662534\") " pod="ai-tenant-e2e-mt-54c01305/e2e-lifecycle-model-54c01305-kserve-6cc9467c9f-m2kr8"
Jul 22 14:19:34.741512 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:19:34.741476    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18231361-6db3-4170-8433-febbcb662534-tmp-dir\") pod \"e2e-lifecycle-model-54c01305-kserve-6cc9467c9f-m2kr8\" (UID: \"18231361-6db3-4170-8433-febbcb662534\") " pod="ai-tenant-e2e-mt-54c01305/e2e-lifecycle-model-54c01305-kserve-6cc9467c9f-m2kr8"
Jul 22 14:19:34.741512 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:19:34.741491    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/18231361-6db3-4170-8433-febbcb662534-model-cache\") pod \"e2e-lifecycle-model-54c01305-kserve-6cc9467c9f-m2kr8\" (UID: \"18231361-6db3-4170-8433-febbcb662534\") " pod="ai-tenant-e2e-mt-54c01305/e2e-lifecycle-model-54c01305-kserve-6cc9467c9f-m2kr8"
Jul 22 14:19:34.841954 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:19:34.841910    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sffb\" (UniqueName: \"kubernetes.io/projected/18231361-6db3-4170-8433-febbcb662534-kube-api-access-8sffb\") pod \"e2e-lifecycle-model-54c01305-kserve-6cc9467c9f-m2kr8\" (UID: \"18231361-6db3-4170-8433-febbcb662534\") " pod="ai-tenant-e2e-mt-54c01305/e2e-lifecycle-model-54c01305-kserve-6cc9467c9f-m2kr8"
Jul 22 14:19:34.841954 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:19:34.841959    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/18231361-6db3-4170-8433-febbcb662534-dshm\") pod \"e2e-lifecycle-model-54c01305-kserve-6cc9467c9f-m2kr8\" (UID: \"18231361-6db3-4170-8433-febbcb662534\") " pod="ai-tenant-e2e-mt-54c01305/e2e-lifecycle-model-54c01305-kserve-6cc9467c9f-m2kr8"
Jul 22 14:19:34.842236 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:19:34.842032    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18231361-6db3-4170-8433-febbcb662534-tls-certs\") pod \"e2e-lifecycle-model-54c01305-kserve-6cc9467c9f-m2kr8\" (UID: \"18231361-6db3-4170-8433-febbcb662534\") " pod="ai-tenant-e2e-mt-54c01305/e2e-lifecycle-model-54c01305-kserve-6cc9467c9f-m2kr8"
Jul 22 14:19:34.842236 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:19:34.842058    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/18231361-6db3-4170-8433-febbcb662534-home\") pod \"e2e-lifecycle-model-54c01305-kserve-6cc9467c9f-m2kr8\" (UID: \"18231361-6db3-4170-8433-febbcb662534\") " pod="ai-tenant-e2e-mt-54c01305/e2e-lifecycle-model-54c01305-kserve-6cc9467c9f-m2kr8"
Jul 22 14:19:34.842236 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:19:34.842076    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18231361-6db3-4170-8433-febbcb662534-tmp-dir\") pod \"e2e-lifecycle-model-54c01305-kserve-6cc9467c9f-m2kr8\" (UID: \"18231361-6db3-4170-8433-febbcb662534\") " pod="ai-tenant-e2e-mt-54c01305/e2e-lifecycle-model-54c01305-kserve-6cc9467c9f-m2kr8"
Jul 22 14:19:34.842236 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:19:34.842092    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/18231361-6db3-4170-8433-febbcb662534-model-cache\") pod \"e2e-lifecycle-model-54c01305-kserve-6cc9467c9f-m2kr8\" (UID: \"18231361-6db3-4170-8433-febbcb662534\") " pod="ai-tenant-e2e-mt-54c01305/e2e-lifecycle-model-54c01305-kserve-6cc9467c9f-m2kr8"
Jul 22 14:19:34.842597 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:19:34.842577    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18231361-6db3-4170-8433-febbcb662534-tmp-dir\") pod \"e2e-lifecycle-model-54c01305-kserve-6cc9467c9f-m2kr8\" (UID: \"18231361-6db3-4170-8433-febbcb662534\") " pod="ai-tenant-e2e-mt-54c01305/e2e-lifecycle-model-54c01305-kserve-6cc9467c9f-m2kr8"
Jul 22 14:19:34.842666 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:19:34.842608    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/18231361-6db3-4170-8433-febbcb662534-model-cache\") pod \"e2e-lifecycle-model-54c01305-kserve-6cc9467c9f-m2kr8\" (UID: \"18231361-6db3-4170-8433-febbcb662534\") " pod="ai-tenant-e2e-mt-54c01305/e2e-lifecycle-model-54c01305-kserve-6cc9467c9f-m2kr8"
Jul 22 14:19:34.842666 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:19:34.842639    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/18231361-6db3-4170-8433-febbcb662534-home\") pod \"e2e-lifecycle-model-54c01305-kserve-6cc9467c9f-m2kr8\" (UID: \"18231361-6db3-4170-8433-febbcb662534\") " pod="ai-tenant-e2e-mt-54c01305/e2e-lifecycle-model-54c01305-kserve-6cc9467c9f-m2kr8"
Jul 22 14:19:34.844377 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:19:34.844359    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/18231361-6db3-4170-8433-febbcb662534-dshm\") pod \"e2e-lifecycle-model-54c01305-kserve-6cc9467c9f-m2kr8\" (UID: \"18231361-6db3-4170-8433-febbcb662534\") " pod="ai-tenant-e2e-mt-54c01305/e2e-lifecycle-model-54c01305-kserve-6cc9467c9f-m2kr8"
Jul 22 14:19:34.844582 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:19:34.844566    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18231361-6db3-4170-8433-febbcb662534-tls-certs\") pod \"e2e-lifecycle-model-54c01305-kserve-6cc9467c9f-m2kr8\" (UID: \"18231361-6db3-4170-8433-febbcb662534\") " pod="ai-tenant-e2e-mt-54c01305/e2e-lifecycle-model-54c01305-kserve-6cc9467c9f-m2kr8"
Jul 22 14:19:34.850651 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:19:34.850628    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sffb\" (UniqueName: \"kubernetes.io/projected/18231361-6db3-4170-8433-febbcb662534-kube-api-access-8sffb\") pod \"e2e-lifecycle-model-54c01305-kserve-6cc9467c9f-m2kr8\" (UID: \"18231361-6db3-4170-8433-febbcb662534\") " pod="ai-tenant-e2e-mt-54c01305/e2e-lifecycle-model-54c01305-kserve-6cc9467c9f-m2kr8"
Jul 22 14:19:34.977273 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:19:34.977175    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-54c01305/e2e-lifecycle-model-54c01305-kserve-6cc9467c9f-m2kr8"
Jul 22 14:19:35.110258 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:19:35.110229    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-54c01305/e2e-lifecycle-model-54c01305-kserve-6cc9467c9f-m2kr8"]
Jul 22 14:19:35.112189 ip-10-0-129-134 kubenswrapper[2571]: W0722 14:19:35.112159    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod18231361_6db3_4170_8433_febbcb662534.slice/crio-09aec7116858c3547c14c03182a84392bf62666cbe54b72ff3222dacb2e95b75 WatchSource:0}: Error finding container 09aec7116858c3547c14c03182a84392bf62666cbe54b72ff3222dacb2e95b75: Status 404 returned error can't find the container with id 09aec7116858c3547c14c03182a84392bf62666cbe54b72ff3222dacb2e95b75
Jul 22 14:19:35.610333 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:19:35.610297    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-54c01305/e2e-lifecycle-model-54c01305-kserve-6cc9467c9f-m2kr8" event={"ID":"18231361-6db3-4170-8433-febbcb662534","Type":"ContainerStarted","Data":"e2b3d564174c7a86341cedfc443df29dd178c961eb88b3f717fc910716d92c67"}
Jul 22 14:19:35.610333 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:19:35.610343    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-54c01305/e2e-lifecycle-model-54c01305-kserve-6cc9467c9f-m2kr8" event={"ID":"18231361-6db3-4170-8433-febbcb662534","Type":"ContainerStarted","Data":"09aec7116858c3547c14c03182a84392bf62666cbe54b72ff3222dacb2e95b75"}
Jul 22 14:19:35.629111 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:19:35.629057    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-54c01305/e2e-lifecycle-model-54c01305-kserve-6cc9467c9f-m2kr8" podStartSLOduration=1.629039187 podStartE2EDuration="1.629039187s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 14:19:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 14:19:35.627573536 +0000 UTC m=+1985.682350214" watchObservedRunningTime="2026-07-22 14:19:35.629039187 +0000 UTC m=+1985.683815863"
Jul 22 14:19:39.671637 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:19:39.671595    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:19:44.977763 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:19:44.977733    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-54c01305/e2e-lifecycle-model-54c01305-kserve-6cc9467c9f-m2kr8"
Jul 22 14:19:44.978165 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:19:44.977960    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-54c01305/e2e-lifecycle-model-54c01305-kserve-6cc9467c9f-m2kr8"
Jul 22 14:19:44.990104 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:19:44.990076    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-54c01305/e2e-lifecycle-model-54c01305-kserve-6cc9467c9f-m2kr8"
Jul 22 14:19:45.668362 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:19:45.668332    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-54c01305/e2e-lifecycle-model-54c01305-kserve-6cc9467c9f-m2kr8"
Jul 22 14:19:51.961887 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:19:51.961848    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:20:13.564352 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:20:13.564314    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:20:21.366169 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:20:21.366135    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:20:26.653255 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:20:26.653218    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-54c01305/e2e-lifecycle-model-54c01305-kserve-6cc9467c9f-m2kr8"]
Jul 22 14:20:41.674610 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:20:41.674550    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-54c01305/e2e-lifecycle-model-54c01305-kserve-6cc9467c9f-m2kr8" podUID="18231361-6db3-4170-8433-febbcb662534" containerName="main" containerID="cri-o://e2b3d564174c7a86341cedfc443df29dd178c961eb88b3f717fc910716d92c67" gracePeriod=45
Jul 22 14:20:41.920022 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:20:41.919992    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-54c01305/e2e-lifecycle-model-54c01305-kserve-6cc9467c9f-m2kr8"
Jul 22 14:20:41.932870 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:20:41.932790    2571 generic.go:356] "Generic (PLEG): container finished" podID="18231361-6db3-4170-8433-febbcb662534" containerID="e2b3d564174c7a86341cedfc443df29dd178c961eb88b3f717fc910716d92c67" exitCode=0
Jul 22 14:20:41.932870 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:20:41.932837    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-54c01305/e2e-lifecycle-model-54c01305-kserve-6cc9467c9f-m2kr8"
Jul 22 14:20:41.933056 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:20:41.932876    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-54c01305/e2e-lifecycle-model-54c01305-kserve-6cc9467c9f-m2kr8" event={"ID":"18231361-6db3-4170-8433-febbcb662534","Type":"ContainerDied","Data":"e2b3d564174c7a86341cedfc443df29dd178c961eb88b3f717fc910716d92c67"}
Jul 22 14:20:41.933056 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:20:41.932918    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-54c01305/e2e-lifecycle-model-54c01305-kserve-6cc9467c9f-m2kr8" event={"ID":"18231361-6db3-4170-8433-febbcb662534","Type":"ContainerDied","Data":"09aec7116858c3547c14c03182a84392bf62666cbe54b72ff3222dacb2e95b75"}
Jul 22 14:20:41.933056 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:20:41.932937    2571 scope.go:117] "RemoveContainer" containerID="e2b3d564174c7a86341cedfc443df29dd178c961eb88b3f717fc910716d92c67"
Jul 22 14:20:41.943283 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:20:41.943257    2571 scope.go:117] "RemoveContainer" containerID="e2b3d564174c7a86341cedfc443df29dd178c961eb88b3f717fc910716d92c67"
Jul 22 14:20:41.943698 ip-10-0-129-134 kubenswrapper[2571]: E0722 14:20:41.943669    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2b3d564174c7a86341cedfc443df29dd178c961eb88b3f717fc910716d92c67\": container with ID starting with e2b3d564174c7a86341cedfc443df29dd178c961eb88b3f717fc910716d92c67 not found: ID does not exist" containerID="e2b3d564174c7a86341cedfc443df29dd178c961eb88b3f717fc910716d92c67"
Jul 22 14:20:41.943780 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:20:41.943712    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2b3d564174c7a86341cedfc443df29dd178c961eb88b3f717fc910716d92c67"} err="failed to get container status \"e2b3d564174c7a86341cedfc443df29dd178c961eb88b3f717fc910716d92c67\": rpc error: code = NotFound desc = could not find container \"e2b3d564174c7a86341cedfc443df29dd178c961eb88b3f717fc910716d92c67\": container with ID starting with e2b3d564174c7a86341cedfc443df29dd178c961eb88b3f717fc910716d92c67 not found: ID does not exist"
Jul 22 14:20:41.989086 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:20:41.989055    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18231361-6db3-4170-8433-febbcb662534-tls-certs\") pod \"18231361-6db3-4170-8433-febbcb662534\" (UID: \"18231361-6db3-4170-8433-febbcb662534\") "
Jul 22 14:20:41.989235 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:20:41.989105    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/18231361-6db3-4170-8433-febbcb662534-dshm\") pod \"18231361-6db3-4170-8433-febbcb662534\" (UID: \"18231361-6db3-4170-8433-febbcb662534\") "
Jul 22 14:20:41.989235 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:20:41.989125    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/18231361-6db3-4170-8433-febbcb662534-model-cache\") pod \"18231361-6db3-4170-8433-febbcb662534\" (UID: \"18231361-6db3-4170-8433-febbcb662534\") "
Jul 22 14:20:41.989235 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:20:41.989155    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18231361-6db3-4170-8433-febbcb662534-tmp-dir\") pod \"18231361-6db3-4170-8433-febbcb662534\" (UID: \"18231361-6db3-4170-8433-febbcb662534\") "
Jul 22 14:20:41.989235 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:20:41.989185    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/18231361-6db3-4170-8433-febbcb662534-home\") pod \"18231361-6db3-4170-8433-febbcb662534\" (UID: \"18231361-6db3-4170-8433-febbcb662534\") "
Jul 22 14:20:41.989394 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:20:41.989297    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8sffb\" (UniqueName: \"kubernetes.io/projected/18231361-6db3-4170-8433-febbcb662534-kube-api-access-8sffb\") pod \"18231361-6db3-4170-8433-febbcb662534\" (UID: \"18231361-6db3-4170-8433-febbcb662534\") "
Jul 22 14:20:41.989574 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:20:41.989476    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18231361-6db3-4170-8433-febbcb662534-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "18231361-6db3-4170-8433-febbcb662534" (UID: "18231361-6db3-4170-8433-febbcb662534"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 14:20:41.989574 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:20:41.989506    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18231361-6db3-4170-8433-febbcb662534-model-cache" (OuterVolumeSpecName: "model-cache") pod "18231361-6db3-4170-8433-febbcb662534" (UID: "18231361-6db3-4170-8433-febbcb662534"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 14:20:41.989574 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:20:41.989535    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18231361-6db3-4170-8433-febbcb662534-home" (OuterVolumeSpecName: "home") pod "18231361-6db3-4170-8433-febbcb662534" (UID: "18231361-6db3-4170-8433-febbcb662534"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 14:20:41.989739 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:20:41.989617    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/18231361-6db3-4170-8433-febbcb662534-home\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 14:20:41.989739 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:20:41.989631    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/18231361-6db3-4170-8433-febbcb662534-model-cache\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 14:20:41.989739 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:20:41.989640    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18231361-6db3-4170-8433-febbcb662534-tmp-dir\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 14:20:41.991566 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:20:41.991537    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18231361-6db3-4170-8433-febbcb662534-kube-api-access-8sffb" (OuterVolumeSpecName: "kube-api-access-8sffb") pod "18231361-6db3-4170-8433-febbcb662534" (UID: "18231361-6db3-4170-8433-febbcb662534"). InnerVolumeSpecName "kube-api-access-8sffb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 14:20:41.991728 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:20:41.991710    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18231361-6db3-4170-8433-febbcb662534-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "18231361-6db3-4170-8433-febbcb662534" (UID: "18231361-6db3-4170-8433-febbcb662534"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 14:20:41.991777 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:20:41.991722    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18231361-6db3-4170-8433-febbcb662534-dshm" (OuterVolumeSpecName: "dshm") pod "18231361-6db3-4170-8433-febbcb662534" (UID: "18231361-6db3-4170-8433-febbcb662534"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 14:20:42.090348 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:20:42.090304    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18231361-6db3-4170-8433-febbcb662534-tls-certs\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 14:20:42.090348 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:20:42.090341    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/18231361-6db3-4170-8433-febbcb662534-dshm\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 14:20:42.090348 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:20:42.090356    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8sffb\" (UniqueName: \"kubernetes.io/projected/18231361-6db3-4170-8433-febbcb662534-kube-api-access-8sffb\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 14:20:42.254169 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:20:42.254132    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-54c01305/e2e-lifecycle-model-54c01305-kserve-6cc9467c9f-m2kr8"]
Jul 22 14:20:42.258244 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:20:42.258219    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-54c01305/e2e-lifecycle-model-54c01305-kserve-6cc9467c9f-m2kr8"]
Jul 22 14:20:43.009651 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:20:43.009618    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18231361-6db3-4170-8433-febbcb662534" path="/var/lib/kubelet/pods/18231361-6db3-4170-8433-febbcb662534/volumes"
Jul 22 14:21:20.062429 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:21:20.062373    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:21:29.854377 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:21:29.854340    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:22:21.363128 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:22:21.363090    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:22:33.654039 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:22:33.653949    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:22:50.165687 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:22:50.165647    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-53a937/test-model-53a937-kserve-bc4d888f-vb6ft"]
Jul 22 14:22:50.166247 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:22:50.166102    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18231361-6db3-4170-8433-febbcb662534" containerName="main"
Jul 22 14:22:50.166247 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:22:50.166115    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="18231361-6db3-4170-8433-febbcb662534" containerName="main"
Jul 22 14:22:50.166247 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:22:50.166203    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="18231361-6db3-4170-8433-febbcb662534" containerName="main"
Jul 22 14:22:50.169570 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:22:50.169553    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-53a937/test-model-53a937-kserve-bc4d888f-vb6ft"
Jul 22 14:22:50.171573 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:22:50.171550    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-53a937\"/\"openshift-service-ca.crt\""
Jul 22 14:22:50.172057 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:22:50.172036    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-53a937\"/\"test-model-53a937-kserve-self-signed-certs\""
Jul 22 14:22:50.172178 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:22:50.172138    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-53a937\"/\"default-dockercfg-qs7g7\""
Jul 22 14:22:50.172238 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:22:50.172181    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-53a937\"/\"kube-root-ca.crt\""
Jul 22 14:22:50.178693 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:22:50.178665    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-53a937/test-model-53a937-kserve-bc4d888f-vb6ft"]
Jul 22 14:22:50.329217 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:22:50.329181    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5e20f98-933b-4183-856f-42d405558124-tls-certs\") pod \"test-model-53a937-kserve-bc4d888f-vb6ft\" (UID: \"b5e20f98-933b-4183-856f-42d405558124\") " pod="ai-tenant-e2e-inf-a-53a937/test-model-53a937-kserve-bc4d888f-vb6ft"
Jul 22 14:22:50.329398 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:22:50.329245    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5e20f98-933b-4183-856f-42d405558124-tmp-dir\") pod \"test-model-53a937-kserve-bc4d888f-vb6ft\" (UID: \"b5e20f98-933b-4183-856f-42d405558124\") " pod="ai-tenant-e2e-inf-a-53a937/test-model-53a937-kserve-bc4d888f-vb6ft"
Jul 22 14:22:50.329398 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:22:50.329294    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b5e20f98-933b-4183-856f-42d405558124-dshm\") pod \"test-model-53a937-kserve-bc4d888f-vb6ft\" (UID: \"b5e20f98-933b-4183-856f-42d405558124\") " pod="ai-tenant-e2e-inf-a-53a937/test-model-53a937-kserve-bc4d888f-vb6ft"
Jul 22 14:22:50.329398 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:22:50.329323    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b5e20f98-933b-4183-856f-42d405558124-model-cache\") pod \"test-model-53a937-kserve-bc4d888f-vb6ft\" (UID: \"b5e20f98-933b-4183-856f-42d405558124\") " pod="ai-tenant-e2e-inf-a-53a937/test-model-53a937-kserve-bc4d888f-vb6ft"
Jul 22 14:22:50.329398 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:22:50.329349    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b5e20f98-933b-4183-856f-42d405558124-home\") pod \"test-model-53a937-kserve-bc4d888f-vb6ft\" (UID: \"b5e20f98-933b-4183-856f-42d405558124\") " pod="ai-tenant-e2e-inf-a-53a937/test-model-53a937-kserve-bc4d888f-vb6ft"
Jul 22 14:22:50.329398 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:22:50.329385    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kblb2\" (UniqueName: \"kubernetes.io/projected/b5e20f98-933b-4183-856f-42d405558124-kube-api-access-kblb2\") pod \"test-model-53a937-kserve-bc4d888f-vb6ft\" (UID: \"b5e20f98-933b-4183-856f-42d405558124\") " pod="ai-tenant-e2e-inf-a-53a937/test-model-53a937-kserve-bc4d888f-vb6ft"
Jul 22 14:22:50.430192 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:22:50.430090    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5e20f98-933b-4183-856f-42d405558124-tmp-dir\") pod \"test-model-53a937-kserve-bc4d888f-vb6ft\" (UID: \"b5e20f98-933b-4183-856f-42d405558124\") " pod="ai-tenant-e2e-inf-a-53a937/test-model-53a937-kserve-bc4d888f-vb6ft"
Jul 22 14:22:50.430192 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:22:50.430138    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b5e20f98-933b-4183-856f-42d405558124-dshm\") pod \"test-model-53a937-kserve-bc4d888f-vb6ft\" (UID: \"b5e20f98-933b-4183-856f-42d405558124\") " pod="ai-tenant-e2e-inf-a-53a937/test-model-53a937-kserve-bc4d888f-vb6ft"
Jul 22 14:22:50.430383 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:22:50.430254    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b5e20f98-933b-4183-856f-42d405558124-model-cache\") pod \"test-model-53a937-kserve-bc4d888f-vb6ft\" (UID: \"b5e20f98-933b-4183-856f-42d405558124\") " pod="ai-tenant-e2e-inf-a-53a937/test-model-53a937-kserve-bc4d888f-vb6ft"
Jul 22 14:22:50.430383 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:22:50.430294    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b5e20f98-933b-4183-856f-42d405558124-home\") pod \"test-model-53a937-kserve-bc4d888f-vb6ft\" (UID: \"b5e20f98-933b-4183-856f-42d405558124\") " pod="ai-tenant-e2e-inf-a-53a937/test-model-53a937-kserve-bc4d888f-vb6ft"
Jul 22 14:22:50.430383 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:22:50.430349    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kblb2\" (UniqueName: \"kubernetes.io/projected/b5e20f98-933b-4183-856f-42d405558124-kube-api-access-kblb2\") pod \"test-model-53a937-kserve-bc4d888f-vb6ft\" (UID: \"b5e20f98-933b-4183-856f-42d405558124\") " pod="ai-tenant-e2e-inf-a-53a937/test-model-53a937-kserve-bc4d888f-vb6ft"
Jul 22 14:22:50.430567 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:22:50.430449    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5e20f98-933b-4183-856f-42d405558124-tls-certs\") pod \"test-model-53a937-kserve-bc4d888f-vb6ft\" (UID: \"b5e20f98-933b-4183-856f-42d405558124\") " pod="ai-tenant-e2e-inf-a-53a937/test-model-53a937-kserve-bc4d888f-vb6ft"
Jul 22 14:22:50.430697 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:22:50.430676    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5e20f98-933b-4183-856f-42d405558124-tmp-dir\") pod \"test-model-53a937-kserve-bc4d888f-vb6ft\" (UID: \"b5e20f98-933b-4183-856f-42d405558124\") " pod="ai-tenant-e2e-inf-a-53a937/test-model-53a937-kserve-bc4d888f-vb6ft"
Jul 22 14:22:50.430764 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:22:50.430678    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b5e20f98-933b-4183-856f-42d405558124-model-cache\") pod \"test-model-53a937-kserve-bc4d888f-vb6ft\" (UID: \"b5e20f98-933b-4183-856f-42d405558124\") " pod="ai-tenant-e2e-inf-a-53a937/test-model-53a937-kserve-bc4d888f-vb6ft"
Jul 22 14:22:50.430816 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:22:50.430763    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b5e20f98-933b-4183-856f-42d405558124-home\") pod \"test-model-53a937-kserve-bc4d888f-vb6ft\" (UID: \"b5e20f98-933b-4183-856f-42d405558124\") " pod="ai-tenant-e2e-inf-a-53a937/test-model-53a937-kserve-bc4d888f-vb6ft"
Jul 22 14:22:50.432676 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:22:50.432650    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b5e20f98-933b-4183-856f-42d405558124-dshm\") pod \"test-model-53a937-kserve-bc4d888f-vb6ft\" (UID: \"b5e20f98-933b-4183-856f-42d405558124\") " pod="ai-tenant-e2e-inf-a-53a937/test-model-53a937-kserve-bc4d888f-vb6ft"
Jul 22 14:22:50.432918 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:22:50.432901    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5e20f98-933b-4183-856f-42d405558124-tls-certs\") pod \"test-model-53a937-kserve-bc4d888f-vb6ft\" (UID: \"b5e20f98-933b-4183-856f-42d405558124\") " pod="ai-tenant-e2e-inf-a-53a937/test-model-53a937-kserve-bc4d888f-vb6ft"
Jul 22 14:22:50.438569 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:22:50.438547    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kblb2\" (UniqueName: \"kubernetes.io/projected/b5e20f98-933b-4183-856f-42d405558124-kube-api-access-kblb2\") pod \"test-model-53a937-kserve-bc4d888f-vb6ft\" (UID: \"b5e20f98-933b-4183-856f-42d405558124\") " pod="ai-tenant-e2e-inf-a-53a937/test-model-53a937-kserve-bc4d888f-vb6ft"
Jul 22 14:22:50.479762 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:22:50.479721    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-53a937/test-model-53a937-kserve-bc4d888f-vb6ft"
Jul 22 14:22:50.617925 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:22:50.617896    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-53a937/test-model-53a937-kserve-bc4d888f-vb6ft"]
Jul 22 14:22:50.619460 ip-10-0-129-134 kubenswrapper[2571]: W0722 14:22:50.619430    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb5e20f98_933b_4183_856f_42d405558124.slice/crio-de53a78bdfeb3aaca8824ce3a0f8cf039ffb959b4563284a40377f353ed18d5f WatchSource:0}: Error finding container de53a78bdfeb3aaca8824ce3a0f8cf039ffb959b4563284a40377f353ed18d5f: Status 404 returned error can't find the container with id de53a78bdfeb3aaca8824ce3a0f8cf039ffb959b4563284a40377f353ed18d5f
Jul 22 14:22:51.565057 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:22:51.565023    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-53a937/test-model-53a937-kserve-bc4d888f-vb6ft" event={"ID":"b5e20f98-933b-4183-856f-42d405558124","Type":"ContainerStarted","Data":"afd7fab50c6ab27b156ef75748c2f10a98b88fb7101a6bdb47d02643820095d3"}
Jul 22 14:22:51.565057 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:22:51.565064    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-53a937/test-model-53a937-kserve-bc4d888f-vb6ft" event={"ID":"b5e20f98-933b-4183-856f-42d405558124","Type":"ContainerStarted","Data":"de53a78bdfeb3aaca8824ce3a0f8cf039ffb959b4563284a40377f353ed18d5f"}
Jul 22 14:22:51.583299 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:22:51.583249    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-53a937/test-model-53a937-kserve-bc4d888f-vb6ft" podStartSLOduration=1.58323243 podStartE2EDuration="1.58323243s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 14:22:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 14:22:51.581395225 +0000 UTC m=+2181.636171905" watchObservedRunningTime="2026-07-22 14:22:51.58323243 +0000 UTC m=+2181.638009108"
Jul 22 14:22:53.566653 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:22:53.566617    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:23:00.480056 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:23:00.480013    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-53a937/test-model-53a937-kserve-bc4d888f-vb6ft"
Jul 22 14:23:00.480503 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:23:00.480076    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-53a937/test-model-53a937-kserve-bc4d888f-vb6ft"
Jul 22 14:23:00.492672 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:23:00.492641    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-53a937/test-model-53a937-kserve-bc4d888f-vb6ft"
Jul 22 14:23:00.619084 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:23:00.619049    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-53a937/test-model-53a937-kserve-bc4d888f-vb6ft"
Jul 22 14:23:04.854135 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:23:04.854098    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:23:31.261926 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:23:31.261897    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-13629f/test-model-13629f-kserve-f4fd7df67-nnmfb"]
Jul 22 14:23:31.265828 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:23:31.265810    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-13629f/test-model-13629f-kserve-f4fd7df67-nnmfb"
Jul 22 14:23:31.267650 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:23:31.267631    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-13629f\"/\"openshift-service-ca.crt\""
Jul 22 14:23:31.267763 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:23:31.267646    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-13629f\"/\"kube-root-ca.crt\""
Jul 22 14:23:31.268511 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:23:31.268492    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-13629f\"/\"default-dockercfg-wchzh\""
Jul 22 14:23:31.268569 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:23:31.268507    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-13629f\"/\"test-model-13629f-kserve-self-signed-certs\""
Jul 22 14:23:31.275525 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:23:31.275505    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-13629f/test-model-13629f-kserve-f4fd7df67-nnmfb"]
Jul 22 14:23:31.321657 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:23:31.321619    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b67685c-67c2-4159-9031-b83ceaab02af-tmp-dir\") pod \"test-model-13629f-kserve-f4fd7df67-nnmfb\" (UID: \"2b67685c-67c2-4159-9031-b83ceaab02af\") " pod="ai-tenant-e2e-inf-b-13629f/test-model-13629f-kserve-f4fd7df67-nnmfb"
Jul 22 14:23:31.321854 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:23:31.321676    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b67685c-67c2-4159-9031-b83ceaab02af-home\") pod \"test-model-13629f-kserve-f4fd7df67-nnmfb\" (UID: \"2b67685c-67c2-4159-9031-b83ceaab02af\") " pod="ai-tenant-e2e-inf-b-13629f/test-model-13629f-kserve-f4fd7df67-nnmfb"
Jul 22 14:23:31.321854 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:23:31.321771    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b67685c-67c2-4159-9031-b83ceaab02af-model-cache\") pod \"test-model-13629f-kserve-f4fd7df67-nnmfb\" (UID: \"2b67685c-67c2-4159-9031-b83ceaab02af\") " pod="ai-tenant-e2e-inf-b-13629f/test-model-13629f-kserve-f4fd7df67-nnmfb"
Jul 22 14:23:31.321854 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:23:31.321805    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqlgv\" (UniqueName: \"kubernetes.io/projected/2b67685c-67c2-4159-9031-b83ceaab02af-kube-api-access-bqlgv\") pod \"test-model-13629f-kserve-f4fd7df67-nnmfb\" (UID: \"2b67685c-67c2-4159-9031-b83ceaab02af\") " pod="ai-tenant-e2e-inf-b-13629f/test-model-13629f-kserve-f4fd7df67-nnmfb"
Jul 22 14:23:31.321854 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:23:31.321832    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b67685c-67c2-4159-9031-b83ceaab02af-tls-certs\") pod \"test-model-13629f-kserve-f4fd7df67-nnmfb\" (UID: \"2b67685c-67c2-4159-9031-b83ceaab02af\") " pod="ai-tenant-e2e-inf-b-13629f/test-model-13629f-kserve-f4fd7df67-nnmfb"
Jul 22 14:23:31.321991 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:23:31.321905    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b67685c-67c2-4159-9031-b83ceaab02af-dshm\") pod \"test-model-13629f-kserve-f4fd7df67-nnmfb\" (UID: \"2b67685c-67c2-4159-9031-b83ceaab02af\") " pod="ai-tenant-e2e-inf-b-13629f/test-model-13629f-kserve-f4fd7df67-nnmfb"
Jul 22 14:23:31.423430 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:23:31.423371    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b67685c-67c2-4159-9031-b83ceaab02af-model-cache\") pod \"test-model-13629f-kserve-f4fd7df67-nnmfb\" (UID: \"2b67685c-67c2-4159-9031-b83ceaab02af\") " pod="ai-tenant-e2e-inf-b-13629f/test-model-13629f-kserve-f4fd7df67-nnmfb"
Jul 22 14:23:31.423631 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:23:31.423437    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqlgv\" (UniqueName: \"kubernetes.io/projected/2b67685c-67c2-4159-9031-b83ceaab02af-kube-api-access-bqlgv\") pod \"test-model-13629f-kserve-f4fd7df67-nnmfb\" (UID: \"2b67685c-67c2-4159-9031-b83ceaab02af\") " pod="ai-tenant-e2e-inf-b-13629f/test-model-13629f-kserve-f4fd7df67-nnmfb"
Jul 22 14:23:31.423631 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:23:31.423463    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b67685c-67c2-4159-9031-b83ceaab02af-tls-certs\") pod \"test-model-13629f-kserve-f4fd7df67-nnmfb\" (UID: \"2b67685c-67c2-4159-9031-b83ceaab02af\") " pod="ai-tenant-e2e-inf-b-13629f/test-model-13629f-kserve-f4fd7df67-nnmfb"
Jul 22 14:23:31.423631 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:23:31.423521    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b67685c-67c2-4159-9031-b83ceaab02af-dshm\") pod \"test-model-13629f-kserve-f4fd7df67-nnmfb\" (UID: \"2b67685c-67c2-4159-9031-b83ceaab02af\") " pod="ai-tenant-e2e-inf-b-13629f/test-model-13629f-kserve-f4fd7df67-nnmfb"
Jul 22 14:23:31.423631 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:23:31.423546    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b67685c-67c2-4159-9031-b83ceaab02af-tmp-dir\") pod \"test-model-13629f-kserve-f4fd7df67-nnmfb\" (UID: \"2b67685c-67c2-4159-9031-b83ceaab02af\") " pod="ai-tenant-e2e-inf-b-13629f/test-model-13629f-kserve-f4fd7df67-nnmfb"
Jul 22 14:23:31.423631 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:23:31.423580    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b67685c-67c2-4159-9031-b83ceaab02af-home\") pod \"test-model-13629f-kserve-f4fd7df67-nnmfb\" (UID: \"2b67685c-67c2-4159-9031-b83ceaab02af\") " pod="ai-tenant-e2e-inf-b-13629f/test-model-13629f-kserve-f4fd7df67-nnmfb"
Jul 22 14:23:31.423900 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:23:31.423800    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b67685c-67c2-4159-9031-b83ceaab02af-model-cache\") pod \"test-model-13629f-kserve-f4fd7df67-nnmfb\" (UID: \"2b67685c-67c2-4159-9031-b83ceaab02af\") " pod="ai-tenant-e2e-inf-b-13629f/test-model-13629f-kserve-f4fd7df67-nnmfb"
Jul 22 14:23:31.424007 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:23:31.423985    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b67685c-67c2-4159-9031-b83ceaab02af-tmp-dir\") pod \"test-model-13629f-kserve-f4fd7df67-nnmfb\" (UID: \"2b67685c-67c2-4159-9031-b83ceaab02af\") " pod="ai-tenant-e2e-inf-b-13629f/test-model-13629f-kserve-f4fd7df67-nnmfb"
Jul 22 14:23:31.424069 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:23:31.424016    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b67685c-67c2-4159-9031-b83ceaab02af-home\") pod \"test-model-13629f-kserve-f4fd7df67-nnmfb\" (UID: \"2b67685c-67c2-4159-9031-b83ceaab02af\") " pod="ai-tenant-e2e-inf-b-13629f/test-model-13629f-kserve-f4fd7df67-nnmfb"
Jul 22 14:23:31.425837 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:23:31.425810    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b67685c-67c2-4159-9031-b83ceaab02af-dshm\") pod \"test-model-13629f-kserve-f4fd7df67-nnmfb\" (UID: \"2b67685c-67c2-4159-9031-b83ceaab02af\") " pod="ai-tenant-e2e-inf-b-13629f/test-model-13629f-kserve-f4fd7df67-nnmfb"
Jul 22 14:23:31.425938 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:23:31.425908    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b67685c-67c2-4159-9031-b83ceaab02af-tls-certs\") pod \"test-model-13629f-kserve-f4fd7df67-nnmfb\" (UID: \"2b67685c-67c2-4159-9031-b83ceaab02af\") " pod="ai-tenant-e2e-inf-b-13629f/test-model-13629f-kserve-f4fd7df67-nnmfb"
Jul 22 14:23:31.432237 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:23:31.432217    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqlgv\" (UniqueName: \"kubernetes.io/projected/2b67685c-67c2-4159-9031-b83ceaab02af-kube-api-access-bqlgv\") pod \"test-model-13629f-kserve-f4fd7df67-nnmfb\" (UID: \"2b67685c-67c2-4159-9031-b83ceaab02af\") " pod="ai-tenant-e2e-inf-b-13629f/test-model-13629f-kserve-f4fd7df67-nnmfb"
Jul 22 14:23:31.576639 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:23:31.576604    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-13629f/test-model-13629f-kserve-f4fd7df67-nnmfb"
Jul 22 14:23:31.713866 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:23:31.713840    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-13629f/test-model-13629f-kserve-f4fd7df67-nnmfb"]
Jul 22 14:23:31.715822 ip-10-0-129-134 kubenswrapper[2571]: W0722 14:23:31.715788    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2b67685c_67c2_4159_9031_b83ceaab02af.slice/crio-c513673cde95bd08d6caf575c5cf4f04ef9f70e4cec5bd8b1951144da258afbc WatchSource:0}: Error finding container c513673cde95bd08d6caf575c5cf4f04ef9f70e4cec5bd8b1951144da258afbc: Status 404 returned error can't find the container with id c513673cde95bd08d6caf575c5cf4f04ef9f70e4cec5bd8b1951144da258afbc
Jul 22 14:23:31.769379 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:23:31.769348    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-13629f/test-model-13629f-kserve-f4fd7df67-nnmfb" event={"ID":"2b67685c-67c2-4159-9031-b83ceaab02af","Type":"ContainerStarted","Data":"c513673cde95bd08d6caf575c5cf4f04ef9f70e4cec5bd8b1951144da258afbc"}
Jul 22 14:23:32.775531 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:23:32.775499    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-13629f/test-model-13629f-kserve-f4fd7df67-nnmfb" event={"ID":"2b67685c-67c2-4159-9031-b83ceaab02af","Type":"ContainerStarted","Data":"782923fb333a9a840746a87f62b32174c656eaf8a74aa51b69347719ef7d65fd"}
Jul 22 14:23:32.796980 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:23:32.796917    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-13629f/test-model-13629f-kserve-f4fd7df67-nnmfb" podStartSLOduration=1.796897052 podStartE2EDuration="1.796897052s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 14:23:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 14:23:32.795335014 +0000 UTC m=+2222.850111692" watchObservedRunningTime="2026-07-22 14:23:32.796897052 +0000 UTC m=+2222.851673732"
Jul 22 14:23:35.359830 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:23:35.359791    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:23:41.576931 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:23:41.576881    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-13629f/test-model-13629f-kserve-f4fd7df67-nnmfb"
Jul 22 14:23:41.577372 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:23:41.576960    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-13629f/test-model-13629f-kserve-f4fd7df67-nnmfb"
Jul 22 14:23:41.589829 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:23:41.589802    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-13629f/test-model-13629f-kserve-f4fd7df67-nnmfb"
Jul 22 14:23:41.830203 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:23:41.830119    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-13629f/test-model-13629f-kserve-f4fd7df67-nnmfb"
Jul 22 14:23:49.664400 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:23:49.664362    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:24:23.782374 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:24:23.782339    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-53a937/test-model-53a937-kserve-bc4d888f-vb6ft"]
Jul 22 14:24:24.697523 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:24:24.697489    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-13629f/test-model-13629f-kserve-f4fd7df67-nnmfb"]
Jul 22 14:24:28.962164 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:24:28.962122    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:24:38.803227 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:24:38.803160    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-53a937/test-model-53a937-kserve-bc4d888f-vb6ft" podUID="b5e20f98-933b-4183-856f-42d405558124" containerName="main" containerID="cri-o://afd7fab50c6ab27b156ef75748c2f10a98b88fb7101a6bdb47d02643820095d3" gracePeriod=45
Jul 22 14:24:39.060654 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:24:39.060588    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-53a937/test-model-53a937-kserve-bc4d888f-vb6ft"
Jul 22 14:24:39.102638 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:24:39.102595    2571 generic.go:356] "Generic (PLEG): container finished" podID="b5e20f98-933b-4183-856f-42d405558124" containerID="afd7fab50c6ab27b156ef75748c2f10a98b88fb7101a6bdb47d02643820095d3" exitCode=0
Jul 22 14:24:39.102814 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:24:39.102646    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-53a937/test-model-53a937-kserve-bc4d888f-vb6ft"
Jul 22 14:24:39.102814 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:24:39.102685    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-53a937/test-model-53a937-kserve-bc4d888f-vb6ft" event={"ID":"b5e20f98-933b-4183-856f-42d405558124","Type":"ContainerDied","Data":"afd7fab50c6ab27b156ef75748c2f10a98b88fb7101a6bdb47d02643820095d3"}
Jul 22 14:24:39.102814 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:24:39.102730    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-53a937/test-model-53a937-kserve-bc4d888f-vb6ft" event={"ID":"b5e20f98-933b-4183-856f-42d405558124","Type":"ContainerDied","Data":"de53a78bdfeb3aaca8824ce3a0f8cf039ffb959b4563284a40377f353ed18d5f"}
Jul 22 14:24:39.102814 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:24:39.102750    2571 scope.go:117] "RemoveContainer" containerID="afd7fab50c6ab27b156ef75748c2f10a98b88fb7101a6bdb47d02643820095d3"
Jul 22 14:24:39.111341 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:24:39.111318    2571 scope.go:117] "RemoveContainer" containerID="afd7fab50c6ab27b156ef75748c2f10a98b88fb7101a6bdb47d02643820095d3"
Jul 22 14:24:39.111702 ip-10-0-129-134 kubenswrapper[2571]: E0722 14:24:39.111682    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"afd7fab50c6ab27b156ef75748c2f10a98b88fb7101a6bdb47d02643820095d3\": container with ID starting with afd7fab50c6ab27b156ef75748c2f10a98b88fb7101a6bdb47d02643820095d3 not found: ID does not exist" containerID="afd7fab50c6ab27b156ef75748c2f10a98b88fb7101a6bdb47d02643820095d3"
Jul 22 14:24:39.111763 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:24:39.111713    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afd7fab50c6ab27b156ef75748c2f10a98b88fb7101a6bdb47d02643820095d3"} err="failed to get container status \"afd7fab50c6ab27b156ef75748c2f10a98b88fb7101a6bdb47d02643820095d3\": rpc error: code = NotFound desc = could not find container \"afd7fab50c6ab27b156ef75748c2f10a98b88fb7101a6bdb47d02643820095d3\": container with ID starting with afd7fab50c6ab27b156ef75748c2f10a98b88fb7101a6bdb47d02643820095d3 not found: ID does not exist"
Jul 22 14:24:39.190912 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:24:39.190874    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b5e20f98-933b-4183-856f-42d405558124-home\") pod \"b5e20f98-933b-4183-856f-42d405558124\" (UID: \"b5e20f98-933b-4183-856f-42d405558124\") "
Jul 22 14:24:39.191122 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:24:39.190955    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b5e20f98-933b-4183-856f-42d405558124-model-cache\") pod \"b5e20f98-933b-4183-856f-42d405558124\" (UID: \"b5e20f98-933b-4183-856f-42d405558124\") "
Jul 22 14:24:39.191122 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:24:39.190977    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5e20f98-933b-4183-856f-42d405558124-tls-certs\") pod \"b5e20f98-933b-4183-856f-42d405558124\" (UID: \"b5e20f98-933b-4183-856f-42d405558124\") "
Jul 22 14:24:39.191122 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:24:39.191002    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kblb2\" (UniqueName: \"kubernetes.io/projected/b5e20f98-933b-4183-856f-42d405558124-kube-api-access-kblb2\") pod \"b5e20f98-933b-4183-856f-42d405558124\" (UID: \"b5e20f98-933b-4183-856f-42d405558124\") "
Jul 22 14:24:39.191122 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:24:39.191048    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b5e20f98-933b-4183-856f-42d405558124-dshm\") pod \"b5e20f98-933b-4183-856f-42d405558124\" (UID: \"b5e20f98-933b-4183-856f-42d405558124\") "
Jul 22 14:24:39.191334 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:24:39.191217    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5e20f98-933b-4183-856f-42d405558124-tmp-dir\") pod \"b5e20f98-933b-4183-856f-42d405558124\" (UID: \"b5e20f98-933b-4183-856f-42d405558124\") "
Jul 22 14:24:39.191334 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:24:39.191245    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5e20f98-933b-4183-856f-42d405558124-home" (OuterVolumeSpecName: "home") pod "b5e20f98-933b-4183-856f-42d405558124" (UID: "b5e20f98-933b-4183-856f-42d405558124"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 14:24:39.191334 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:24:39.191283    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5e20f98-933b-4183-856f-42d405558124-model-cache" (OuterVolumeSpecName: "model-cache") pod "b5e20f98-933b-4183-856f-42d405558124" (UID: "b5e20f98-933b-4183-856f-42d405558124"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 14:24:39.191542 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:24:39.191509    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5e20f98-933b-4183-856f-42d405558124-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b5e20f98-933b-4183-856f-42d405558124" (UID: "b5e20f98-933b-4183-856f-42d405558124"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 14:24:39.191665 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:24:39.191628    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b5e20f98-933b-4183-856f-42d405558124-model-cache\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 14:24:39.191665 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:24:39.191640    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5e20f98-933b-4183-856f-42d405558124-tmp-dir\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 14:24:39.191665 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:24:39.191648    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b5e20f98-933b-4183-856f-42d405558124-home\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 14:24:39.193441 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:24:39.193401    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5e20f98-933b-4183-856f-42d405558124-kube-api-access-kblb2" (OuterVolumeSpecName: "kube-api-access-kblb2") pod "b5e20f98-933b-4183-856f-42d405558124" (UID: "b5e20f98-933b-4183-856f-42d405558124"). InnerVolumeSpecName "kube-api-access-kblb2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 14:24:39.193726 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:24:39.193706    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5e20f98-933b-4183-856f-42d405558124-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b5e20f98-933b-4183-856f-42d405558124" (UID: "b5e20f98-933b-4183-856f-42d405558124"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 14:24:39.193795 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:24:39.193705    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5e20f98-933b-4183-856f-42d405558124-dshm" (OuterVolumeSpecName: "dshm") pod "b5e20f98-933b-4183-856f-42d405558124" (UID: "b5e20f98-933b-4183-856f-42d405558124"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 14:24:39.292369 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:24:39.292333    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b5e20f98-933b-4183-856f-42d405558124-dshm\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 14:24:39.292369 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:24:39.292364    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5e20f98-933b-4183-856f-42d405558124-tls-certs\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 14:24:39.292369 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:24:39.292375    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kblb2\" (UniqueName: \"kubernetes.io/projected/b5e20f98-933b-4183-856f-42d405558124-kube-api-access-kblb2\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 14:24:39.424747 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:24:39.424714    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-53a937/test-model-53a937-kserve-bc4d888f-vb6ft"]
Jul 22 14:24:39.428989 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:24:39.428957    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-53a937/test-model-53a937-kserve-bc4d888f-vb6ft"]
Jul 22 14:24:39.719525 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:24:39.719399    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-13629f/test-model-13629f-kserve-f4fd7df67-nnmfb" podUID="2b67685c-67c2-4159-9031-b83ceaab02af" containerName="main" containerID="cri-o://782923fb333a9a840746a87f62b32174c656eaf8a74aa51b69347719ef7d65fd" gracePeriod=45
Jul 22 14:24:39.980150 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:24:39.980086    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-13629f/test-model-13629f-kserve-f4fd7df67-nnmfb"
Jul 22 14:24:40.100904 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:24:40.100855    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b67685c-67c2-4159-9031-b83ceaab02af-home\") pod \"2b67685c-67c2-4159-9031-b83ceaab02af\" (UID: \"2b67685c-67c2-4159-9031-b83ceaab02af\") "
Jul 22 14:24:40.100904 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:24:40.100917    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b67685c-67c2-4159-9031-b83ceaab02af-tmp-dir\") pod \"2b67685c-67c2-4159-9031-b83ceaab02af\" (UID: \"2b67685c-67c2-4159-9031-b83ceaab02af\") "
Jul 22 14:24:40.101126 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:24:40.101085    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b67685c-67c2-4159-9031-b83ceaab02af-model-cache\") pod \"2b67685c-67c2-4159-9031-b83ceaab02af\" (UID: \"2b67685c-67c2-4159-9031-b83ceaab02af\") "
Jul 22 14:24:40.101162 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:24:40.101144    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b67685c-67c2-4159-9031-b83ceaab02af-home" (OuterVolumeSpecName: "home") pod "2b67685c-67c2-4159-9031-b83ceaab02af" (UID: "2b67685c-67c2-4159-9031-b83ceaab02af"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 14:24:40.101197 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:24:40.101157    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b67685c-67c2-4159-9031-b83ceaab02af-dshm\") pod \"2b67685c-67c2-4159-9031-b83ceaab02af\" (UID: \"2b67685c-67c2-4159-9031-b83ceaab02af\") "
Jul 22 14:24:40.101231 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:24:40.101195    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b67685c-67c2-4159-9031-b83ceaab02af-tls-certs\") pod \"2b67685c-67c2-4159-9031-b83ceaab02af\" (UID: \"2b67685c-67c2-4159-9031-b83ceaab02af\") "
Jul 22 14:24:40.101231 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:24:40.101216    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bqlgv\" (UniqueName: \"kubernetes.io/projected/2b67685c-67c2-4159-9031-b83ceaab02af-kube-api-access-bqlgv\") pod \"2b67685c-67c2-4159-9031-b83ceaab02af\" (UID: \"2b67685c-67c2-4159-9031-b83ceaab02af\") "
Jul 22 14:24:40.101336 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:24:40.101155    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b67685c-67c2-4159-9031-b83ceaab02af-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2b67685c-67c2-4159-9031-b83ceaab02af" (UID: "2b67685c-67c2-4159-9031-b83ceaab02af"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 14:24:40.101336 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:24:40.101298    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b67685c-67c2-4159-9031-b83ceaab02af-model-cache" (OuterVolumeSpecName: "model-cache") pod "2b67685c-67c2-4159-9031-b83ceaab02af" (UID: "2b67685c-67c2-4159-9031-b83ceaab02af"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 14:24:40.101601 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:24:40.101584    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b67685c-67c2-4159-9031-b83ceaab02af-home\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 14:24:40.101671 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:24:40.101603    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b67685c-67c2-4159-9031-b83ceaab02af-tmp-dir\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 14:24:40.101671 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:24:40.101612    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b67685c-67c2-4159-9031-b83ceaab02af-model-cache\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 14:24:40.103455 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:24:40.103425    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b67685c-67c2-4159-9031-b83ceaab02af-dshm" (OuterVolumeSpecName: "dshm") pod "2b67685c-67c2-4159-9031-b83ceaab02af" (UID: "2b67685c-67c2-4159-9031-b83ceaab02af"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 14:24:40.103563 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:24:40.103516    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b67685c-67c2-4159-9031-b83ceaab02af-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2b67685c-67c2-4159-9031-b83ceaab02af" (UID: "2b67685c-67c2-4159-9031-b83ceaab02af"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 14:24:40.103563 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:24:40.103528    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b67685c-67c2-4159-9031-b83ceaab02af-kube-api-access-bqlgv" (OuterVolumeSpecName: "kube-api-access-bqlgv") pod "2b67685c-67c2-4159-9031-b83ceaab02af" (UID: "2b67685c-67c2-4159-9031-b83ceaab02af"). InnerVolumeSpecName "kube-api-access-bqlgv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 14:24:40.110060 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:24:40.109870    2571 generic.go:356] "Generic (PLEG): container finished" podID="2b67685c-67c2-4159-9031-b83ceaab02af" containerID="782923fb333a9a840746a87f62b32174c656eaf8a74aa51b69347719ef7d65fd" exitCode=0
Jul 22 14:24:40.110060 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:24:40.109912    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-13629f/test-model-13629f-kserve-f4fd7df67-nnmfb"
Jul 22 14:24:40.110060 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:24:40.109943    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-13629f/test-model-13629f-kserve-f4fd7df67-nnmfb" event={"ID":"2b67685c-67c2-4159-9031-b83ceaab02af","Type":"ContainerDied","Data":"782923fb333a9a840746a87f62b32174c656eaf8a74aa51b69347719ef7d65fd"}
Jul 22 14:24:40.110060 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:24:40.109989    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-13629f/test-model-13629f-kserve-f4fd7df67-nnmfb" event={"ID":"2b67685c-67c2-4159-9031-b83ceaab02af","Type":"ContainerDied","Data":"c513673cde95bd08d6caf575c5cf4f04ef9f70e4cec5bd8b1951144da258afbc"}
Jul 22 14:24:40.110060 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:24:40.110007    2571 scope.go:117] "RemoveContainer" containerID="782923fb333a9a840746a87f62b32174c656eaf8a74aa51b69347719ef7d65fd"
Jul 22 14:24:40.123782 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:24:40.123765    2571 scope.go:117] "RemoveContainer" containerID="782923fb333a9a840746a87f62b32174c656eaf8a74aa51b69347719ef7d65fd"
Jul 22 14:24:40.124052 ip-10-0-129-134 kubenswrapper[2571]: E0722 14:24:40.124024    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"782923fb333a9a840746a87f62b32174c656eaf8a74aa51b69347719ef7d65fd\": container with ID starting with 782923fb333a9a840746a87f62b32174c656eaf8a74aa51b69347719ef7d65fd not found: ID does not exist" containerID="782923fb333a9a840746a87f62b32174c656eaf8a74aa51b69347719ef7d65fd"
Jul 22 14:24:40.124109 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:24:40.124054    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"782923fb333a9a840746a87f62b32174c656eaf8a74aa51b69347719ef7d65fd"} err="failed to get container status \"782923fb333a9a840746a87f62b32174c656eaf8a74aa51b69347719ef7d65fd\": rpc error: code = NotFound desc = could not find container \"782923fb333a9a840746a87f62b32174c656eaf8a74aa51b69347719ef7d65fd\": container with ID starting with 782923fb333a9a840746a87f62b32174c656eaf8a74aa51b69347719ef7d65fd not found: ID does not exist"
Jul 22 14:24:40.135239 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:24:40.135215    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-13629f/test-model-13629f-kserve-f4fd7df67-nnmfb"]
Jul 22 14:24:40.136988 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:24:40.136965    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-13629f/test-model-13629f-kserve-f4fd7df67-nnmfb"]
Jul 22 14:24:40.202636 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:24:40.202603    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b67685c-67c2-4159-9031-b83ceaab02af-dshm\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 14:24:40.202636 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:24:40.202629    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b67685c-67c2-4159-9031-b83ceaab02af-tls-certs\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 14:24:40.202636 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:24:40.202639    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bqlgv\" (UniqueName: \"kubernetes.io/projected/2b67685c-67c2-4159-9031-b83ceaab02af-kube-api-access-bqlgv\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 14:24:41.009770 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:24:41.009733    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b67685c-67c2-4159-9031-b83ceaab02af" path="/var/lib/kubelet/pods/2b67685c-67c2-4159-9031-b83ceaab02af/volumes"
Jul 22 14:24:41.010153 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:24:41.010102    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5e20f98-933b-4183-856f-42d405558124" path="/var/lib/kubelet/pods/b5e20f98-933b-4183-856f-42d405558124/volumes"
Jul 22 14:24:44.858104 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:24:44.858067    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:25:00.461657 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:25:00.461613    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:25:18.965672 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:25:18.965633    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:25:29.863030 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:25:29.862945    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:25:51.457227 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:25:51.457194    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:26:20.262503 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:26:20.262464    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:26:37.769348 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:26:37.769309    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:26:46.260618 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:26:46.260585    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:26:59.558206 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:26:59.558105    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-7d1f11/auth-test-model-7d1f11-kserve-657b48b667-h69q5"]
Jul 22 14:26:59.558758 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:26:59.558738    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b67685c-67c2-4159-9031-b83ceaab02af" containerName="main"
Jul 22 14:26:59.558758 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:26:59.558758    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b67685c-67c2-4159-9031-b83ceaab02af" containerName="main"
Jul 22 14:26:59.558897 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:26:59.558777    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5e20f98-933b-4183-856f-42d405558124" containerName="main"
Jul 22 14:26:59.558897 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:26:59.558787    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5e20f98-933b-4183-856f-42d405558124" containerName="main"
Jul 22 14:26:59.559004 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:26:59.558916    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5e20f98-933b-4183-856f-42d405558124" containerName="main"
Jul 22 14:26:59.559004 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:26:59.558930    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b67685c-67c2-4159-9031-b83ceaab02af" containerName="main"
Jul 22 14:26:59.562525 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:26:59.562504    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7d1f11/auth-test-model-7d1f11-kserve-657b48b667-h69q5"
Jul 22 14:26:59.565008 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:26:59.564984    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-7d1f11\"/\"openshift-service-ca.crt\""
Jul 22 14:26:59.565140 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:26:59.564984    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-7d1f11\"/\"auth-test-model-7d1f11-kserve-self-signed-certs\""
Jul 22 14:26:59.565140 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:26:59.564993    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-7d1f11\"/\"kube-root-ca.crt\""
Jul 22 14:26:59.565140 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:26:59.564995    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-7d1f11\"/\"default-dockercfg-9fp48\""
Jul 22 14:26:59.571319 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:26:59.571294    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-7d1f11/auth-test-model-7d1f11-kserve-657b48b667-h69q5"]
Jul 22 14:26:59.626691 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:26:59.626657    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4a7ed30-16fe-462a-8e3f-f70f6cf01642-tls-certs\") pod \"auth-test-model-7d1f11-kserve-657b48b667-h69q5\" (UID: \"a4a7ed30-16fe-462a-8e3f-f70f6cf01642\") " pod="ai-tenant-e2e-shared-a-7d1f11/auth-test-model-7d1f11-kserve-657b48b667-h69q5"
Jul 22 14:26:59.626691 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:26:59.626699    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a4a7ed30-16fe-462a-8e3f-f70f6cf01642-dshm\") pod \"auth-test-model-7d1f11-kserve-657b48b667-h69q5\" (UID: \"a4a7ed30-16fe-462a-8e3f-f70f6cf01642\") " pod="ai-tenant-e2e-shared-a-7d1f11/auth-test-model-7d1f11-kserve-657b48b667-h69q5"
Jul 22 14:26:59.626955 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:26:59.626754    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgknw\" (UniqueName: \"kubernetes.io/projected/a4a7ed30-16fe-462a-8e3f-f70f6cf01642-kube-api-access-kgknw\") pod \"auth-test-model-7d1f11-kserve-657b48b667-h69q5\" (UID: \"a4a7ed30-16fe-462a-8e3f-f70f6cf01642\") " pod="ai-tenant-e2e-shared-a-7d1f11/auth-test-model-7d1f11-kserve-657b48b667-h69q5"
Jul 22 14:26:59.626955 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:26:59.626779    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a4a7ed30-16fe-462a-8e3f-f70f6cf01642-model-cache\") pod \"auth-test-model-7d1f11-kserve-657b48b667-h69q5\" (UID: \"a4a7ed30-16fe-462a-8e3f-f70f6cf01642\") " pod="ai-tenant-e2e-shared-a-7d1f11/auth-test-model-7d1f11-kserve-657b48b667-h69q5"
Jul 22 14:26:59.626955 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:26:59.626803    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a4a7ed30-16fe-462a-8e3f-f70f6cf01642-home\") pod \"auth-test-model-7d1f11-kserve-657b48b667-h69q5\" (UID: \"a4a7ed30-16fe-462a-8e3f-f70f6cf01642\") " pod="ai-tenant-e2e-shared-a-7d1f11/auth-test-model-7d1f11-kserve-657b48b667-h69q5"
Jul 22 14:26:59.626955 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:26:59.626875    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4a7ed30-16fe-462a-8e3f-f70f6cf01642-tmp-dir\") pod \"auth-test-model-7d1f11-kserve-657b48b667-h69q5\" (UID: \"a4a7ed30-16fe-462a-8e3f-f70f6cf01642\") " pod="ai-tenant-e2e-shared-a-7d1f11/auth-test-model-7d1f11-kserve-657b48b667-h69q5"
Jul 22 14:26:59.727978 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:26:59.727939    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgknw\" (UniqueName: \"kubernetes.io/projected/a4a7ed30-16fe-462a-8e3f-f70f6cf01642-kube-api-access-kgknw\") pod \"auth-test-model-7d1f11-kserve-657b48b667-h69q5\" (UID: \"a4a7ed30-16fe-462a-8e3f-f70f6cf01642\") " pod="ai-tenant-e2e-shared-a-7d1f11/auth-test-model-7d1f11-kserve-657b48b667-h69q5"
Jul 22 14:26:59.727978 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:26:59.727982    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a4a7ed30-16fe-462a-8e3f-f70f6cf01642-model-cache\") pod \"auth-test-model-7d1f11-kserve-657b48b667-h69q5\" (UID: \"a4a7ed30-16fe-462a-8e3f-f70f6cf01642\") " pod="ai-tenant-e2e-shared-a-7d1f11/auth-test-model-7d1f11-kserve-657b48b667-h69q5"
Jul 22 14:26:59.728244 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:26:59.728022    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a4a7ed30-16fe-462a-8e3f-f70f6cf01642-home\") pod \"auth-test-model-7d1f11-kserve-657b48b667-h69q5\" (UID: \"a4a7ed30-16fe-462a-8e3f-f70f6cf01642\") " pod="ai-tenant-e2e-shared-a-7d1f11/auth-test-model-7d1f11-kserve-657b48b667-h69q5"
Jul 22 14:26:59.728244 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:26:59.728056    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4a7ed30-16fe-462a-8e3f-f70f6cf01642-tmp-dir\") pod \"auth-test-model-7d1f11-kserve-657b48b667-h69q5\" (UID: \"a4a7ed30-16fe-462a-8e3f-f70f6cf01642\") " pod="ai-tenant-e2e-shared-a-7d1f11/auth-test-model-7d1f11-kserve-657b48b667-h69q5"
Jul 22 14:26:59.728244 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:26:59.728176    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4a7ed30-16fe-462a-8e3f-f70f6cf01642-tls-certs\") pod \"auth-test-model-7d1f11-kserve-657b48b667-h69q5\" (UID: \"a4a7ed30-16fe-462a-8e3f-f70f6cf01642\") " pod="ai-tenant-e2e-shared-a-7d1f11/auth-test-model-7d1f11-kserve-657b48b667-h69q5"
Jul 22 14:26:59.728244 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:26:59.728204    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a4a7ed30-16fe-462a-8e3f-f70f6cf01642-dshm\") pod \"auth-test-model-7d1f11-kserve-657b48b667-h69q5\" (UID: \"a4a7ed30-16fe-462a-8e3f-f70f6cf01642\") " pod="ai-tenant-e2e-shared-a-7d1f11/auth-test-model-7d1f11-kserve-657b48b667-h69q5"
Jul 22 14:26:59.728480 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:26:59.728385    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a4a7ed30-16fe-462a-8e3f-f70f6cf01642-model-cache\") pod \"auth-test-model-7d1f11-kserve-657b48b667-h69q5\" (UID: \"a4a7ed30-16fe-462a-8e3f-f70f6cf01642\") " pod="ai-tenant-e2e-shared-a-7d1f11/auth-test-model-7d1f11-kserve-657b48b667-h69q5"
Jul 22 14:26:59.728480 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:26:59.728422    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a4a7ed30-16fe-462a-8e3f-f70f6cf01642-home\") pod \"auth-test-model-7d1f11-kserve-657b48b667-h69q5\" (UID: \"a4a7ed30-16fe-462a-8e3f-f70f6cf01642\") " pod="ai-tenant-e2e-shared-a-7d1f11/auth-test-model-7d1f11-kserve-657b48b667-h69q5"
Jul 22 14:26:59.728589 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:26:59.728484    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4a7ed30-16fe-462a-8e3f-f70f6cf01642-tmp-dir\") pod \"auth-test-model-7d1f11-kserve-657b48b667-h69q5\" (UID: \"a4a7ed30-16fe-462a-8e3f-f70f6cf01642\") " pod="ai-tenant-e2e-shared-a-7d1f11/auth-test-model-7d1f11-kserve-657b48b667-h69q5"
Jul 22 14:26:59.730553 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:26:59.730527    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a4a7ed30-16fe-462a-8e3f-f70f6cf01642-dshm\") pod \"auth-test-model-7d1f11-kserve-657b48b667-h69q5\" (UID: \"a4a7ed30-16fe-462a-8e3f-f70f6cf01642\") " pod="ai-tenant-e2e-shared-a-7d1f11/auth-test-model-7d1f11-kserve-657b48b667-h69q5"
Jul 22 14:26:59.730713 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:26:59.730697    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4a7ed30-16fe-462a-8e3f-f70f6cf01642-tls-certs\") pod \"auth-test-model-7d1f11-kserve-657b48b667-h69q5\" (UID: \"a4a7ed30-16fe-462a-8e3f-f70f6cf01642\") " pod="ai-tenant-e2e-shared-a-7d1f11/auth-test-model-7d1f11-kserve-657b48b667-h69q5"
Jul 22 14:26:59.736618 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:26:59.736590    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgknw\" (UniqueName: \"kubernetes.io/projected/a4a7ed30-16fe-462a-8e3f-f70f6cf01642-kube-api-access-kgknw\") pod \"auth-test-model-7d1f11-kserve-657b48b667-h69q5\" (UID: \"a4a7ed30-16fe-462a-8e3f-f70f6cf01642\") " pod="ai-tenant-e2e-shared-a-7d1f11/auth-test-model-7d1f11-kserve-657b48b667-h69q5"
Jul 22 14:26:59.873855 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:26:59.873759    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7d1f11/auth-test-model-7d1f11-kserve-657b48b667-h69q5"
Jul 22 14:27:00.015962 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:27:00.015936    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-7d1f11/auth-test-model-7d1f11-kserve-657b48b667-h69q5"]
Jul 22 14:27:00.017625 ip-10-0-129-134 kubenswrapper[2571]: W0722 14:27:00.017602    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda4a7ed30_16fe_462a_8e3f_f70f6cf01642.slice/crio-9d50dd94b209515549eb3d05d89a73afcf058299f2294e6bba62ab7098cb7611 WatchSource:0}: Error finding container 9d50dd94b209515549eb3d05d89a73afcf058299f2294e6bba62ab7098cb7611: Status 404 returned error can't find the container with id 9d50dd94b209515549eb3d05d89a73afcf058299f2294e6bba62ab7098cb7611
Jul 22 14:27:00.799624 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:27:00.799591    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7d1f11/auth-test-model-7d1f11-kserve-657b48b667-h69q5" event={"ID":"a4a7ed30-16fe-462a-8e3f-f70f6cf01642","Type":"ContainerStarted","Data":"8891706677e1e079994dc55537f746ea0a86155d0d9df9cab01320d85b084934"}
Jul 22 14:27:00.800034 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:27:00.799634    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7d1f11/auth-test-model-7d1f11-kserve-657b48b667-h69q5" event={"ID":"a4a7ed30-16fe-462a-8e3f-f70f6cf01642","Type":"ContainerStarted","Data":"9d50dd94b209515549eb3d05d89a73afcf058299f2294e6bba62ab7098cb7611"}
Jul 22 14:27:00.821125 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:27:00.821073    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-7d1f11/auth-test-model-7d1f11-kserve-657b48b667-h69q5" podStartSLOduration=1.821055941 podStartE2EDuration="1.821055941s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 14:26:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 14:27:00.818978172 +0000 UTC m=+2430.873754863" watchObservedRunningTime="2026-07-22 14:27:00.821055941 +0000 UTC m=+2430.875832617"
Jul 22 14:27:03.157477 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:27:03.157439    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:27:09.874474 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:27:09.874424    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-7d1f11/auth-test-model-7d1f11-kserve-657b48b667-h69q5"
Jul 22 14:27:09.874474 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:27:09.874484    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-7d1f11/auth-test-model-7d1f11-kserve-657b48b667-h69q5"
Jul 22 14:27:09.887356 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:27:09.887326    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-7d1f11/auth-test-model-7d1f11-kserve-657b48b667-h69q5"
Jul 22 14:27:10.863082 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:27:10.863051    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-7d1f11/auth-test-model-7d1f11-kserve-657b48b667-h69q5"
Jul 22 14:27:31.462958 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:27:31.462915    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-f0b3df/auth-test-model-f0b3df-kserve-b7c467bdc-wbb5b"]
Jul 22 14:27:31.466695 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:27:31.466675    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f0b3df/auth-test-model-f0b3df-kserve-b7c467bdc-wbb5b"
Jul 22 14:27:31.469608 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:27:31.469583    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f0b3df\"/\"kube-root-ca.crt\""
Jul 22 14:27:31.469752 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:27:31.469583    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f0b3df\"/\"openshift-service-ca.crt\""
Jul 22 14:27:31.469752 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:27:31.469682    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f0b3df\"/\"default-dockercfg-b76ns\""
Jul 22 14:27:31.469752 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:27:31.469696    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f0b3df\"/\"auth-test-model-f0b3df-kserve-self-signed-certs\""
Jul 22 14:27:31.475113 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:27:31.475078    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f0b3df/auth-test-model-f0b3df-kserve-b7c467bdc-wbb5b"]
Jul 22 14:27:31.551881 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:27:31.551840    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f84803a9-3ab6-4e3d-af24-6e74f01cebf0-dshm\") pod \"auth-test-model-f0b3df-kserve-b7c467bdc-wbb5b\" (UID: \"f84803a9-3ab6-4e3d-af24-6e74f01cebf0\") " pod="ai-tenant-e2e-shared-b-f0b3df/auth-test-model-f0b3df-kserve-b7c467bdc-wbb5b"
Jul 22 14:27:31.551881 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:27:31.551882    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f84803a9-3ab6-4e3d-af24-6e74f01cebf0-model-cache\") pod \"auth-test-model-f0b3df-kserve-b7c467bdc-wbb5b\" (UID: \"f84803a9-3ab6-4e3d-af24-6e74f01cebf0\") " pod="ai-tenant-e2e-shared-b-f0b3df/auth-test-model-f0b3df-kserve-b7c467bdc-wbb5b"
Jul 22 14:27:31.552210 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:27:31.551910    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxr2f\" (UniqueName: \"kubernetes.io/projected/f84803a9-3ab6-4e3d-af24-6e74f01cebf0-kube-api-access-mxr2f\") pod \"auth-test-model-f0b3df-kserve-b7c467bdc-wbb5b\" (UID: \"f84803a9-3ab6-4e3d-af24-6e74f01cebf0\") " pod="ai-tenant-e2e-shared-b-f0b3df/auth-test-model-f0b3df-kserve-b7c467bdc-wbb5b"
Jul 22 14:27:31.552210 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:27:31.551988    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f84803a9-3ab6-4e3d-af24-6e74f01cebf0-tmp-dir\") pod \"auth-test-model-f0b3df-kserve-b7c467bdc-wbb5b\" (UID: \"f84803a9-3ab6-4e3d-af24-6e74f01cebf0\") " pod="ai-tenant-e2e-shared-b-f0b3df/auth-test-model-f0b3df-kserve-b7c467bdc-wbb5b"
Jul 22 14:27:31.552210 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:27:31.552125    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f84803a9-3ab6-4e3d-af24-6e74f01cebf0-home\") pod \"auth-test-model-f0b3df-kserve-b7c467bdc-wbb5b\" (UID: \"f84803a9-3ab6-4e3d-af24-6e74f01cebf0\") " pod="ai-tenant-e2e-shared-b-f0b3df/auth-test-model-f0b3df-kserve-b7c467bdc-wbb5b"
Jul 22 14:27:31.552210 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:27:31.552163    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f84803a9-3ab6-4e3d-af24-6e74f01cebf0-tls-certs\") pod \"auth-test-model-f0b3df-kserve-b7c467bdc-wbb5b\" (UID: \"f84803a9-3ab6-4e3d-af24-6e74f01cebf0\") " pod="ai-tenant-e2e-shared-b-f0b3df/auth-test-model-f0b3df-kserve-b7c467bdc-wbb5b"
Jul 22 14:27:31.653296 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:27:31.653246    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f84803a9-3ab6-4e3d-af24-6e74f01cebf0-home\") pod \"auth-test-model-f0b3df-kserve-b7c467bdc-wbb5b\" (UID: \"f84803a9-3ab6-4e3d-af24-6e74f01cebf0\") " pod="ai-tenant-e2e-shared-b-f0b3df/auth-test-model-f0b3df-kserve-b7c467bdc-wbb5b"
Jul 22 14:27:31.653296 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:27:31.653295    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f84803a9-3ab6-4e3d-af24-6e74f01cebf0-tls-certs\") pod \"auth-test-model-f0b3df-kserve-b7c467bdc-wbb5b\" (UID: \"f84803a9-3ab6-4e3d-af24-6e74f01cebf0\") " pod="ai-tenant-e2e-shared-b-f0b3df/auth-test-model-f0b3df-kserve-b7c467bdc-wbb5b"
Jul 22 14:27:31.653607 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:27:31.653331    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f84803a9-3ab6-4e3d-af24-6e74f01cebf0-dshm\") pod \"auth-test-model-f0b3df-kserve-b7c467bdc-wbb5b\" (UID: \"f84803a9-3ab6-4e3d-af24-6e74f01cebf0\") " pod="ai-tenant-e2e-shared-b-f0b3df/auth-test-model-f0b3df-kserve-b7c467bdc-wbb5b"
Jul 22 14:27:31.653607 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:27:31.653348    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f84803a9-3ab6-4e3d-af24-6e74f01cebf0-model-cache\") pod \"auth-test-model-f0b3df-kserve-b7c467bdc-wbb5b\" (UID: \"f84803a9-3ab6-4e3d-af24-6e74f01cebf0\") " pod="ai-tenant-e2e-shared-b-f0b3df/auth-test-model-f0b3df-kserve-b7c467bdc-wbb5b"
Jul 22 14:27:31.653607 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:27:31.653366    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxr2f\" (UniqueName: \"kubernetes.io/projected/f84803a9-3ab6-4e3d-af24-6e74f01cebf0-kube-api-access-mxr2f\") pod \"auth-test-model-f0b3df-kserve-b7c467bdc-wbb5b\" (UID: \"f84803a9-3ab6-4e3d-af24-6e74f01cebf0\") " pod="ai-tenant-e2e-shared-b-f0b3df/auth-test-model-f0b3df-kserve-b7c467bdc-wbb5b"
Jul 22 14:27:31.653607 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:27:31.653398    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f84803a9-3ab6-4e3d-af24-6e74f01cebf0-tmp-dir\") pod \"auth-test-model-f0b3df-kserve-b7c467bdc-wbb5b\" (UID: \"f84803a9-3ab6-4e3d-af24-6e74f01cebf0\") " pod="ai-tenant-e2e-shared-b-f0b3df/auth-test-model-f0b3df-kserve-b7c467bdc-wbb5b"
Jul 22 14:27:31.653831 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:27:31.653754    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f84803a9-3ab6-4e3d-af24-6e74f01cebf0-home\") pod \"auth-test-model-f0b3df-kserve-b7c467bdc-wbb5b\" (UID: \"f84803a9-3ab6-4e3d-af24-6e74f01cebf0\") " pod="ai-tenant-e2e-shared-b-f0b3df/auth-test-model-f0b3df-kserve-b7c467bdc-wbb5b"
Jul 22 14:27:31.653831 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:27:31.653804    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f84803a9-3ab6-4e3d-af24-6e74f01cebf0-tmp-dir\") pod \"auth-test-model-f0b3df-kserve-b7c467bdc-wbb5b\" (UID: \"f84803a9-3ab6-4e3d-af24-6e74f01cebf0\") " pod="ai-tenant-e2e-shared-b-f0b3df/auth-test-model-f0b3df-kserve-b7c467bdc-wbb5b"
Jul 22 14:27:31.653915 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:27:31.653853    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f84803a9-3ab6-4e3d-af24-6e74f01cebf0-model-cache\") pod \"auth-test-model-f0b3df-kserve-b7c467bdc-wbb5b\" (UID: \"f84803a9-3ab6-4e3d-af24-6e74f01cebf0\") " pod="ai-tenant-e2e-shared-b-f0b3df/auth-test-model-f0b3df-kserve-b7c467bdc-wbb5b"
Jul 22 14:27:31.655701 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:27:31.655673    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f84803a9-3ab6-4e3d-af24-6e74f01cebf0-dshm\") pod \"auth-test-model-f0b3df-kserve-b7c467bdc-wbb5b\" (UID: \"f84803a9-3ab6-4e3d-af24-6e74f01cebf0\") " pod="ai-tenant-e2e-shared-b-f0b3df/auth-test-model-f0b3df-kserve-b7c467bdc-wbb5b"
Jul 22 14:27:31.655966 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:27:31.655945    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f84803a9-3ab6-4e3d-af24-6e74f01cebf0-tls-certs\") pod \"auth-test-model-f0b3df-kserve-b7c467bdc-wbb5b\" (UID: \"f84803a9-3ab6-4e3d-af24-6e74f01cebf0\") " pod="ai-tenant-e2e-shared-b-f0b3df/auth-test-model-f0b3df-kserve-b7c467bdc-wbb5b"
Jul 22 14:27:31.660865 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:27:31.660842    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxr2f\" (UniqueName: \"kubernetes.io/projected/f84803a9-3ab6-4e3d-af24-6e74f01cebf0-kube-api-access-mxr2f\") pod \"auth-test-model-f0b3df-kserve-b7c467bdc-wbb5b\" (UID: \"f84803a9-3ab6-4e3d-af24-6e74f01cebf0\") " pod="ai-tenant-e2e-shared-b-f0b3df/auth-test-model-f0b3df-kserve-b7c467bdc-wbb5b"
Jul 22 14:27:31.777671 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:27:31.777581    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f0b3df/auth-test-model-f0b3df-kserve-b7c467bdc-wbb5b"
Jul 22 14:27:31.916446 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:27:31.916417    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f0b3df/auth-test-model-f0b3df-kserve-b7c467bdc-wbb5b"]
Jul 22 14:27:31.918307 ip-10-0-129-134 kubenswrapper[2571]: W0722 14:27:31.918282    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf84803a9_3ab6_4e3d_af24_6e74f01cebf0.slice/crio-f1ccf6d44136cc58a3d1dff55ff171880668bd31ab1d8d5f8ecfdbbd54b90e83 WatchSource:0}: Error finding container f1ccf6d44136cc58a3d1dff55ff171880668bd31ab1d8d5f8ecfdbbd54b90e83: Status 404 returned error can't find the container with id f1ccf6d44136cc58a3d1dff55ff171880668bd31ab1d8d5f8ecfdbbd54b90e83
Jul 22 14:27:31.958187 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:27:31.958151    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f0b3df/auth-test-model-f0b3df-kserve-b7c467bdc-wbb5b" event={"ID":"f84803a9-3ab6-4e3d-af24-6e74f01cebf0","Type":"ContainerStarted","Data":"f1ccf6d44136cc58a3d1dff55ff171880668bd31ab1d8d5f8ecfdbbd54b90e83"}
Jul 22 14:27:32.967901 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:27:32.967858    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f0b3df/auth-test-model-f0b3df-kserve-b7c467bdc-wbb5b" event={"ID":"f84803a9-3ab6-4e3d-af24-6e74f01cebf0","Type":"ContainerStarted","Data":"62f39bf29bb54de723065206b4d9f99f26eaeb9e4c4b44b1f9805e312cd2714c"}
Jul 22 14:27:32.987224 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:27:32.987175    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-f0b3df/auth-test-model-f0b3df-kserve-b7c467bdc-wbb5b" podStartSLOduration=1.98716028 podStartE2EDuration="1.98716028s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 14:27:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 14:27:32.985915448 +0000 UTC m=+2463.040692124" watchObservedRunningTime="2026-07-22 14:27:32.98716028 +0000 UTC m=+2463.041937002"
Jul 22 14:27:35.062738 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:27:35.062704    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:27:41.778470 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:27:41.778395    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-f0b3df/auth-test-model-f0b3df-kserve-b7c467bdc-wbb5b"
Jul 22 14:27:41.778470 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:27:41.778477    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-f0b3df/auth-test-model-f0b3df-kserve-b7c467bdc-wbb5b"
Jul 22 14:27:41.791144 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:27:41.791112    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-f0b3df/auth-test-model-f0b3df-kserve-b7c467bdc-wbb5b"
Jul 22 14:27:42.021930 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:27:42.021893    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-f0b3df/auth-test-model-f0b3df-kserve-b7c467bdc-wbb5b"
Jul 22 14:28:04.165551 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:28:04.165511    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:28:19.457064 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:28:19.457031    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:28:35.960869 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:28:35.960774    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:28:54.463497 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:28:54.463461    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:29:09.261673 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:09.261637    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:29:27.258634 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:27.258598    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:29:42.370864 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:42.370824    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-7d1f11/auth-test-model-7d1f11-kserve-657b48b667-h69q5"]
Jul 22 14:29:43.164443 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:43.164392    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f0b3df/auth-test-model-f0b3df-kserve-b7c467bdc-wbb5b"]
Jul 22 14:29:46.357897 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:46.357866    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:29:50.643254 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:50.643223    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-7d1f11/sub-test-model-7d1f11-kserve-cb656fb59-654kd"]
Jul 22 14:29:50.646761 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:50.646741    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7d1f11/sub-test-model-7d1f11-kserve-cb656fb59-654kd"
Jul 22 14:29:50.648631 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:50.648614    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-7d1f11\"/\"sub-test-model-7d1f11-kserve-self-signed-certs\""
Jul 22 14:29:50.654145 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:50.654118    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-7d1f11/sub-test-model-7d1f11-kserve-cb656fb59-654kd"]
Jul 22 14:29:50.737217 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:50.737185    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e-dshm\") pod \"sub-test-model-7d1f11-kserve-cb656fb59-654kd\" (UID: \"fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e\") " pod="ai-tenant-e2e-shared-a-7d1f11/sub-test-model-7d1f11-kserve-cb656fb59-654kd"
Jul 22 14:29:50.737399 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:50.737247    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwk5l\" (UniqueName: \"kubernetes.io/projected/fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e-kube-api-access-xwk5l\") pod \"sub-test-model-7d1f11-kserve-cb656fb59-654kd\" (UID: \"fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e\") " pod="ai-tenant-e2e-shared-a-7d1f11/sub-test-model-7d1f11-kserve-cb656fb59-654kd"
Jul 22 14:29:50.737399 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:50.737285    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e-tls-certs\") pod \"sub-test-model-7d1f11-kserve-cb656fb59-654kd\" (UID: \"fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e\") " pod="ai-tenant-e2e-shared-a-7d1f11/sub-test-model-7d1f11-kserve-cb656fb59-654kd"
Jul 22 14:29:50.737399 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:50.737307    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e-home\") pod \"sub-test-model-7d1f11-kserve-cb656fb59-654kd\" (UID: \"fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e\") " pod="ai-tenant-e2e-shared-a-7d1f11/sub-test-model-7d1f11-kserve-cb656fb59-654kd"
Jul 22 14:29:50.737555 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:50.737456    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e-model-cache\") pod \"sub-test-model-7d1f11-kserve-cb656fb59-654kd\" (UID: \"fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e\") " pod="ai-tenant-e2e-shared-a-7d1f11/sub-test-model-7d1f11-kserve-cb656fb59-654kd"
Jul 22 14:29:50.737555 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:50.737501    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e-tmp-dir\") pod \"sub-test-model-7d1f11-kserve-cb656fb59-654kd\" (UID: \"fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e\") " pod="ai-tenant-e2e-shared-a-7d1f11/sub-test-model-7d1f11-kserve-cb656fb59-654kd"
Jul 22 14:29:50.838335 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:50.838296    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e-model-cache\") pod \"sub-test-model-7d1f11-kserve-cb656fb59-654kd\" (UID: \"fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e\") " pod="ai-tenant-e2e-shared-a-7d1f11/sub-test-model-7d1f11-kserve-cb656fb59-654kd"
Jul 22 14:29:50.838335 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:50.838343    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e-tmp-dir\") pod \"sub-test-model-7d1f11-kserve-cb656fb59-654kd\" (UID: \"fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e\") " pod="ai-tenant-e2e-shared-a-7d1f11/sub-test-model-7d1f11-kserve-cb656fb59-654kd"
Jul 22 14:29:50.838639 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:50.838378    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e-dshm\") pod \"sub-test-model-7d1f11-kserve-cb656fb59-654kd\" (UID: \"fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e\") " pod="ai-tenant-e2e-shared-a-7d1f11/sub-test-model-7d1f11-kserve-cb656fb59-654kd"
Jul 22 14:29:50.838639 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:50.838442    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwk5l\" (UniqueName: \"kubernetes.io/projected/fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e-kube-api-access-xwk5l\") pod \"sub-test-model-7d1f11-kserve-cb656fb59-654kd\" (UID: \"fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e\") " pod="ai-tenant-e2e-shared-a-7d1f11/sub-test-model-7d1f11-kserve-cb656fb59-654kd"
Jul 22 14:29:50.838639 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:50.838466    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e-tls-certs\") pod \"sub-test-model-7d1f11-kserve-cb656fb59-654kd\" (UID: \"fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e\") " pod="ai-tenant-e2e-shared-a-7d1f11/sub-test-model-7d1f11-kserve-cb656fb59-654kd"
Jul 22 14:29:50.838639 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:50.838484    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e-home\") pod \"sub-test-model-7d1f11-kserve-cb656fb59-654kd\" (UID: \"fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e\") " pod="ai-tenant-e2e-shared-a-7d1f11/sub-test-model-7d1f11-kserve-cb656fb59-654kd"
Jul 22 14:29:50.838842 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:50.838821    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e-tmp-dir\") pod \"sub-test-model-7d1f11-kserve-cb656fb59-654kd\" (UID: \"fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e\") " pod="ai-tenant-e2e-shared-a-7d1f11/sub-test-model-7d1f11-kserve-cb656fb59-654kd"
Jul 22 14:29:50.838904 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:50.838884    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e-model-cache\") pod \"sub-test-model-7d1f11-kserve-cb656fb59-654kd\" (UID: \"fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e\") " pod="ai-tenant-e2e-shared-a-7d1f11/sub-test-model-7d1f11-kserve-cb656fb59-654kd"
Jul 22 14:29:50.838966 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:50.838947    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e-home\") pod \"sub-test-model-7d1f11-kserve-cb656fb59-654kd\" (UID: \"fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e\") " pod="ai-tenant-e2e-shared-a-7d1f11/sub-test-model-7d1f11-kserve-cb656fb59-654kd"
Jul 22 14:29:50.840767 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:50.840750    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e-dshm\") pod \"sub-test-model-7d1f11-kserve-cb656fb59-654kd\" (UID: \"fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e\") " pod="ai-tenant-e2e-shared-a-7d1f11/sub-test-model-7d1f11-kserve-cb656fb59-654kd"
Jul 22 14:29:50.840947 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:50.840929    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e-tls-certs\") pod \"sub-test-model-7d1f11-kserve-cb656fb59-654kd\" (UID: \"fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e\") " pod="ai-tenant-e2e-shared-a-7d1f11/sub-test-model-7d1f11-kserve-cb656fb59-654kd"
Jul 22 14:29:50.845842 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:50.845820    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwk5l\" (UniqueName: \"kubernetes.io/projected/fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e-kube-api-access-xwk5l\") pod \"sub-test-model-7d1f11-kserve-cb656fb59-654kd\" (UID: \"fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e\") " pod="ai-tenant-e2e-shared-a-7d1f11/sub-test-model-7d1f11-kserve-cb656fb59-654kd"
Jul 22 14:29:50.956834 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:50.956730    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7d1f11/sub-test-model-7d1f11-kserve-cb656fb59-654kd"
Jul 22 14:29:51.096938 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:51.096906    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-7d1f11/sub-test-model-7d1f11-kserve-cb656fb59-654kd"]
Jul 22 14:29:51.099372 ip-10-0-129-134 kubenswrapper[2571]: W0722 14:29:51.099332    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfbcb5cf5_afbf_481f_acbd_f0f474f6ae6e.slice/crio-5c84b3d1fa1ee0ffb08a778f44bacd8a87915b8d0e5c0a402ea93f041a360664 WatchSource:0}: Error finding container 5c84b3d1fa1ee0ffb08a778f44bacd8a87915b8d0e5c0a402ea93f041a360664: Status 404 returned error can't find the container with id 5c84b3d1fa1ee0ffb08a778f44bacd8a87915b8d0e5c0a402ea93f041a360664
Jul 22 14:29:51.651786 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:51.651750    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7d1f11/sub-test-model-7d1f11-kserve-cb656fb59-654kd" event={"ID":"fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e","Type":"ContainerStarted","Data":"535d984f3c09f1ccb483857a2eb68df9db22722d24f6321e877fa6bfa1b5ee5f"}
Jul 22 14:29:51.652265 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:51.651800    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7d1f11/sub-test-model-7d1f11-kserve-cb656fb59-654kd" event={"ID":"fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e","Type":"ContainerStarted","Data":"5c84b3d1fa1ee0ffb08a778f44bacd8a87915b8d0e5c0a402ea93f041a360664"}
Jul 22 14:29:51.670042 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:51.669997    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-7d1f11/sub-test-model-7d1f11-kserve-cb656fb59-654kd" podStartSLOduration=1.6699836019999998 podStartE2EDuration="1.669983602s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 14:29:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 14:29:51.668296427 +0000 UTC m=+2601.723073116" watchObservedRunningTime="2026-07-22 14:29:51.669983602 +0000 UTC m=+2601.724760278"
Jul 22 14:29:57.391754 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:57.391693    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-7d1f11/auth-test-model-7d1f11-kserve-657b48b667-h69q5" podUID="a4a7ed30-16fe-462a-8e3f-f70f6cf01642" containerName="main" containerID="cri-o://8891706677e1e079994dc55537f746ea0a86155d0d9df9cab01320d85b084934" gracePeriod=45
Jul 22 14:29:57.641198 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:57.641171    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7d1f11/auth-test-model-7d1f11-kserve-657b48b667-h69q5"
Jul 22 14:29:57.683193 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:57.683109    2571 generic.go:356] "Generic (PLEG): container finished" podID="a4a7ed30-16fe-462a-8e3f-f70f6cf01642" containerID="8891706677e1e079994dc55537f746ea0a86155d0d9df9cab01320d85b084934" exitCode=0
Jul 22 14:29:57.683193 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:57.683152    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7d1f11/auth-test-model-7d1f11-kserve-657b48b667-h69q5"
Jul 22 14:29:57.683372 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:57.683154    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7d1f11/auth-test-model-7d1f11-kserve-657b48b667-h69q5" event={"ID":"a4a7ed30-16fe-462a-8e3f-f70f6cf01642","Type":"ContainerDied","Data":"8891706677e1e079994dc55537f746ea0a86155d0d9df9cab01320d85b084934"}
Jul 22 14:29:57.683372 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:57.683277    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7d1f11/auth-test-model-7d1f11-kserve-657b48b667-h69q5" event={"ID":"a4a7ed30-16fe-462a-8e3f-f70f6cf01642","Type":"ContainerDied","Data":"9d50dd94b209515549eb3d05d89a73afcf058299f2294e6bba62ab7098cb7611"}
Jul 22 14:29:57.683372 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:57.683297    2571 scope.go:117] "RemoveContainer" containerID="8891706677e1e079994dc55537f746ea0a86155d0d9df9cab01320d85b084934"
Jul 22 14:29:57.693578 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:57.693554    2571 scope.go:117] "RemoveContainer" containerID="8891706677e1e079994dc55537f746ea0a86155d0d9df9cab01320d85b084934"
Jul 22 14:29:57.693850 ip-10-0-129-134 kubenswrapper[2571]: E0722 14:29:57.693829    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8891706677e1e079994dc55537f746ea0a86155d0d9df9cab01320d85b084934\": container with ID starting with 8891706677e1e079994dc55537f746ea0a86155d0d9df9cab01320d85b084934 not found: ID does not exist" containerID="8891706677e1e079994dc55537f746ea0a86155d0d9df9cab01320d85b084934"
Jul 22 14:29:57.693901 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:57.693859    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8891706677e1e079994dc55537f746ea0a86155d0d9df9cab01320d85b084934"} err="failed to get container status \"8891706677e1e079994dc55537f746ea0a86155d0d9df9cab01320d85b084934\": rpc error: code = NotFound desc = could not find container \"8891706677e1e079994dc55537f746ea0a86155d0d9df9cab01320d85b084934\": container with ID starting with 8891706677e1e079994dc55537f746ea0a86155d0d9df9cab01320d85b084934 not found: ID does not exist"
Jul 22 14:29:57.704239 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:57.704209    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a4a7ed30-16fe-462a-8e3f-f70f6cf01642-dshm\") pod \"a4a7ed30-16fe-462a-8e3f-f70f6cf01642\" (UID: \"a4a7ed30-16fe-462a-8e3f-f70f6cf01642\") "
Jul 22 14:29:57.704359 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:57.704241    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kgknw\" (UniqueName: \"kubernetes.io/projected/a4a7ed30-16fe-462a-8e3f-f70f6cf01642-kube-api-access-kgknw\") pod \"a4a7ed30-16fe-462a-8e3f-f70f6cf01642\" (UID: \"a4a7ed30-16fe-462a-8e3f-f70f6cf01642\") "
Jul 22 14:29:57.704359 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:57.704262    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4a7ed30-16fe-462a-8e3f-f70f6cf01642-tls-certs\") pod \"a4a7ed30-16fe-462a-8e3f-f70f6cf01642\" (UID: \"a4a7ed30-16fe-462a-8e3f-f70f6cf01642\") "
Jul 22 14:29:57.704359 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:57.704347    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a4a7ed30-16fe-462a-8e3f-f70f6cf01642-model-cache\") pod \"a4a7ed30-16fe-462a-8e3f-f70f6cf01642\" (UID: \"a4a7ed30-16fe-462a-8e3f-f70f6cf01642\") "
Jul 22 14:29:57.704493 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:57.704440    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4a7ed30-16fe-462a-8e3f-f70f6cf01642-tmp-dir\") pod \"a4a7ed30-16fe-462a-8e3f-f70f6cf01642\" (UID: \"a4a7ed30-16fe-462a-8e3f-f70f6cf01642\") "
Jul 22 14:29:57.704493 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:57.704468    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a4a7ed30-16fe-462a-8e3f-f70f6cf01642-home\") pod \"a4a7ed30-16fe-462a-8e3f-f70f6cf01642\" (UID: \"a4a7ed30-16fe-462a-8e3f-f70f6cf01642\") "
Jul 22 14:29:57.704698 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:57.704643    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4a7ed30-16fe-462a-8e3f-f70f6cf01642-model-cache" (OuterVolumeSpecName: "model-cache") pod "a4a7ed30-16fe-462a-8e3f-f70f6cf01642" (UID: "a4a7ed30-16fe-462a-8e3f-f70f6cf01642"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 14:29:57.704823 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:57.704725    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4a7ed30-16fe-462a-8e3f-f70f6cf01642-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a4a7ed30-16fe-462a-8e3f-f70f6cf01642" (UID: "a4a7ed30-16fe-462a-8e3f-f70f6cf01642"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 14:29:57.704874 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:57.704817    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4a7ed30-16fe-462a-8e3f-f70f6cf01642-home" (OuterVolumeSpecName: "home") pod "a4a7ed30-16fe-462a-8e3f-f70f6cf01642" (UID: "a4a7ed30-16fe-462a-8e3f-f70f6cf01642"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 14:29:57.704935 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:57.704918    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a4a7ed30-16fe-462a-8e3f-f70f6cf01642-model-cache\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 14:29:57.704980 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:57.704937    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4a7ed30-16fe-462a-8e3f-f70f6cf01642-tmp-dir\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 14:29:57.704980 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:57.704950    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a4a7ed30-16fe-462a-8e3f-f70f6cf01642-home\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 14:29:57.706641 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:57.706620    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4a7ed30-16fe-462a-8e3f-f70f6cf01642-dshm" (OuterVolumeSpecName: "dshm") pod "a4a7ed30-16fe-462a-8e3f-f70f6cf01642" (UID: "a4a7ed30-16fe-462a-8e3f-f70f6cf01642"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 14:29:57.706641 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:57.706634    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4a7ed30-16fe-462a-8e3f-f70f6cf01642-kube-api-access-kgknw" (OuterVolumeSpecName: "kube-api-access-kgknw") pod "a4a7ed30-16fe-462a-8e3f-f70f6cf01642" (UID: "a4a7ed30-16fe-462a-8e3f-f70f6cf01642"). InnerVolumeSpecName "kube-api-access-kgknw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 14:29:57.706777 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:57.706647    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4a7ed30-16fe-462a-8e3f-f70f6cf01642-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a4a7ed30-16fe-462a-8e3f-f70f6cf01642" (UID: "a4a7ed30-16fe-462a-8e3f-f70f6cf01642"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 14:29:57.805855 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:57.805811    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a4a7ed30-16fe-462a-8e3f-f70f6cf01642-dshm\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 14:29:57.805855 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:57.805845    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kgknw\" (UniqueName: \"kubernetes.io/projected/a4a7ed30-16fe-462a-8e3f-f70f6cf01642-kube-api-access-kgknw\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 14:29:57.805855 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:57.805859    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4a7ed30-16fe-462a-8e3f-f70f6cf01642-tls-certs\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 14:29:58.005109 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:58.005081    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-7d1f11/auth-test-model-7d1f11-kserve-657b48b667-h69q5"]
Jul 22 14:29:58.009728 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:58.009696    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-7d1f11/auth-test-model-7d1f11-kserve-657b48b667-h69q5"]
Jul 22 14:29:58.185109 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:58.185064    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-f0b3df/auth-test-model-f0b3df-kserve-b7c467bdc-wbb5b" podUID="f84803a9-3ab6-4e3d-af24-6e74f01cebf0" containerName="main" containerID="cri-o://62f39bf29bb54de723065206b4d9f99f26eaeb9e4c4b44b1f9805e312cd2714c" gracePeriod=45
Jul 22 14:29:58.443322 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:58.443297    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f0b3df/auth-test-model-f0b3df-kserve-b7c467bdc-wbb5b"
Jul 22 14:29:58.513061 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:58.513019    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f84803a9-3ab6-4e3d-af24-6e74f01cebf0-dshm\") pod \"f84803a9-3ab6-4e3d-af24-6e74f01cebf0\" (UID: \"f84803a9-3ab6-4e3d-af24-6e74f01cebf0\") "
Jul 22 14:29:58.513061 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:58.513058    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f84803a9-3ab6-4e3d-af24-6e74f01cebf0-home\") pod \"f84803a9-3ab6-4e3d-af24-6e74f01cebf0\" (UID: \"f84803a9-3ab6-4e3d-af24-6e74f01cebf0\") "
Jul 22 14:29:58.513324 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:58.513084    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f84803a9-3ab6-4e3d-af24-6e74f01cebf0-tls-certs\") pod \"f84803a9-3ab6-4e3d-af24-6e74f01cebf0\" (UID: \"f84803a9-3ab6-4e3d-af24-6e74f01cebf0\") "
Jul 22 14:29:58.513324 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:58.513159    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f84803a9-3ab6-4e3d-af24-6e74f01cebf0-tmp-dir\") pod \"f84803a9-3ab6-4e3d-af24-6e74f01cebf0\" (UID: \"f84803a9-3ab6-4e3d-af24-6e74f01cebf0\") "
Jul 22 14:29:58.513324 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:58.513204    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f84803a9-3ab6-4e3d-af24-6e74f01cebf0-model-cache\") pod \"f84803a9-3ab6-4e3d-af24-6e74f01cebf0\" (UID: \"f84803a9-3ab6-4e3d-af24-6e74f01cebf0\") "
Jul 22 14:29:58.513324 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:58.513261    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mxr2f\" (UniqueName: \"kubernetes.io/projected/f84803a9-3ab6-4e3d-af24-6e74f01cebf0-kube-api-access-mxr2f\") pod \"f84803a9-3ab6-4e3d-af24-6e74f01cebf0\" (UID: \"f84803a9-3ab6-4e3d-af24-6e74f01cebf0\") "
Jul 22 14:29:58.513561 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:58.513369    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f84803a9-3ab6-4e3d-af24-6e74f01cebf0-home" (OuterVolumeSpecName: "home") pod "f84803a9-3ab6-4e3d-af24-6e74f01cebf0" (UID: "f84803a9-3ab6-4e3d-af24-6e74f01cebf0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 14:29:58.513561 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:58.513398    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f84803a9-3ab6-4e3d-af24-6e74f01cebf0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f84803a9-3ab6-4e3d-af24-6e74f01cebf0" (UID: "f84803a9-3ab6-4e3d-af24-6e74f01cebf0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 14:29:58.513561 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:58.513528    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f84803a9-3ab6-4e3d-af24-6e74f01cebf0-model-cache" (OuterVolumeSpecName: "model-cache") pod "f84803a9-3ab6-4e3d-af24-6e74f01cebf0" (UID: "f84803a9-3ab6-4e3d-af24-6e74f01cebf0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 14:29:58.513674 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:58.513663    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f84803a9-3ab6-4e3d-af24-6e74f01cebf0-home\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 14:29:58.513711 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:58.513700    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f84803a9-3ab6-4e3d-af24-6e74f01cebf0-tmp-dir\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 14:29:58.513748 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:58.513711    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f84803a9-3ab6-4e3d-af24-6e74f01cebf0-model-cache\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 14:29:58.515521 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:58.515497    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f84803a9-3ab6-4e3d-af24-6e74f01cebf0-kube-api-access-mxr2f" (OuterVolumeSpecName: "kube-api-access-mxr2f") pod "f84803a9-3ab6-4e3d-af24-6e74f01cebf0" (UID: "f84803a9-3ab6-4e3d-af24-6e74f01cebf0"). InnerVolumeSpecName "kube-api-access-mxr2f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 14:29:58.515753 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:58.515719    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f84803a9-3ab6-4e3d-af24-6e74f01cebf0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f84803a9-3ab6-4e3d-af24-6e74f01cebf0" (UID: "f84803a9-3ab6-4e3d-af24-6e74f01cebf0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 14:29:58.515753 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:58.515727    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f84803a9-3ab6-4e3d-af24-6e74f01cebf0-dshm" (OuterVolumeSpecName: "dshm") pod "f84803a9-3ab6-4e3d-af24-6e74f01cebf0" (UID: "f84803a9-3ab6-4e3d-af24-6e74f01cebf0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 14:29:58.614292 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:58.614202    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mxr2f\" (UniqueName: \"kubernetes.io/projected/f84803a9-3ab6-4e3d-af24-6e74f01cebf0-kube-api-access-mxr2f\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 14:29:58.614292 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:58.614232    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f84803a9-3ab6-4e3d-af24-6e74f01cebf0-dshm\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 14:29:58.614292 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:58.614242    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f84803a9-3ab6-4e3d-af24-6e74f01cebf0-tls-certs\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 14:29:58.690664 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:58.690628    2571 generic.go:356] "Generic (PLEG): container finished" podID="f84803a9-3ab6-4e3d-af24-6e74f01cebf0" containerID="62f39bf29bb54de723065206b4d9f99f26eaeb9e4c4b44b1f9805e312cd2714c" exitCode=0
Jul 22 14:29:58.690843 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:58.690686    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f0b3df/auth-test-model-f0b3df-kserve-b7c467bdc-wbb5b"
Jul 22 14:29:58.690843 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:58.690714    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f0b3df/auth-test-model-f0b3df-kserve-b7c467bdc-wbb5b" event={"ID":"f84803a9-3ab6-4e3d-af24-6e74f01cebf0","Type":"ContainerDied","Data":"62f39bf29bb54de723065206b4d9f99f26eaeb9e4c4b44b1f9805e312cd2714c"}
Jul 22 14:29:58.690843 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:58.690758    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f0b3df/auth-test-model-f0b3df-kserve-b7c467bdc-wbb5b" event={"ID":"f84803a9-3ab6-4e3d-af24-6e74f01cebf0","Type":"ContainerDied","Data":"f1ccf6d44136cc58a3d1dff55ff171880668bd31ab1d8d5f8ecfdbbd54b90e83"}
Jul 22 14:29:58.690843 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:58.690776    2571 scope.go:117] "RemoveContainer" containerID="62f39bf29bb54de723065206b4d9f99f26eaeb9e4c4b44b1f9805e312cd2714c"
Jul 22 14:29:58.700340 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:58.700304    2571 scope.go:117] "RemoveContainer" containerID="62f39bf29bb54de723065206b4d9f99f26eaeb9e4c4b44b1f9805e312cd2714c"
Jul 22 14:29:58.700668 ip-10-0-129-134 kubenswrapper[2571]: E0722 14:29:58.700646    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62f39bf29bb54de723065206b4d9f99f26eaeb9e4c4b44b1f9805e312cd2714c\": container with ID starting with 62f39bf29bb54de723065206b4d9f99f26eaeb9e4c4b44b1f9805e312cd2714c not found: ID does not exist" containerID="62f39bf29bb54de723065206b4d9f99f26eaeb9e4c4b44b1f9805e312cd2714c"
Jul 22 14:29:58.700754 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:58.700673    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62f39bf29bb54de723065206b4d9f99f26eaeb9e4c4b44b1f9805e312cd2714c"} err="failed to get container status \"62f39bf29bb54de723065206b4d9f99f26eaeb9e4c4b44b1f9805e312cd2714c\": rpc error: code = NotFound desc = could not find container \"62f39bf29bb54de723065206b4d9f99f26eaeb9e4c4b44b1f9805e312cd2714c\": container with ID starting with 62f39bf29bb54de723065206b4d9f99f26eaeb9e4c4b44b1f9805e312cd2714c not found: ID does not exist"
Jul 22 14:29:58.711573 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:58.711541    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f0b3df/auth-test-model-f0b3df-kserve-b7c467bdc-wbb5b"]
Jul 22 14:29:58.715952 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:58.715921    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-f0b3df/auth-test-model-f0b3df-kserve-b7c467bdc-wbb5b"]
Jul 22 14:29:59.010425 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:59.010320    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4a7ed30-16fe-462a-8e3f-f70f6cf01642" path="/var/lib/kubelet/pods/a4a7ed30-16fe-462a-8e3f-f70f6cf01642/volumes"
Jul 22 14:29:59.010909 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:59.010892    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f84803a9-3ab6-4e3d-af24-6e74f01cebf0" path="/var/lib/kubelet/pods/f84803a9-3ab6-4e3d-af24-6e74f01cebf0/volumes"
Jul 22 14:29:59.663887 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:29:59.663847    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:30:00.956870 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:30:00.956832    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-7d1f11/sub-test-model-7d1f11-kserve-cb656fb59-654kd"
Jul 22 14:30:00.957269 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:30:00.956888    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-7d1f11/sub-test-model-7d1f11-kserve-cb656fb59-654kd"
Jul 22 14:30:00.969517 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:30:00.969490    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-7d1f11/sub-test-model-7d1f11-kserve-cb656fb59-654kd"
Jul 22 14:30:01.717356 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:30:01.717327    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-7d1f11/sub-test-model-7d1f11-kserve-cb656fb59-654kd"
Jul 22 14:30:14.961094 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:30:14.961056    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-f0b3df/sub-test-model-f0b3df-kserve-5d6444688f-9vgnb"]
Jul 22 14:30:14.961724 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:30:14.961670    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4a7ed30-16fe-462a-8e3f-f70f6cf01642" containerName="main"
Jul 22 14:30:14.961724 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:30:14.961687    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4a7ed30-16fe-462a-8e3f-f70f6cf01642" containerName="main"
Jul 22 14:30:14.961724 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:30:14.961702    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f84803a9-3ab6-4e3d-af24-6e74f01cebf0" containerName="main"
Jul 22 14:30:14.961724 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:30:14.961710    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="f84803a9-3ab6-4e3d-af24-6e74f01cebf0" containerName="main"
Jul 22 14:30:14.961963 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:30:14.961806    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="f84803a9-3ab6-4e3d-af24-6e74f01cebf0" containerName="main"
Jul 22 14:30:14.961963 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:30:14.961820    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4a7ed30-16fe-462a-8e3f-f70f6cf01642" containerName="main"
Jul 22 14:30:14.965192 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:30:14.965163    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f0b3df/sub-test-model-f0b3df-kserve-5d6444688f-9vgnb"
Jul 22 14:30:14.967859 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:30:14.967834    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f0b3df\"/\"openshift-service-ca.crt\""
Jul 22 14:30:14.967996 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:30:14.967834    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f0b3df\"/\"default-dockercfg-b76ns\""
Jul 22 14:30:14.967996 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:30:14.967881    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f0b3df\"/\"kube-root-ca.crt\""
Jul 22 14:30:14.967996 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:30:14.967839    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f0b3df\"/\"sub-test-model-f0b3df-kserve-self-signed-certs\""
Jul 22 14:30:14.972183 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:30:14.972162    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f0b3df/sub-test-model-f0b3df-kserve-5d6444688f-9vgnb"]
Jul 22 14:30:15.077067 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:30:15.077023    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93770ec8-0479-447c-a8ca-f0a3e4c605ad-home\") pod \"sub-test-model-f0b3df-kserve-5d6444688f-9vgnb\" (UID: \"93770ec8-0479-447c-a8ca-f0a3e4c605ad\") " pod="ai-tenant-e2e-shared-b-f0b3df/sub-test-model-f0b3df-kserve-5d6444688f-9vgnb"
Jul 22 14:30:15.077264 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:30:15.077104    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93770ec8-0479-447c-a8ca-f0a3e4c605ad-dshm\") pod \"sub-test-model-f0b3df-kserve-5d6444688f-9vgnb\" (UID: \"93770ec8-0479-447c-a8ca-f0a3e4c605ad\") " pod="ai-tenant-e2e-shared-b-f0b3df/sub-test-model-f0b3df-kserve-5d6444688f-9vgnb"
Jul 22 14:30:15.077264 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:30:15.077133    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93770ec8-0479-447c-a8ca-f0a3e4c605ad-model-cache\") pod \"sub-test-model-f0b3df-kserve-5d6444688f-9vgnb\" (UID: \"93770ec8-0479-447c-a8ca-f0a3e4c605ad\") " pod="ai-tenant-e2e-shared-b-f0b3df/sub-test-model-f0b3df-kserve-5d6444688f-9vgnb"
Jul 22 14:30:15.077264 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:30:15.077160    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93770ec8-0479-447c-a8ca-f0a3e4c605ad-tls-certs\") pod \"sub-test-model-f0b3df-kserve-5d6444688f-9vgnb\" (UID: \"93770ec8-0479-447c-a8ca-f0a3e4c605ad\") " pod="ai-tenant-e2e-shared-b-f0b3df/sub-test-model-f0b3df-kserve-5d6444688f-9vgnb"
Jul 22 14:30:15.077393 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:30:15.077274    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghv49\" (UniqueName: \"kubernetes.io/projected/93770ec8-0479-447c-a8ca-f0a3e4c605ad-kube-api-access-ghv49\") pod \"sub-test-model-f0b3df-kserve-5d6444688f-9vgnb\" (UID: \"93770ec8-0479-447c-a8ca-f0a3e4c605ad\") " pod="ai-tenant-e2e-shared-b-f0b3df/sub-test-model-f0b3df-kserve-5d6444688f-9vgnb"
Jul 22 14:30:15.077393 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:30:15.077332    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93770ec8-0479-447c-a8ca-f0a3e4c605ad-tmp-dir\") pod \"sub-test-model-f0b3df-kserve-5d6444688f-9vgnb\" (UID: \"93770ec8-0479-447c-a8ca-f0a3e4c605ad\") " pod="ai-tenant-e2e-shared-b-f0b3df/sub-test-model-f0b3df-kserve-5d6444688f-9vgnb"
Jul 22 14:30:15.178467 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:30:15.178383    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93770ec8-0479-447c-a8ca-f0a3e4c605ad-home\") pod \"sub-test-model-f0b3df-kserve-5d6444688f-9vgnb\" (UID: \"93770ec8-0479-447c-a8ca-f0a3e4c605ad\") " pod="ai-tenant-e2e-shared-b-f0b3df/sub-test-model-f0b3df-kserve-5d6444688f-9vgnb"
Jul 22 14:30:15.178687 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:30:15.178516    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93770ec8-0479-447c-a8ca-f0a3e4c605ad-dshm\") pod \"sub-test-model-f0b3df-kserve-5d6444688f-9vgnb\" (UID: \"93770ec8-0479-447c-a8ca-f0a3e4c605ad\") " pod="ai-tenant-e2e-shared-b-f0b3df/sub-test-model-f0b3df-kserve-5d6444688f-9vgnb"
Jul 22 14:30:15.178687 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:30:15.178556    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93770ec8-0479-447c-a8ca-f0a3e4c605ad-model-cache\") pod \"sub-test-model-f0b3df-kserve-5d6444688f-9vgnb\" (UID: \"93770ec8-0479-447c-a8ca-f0a3e4c605ad\") " pod="ai-tenant-e2e-shared-b-f0b3df/sub-test-model-f0b3df-kserve-5d6444688f-9vgnb"
Jul 22 14:30:15.178687 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:30:15.178586    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93770ec8-0479-447c-a8ca-f0a3e4c605ad-tls-certs\") pod \"sub-test-model-f0b3df-kserve-5d6444688f-9vgnb\" (UID: \"93770ec8-0479-447c-a8ca-f0a3e4c605ad\") " pod="ai-tenant-e2e-shared-b-f0b3df/sub-test-model-f0b3df-kserve-5d6444688f-9vgnb"
Jul 22 14:30:15.178687 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:30:15.178659    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghv49\" (UniqueName: \"kubernetes.io/projected/93770ec8-0479-447c-a8ca-f0a3e4c605ad-kube-api-access-ghv49\") pod \"sub-test-model-f0b3df-kserve-5d6444688f-9vgnb\" (UID: \"93770ec8-0479-447c-a8ca-f0a3e4c605ad\") " pod="ai-tenant-e2e-shared-b-f0b3df/sub-test-model-f0b3df-kserve-5d6444688f-9vgnb"
Jul 22 14:30:15.178915 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:30:15.178711    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93770ec8-0479-447c-a8ca-f0a3e4c605ad-tmp-dir\") pod \"sub-test-model-f0b3df-kserve-5d6444688f-9vgnb\" (UID: \"93770ec8-0479-447c-a8ca-f0a3e4c605ad\") " pod="ai-tenant-e2e-shared-b-f0b3df/sub-test-model-f0b3df-kserve-5d6444688f-9vgnb"
Jul 22 14:30:15.178915 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:30:15.178781    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93770ec8-0479-447c-a8ca-f0a3e4c605ad-home\") pod \"sub-test-model-f0b3df-kserve-5d6444688f-9vgnb\" (UID: \"93770ec8-0479-447c-a8ca-f0a3e4c605ad\") " pod="ai-tenant-e2e-shared-b-f0b3df/sub-test-model-f0b3df-kserve-5d6444688f-9vgnb"
Jul 22 14:30:15.179031 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:30:15.178929    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93770ec8-0479-447c-a8ca-f0a3e4c605ad-model-cache\") pod \"sub-test-model-f0b3df-kserve-5d6444688f-9vgnb\" (UID: \"93770ec8-0479-447c-a8ca-f0a3e4c605ad\") " pod="ai-tenant-e2e-shared-b-f0b3df/sub-test-model-f0b3df-kserve-5d6444688f-9vgnb"
Jul 22 14:30:15.179085 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:30:15.179028    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93770ec8-0479-447c-a8ca-f0a3e4c605ad-tmp-dir\") pod \"sub-test-model-f0b3df-kserve-5d6444688f-9vgnb\" (UID: \"93770ec8-0479-447c-a8ca-f0a3e4c605ad\") " pod="ai-tenant-e2e-shared-b-f0b3df/sub-test-model-f0b3df-kserve-5d6444688f-9vgnb"
Jul 22 14:30:15.180719 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:30:15.180701    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93770ec8-0479-447c-a8ca-f0a3e4c605ad-dshm\") pod \"sub-test-model-f0b3df-kserve-5d6444688f-9vgnb\" (UID: \"93770ec8-0479-447c-a8ca-f0a3e4c605ad\") " pod="ai-tenant-e2e-shared-b-f0b3df/sub-test-model-f0b3df-kserve-5d6444688f-9vgnb"
Jul 22 14:30:15.181044 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:30:15.181025    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93770ec8-0479-447c-a8ca-f0a3e4c605ad-tls-certs\") pod \"sub-test-model-f0b3df-kserve-5d6444688f-9vgnb\" (UID: \"93770ec8-0479-447c-a8ca-f0a3e4c605ad\") " pod="ai-tenant-e2e-shared-b-f0b3df/sub-test-model-f0b3df-kserve-5d6444688f-9vgnb"
Jul 22 14:30:15.187095 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:30:15.187063    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghv49\" (UniqueName: \"kubernetes.io/projected/93770ec8-0479-447c-a8ca-f0a3e4c605ad-kube-api-access-ghv49\") pod \"sub-test-model-f0b3df-kserve-5d6444688f-9vgnb\" (UID: \"93770ec8-0479-447c-a8ca-f0a3e4c605ad\") " pod="ai-tenant-e2e-shared-b-f0b3df/sub-test-model-f0b3df-kserve-5d6444688f-9vgnb"
Jul 22 14:30:15.277687 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:30:15.277592    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f0b3df/sub-test-model-f0b3df-kserve-5d6444688f-9vgnb"
Jul 22 14:30:15.420616 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:30:15.420591    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f0b3df/sub-test-model-f0b3df-kserve-5d6444688f-9vgnb"]
Jul 22 14:30:15.422809 ip-10-0-129-134 kubenswrapper[2571]: W0722 14:30:15.422778    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod93770ec8_0479_447c_a8ca_f0a3e4c605ad.slice/crio-3400b946339abd9658ad25af5274fa816bb2be695aed8f7604645709a769061f WatchSource:0}: Error finding container 3400b946339abd9658ad25af5274fa816bb2be695aed8f7604645709a769061f: Status 404 returned error can't find the container with id 3400b946339abd9658ad25af5274fa816bb2be695aed8f7604645709a769061f
Jul 22 14:30:15.780166 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:30:15.780134    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f0b3df/sub-test-model-f0b3df-kserve-5d6444688f-9vgnb" event={"ID":"93770ec8-0479-447c-a8ca-f0a3e4c605ad","Type":"ContainerStarted","Data":"d814831f0a639b8f3eed4c52dbac52a3cc9fe47a04b73140c372ccafcfeaaade"}
Jul 22 14:30:15.780360 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:30:15.780177    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f0b3df/sub-test-model-f0b3df-kserve-5d6444688f-9vgnb" event={"ID":"93770ec8-0479-447c-a8ca-f0a3e4c605ad","Type":"ContainerStarted","Data":"3400b946339abd9658ad25af5274fa816bb2be695aed8f7604645709a769061f"}
Jul 22 14:30:15.797123 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:30:15.797068    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-f0b3df/sub-test-model-f0b3df-kserve-5d6444688f-9vgnb" podStartSLOduration=1.797051803 podStartE2EDuration="1.797051803s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 14:30:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 14:30:15.795717265 +0000 UTC m=+2625.850493953" watchObservedRunningTime="2026-07-22 14:30:15.797051803 +0000 UTC m=+2625.851828479"
Jul 22 14:30:18.261567 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:30:18.261526    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:30:25.278485 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:30:25.278443    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-f0b3df/sub-test-model-f0b3df-kserve-5d6444688f-9vgnb"
Jul 22 14:30:25.278969 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:30:25.278498    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-f0b3df/sub-test-model-f0b3df-kserve-5d6444688f-9vgnb"
Jul 22 14:30:25.291244 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:30:25.291218    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-f0b3df/sub-test-model-f0b3df-kserve-5d6444688f-9vgnb"
Jul 22 14:30:25.838822 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:30:25.838794    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-f0b3df/sub-test-model-f0b3df-kserve-5d6444688f-9vgnb"
Jul 22 14:30:48.252942 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:30:48.252904    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:31:02.257209 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:02.257174    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:31:08.436012 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:08.435975    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-7d1f11/sub-test-model-7d1f11-kserve-cb656fb59-654kd"]
Jul 22 14:31:09.263094 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:09.263062    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f0b3df/sub-test-model-f0b3df-kserve-5d6444688f-9vgnb"]
Jul 22 14:31:20.158473 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:20.158432    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-7d1f11/rate-test-model-7d1f11-kserve-84d8b654c5-bnqfv"]
Jul 22 14:31:20.162063 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:20.162044    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7d1f11/rate-test-model-7d1f11-kserve-84d8b654c5-bnqfv"
Jul 22 14:31:20.164743 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:20.164717    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-7d1f11\"/\"rate-test-model-7d1f11-kserve-self-signed-certs\""
Jul 22 14:31:20.172545 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:20.172513    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-7d1f11/rate-test-model-7d1f11-kserve-84d8b654c5-bnqfv"]
Jul 22 14:31:20.231194 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:20.231155    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24a0e522-a535-4b85-9510-1f30bf5c0f97-model-cache\") pod \"rate-test-model-7d1f11-kserve-84d8b654c5-bnqfv\" (UID: \"24a0e522-a535-4b85-9510-1f30bf5c0f97\") " pod="ai-tenant-e2e-shared-a-7d1f11/rate-test-model-7d1f11-kserve-84d8b654c5-bnqfv"
Jul 22 14:31:20.231194 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:20.231193    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/24a0e522-a535-4b85-9510-1f30bf5c0f97-dshm\") pod \"rate-test-model-7d1f11-kserve-84d8b654c5-bnqfv\" (UID: \"24a0e522-a535-4b85-9510-1f30bf5c0f97\") " pod="ai-tenant-e2e-shared-a-7d1f11/rate-test-model-7d1f11-kserve-84d8b654c5-bnqfv"
Jul 22 14:31:20.231480 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:20.231230    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jptns\" (UniqueName: \"kubernetes.io/projected/24a0e522-a535-4b85-9510-1f30bf5c0f97-kube-api-access-jptns\") pod \"rate-test-model-7d1f11-kserve-84d8b654c5-bnqfv\" (UID: \"24a0e522-a535-4b85-9510-1f30bf5c0f97\") " pod="ai-tenant-e2e-shared-a-7d1f11/rate-test-model-7d1f11-kserve-84d8b654c5-bnqfv"
Jul 22 14:31:20.231480 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:20.231316    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24a0e522-a535-4b85-9510-1f30bf5c0f97-tls-certs\") pod \"rate-test-model-7d1f11-kserve-84d8b654c5-bnqfv\" (UID: \"24a0e522-a535-4b85-9510-1f30bf5c0f97\") " pod="ai-tenant-e2e-shared-a-7d1f11/rate-test-model-7d1f11-kserve-84d8b654c5-bnqfv"
Jul 22 14:31:20.231480 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:20.231367    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/24a0e522-a535-4b85-9510-1f30bf5c0f97-home\") pod \"rate-test-model-7d1f11-kserve-84d8b654c5-bnqfv\" (UID: \"24a0e522-a535-4b85-9510-1f30bf5c0f97\") " pod="ai-tenant-e2e-shared-a-7d1f11/rate-test-model-7d1f11-kserve-84d8b654c5-bnqfv"
Jul 22 14:31:20.231480 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:20.231450    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24a0e522-a535-4b85-9510-1f30bf5c0f97-tmp-dir\") pod \"rate-test-model-7d1f11-kserve-84d8b654c5-bnqfv\" (UID: \"24a0e522-a535-4b85-9510-1f30bf5c0f97\") " pod="ai-tenant-e2e-shared-a-7d1f11/rate-test-model-7d1f11-kserve-84d8b654c5-bnqfv"
Jul 22 14:31:20.332442 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:20.332363    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/24a0e522-a535-4b85-9510-1f30bf5c0f97-home\") pod \"rate-test-model-7d1f11-kserve-84d8b654c5-bnqfv\" (UID: \"24a0e522-a535-4b85-9510-1f30bf5c0f97\") " pod="ai-tenant-e2e-shared-a-7d1f11/rate-test-model-7d1f11-kserve-84d8b654c5-bnqfv"
Jul 22 14:31:20.332442 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:20.332449    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24a0e522-a535-4b85-9510-1f30bf5c0f97-tmp-dir\") pod \"rate-test-model-7d1f11-kserve-84d8b654c5-bnqfv\" (UID: \"24a0e522-a535-4b85-9510-1f30bf5c0f97\") " pod="ai-tenant-e2e-shared-a-7d1f11/rate-test-model-7d1f11-kserve-84d8b654c5-bnqfv"
Jul 22 14:31:20.332718 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:20.332543    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24a0e522-a535-4b85-9510-1f30bf5c0f97-model-cache\") pod \"rate-test-model-7d1f11-kserve-84d8b654c5-bnqfv\" (UID: \"24a0e522-a535-4b85-9510-1f30bf5c0f97\") " pod="ai-tenant-e2e-shared-a-7d1f11/rate-test-model-7d1f11-kserve-84d8b654c5-bnqfv"
Jul 22 14:31:20.332718 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:20.332560    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/24a0e522-a535-4b85-9510-1f30bf5c0f97-dshm\") pod \"rate-test-model-7d1f11-kserve-84d8b654c5-bnqfv\" (UID: \"24a0e522-a535-4b85-9510-1f30bf5c0f97\") " pod="ai-tenant-e2e-shared-a-7d1f11/rate-test-model-7d1f11-kserve-84d8b654c5-bnqfv"
Jul 22 14:31:20.332718 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:20.332578    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jptns\" (UniqueName: \"kubernetes.io/projected/24a0e522-a535-4b85-9510-1f30bf5c0f97-kube-api-access-jptns\") pod \"rate-test-model-7d1f11-kserve-84d8b654c5-bnqfv\" (UID: \"24a0e522-a535-4b85-9510-1f30bf5c0f97\") " pod="ai-tenant-e2e-shared-a-7d1f11/rate-test-model-7d1f11-kserve-84d8b654c5-bnqfv"
Jul 22 14:31:20.332718 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:20.332601    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24a0e522-a535-4b85-9510-1f30bf5c0f97-tls-certs\") pod \"rate-test-model-7d1f11-kserve-84d8b654c5-bnqfv\" (UID: \"24a0e522-a535-4b85-9510-1f30bf5c0f97\") " pod="ai-tenant-e2e-shared-a-7d1f11/rate-test-model-7d1f11-kserve-84d8b654c5-bnqfv"
Jul 22 14:31:20.332924 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:20.332837    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24a0e522-a535-4b85-9510-1f30bf5c0f97-tmp-dir\") pod \"rate-test-model-7d1f11-kserve-84d8b654c5-bnqfv\" (UID: \"24a0e522-a535-4b85-9510-1f30bf5c0f97\") " pod="ai-tenant-e2e-shared-a-7d1f11/rate-test-model-7d1f11-kserve-84d8b654c5-bnqfv"
Jul 22 14:31:20.332924 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:20.332875    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/24a0e522-a535-4b85-9510-1f30bf5c0f97-home\") pod \"rate-test-model-7d1f11-kserve-84d8b654c5-bnqfv\" (UID: \"24a0e522-a535-4b85-9510-1f30bf5c0f97\") " pod="ai-tenant-e2e-shared-a-7d1f11/rate-test-model-7d1f11-kserve-84d8b654c5-bnqfv"
Jul 22 14:31:20.333006 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:20.332922    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24a0e522-a535-4b85-9510-1f30bf5c0f97-model-cache\") pod \"rate-test-model-7d1f11-kserve-84d8b654c5-bnqfv\" (UID: \"24a0e522-a535-4b85-9510-1f30bf5c0f97\") " pod="ai-tenant-e2e-shared-a-7d1f11/rate-test-model-7d1f11-kserve-84d8b654c5-bnqfv"
Jul 22 14:31:20.334953 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:20.334921    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/24a0e522-a535-4b85-9510-1f30bf5c0f97-dshm\") pod \"rate-test-model-7d1f11-kserve-84d8b654c5-bnqfv\" (UID: \"24a0e522-a535-4b85-9510-1f30bf5c0f97\") " pod="ai-tenant-e2e-shared-a-7d1f11/rate-test-model-7d1f11-kserve-84d8b654c5-bnqfv"
Jul 22 14:31:20.335140 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:20.335125    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24a0e522-a535-4b85-9510-1f30bf5c0f97-tls-certs\") pod \"rate-test-model-7d1f11-kserve-84d8b654c5-bnqfv\" (UID: \"24a0e522-a535-4b85-9510-1f30bf5c0f97\") " pod="ai-tenant-e2e-shared-a-7d1f11/rate-test-model-7d1f11-kserve-84d8b654c5-bnqfv"
Jul 22 14:31:20.341209 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:20.341186    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jptns\" (UniqueName: \"kubernetes.io/projected/24a0e522-a535-4b85-9510-1f30bf5c0f97-kube-api-access-jptns\") pod \"rate-test-model-7d1f11-kserve-84d8b654c5-bnqfv\" (UID: \"24a0e522-a535-4b85-9510-1f30bf5c0f97\") " pod="ai-tenant-e2e-shared-a-7d1f11/rate-test-model-7d1f11-kserve-84d8b654c5-bnqfv"
Jul 22 14:31:20.473314 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:20.473212    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7d1f11/rate-test-model-7d1f11-kserve-84d8b654c5-bnqfv"
Jul 22 14:31:20.617033 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:20.617007    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-7d1f11/rate-test-model-7d1f11-kserve-84d8b654c5-bnqfv"]
Jul 22 14:31:21.103313 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:21.103272    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7d1f11/rate-test-model-7d1f11-kserve-84d8b654c5-bnqfv" event={"ID":"24a0e522-a535-4b85-9510-1f30bf5c0f97","Type":"ContainerStarted","Data":"eb7e13ed8013c7c25acf17f256c02a0229de02e4c6190816bc54e31fc53f347a"}
Jul 22 14:31:21.103534 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:21.103322    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7d1f11/rate-test-model-7d1f11-kserve-84d8b654c5-bnqfv" event={"ID":"24a0e522-a535-4b85-9510-1f30bf5c0f97","Type":"ContainerStarted","Data":"cabd262c263d5f524c2fe4832eadae9dded36fa8306e414ccacec57640e9de5a"}
Jul 22 14:31:21.121622 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:21.121568    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-7d1f11/rate-test-model-7d1f11-kserve-84d8b654c5-bnqfv" podStartSLOduration=1.121552613 podStartE2EDuration="1.121552613s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 14:31:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 14:31:21.119505291 +0000 UTC m=+2691.174281975" watchObservedRunningTime="2026-07-22 14:31:21.121552613 +0000 UTC m=+2691.176329290"
Jul 22 14:31:21.160144 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:21.160113    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:31:23.456680 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:23.456586    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-7d1f11/sub-test-model-7d1f11-kserve-cb656fb59-654kd" podUID="fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e" containerName="main" containerID="cri-o://535d984f3c09f1ccb483857a2eb68df9db22722d24f6321e877fa6bfa1b5ee5f" gracePeriod=45
Jul 22 14:31:23.709563 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:23.709496    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7d1f11/sub-test-model-7d1f11-kserve-cb656fb59-654kd"
Jul 22 14:31:23.867137 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:23.867096    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e-tmp-dir\") pod \"fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e\" (UID: \"fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e\") "
Jul 22 14:31:23.867348 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:23.867208    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e-tls-certs\") pod \"fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e\" (UID: \"fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e\") "
Jul 22 14:31:23.867348 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:23.867237    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e-home\") pod \"fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e\" (UID: \"fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e\") "
Jul 22 14:31:23.867348 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:23.867265    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e-dshm\") pod \"fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e\" (UID: \"fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e\") "
Jul 22 14:31:23.867348 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:23.867296    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xwk5l\" (UniqueName: \"kubernetes.io/projected/fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e-kube-api-access-xwk5l\") pod \"fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e\" (UID: \"fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e\") "
Jul 22 14:31:23.867348 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:23.867326    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e-model-cache\") pod \"fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e\" (UID: \"fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e\") "
Jul 22 14:31:23.867652 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:23.867371    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e" (UID: "fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 14:31:23.867652 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:23.867570    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e-home" (OuterVolumeSpecName: "home") pod "fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e" (UID: "fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 14:31:23.867652 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:23.867631    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e-model-cache" (OuterVolumeSpecName: "model-cache") pod "fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e" (UID: "fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 14:31:23.867761 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:23.867713    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e-model-cache\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 14:31:23.867761 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:23.867732    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e-tmp-dir\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 14:31:23.867761 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:23.867745    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e-home\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 14:31:23.869571 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:23.869543    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e-dshm" (OuterVolumeSpecName: "dshm") pod "fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e" (UID: "fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 14:31:23.869686 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:23.869609    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e" (UID: "fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 14:31:23.869686 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:23.869676    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e-kube-api-access-xwk5l" (OuterVolumeSpecName: "kube-api-access-xwk5l") pod "fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e" (UID: "fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e"). InnerVolumeSpecName "kube-api-access-xwk5l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 14:31:23.968543 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:23.968454    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e-tls-certs\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 14:31:23.968543 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:23.968482    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e-dshm\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 14:31:23.968543 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:23.968492    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xwk5l\" (UniqueName: \"kubernetes.io/projected/fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e-kube-api-access-xwk5l\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 14:31:24.119692 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:24.119655    2571 generic.go:356] "Generic (PLEG): container finished" podID="fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e" containerID="535d984f3c09f1ccb483857a2eb68df9db22722d24f6321e877fa6bfa1b5ee5f" exitCode=0
Jul 22 14:31:24.119895 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:24.119696    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7d1f11/sub-test-model-7d1f11-kserve-cb656fb59-654kd"
Jul 22 14:31:24.119895 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:24.119740    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7d1f11/sub-test-model-7d1f11-kserve-cb656fb59-654kd" event={"ID":"fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e","Type":"ContainerDied","Data":"535d984f3c09f1ccb483857a2eb68df9db22722d24f6321e877fa6bfa1b5ee5f"}
Jul 22 14:31:24.119895 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:24.119788    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7d1f11/sub-test-model-7d1f11-kserve-cb656fb59-654kd" event={"ID":"fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e","Type":"ContainerDied","Data":"5c84b3d1fa1ee0ffb08a778f44bacd8a87915b8d0e5c0a402ea93f041a360664"}
Jul 22 14:31:24.119895 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:24.119809    2571 scope.go:117] "RemoveContainer" containerID="535d984f3c09f1ccb483857a2eb68df9db22722d24f6321e877fa6bfa1b5ee5f"
Jul 22 14:31:24.129120 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:24.129091    2571 scope.go:117] "RemoveContainer" containerID="535d984f3c09f1ccb483857a2eb68df9db22722d24f6321e877fa6bfa1b5ee5f"
Jul 22 14:31:24.129399 ip-10-0-129-134 kubenswrapper[2571]: E0722 14:31:24.129380    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"535d984f3c09f1ccb483857a2eb68df9db22722d24f6321e877fa6bfa1b5ee5f\": container with ID starting with 535d984f3c09f1ccb483857a2eb68df9db22722d24f6321e877fa6bfa1b5ee5f not found: ID does not exist" containerID="535d984f3c09f1ccb483857a2eb68df9db22722d24f6321e877fa6bfa1b5ee5f"
Jul 22 14:31:24.129496 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:24.129422    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"535d984f3c09f1ccb483857a2eb68df9db22722d24f6321e877fa6bfa1b5ee5f"} err="failed to get container status \"535d984f3c09f1ccb483857a2eb68df9db22722d24f6321e877fa6bfa1b5ee5f\": rpc error: code = NotFound desc = could not find container \"535d984f3c09f1ccb483857a2eb68df9db22722d24f6321e877fa6bfa1b5ee5f\": container with ID starting with 535d984f3c09f1ccb483857a2eb68df9db22722d24f6321e877fa6bfa1b5ee5f not found: ID does not exist"
Jul 22 14:31:24.140773 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:24.140741    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-7d1f11/sub-test-model-7d1f11-kserve-cb656fb59-654kd"]
Jul 22 14:31:24.143814 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:24.143791    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-7d1f11/sub-test-model-7d1f11-kserve-cb656fb59-654kd"]
Jul 22 14:31:24.284504 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:24.284389    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-f0b3df/sub-test-model-f0b3df-kserve-5d6444688f-9vgnb" podUID="93770ec8-0479-447c-a8ca-f0a3e4c605ad" containerName="main" containerID="cri-o://d814831f0a639b8f3eed4c52dbac52a3cc9fe47a04b73140c372ccafcfeaaade" gracePeriod=45
Jul 22 14:31:24.541829 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:24.541759    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f0b3df/sub-test-model-f0b3df-kserve-5d6444688f-9vgnb"
Jul 22 14:31:24.675621 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:24.675584    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93770ec8-0479-447c-a8ca-f0a3e4c605ad-tls-certs\") pod \"93770ec8-0479-447c-a8ca-f0a3e4c605ad\" (UID: \"93770ec8-0479-447c-a8ca-f0a3e4c605ad\") "
Jul 22 14:31:24.675790 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:24.675663    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93770ec8-0479-447c-a8ca-f0a3e4c605ad-dshm\") pod \"93770ec8-0479-447c-a8ca-f0a3e4c605ad\" (UID: \"93770ec8-0479-447c-a8ca-f0a3e4c605ad\") "
Jul 22 14:31:24.675790 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:24.675760    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93770ec8-0479-447c-a8ca-f0a3e4c605ad-home\") pod \"93770ec8-0479-447c-a8ca-f0a3e4c605ad\" (UID: \"93770ec8-0479-447c-a8ca-f0a3e4c605ad\") "
Jul 22 14:31:24.675934 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:24.675809    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93770ec8-0479-447c-a8ca-f0a3e4c605ad-model-cache\") pod \"93770ec8-0479-447c-a8ca-f0a3e4c605ad\" (UID: \"93770ec8-0479-447c-a8ca-f0a3e4c605ad\") "
Jul 22 14:31:24.675934 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:24.675853    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93770ec8-0479-447c-a8ca-f0a3e4c605ad-tmp-dir\") pod \"93770ec8-0479-447c-a8ca-f0a3e4c605ad\" (UID: \"93770ec8-0479-447c-a8ca-f0a3e4c605ad\") "
Jul 22 14:31:24.675934 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:24.675909    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ghv49\" (UniqueName: \"kubernetes.io/projected/93770ec8-0479-447c-a8ca-f0a3e4c605ad-kube-api-access-ghv49\") pod \"93770ec8-0479-447c-a8ca-f0a3e4c605ad\" (UID: \"93770ec8-0479-447c-a8ca-f0a3e4c605ad\") "
Jul 22 14:31:24.676098 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:24.676064    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93770ec8-0479-447c-a8ca-f0a3e4c605ad-home" (OuterVolumeSpecName: "home") pod "93770ec8-0479-447c-a8ca-f0a3e4c605ad" (UID: "93770ec8-0479-447c-a8ca-f0a3e4c605ad"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 14:31:24.676208 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:24.676182    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93770ec8-0479-447c-a8ca-f0a3e4c605ad-model-cache" (OuterVolumeSpecName: "model-cache") pod "93770ec8-0479-447c-a8ca-f0a3e4c605ad" (UID: "93770ec8-0479-447c-a8ca-f0a3e4c605ad"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 14:31:24.676262 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:24.676200    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93770ec8-0479-447c-a8ca-f0a3e4c605ad-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "93770ec8-0479-447c-a8ca-f0a3e4c605ad" (UID: "93770ec8-0479-447c-a8ca-f0a3e4c605ad"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 14:31:24.676387 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:24.676370    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93770ec8-0479-447c-a8ca-f0a3e4c605ad-home\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 14:31:24.676474 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:24.676391    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93770ec8-0479-447c-a8ca-f0a3e4c605ad-model-cache\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 14:31:24.676474 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:24.676431    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93770ec8-0479-447c-a8ca-f0a3e4c605ad-tmp-dir\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 14:31:24.677847 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:24.677825    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93770ec8-0479-447c-a8ca-f0a3e4c605ad-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "93770ec8-0479-447c-a8ca-f0a3e4c605ad" (UID: "93770ec8-0479-447c-a8ca-f0a3e4c605ad"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 14:31:24.677982 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:24.677939    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93770ec8-0479-447c-a8ca-f0a3e4c605ad-kube-api-access-ghv49" (OuterVolumeSpecName: "kube-api-access-ghv49") pod "93770ec8-0479-447c-a8ca-f0a3e4c605ad" (UID: "93770ec8-0479-447c-a8ca-f0a3e4c605ad"). InnerVolumeSpecName "kube-api-access-ghv49". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 14:31:24.677982 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:24.677939    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93770ec8-0479-447c-a8ca-f0a3e4c605ad-dshm" (OuterVolumeSpecName: "dshm") pod "93770ec8-0479-447c-a8ca-f0a3e4c605ad" (UID: "93770ec8-0479-447c-a8ca-f0a3e4c605ad"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 14:31:24.777844 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:24.777807    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ghv49\" (UniqueName: \"kubernetes.io/projected/93770ec8-0479-447c-a8ca-f0a3e4c605ad-kube-api-access-ghv49\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 14:31:24.777844 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:24.777837    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93770ec8-0479-447c-a8ca-f0a3e4c605ad-tls-certs\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 14:31:24.777844 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:24.777848    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93770ec8-0479-447c-a8ca-f0a3e4c605ad-dshm\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 14:31:25.009911 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:25.009878    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e" path="/var/lib/kubelet/pods/fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e/volumes"
Jul 22 14:31:25.126903 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:25.126870    2571 generic.go:356] "Generic (PLEG): container finished" podID="93770ec8-0479-447c-a8ca-f0a3e4c605ad" containerID="d814831f0a639b8f3eed4c52dbac52a3cc9fe47a04b73140c372ccafcfeaaade" exitCode=0
Jul 22 14:31:25.127051 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:25.126916    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f0b3df/sub-test-model-f0b3df-kserve-5d6444688f-9vgnb"
Jul 22 14:31:25.127051 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:25.126934    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f0b3df/sub-test-model-f0b3df-kserve-5d6444688f-9vgnb" event={"ID":"93770ec8-0479-447c-a8ca-f0a3e4c605ad","Type":"ContainerDied","Data":"d814831f0a639b8f3eed4c52dbac52a3cc9fe47a04b73140c372ccafcfeaaade"}
Jul 22 14:31:25.127051 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:25.126966    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f0b3df/sub-test-model-f0b3df-kserve-5d6444688f-9vgnb" event={"ID":"93770ec8-0479-447c-a8ca-f0a3e4c605ad","Type":"ContainerDied","Data":"3400b946339abd9658ad25af5274fa816bb2be695aed8f7604645709a769061f"}
Jul 22 14:31:25.127051 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:25.126984    2571 scope.go:117] "RemoveContainer" containerID="d814831f0a639b8f3eed4c52dbac52a3cc9fe47a04b73140c372ccafcfeaaade"
Jul 22 14:31:25.135439 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:25.135397    2571 scope.go:117] "RemoveContainer" containerID="d814831f0a639b8f3eed4c52dbac52a3cc9fe47a04b73140c372ccafcfeaaade"
Jul 22 14:31:25.135715 ip-10-0-129-134 kubenswrapper[2571]: E0722 14:31:25.135697    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d814831f0a639b8f3eed4c52dbac52a3cc9fe47a04b73140c372ccafcfeaaade\": container with ID starting with d814831f0a639b8f3eed4c52dbac52a3cc9fe47a04b73140c372ccafcfeaaade not found: ID does not exist" containerID="d814831f0a639b8f3eed4c52dbac52a3cc9fe47a04b73140c372ccafcfeaaade"
Jul 22 14:31:25.135778 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:25.135726    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d814831f0a639b8f3eed4c52dbac52a3cc9fe47a04b73140c372ccafcfeaaade"} err="failed to get container status \"d814831f0a639b8f3eed4c52dbac52a3cc9fe47a04b73140c372ccafcfeaaade\": rpc error: code = NotFound desc = could not find container \"d814831f0a639b8f3eed4c52dbac52a3cc9fe47a04b73140c372ccafcfeaaade\": container with ID starting with d814831f0a639b8f3eed4c52dbac52a3cc9fe47a04b73140c372ccafcfeaaade not found: ID does not exist"
Jul 22 14:31:25.142806 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:25.142766    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f0b3df/sub-test-model-f0b3df-kserve-5d6444688f-9vgnb"]
Jul 22 14:31:25.144734 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:25.144711    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-f0b3df/sub-test-model-f0b3df-kserve-5d6444688f-9vgnb"]
Jul 22 14:31:27.009838 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:27.009796    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93770ec8-0479-447c-a8ca-f0a3e4c605ad" path="/var/lib/kubelet/pods/93770ec8-0479-447c-a8ca-f0a3e4c605ad/volumes"
Jul 22 14:31:30.473905 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:30.473864    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-7d1f11/rate-test-model-7d1f11-kserve-84d8b654c5-bnqfv"
Jul 22 14:31:30.474310 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:30.473918    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-7d1f11/rate-test-model-7d1f11-kserve-84d8b654c5-bnqfv"
Jul 22 14:31:30.486813 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:30.486780    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-7d1f11/rate-test-model-7d1f11-kserve-84d8b654c5-bnqfv"
Jul 22 14:31:31.156065 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:31.156037    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:31:31.167288 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:31.167256    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-7d1f11/rate-test-model-7d1f11-kserve-84d8b654c5-bnqfv"
Jul 22 14:31:46.467319 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:46.467282    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-f0b3df/rate-test-model-f0b3df-kserve-7f4c857879-cv9hq"]
Jul 22 14:31:46.467802 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:46.467783    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93770ec8-0479-447c-a8ca-f0a3e4c605ad" containerName="main"
Jul 22 14:31:46.467850 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:46.467806    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="93770ec8-0479-447c-a8ca-f0a3e4c605ad" containerName="main"
Jul 22 14:31:46.467850 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:46.467827    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e" containerName="main"
Jul 22 14:31:46.467850 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:46.467833    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e" containerName="main"
Jul 22 14:31:46.467939 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:46.467928    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbcb5cf5-afbf-481f-acbd-f0f474f6ae6e" containerName="main"
Jul 22 14:31:46.467977 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:46.467939    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="93770ec8-0479-447c-a8ca-f0a3e4c605ad" containerName="main"
Jul 22 14:31:46.470853 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:46.470837    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f0b3df/rate-test-model-f0b3df-kserve-7f4c857879-cv9hq"
Jul 22 14:31:46.473336 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:46.473307    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f0b3df\"/\"default-dockercfg-b76ns\""
Jul 22 14:31:46.473496 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:46.473393    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f0b3df\"/\"rate-test-model-f0b3df-kserve-self-signed-certs\""
Jul 22 14:31:46.473496 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:46.473437    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f0b3df\"/\"kube-root-ca.crt\""
Jul 22 14:31:46.473704 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:46.473688    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f0b3df\"/\"openshift-service-ca.crt\""
Jul 22 14:31:46.482583 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:46.482550    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f0b3df/rate-test-model-f0b3df-kserve-7f4c857879-cv9hq"]
Jul 22 14:31:46.588862 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:46.588826    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41ccab8b-5953-48b3-9ca8-76a9fd9d8f22-tmp-dir\") pod \"rate-test-model-f0b3df-kserve-7f4c857879-cv9hq\" (UID: \"41ccab8b-5953-48b3-9ca8-76a9fd9d8f22\") " pod="ai-tenant-e2e-shared-b-f0b3df/rate-test-model-f0b3df-kserve-7f4c857879-cv9hq"
Jul 22 14:31:46.588862 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:46.588865    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/41ccab8b-5953-48b3-9ca8-76a9fd9d8f22-tls-certs\") pod \"rate-test-model-f0b3df-kserve-7f4c857879-cv9hq\" (UID: \"41ccab8b-5953-48b3-9ca8-76a9fd9d8f22\") " pod="ai-tenant-e2e-shared-b-f0b3df/rate-test-model-f0b3df-kserve-7f4c857879-cv9hq"
Jul 22 14:31:46.589089 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:46.588888    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/41ccab8b-5953-48b3-9ca8-76a9fd9d8f22-model-cache\") pod \"rate-test-model-f0b3df-kserve-7f4c857879-cv9hq\" (UID: \"41ccab8b-5953-48b3-9ca8-76a9fd9d8f22\") " pod="ai-tenant-e2e-shared-b-f0b3df/rate-test-model-f0b3df-kserve-7f4c857879-cv9hq"
Jul 22 14:31:46.589089 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:46.589039    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqfg7\" (UniqueName: \"kubernetes.io/projected/41ccab8b-5953-48b3-9ca8-76a9fd9d8f22-kube-api-access-xqfg7\") pod \"rate-test-model-f0b3df-kserve-7f4c857879-cv9hq\" (UID: \"41ccab8b-5953-48b3-9ca8-76a9fd9d8f22\") " pod="ai-tenant-e2e-shared-b-f0b3df/rate-test-model-f0b3df-kserve-7f4c857879-cv9hq"
Jul 22 14:31:46.589089 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:46.589085    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/41ccab8b-5953-48b3-9ca8-76a9fd9d8f22-home\") pod \"rate-test-model-f0b3df-kserve-7f4c857879-cv9hq\" (UID: \"41ccab8b-5953-48b3-9ca8-76a9fd9d8f22\") " pod="ai-tenant-e2e-shared-b-f0b3df/rate-test-model-f0b3df-kserve-7f4c857879-cv9hq"
Jul 22 14:31:46.589192 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:46.589141    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/41ccab8b-5953-48b3-9ca8-76a9fd9d8f22-dshm\") pod \"rate-test-model-f0b3df-kserve-7f4c857879-cv9hq\" (UID: \"41ccab8b-5953-48b3-9ca8-76a9fd9d8f22\") " pod="ai-tenant-e2e-shared-b-f0b3df/rate-test-model-f0b3df-kserve-7f4c857879-cv9hq"
Jul 22 14:31:46.690711 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:46.690676    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqfg7\" (UniqueName: \"kubernetes.io/projected/41ccab8b-5953-48b3-9ca8-76a9fd9d8f22-kube-api-access-xqfg7\") pod \"rate-test-model-f0b3df-kserve-7f4c857879-cv9hq\" (UID: \"41ccab8b-5953-48b3-9ca8-76a9fd9d8f22\") " pod="ai-tenant-e2e-shared-b-f0b3df/rate-test-model-f0b3df-kserve-7f4c857879-cv9hq"
Jul 22 14:31:46.690833 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:46.690722    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/41ccab8b-5953-48b3-9ca8-76a9fd9d8f22-home\") pod \"rate-test-model-f0b3df-kserve-7f4c857879-cv9hq\" (UID: \"41ccab8b-5953-48b3-9ca8-76a9fd9d8f22\") " pod="ai-tenant-e2e-shared-b-f0b3df/rate-test-model-f0b3df-kserve-7f4c857879-cv9hq"
Jul 22 14:31:46.690833 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:46.690756    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/41ccab8b-5953-48b3-9ca8-76a9fd9d8f22-dshm\") pod \"rate-test-model-f0b3df-kserve-7f4c857879-cv9hq\" (UID: \"41ccab8b-5953-48b3-9ca8-76a9fd9d8f22\") " pod="ai-tenant-e2e-shared-b-f0b3df/rate-test-model-f0b3df-kserve-7f4c857879-cv9hq"
Jul 22 14:31:46.690833 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:46.690787    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41ccab8b-5953-48b3-9ca8-76a9fd9d8f22-tmp-dir\") pod \"rate-test-model-f0b3df-kserve-7f4c857879-cv9hq\" (UID: \"41ccab8b-5953-48b3-9ca8-76a9fd9d8f22\") " pod="ai-tenant-e2e-shared-b-f0b3df/rate-test-model-f0b3df-kserve-7f4c857879-cv9hq"
Jul 22 14:31:46.690833 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:46.690804    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/41ccab8b-5953-48b3-9ca8-76a9fd9d8f22-tls-certs\") pod \"rate-test-model-f0b3df-kserve-7f4c857879-cv9hq\" (UID: \"41ccab8b-5953-48b3-9ca8-76a9fd9d8f22\") " pod="ai-tenant-e2e-shared-b-f0b3df/rate-test-model-f0b3df-kserve-7f4c857879-cv9hq"
Jul 22 14:31:46.690833 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:46.690825    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/41ccab8b-5953-48b3-9ca8-76a9fd9d8f22-model-cache\") pod \"rate-test-model-f0b3df-kserve-7f4c857879-cv9hq\" (UID: \"41ccab8b-5953-48b3-9ca8-76a9fd9d8f22\") " pod="ai-tenant-e2e-shared-b-f0b3df/rate-test-model-f0b3df-kserve-7f4c857879-cv9hq"
Jul 22 14:31:46.691298 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:46.691275    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/41ccab8b-5953-48b3-9ca8-76a9fd9d8f22-home\") pod \"rate-test-model-f0b3df-kserve-7f4c857879-cv9hq\" (UID: \"41ccab8b-5953-48b3-9ca8-76a9fd9d8f22\") " pod="ai-tenant-e2e-shared-b-f0b3df/rate-test-model-f0b3df-kserve-7f4c857879-cv9hq"
Jul 22 14:31:46.691363 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:46.691288    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/41ccab8b-5953-48b3-9ca8-76a9fd9d8f22-model-cache\") pod \"rate-test-model-f0b3df-kserve-7f4c857879-cv9hq\" (UID: \"41ccab8b-5953-48b3-9ca8-76a9fd9d8f22\") " pod="ai-tenant-e2e-shared-b-f0b3df/rate-test-model-f0b3df-kserve-7f4c857879-cv9hq"
Jul 22 14:31:46.691363 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:46.691330    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41ccab8b-5953-48b3-9ca8-76a9fd9d8f22-tmp-dir\") pod \"rate-test-model-f0b3df-kserve-7f4c857879-cv9hq\" (UID: \"41ccab8b-5953-48b3-9ca8-76a9fd9d8f22\") " pod="ai-tenant-e2e-shared-b-f0b3df/rate-test-model-f0b3df-kserve-7f4c857879-cv9hq"
Jul 22 14:31:46.693068 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:46.693043    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/41ccab8b-5953-48b3-9ca8-76a9fd9d8f22-dshm\") pod \"rate-test-model-f0b3df-kserve-7f4c857879-cv9hq\" (UID: \"41ccab8b-5953-48b3-9ca8-76a9fd9d8f22\") " pod="ai-tenant-e2e-shared-b-f0b3df/rate-test-model-f0b3df-kserve-7f4c857879-cv9hq"
Jul 22 14:31:46.693438 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:46.693419    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/41ccab8b-5953-48b3-9ca8-76a9fd9d8f22-tls-certs\") pod \"rate-test-model-f0b3df-kserve-7f4c857879-cv9hq\" (UID: \"41ccab8b-5953-48b3-9ca8-76a9fd9d8f22\") " pod="ai-tenant-e2e-shared-b-f0b3df/rate-test-model-f0b3df-kserve-7f4c857879-cv9hq"
Jul 22 14:31:46.698377 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:46.698346    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqfg7\" (UniqueName: \"kubernetes.io/projected/41ccab8b-5953-48b3-9ca8-76a9fd9d8f22-kube-api-access-xqfg7\") pod \"rate-test-model-f0b3df-kserve-7f4c857879-cv9hq\" (UID: \"41ccab8b-5953-48b3-9ca8-76a9fd9d8f22\") " pod="ai-tenant-e2e-shared-b-f0b3df/rate-test-model-f0b3df-kserve-7f4c857879-cv9hq"
Jul 22 14:31:46.781950 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:46.781855    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f0b3df/rate-test-model-f0b3df-kserve-7f4c857879-cv9hq"
Jul 22 14:31:46.918377 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:46.918345    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f0b3df/rate-test-model-f0b3df-kserve-7f4c857879-cv9hq"]
Jul 22 14:31:47.233118 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:47.233083    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f0b3df/rate-test-model-f0b3df-kserve-7f4c857879-cv9hq" event={"ID":"41ccab8b-5953-48b3-9ca8-76a9fd9d8f22","Type":"ContainerStarted","Data":"d7bf2b1615bb841e6561a741a4c5380e00db00f9c06a6396167b9debda2b6df7"}
Jul 22 14:31:47.233318 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:47.233130    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f0b3df/rate-test-model-f0b3df-kserve-7f4c857879-cv9hq" event={"ID":"41ccab8b-5953-48b3-9ca8-76a9fd9d8f22","Type":"ContainerStarted","Data":"0eee5ae2e614566a130b4334207868257f10dd7f7f49354b81fb5e3187a6c6af"}
Jul 22 14:31:47.250988 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:47.250934    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-f0b3df/rate-test-model-f0b3df-kserve-7f4c857879-cv9hq" podStartSLOduration=1.2509148190000001 podStartE2EDuration="1.250914819s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 14:31:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 14:31:47.249867009 +0000 UTC m=+2717.304643686" watchObservedRunningTime="2026-07-22 14:31:47.250914819 +0000 UTC m=+2717.305691495"
Jul 22 14:31:50.066881 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:50.066843    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:31:56.782991 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:56.782952    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-f0b3df/rate-test-model-f0b3df-kserve-7f4c857879-cv9hq"
Jul 22 14:31:56.782991 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:56.783002    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-f0b3df/rate-test-model-f0b3df-kserve-7f4c857879-cv9hq"
Jul 22 14:31:56.795682 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:56.795655    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-f0b3df/rate-test-model-f0b3df-kserve-7f4c857879-cv9hq"
Jul 22 14:31:57.292804 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:31:57.292770    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-f0b3df/rate-test-model-f0b3df-kserve-7f4c857879-cv9hq"
Jul 22 14:32:09.251975 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:09.251935    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:32:24.263290 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:24.263250    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:32:30.713643 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:30.713603    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-7d1f11/rate-test-model-7d1f11-kserve-84d8b654c5-bnqfv"]
Jul 22 14:32:31.651058 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:31.651018    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f0b3df/rate-test-model-f0b3df-kserve-7f4c857879-cv9hq"]
Jul 22 14:32:44.162223 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:44.162182    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:32:45.734151 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:45.734095    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-7d1f11/rate-test-model-7d1f11-kserve-84d8b654c5-bnqfv" podUID="24a0e522-a535-4b85-9510-1f30bf5c0f97" containerName="main" containerID="cri-o://eb7e13ed8013c7c25acf17f256c02a0229de02e4c6190816bc54e31fc53f347a" gracePeriod=45
Jul 22 14:32:45.980440 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:45.980391    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7d1f11/rate-test-model-7d1f11-kserve-84d8b654c5-bnqfv"
Jul 22 14:32:46.087125 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:46.087082    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/24a0e522-a535-4b85-9510-1f30bf5c0f97-dshm\") pod \"24a0e522-a535-4b85-9510-1f30bf5c0f97\" (UID: \"24a0e522-a535-4b85-9510-1f30bf5c0f97\") "
Jul 22 14:32:46.087303 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:46.087142    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24a0e522-a535-4b85-9510-1f30bf5c0f97-tmp-dir\") pod \"24a0e522-a535-4b85-9510-1f30bf5c0f97\" (UID: \"24a0e522-a535-4b85-9510-1f30bf5c0f97\") "
Jul 22 14:32:46.087303 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:46.087187    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24a0e522-a535-4b85-9510-1f30bf5c0f97-tls-certs\") pod \"24a0e522-a535-4b85-9510-1f30bf5c0f97\" (UID: \"24a0e522-a535-4b85-9510-1f30bf5c0f97\") "
Jul 22 14:32:46.087303 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:46.087231    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jptns\" (UniqueName: \"kubernetes.io/projected/24a0e522-a535-4b85-9510-1f30bf5c0f97-kube-api-access-jptns\") pod \"24a0e522-a535-4b85-9510-1f30bf5c0f97\" (UID: \"24a0e522-a535-4b85-9510-1f30bf5c0f97\") "
Jul 22 14:32:46.087303 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:46.087294    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/24a0e522-a535-4b85-9510-1f30bf5c0f97-home\") pod \"24a0e522-a535-4b85-9510-1f30bf5c0f97\" (UID: \"24a0e522-a535-4b85-9510-1f30bf5c0f97\") "
Jul 22 14:32:46.087545 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:46.087342    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24a0e522-a535-4b85-9510-1f30bf5c0f97-model-cache\") pod \"24a0e522-a535-4b85-9510-1f30bf5c0f97\" (UID: \"24a0e522-a535-4b85-9510-1f30bf5c0f97\") "
Jul 22 14:32:46.087545 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:46.087375    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24a0e522-a535-4b85-9510-1f30bf5c0f97-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "24a0e522-a535-4b85-9510-1f30bf5c0f97" (UID: "24a0e522-a535-4b85-9510-1f30bf5c0f97"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 14:32:46.087655 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:46.087602    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24a0e522-a535-4b85-9510-1f30bf5c0f97-home" (OuterVolumeSpecName: "home") pod "24a0e522-a535-4b85-9510-1f30bf5c0f97" (UID: "24a0e522-a535-4b85-9510-1f30bf5c0f97"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 14:32:46.087655 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:46.087637    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24a0e522-a535-4b85-9510-1f30bf5c0f97-model-cache" (OuterVolumeSpecName: "model-cache") pod "24a0e522-a535-4b85-9510-1f30bf5c0f97" (UID: "24a0e522-a535-4b85-9510-1f30bf5c0f97"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 14:32:46.087747 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:46.087736    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/24a0e522-a535-4b85-9510-1f30bf5c0f97-home\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 14:32:46.087784 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:46.087751    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24a0e522-a535-4b85-9510-1f30bf5c0f97-model-cache\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 14:32:46.087784 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:46.087761    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24a0e522-a535-4b85-9510-1f30bf5c0f97-tmp-dir\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 14:32:46.089433 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:46.089394    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24a0e522-a535-4b85-9510-1f30bf5c0f97-kube-api-access-jptns" (OuterVolumeSpecName: "kube-api-access-jptns") pod "24a0e522-a535-4b85-9510-1f30bf5c0f97" (UID: "24a0e522-a535-4b85-9510-1f30bf5c0f97"). InnerVolumeSpecName "kube-api-access-jptns". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 14:32:46.089514 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:46.089401    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24a0e522-a535-4b85-9510-1f30bf5c0f97-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "24a0e522-a535-4b85-9510-1f30bf5c0f97" (UID: "24a0e522-a535-4b85-9510-1f30bf5c0f97"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 14:32:46.089514 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:46.089457    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24a0e522-a535-4b85-9510-1f30bf5c0f97-dshm" (OuterVolumeSpecName: "dshm") pod "24a0e522-a535-4b85-9510-1f30bf5c0f97" (UID: "24a0e522-a535-4b85-9510-1f30bf5c0f97"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 14:32:46.188987 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:46.188950    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/24a0e522-a535-4b85-9510-1f30bf5c0f97-dshm\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 14:32:46.188987 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:46.188989    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24a0e522-a535-4b85-9510-1f30bf5c0f97-tls-certs\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 14:32:46.189192 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:46.189011    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jptns\" (UniqueName: \"kubernetes.io/projected/24a0e522-a535-4b85-9510-1f30bf5c0f97-kube-api-access-jptns\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 14:32:46.527868 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:46.527780    2571 generic.go:356] "Generic (PLEG): container finished" podID="24a0e522-a535-4b85-9510-1f30bf5c0f97" containerID="eb7e13ed8013c7c25acf17f256c02a0229de02e4c6190816bc54e31fc53f347a" exitCode=0
Jul 22 14:32:46.527868 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:46.527822    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7d1f11/rate-test-model-7d1f11-kserve-84d8b654c5-bnqfv"
Jul 22 14:32:46.527868 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:46.527851    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7d1f11/rate-test-model-7d1f11-kserve-84d8b654c5-bnqfv" event={"ID":"24a0e522-a535-4b85-9510-1f30bf5c0f97","Type":"ContainerDied","Data":"eb7e13ed8013c7c25acf17f256c02a0229de02e4c6190816bc54e31fc53f347a"}
Jul 22 14:32:46.528160 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:46.527893    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7d1f11/rate-test-model-7d1f11-kserve-84d8b654c5-bnqfv" event={"ID":"24a0e522-a535-4b85-9510-1f30bf5c0f97","Type":"ContainerDied","Data":"cabd262c263d5f524c2fe4832eadae9dded36fa8306e414ccacec57640e9de5a"}
Jul 22 14:32:46.528160 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:46.527912    2571 scope.go:117] "RemoveContainer" containerID="eb7e13ed8013c7c25acf17f256c02a0229de02e4c6190816bc54e31fc53f347a"
Jul 22 14:32:46.539614 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:46.539585    2571 scope.go:117] "RemoveContainer" containerID="eb7e13ed8013c7c25acf17f256c02a0229de02e4c6190816bc54e31fc53f347a"
Jul 22 14:32:46.539994 ip-10-0-129-134 kubenswrapper[2571]: E0722 14:32:46.539973    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb7e13ed8013c7c25acf17f256c02a0229de02e4c6190816bc54e31fc53f347a\": container with ID starting with eb7e13ed8013c7c25acf17f256c02a0229de02e4c6190816bc54e31fc53f347a not found: ID does not exist" containerID="eb7e13ed8013c7c25acf17f256c02a0229de02e4c6190816bc54e31fc53f347a"
Jul 22 14:32:46.540090 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:46.540008    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb7e13ed8013c7c25acf17f256c02a0229de02e4c6190816bc54e31fc53f347a"} err="failed to get container status \"eb7e13ed8013c7c25acf17f256c02a0229de02e4c6190816bc54e31fc53f347a\": rpc error: code = NotFound desc = could not find container \"eb7e13ed8013c7c25acf17f256c02a0229de02e4c6190816bc54e31fc53f347a\": container with ID starting with eb7e13ed8013c7c25acf17f256c02a0229de02e4c6190816bc54e31fc53f347a not found: ID does not exist"
Jul 22 14:32:46.550497 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:46.550466    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-7d1f11/rate-test-model-7d1f11-kserve-84d8b654c5-bnqfv"]
Jul 22 14:32:46.556930 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:46.556901    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-7d1f11/rate-test-model-7d1f11-kserve-84d8b654c5-bnqfv"]
Jul 22 14:32:46.671753 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:46.671710    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-f0b3df/rate-test-model-f0b3df-kserve-7f4c857879-cv9hq" podUID="41ccab8b-5953-48b3-9ca8-76a9fd9d8f22" containerName="main" containerID="cri-o://d7bf2b1615bb841e6561a741a4c5380e00db00f9c06a6396167b9debda2b6df7" gracePeriod=45
Jul 22 14:32:46.925745 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:46.925714    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f0b3df/rate-test-model-f0b3df-kserve-7f4c857879-cv9hq"
Jul 22 14:32:47.010133 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:47.010098    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24a0e522-a535-4b85-9510-1f30bf5c0f97" path="/var/lib/kubelet/pods/24a0e522-a535-4b85-9510-1f30bf5c0f97/volumes"
Jul 22 14:32:47.098018 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:47.097987    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/41ccab8b-5953-48b3-9ca8-76a9fd9d8f22-tls-certs\") pod \"41ccab8b-5953-48b3-9ca8-76a9fd9d8f22\" (UID: \"41ccab8b-5953-48b3-9ca8-76a9fd9d8f22\") "
Jul 22 14:32:47.098193 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:47.098039    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/41ccab8b-5953-48b3-9ca8-76a9fd9d8f22-model-cache\") pod \"41ccab8b-5953-48b3-9ca8-76a9fd9d8f22\" (UID: \"41ccab8b-5953-48b3-9ca8-76a9fd9d8f22\") "
Jul 22 14:32:47.098193 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:47.098059    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/41ccab8b-5953-48b3-9ca8-76a9fd9d8f22-home\") pod \"41ccab8b-5953-48b3-9ca8-76a9fd9d8f22\" (UID: \"41ccab8b-5953-48b3-9ca8-76a9fd9d8f22\") "
Jul 22 14:32:47.098193 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:47.098122    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xqfg7\" (UniqueName: \"kubernetes.io/projected/41ccab8b-5953-48b3-9ca8-76a9fd9d8f22-kube-api-access-xqfg7\") pod \"41ccab8b-5953-48b3-9ca8-76a9fd9d8f22\" (UID: \"41ccab8b-5953-48b3-9ca8-76a9fd9d8f22\") "
Jul 22 14:32:47.098379 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:47.098232    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/41ccab8b-5953-48b3-9ca8-76a9fd9d8f22-dshm\") pod \"41ccab8b-5953-48b3-9ca8-76a9fd9d8f22\" (UID: \"41ccab8b-5953-48b3-9ca8-76a9fd9d8f22\") "
Jul 22 14:32:47.098379 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:47.098266    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41ccab8b-5953-48b3-9ca8-76a9fd9d8f22-tmp-dir\") pod \"41ccab8b-5953-48b3-9ca8-76a9fd9d8f22\" (UID: \"41ccab8b-5953-48b3-9ca8-76a9fd9d8f22\") "
Jul 22 14:32:47.098379 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:47.098334    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41ccab8b-5953-48b3-9ca8-76a9fd9d8f22-model-cache" (OuterVolumeSpecName: "model-cache") pod "41ccab8b-5953-48b3-9ca8-76a9fd9d8f22" (UID: "41ccab8b-5953-48b3-9ca8-76a9fd9d8f22"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 14:32:47.098379 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:47.098346    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41ccab8b-5953-48b3-9ca8-76a9fd9d8f22-home" (OuterVolumeSpecName: "home") pod "41ccab8b-5953-48b3-9ca8-76a9fd9d8f22" (UID: "41ccab8b-5953-48b3-9ca8-76a9fd9d8f22"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 14:32:47.098607 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:47.098515    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41ccab8b-5953-48b3-9ca8-76a9fd9d8f22-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "41ccab8b-5953-48b3-9ca8-76a9fd9d8f22" (UID: "41ccab8b-5953-48b3-9ca8-76a9fd9d8f22"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 14:32:47.098669 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:47.098653    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41ccab8b-5953-48b3-9ca8-76a9fd9d8f22-tmp-dir\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 14:32:47.098709 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:47.098675    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/41ccab8b-5953-48b3-9ca8-76a9fd9d8f22-model-cache\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 14:32:47.098709 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:47.098688    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/41ccab8b-5953-48b3-9ca8-76a9fd9d8f22-home\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 14:32:47.100357 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:47.100331    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41ccab8b-5953-48b3-9ca8-76a9fd9d8f22-kube-api-access-xqfg7" (OuterVolumeSpecName: "kube-api-access-xqfg7") pod "41ccab8b-5953-48b3-9ca8-76a9fd9d8f22" (UID: "41ccab8b-5953-48b3-9ca8-76a9fd9d8f22"). InnerVolumeSpecName "kube-api-access-xqfg7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 14:32:47.100476 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:47.100378    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41ccab8b-5953-48b3-9ca8-76a9fd9d8f22-dshm" (OuterVolumeSpecName: "dshm") pod "41ccab8b-5953-48b3-9ca8-76a9fd9d8f22" (UID: "41ccab8b-5953-48b3-9ca8-76a9fd9d8f22"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 14:32:47.100537 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:47.100481    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41ccab8b-5953-48b3-9ca8-76a9fd9d8f22-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "41ccab8b-5953-48b3-9ca8-76a9fd9d8f22" (UID: "41ccab8b-5953-48b3-9ca8-76a9fd9d8f22"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 14:32:47.199872 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:47.199831    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/41ccab8b-5953-48b3-9ca8-76a9fd9d8f22-tls-certs\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 14:32:47.199872 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:47.199860    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xqfg7\" (UniqueName: \"kubernetes.io/projected/41ccab8b-5953-48b3-9ca8-76a9fd9d8f22-kube-api-access-xqfg7\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 14:32:47.199872 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:47.199869    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/41ccab8b-5953-48b3-9ca8-76a9fd9d8f22-dshm\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 14:32:47.468999 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:47.468917    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7614-140515782236176"]
Jul 22 14:32:47.469310 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:47.469297    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24a0e522-a535-4b85-9510-1f30bf5c0f97" containerName="main"
Jul 22 14:32:47.469353 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:47.469311    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="24a0e522-a535-4b85-9510-1f30bf5c0f97" containerName="main"
Jul 22 14:32:47.469353 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:47.469322    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41ccab8b-5953-48b3-9ca8-76a9fd9d8f22" containerName="main"
Jul 22 14:32:47.469353 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:47.469327    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="41ccab8b-5953-48b3-9ca8-76a9fd9d8f22" containerName="main"
Jul 22 14:32:47.469480 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:47.469388    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="41ccab8b-5953-48b3-9ca8-76a9fd9d8f22" containerName="main"
Jul 22 14:32:47.469480 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:47.469399    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="24a0e522-a535-4b85-9510-1f30bf5c0f97" containerName="main"
Jul 22 14:32:47.472629 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:47.472611    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7614-140515782236176"
Jul 22 14:32:47.475193 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:47.475164    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-47wr4\""
Jul 22 14:32:47.476682 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:47.476657    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7614-140515782236176"]
Jul 22 14:32:47.535064 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:47.535029    2571 generic.go:356] "Generic (PLEG): container finished" podID="41ccab8b-5953-48b3-9ca8-76a9fd9d8f22" containerID="d7bf2b1615bb841e6561a741a4c5380e00db00f9c06a6396167b9debda2b6df7" exitCode=0
Jul 22 14:32:47.535218 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:47.535077    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f0b3df/rate-test-model-f0b3df-kserve-7f4c857879-cv9hq"
Jul 22 14:32:47.535218 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:47.535085    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f0b3df/rate-test-model-f0b3df-kserve-7f4c857879-cv9hq" event={"ID":"41ccab8b-5953-48b3-9ca8-76a9fd9d8f22","Type":"ContainerDied","Data":"d7bf2b1615bb841e6561a741a4c5380e00db00f9c06a6396167b9debda2b6df7"}
Jul 22 14:32:47.535218 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:47.535124    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f0b3df/rate-test-model-f0b3df-kserve-7f4c857879-cv9hq" event={"ID":"41ccab8b-5953-48b3-9ca8-76a9fd9d8f22","Type":"ContainerDied","Data":"0eee5ae2e614566a130b4334207868257f10dd7f7f49354b81fb5e3187a6c6af"}
Jul 22 14:32:47.535218 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:47.535147    2571 scope.go:117] "RemoveContainer" containerID="d7bf2b1615bb841e6561a741a4c5380e00db00f9c06a6396167b9debda2b6df7"
Jul 22 14:32:47.544677 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:47.544661    2571 scope.go:117] "RemoveContainer" containerID="d7bf2b1615bb841e6561a741a4c5380e00db00f9c06a6396167b9debda2b6df7"
Jul 22 14:32:47.545002 ip-10-0-129-134 kubenswrapper[2571]: E0722 14:32:47.544978    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7bf2b1615bb841e6561a741a4c5380e00db00f9c06a6396167b9debda2b6df7\": container with ID starting with d7bf2b1615bb841e6561a741a4c5380e00db00f9c06a6396167b9debda2b6df7 not found: ID does not exist" containerID="d7bf2b1615bb841e6561a741a4c5380e00db00f9c06a6396167b9debda2b6df7"
Jul 22 14:32:47.545101 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:47.545019    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7bf2b1615bb841e6561a741a4c5380e00db00f9c06a6396167b9debda2b6df7"} err="failed to get container status \"d7bf2b1615bb841e6561a741a4c5380e00db00f9c06a6396167b9debda2b6df7\": rpc error: code = NotFound desc = could not find container \"d7bf2b1615bb841e6561a741a4c5380e00db00f9c06a6396167b9debda2b6df7\": container with ID starting with d7bf2b1615bb841e6561a741a4c5380e00db00f9c06a6396167b9debda2b6df7 not found: ID does not exist"
Jul 22 14:32:47.560172 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:47.560142    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f0b3df/rate-test-model-f0b3df-kserve-7f4c857879-cv9hq"]
Jul 22 14:32:47.561800 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:47.561780    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-f0b3df/rate-test-model-f0b3df-kserve-7f4c857879-cv9hq"]
Jul 22 14:32:47.603845 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:47.603808    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sttkj\" (UniqueName: \"kubernetes.io/projected/84571509-4e73-4fb7-9878-4866151552d3-kube-api-access-sttkj\") pod \"test-curl-7614-140515782236176\" (UID: \"84571509-4e73-4fb7-9878-4866151552d3\") " pod="opendatahub/test-curl-7614-140515782236176"
Jul 22 14:32:47.705112 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:47.705066    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sttkj\" (UniqueName: \"kubernetes.io/projected/84571509-4e73-4fb7-9878-4866151552d3-kube-api-access-sttkj\") pod \"test-curl-7614-140515782236176\" (UID: \"84571509-4e73-4fb7-9878-4866151552d3\") " pod="opendatahub/test-curl-7614-140515782236176"
Jul 22 14:32:47.712937 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:47.712905    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sttkj\" (UniqueName: \"kubernetes.io/projected/84571509-4e73-4fb7-9878-4866151552d3-kube-api-access-sttkj\") pod \"test-curl-7614-140515782236176\" (UID: \"84571509-4e73-4fb7-9878-4866151552d3\") " pod="opendatahub/test-curl-7614-140515782236176"
Jul 22 14:32:47.784441 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:47.784330    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7614-140515782236176"
Jul 22 14:32:47.918255 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:47.918230    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7614-140515782236176"]
Jul 22 14:32:47.919987 ip-10-0-129-134 kubenswrapper[2571]: W0722 14:32:47.919962    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod84571509_4e73_4fb7_9878_4866151552d3.slice/crio-9fa13c75a9e1cc8cb9435457ee8dc51c45fa965c60c8df63c530d2d1191b5be1 WatchSource:0}: Error finding container 9fa13c75a9e1cc8cb9435457ee8dc51c45fa965c60c8df63c530d2d1191b5be1: Status 404 returned error can't find the container with id 9fa13c75a9e1cc8cb9435457ee8dc51c45fa965c60c8df63c530d2d1191b5be1
Jul 22 14:32:47.921195 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:47.921178    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 14:32:48.541625 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:48.541593    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7614-140515782236176" event={"ID":"84571509-4e73-4fb7-9878-4866151552d3","Type":"ContainerStarted","Data":"9fa13c75a9e1cc8cb9435457ee8dc51c45fa965c60c8df63c530d2d1191b5be1"}
Jul 22 14:32:49.009685 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:49.009646    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41ccab8b-5953-48b3-9ca8-76a9fd9d8f22" path="/var/lib/kubelet/pods/41ccab8b-5953-48b3-9ca8-76a9fd9d8f22/volumes"
Jul 22 14:32:49.549644 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:49.549609    2571 generic.go:356] "Generic (PLEG): container finished" podID="84571509-4e73-4fb7-9878-4866151552d3" containerID="e1931f84be5d993b429dcb5cf1e6cfa67f8910a22c6e01aa71567f66f727894b" exitCode=0
Jul 22 14:32:49.550043 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:49.549702    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7614-140515782236176" event={"ID":"84571509-4e73-4fb7-9878-4866151552d3","Type":"ContainerDied","Data":"e1931f84be5d993b429dcb5cf1e6cfa67f8910a22c6e01aa71567f66f727894b"}
Jul 22 14:32:50.692674 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:50.692649    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7614-140515782236176"
Jul 22 14:32:50.728708 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:50.728673    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7614-140515782236176_84571509-4e73-4fb7-9878-4866151552d3/test-curl-7614-140515782236176/0.log"
Jul 22 14:32:50.751583 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:50.751548    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7614-140515782236176"]
Jul 22 14:32:50.755746 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:50.755721    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7614-140515782236176"]
Jul 22 14:32:50.834296 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:50.834194    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sttkj\" (UniqueName: \"kubernetes.io/projected/84571509-4e73-4fb7-9878-4866151552d3-kube-api-access-sttkj\") pod \"84571509-4e73-4fb7-9878-4866151552d3\" (UID: \"84571509-4e73-4fb7-9878-4866151552d3\") "
Jul 22 14:32:50.836525 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:50.836494    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84571509-4e73-4fb7-9878-4866151552d3-kube-api-access-sttkj" (OuterVolumeSpecName: "kube-api-access-sttkj") pod "84571509-4e73-4fb7-9878-4866151552d3" (UID: "84571509-4e73-4fb7-9878-4866151552d3"). InnerVolumeSpecName "kube-api-access-sttkj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 14:32:50.935631 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:50.935595    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sttkj\" (UniqueName: \"kubernetes.io/projected/84571509-4e73-4fb7-9878-4866151552d3-kube-api-access-sttkj\") on node \"ip-10-0-129-134.ec2.internal\" DevicePath \"\""
Jul 22 14:32:51.010195 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:51.010161    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84571509-4e73-4fb7-9878-4866151552d3" path="/var/lib/kubelet/pods/84571509-4e73-4fb7-9878-4866151552d3/volumes"
Jul 22 14:32:51.563523 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:51.563493    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7614-140515782236176"
Jul 22 14:32:51.563741 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:32:51.563544    2571 scope.go:117] "RemoveContainer" containerID="e1931f84be5d993b429dcb5cf1e6cfa67f8910a22c6e01aa71567f66f727894b"
Jul 22 14:33:04.081507 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:33:04.081467    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:33:26.762008 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:33:26.761966    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jdlnr"]
Jul 22 14:33:42.401441 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:33:42.401398    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-65657c6f45-mtkf6_528a3944-350d-4dff-a282-f1d19603ce58/copy-manifests/0.log"
Jul 22 14:33:42.408992 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:33:42.408960    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-65657c6f45-mtkf6_528a3944-350d-4dff-a282-f1d19603ce58/manager/0.log"
Jul 22 14:33:45.002096 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:33:45.002067    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-mxjl8_239b7f6e-7911-44e9-ad38-18ff81c82793/kuadrant-console-plugin/0.log"
Jul 22 14:33:45.366450 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:33:45.366395    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-jdlnr_d0663eea-3652-4fa6-ae21-5bae8d48a352/limitador/0.log"
Jul 22 14:33:46.131282 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:33:46.131237    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6cd5b47b7c-22b2j_aa75070f-78a1-42ae-966a-a489d3a50117/kube-auth-proxy/0.log"
Jul 22 14:33:47.098045 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:33:47.098016    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-8n7k4_355939bd-e62c-4392-8d02-d0a34c6d7f87/main/0.log"
Jul 22 14:33:47.607890 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:33:47.607857    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-gcpnm_919ba490-d3ce-4933-98c9-9b1d369e196a/main/0.log"
Jul 22 14:33:47.725335 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:33:47.725300    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-hswq6_97bd4461-4fa4-4582-8115-8c39e665cbcf/main/0.log"
Jul 22 14:33:56.239717 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:33:56.239672    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-2mjnn_f98c3223-5fb5-4366-98ba-2fe5d046a496/global-pull-secret-syncer/0.log"
Jul 22 14:33:56.448053 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:33:56.448016    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-t8btt_8cc6486a-acc2-43e8-8909-bb52ed47fd7a/konnectivity-agent/0.log"
Jul 22 14:33:56.472943 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:33:56.472905    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-134.ec2.internal_2fe22260834f3ba68797b548033e91dd/haproxy/0.log"
Jul 22 14:34:02.477831 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:02.477798    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-mxjl8_239b7f6e-7911-44e9-ad38-18ff81c82793/kuadrant-console-plugin/0.log"
Jul 22 14:34:02.724351 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:02.724316    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-jdlnr_d0663eea-3652-4fa6-ae21-5bae8d48a352/limitador/0.log"
Jul 22 14:34:04.373147 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:04.373056    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3a60900c-94b9-4f64-863e-03c5abf6e7af/alertmanager/0.log"
Jul 22 14:34:04.395649 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:04.395622    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3a60900c-94b9-4f64-863e-03c5abf6e7af/config-reloader/0.log"
Jul 22 14:34:04.420002 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:04.419975    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3a60900c-94b9-4f64-863e-03c5abf6e7af/kube-rbac-proxy-web/0.log"
Jul 22 14:34:04.439844 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:04.439815    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3a60900c-94b9-4f64-863e-03c5abf6e7af/kube-rbac-proxy/0.log"
Jul 22 14:34:04.463218 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:04.463190    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3a60900c-94b9-4f64-863e-03c5abf6e7af/kube-rbac-proxy-metric/0.log"
Jul 22 14:34:04.482872 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:04.482838    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3a60900c-94b9-4f64-863e-03c5abf6e7af/prom-label-proxy/0.log"
Jul 22 14:34:04.507360 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:04.507327    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3a60900c-94b9-4f64-863e-03c5abf6e7af/init-config-reloader/0.log"
Jul 22 14:34:04.577856 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:04.577834    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-nfm9n_e46d2550-e8cc-4cf9-95d8-e33f0a187d87/kube-state-metrics/0.log"
Jul 22 14:34:04.595072 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:04.595040    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-nfm9n_e46d2550-e8cc-4cf9-95d8-e33f0a187d87/kube-rbac-proxy-main/0.log"
Jul 22 14:34:04.615401 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:04.615375    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-nfm9n_e46d2550-e8cc-4cf9-95d8-e33f0a187d87/kube-rbac-proxy-self/0.log"
Jul 22 14:34:04.640933 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:04.640840    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5cc75bbc57-kzjfv_32a4bdae-4f6e-4f69-a274-272029d112cb/metrics-server/0.log"
Jul 22 14:34:04.664422 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:04.664382    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-m85wz_d18e428b-7e50-4856-accf-a11a1b24c9db/monitoring-plugin/0.log"
Jul 22 14:34:04.784620 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:04.784590    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5x2fw_503d6cac-907a-4386-88f6-be0aeab5f8c3/node-exporter/0.log"
Jul 22 14:34:04.802976 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:04.802944    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5x2fw_503d6cac-907a-4386-88f6-be0aeab5f8c3/kube-rbac-proxy/0.log"
Jul 22 14:34:04.822954 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:04.822925    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5x2fw_503d6cac-907a-4386-88f6-be0aeab5f8c3/init-textfile/0.log"
Jul 22 14:34:04.926435 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:04.926320    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-4qzld_6003069e-d7f1-4ba5-a4aa-443d288f9a76/kube-rbac-proxy-main/0.log"
Jul 22 14:34:04.945858 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:04.945830    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-4qzld_6003069e-d7f1-4ba5-a4aa-443d288f9a76/kube-rbac-proxy-self/0.log"
Jul 22 14:34:04.965312 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:04.965271    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-4qzld_6003069e-d7f1-4ba5-a4aa-443d288f9a76/openshift-state-metrics/0.log"
Jul 22 14:34:05.000195 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:05.000169    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_871196a7-66d1-4412-9e0a-50782afa3418/prometheus/0.log"
Jul 22 14:34:05.020167 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:05.020139    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_871196a7-66d1-4412-9e0a-50782afa3418/config-reloader/0.log"
Jul 22 14:34:05.039766 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:05.039731    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_871196a7-66d1-4412-9e0a-50782afa3418/thanos-sidecar/0.log"
Jul 22 14:34:05.062624 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:05.062595    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_871196a7-66d1-4412-9e0a-50782afa3418/kube-rbac-proxy-web/0.log"
Jul 22 14:34:05.082480 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:05.082452    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_871196a7-66d1-4412-9e0a-50782afa3418/kube-rbac-proxy/0.log"
Jul 22 14:34:05.103948 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:05.103922    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_871196a7-66d1-4412-9e0a-50782afa3418/kube-rbac-proxy-thanos/0.log"
Jul 22 14:34:05.124668 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:05.124644    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_871196a7-66d1-4412-9e0a-50782afa3418/init-config-reloader/0.log"
Jul 22 14:34:05.153966 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:05.153937    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-s9795_03c6e61c-b09c-4e49-8e27-350275208260/prometheus-operator/0.log"
Jul 22 14:34:05.168528 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:05.168500    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-s9795_03c6e61c-b09c-4e49-8e27-350275208260/kube-rbac-proxy/0.log"
Jul 22 14:34:05.190053 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:05.189968    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-2txv7_01a4e9d8-2df7-4ae4-b6ae-0960a2e30a4e/prometheus-operator-admission-webhook/0.log"
Jul 22 14:34:05.292057 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:05.292021    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f97895fff-4bg8g_3a0ef70c-bde8-4340-8e02-33261da5f404/thanos-query/0.log"
Jul 22 14:34:05.310859 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:05.310830    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f97895fff-4bg8g_3a0ef70c-bde8-4340-8e02-33261da5f404/kube-rbac-proxy-web/0.log"
Jul 22 14:34:05.330886 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:05.330856    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f97895fff-4bg8g_3a0ef70c-bde8-4340-8e02-33261da5f404/kube-rbac-proxy/0.log"
Jul 22 14:34:05.350800 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:05.350768    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f97895fff-4bg8g_3a0ef70c-bde8-4340-8e02-33261da5f404/prom-label-proxy/0.log"
Jul 22 14:34:05.371240 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:05.371213    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f97895fff-4bg8g_3a0ef70c-bde8-4340-8e02-33261da5f404/kube-rbac-proxy-rules/0.log"
Jul 22 14:34:05.391024 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:05.390998    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f97895fff-4bg8g_3a0ef70c-bde8-4340-8e02-33261da5f404/kube-rbac-proxy-metrics/0.log"
Jul 22 14:34:06.211254 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:06.211221    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-nmppv/perf-node-gather-daemonset-f7bmt"]
Jul 22 14:34:06.211648 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:06.211634    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84571509-4e73-4fb7-9878-4866151552d3" containerName="test-curl-7614-140515782236176"
Jul 22 14:34:06.211696 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:06.211649    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="84571509-4e73-4fb7-9878-4866151552d3" containerName="test-curl-7614-140515782236176"
Jul 22 14:34:06.211739 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:06.211711    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="84571509-4e73-4fb7-9878-4866151552d3" containerName="test-curl-7614-140515782236176"
Jul 22 14:34:06.215068 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:06.215046    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nmppv/perf-node-gather-daemonset-f7bmt"
Jul 22 14:34:06.216976 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:06.216954    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nmppv\"/\"kube-root-ca.crt\""
Jul 22 14:34:06.217107 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:06.217090    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nmppv\"/\"openshift-service-ca.crt\""
Jul 22 14:34:06.217503 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:06.217489    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-nmppv\"/\"default-dockercfg-f2m7r\""
Jul 22 14:34:06.223986 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:06.223962    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nmppv/perf-node-gather-daemonset-f7bmt"]
Jul 22 14:34:06.363277 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:06.363235    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mz6m\" (UniqueName: \"kubernetes.io/projected/0d199688-8134-4e4e-8d88-e07ba59a135f-kube-api-access-9mz6m\") pod \"perf-node-gather-daemonset-f7bmt\" (UID: \"0d199688-8134-4e4e-8d88-e07ba59a135f\") " pod="openshift-must-gather-nmppv/perf-node-gather-daemonset-f7bmt"
Jul 22 14:34:06.363497 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:06.363291    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0d199688-8134-4e4e-8d88-e07ba59a135f-lib-modules\") pod \"perf-node-gather-daemonset-f7bmt\" (UID: \"0d199688-8134-4e4e-8d88-e07ba59a135f\") " pod="openshift-must-gather-nmppv/perf-node-gather-daemonset-f7bmt"
Jul 22 14:34:06.363497 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:06.363339    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0d199688-8134-4e4e-8d88-e07ba59a135f-sys\") pod \"perf-node-gather-daemonset-f7bmt\" (UID: \"0d199688-8134-4e4e-8d88-e07ba59a135f\") " pod="openshift-must-gather-nmppv/perf-node-gather-daemonset-f7bmt"
Jul 22 14:34:06.363497 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:06.363365    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0d199688-8134-4e4e-8d88-e07ba59a135f-podres\") pod \"perf-node-gather-daemonset-f7bmt\" (UID: \"0d199688-8134-4e4e-8d88-e07ba59a135f\") " pod="openshift-must-gather-nmppv/perf-node-gather-daemonset-f7bmt"
Jul 22 14:34:06.363497 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:06.363391    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0d199688-8134-4e4e-8d88-e07ba59a135f-proc\") pod \"perf-node-gather-daemonset-f7bmt\" (UID: \"0d199688-8134-4e4e-8d88-e07ba59a135f\") " pod="openshift-must-gather-nmppv/perf-node-gather-daemonset-f7bmt"
Jul 22 14:34:06.464797 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:06.464713    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0d199688-8134-4e4e-8d88-e07ba59a135f-lib-modules\") pod \"perf-node-gather-daemonset-f7bmt\" (UID: \"0d199688-8134-4e4e-8d88-e07ba59a135f\") " pod="openshift-must-gather-nmppv/perf-node-gather-daemonset-f7bmt"
Jul 22 14:34:06.464797 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:06.464761    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0d199688-8134-4e4e-8d88-e07ba59a135f-sys\") pod \"perf-node-gather-daemonset-f7bmt\" (UID: \"0d199688-8134-4e4e-8d88-e07ba59a135f\") " pod="openshift-must-gather-nmppv/perf-node-gather-daemonset-f7bmt"
Jul 22 14:34:06.464797 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:06.464779    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0d199688-8134-4e4e-8d88-e07ba59a135f-podres\") pod \"perf-node-gather-daemonset-f7bmt\" (UID: \"0d199688-8134-4e4e-8d88-e07ba59a135f\") " pod="openshift-must-gather-nmppv/perf-node-gather-daemonset-f7bmt"
Jul 22 14:34:06.464797 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:06.464799    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0d199688-8134-4e4e-8d88-e07ba59a135f-proc\") pod \"perf-node-gather-daemonset-f7bmt\" (UID: \"0d199688-8134-4e4e-8d88-e07ba59a135f\") " pod="openshift-must-gather-nmppv/perf-node-gather-daemonset-f7bmt"
Jul 22 14:34:06.465291 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:06.464848    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0d199688-8134-4e4e-8d88-e07ba59a135f-sys\") pod \"perf-node-gather-daemonset-f7bmt\" (UID: \"0d199688-8134-4e4e-8d88-e07ba59a135f\") " pod="openshift-must-gather-nmppv/perf-node-gather-daemonset-f7bmt"
Jul 22 14:34:06.465291 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:06.464902    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0d199688-8134-4e4e-8d88-e07ba59a135f-lib-modules\") pod \"perf-node-gather-daemonset-f7bmt\" (UID: \"0d199688-8134-4e4e-8d88-e07ba59a135f\") " pod="openshift-must-gather-nmppv/perf-node-gather-daemonset-f7bmt"
Jul 22 14:34:06.465291 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:06.464915    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0d199688-8134-4e4e-8d88-e07ba59a135f-podres\") pod \"perf-node-gather-daemonset-f7bmt\" (UID: \"0d199688-8134-4e4e-8d88-e07ba59a135f\") " pod="openshift-must-gather-nmppv/perf-node-gather-daemonset-f7bmt"
Jul 22 14:34:06.465291 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:06.464922    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0d199688-8134-4e4e-8d88-e07ba59a135f-proc\") pod \"perf-node-gather-daemonset-f7bmt\" (UID: \"0d199688-8134-4e4e-8d88-e07ba59a135f\") " pod="openshift-must-gather-nmppv/perf-node-gather-daemonset-f7bmt"
Jul 22 14:34:06.465291 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:06.464910    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mz6m\" (UniqueName: \"kubernetes.io/projected/0d199688-8134-4e4e-8d88-e07ba59a135f-kube-api-access-9mz6m\") pod \"perf-node-gather-daemonset-f7bmt\" (UID: \"0d199688-8134-4e4e-8d88-e07ba59a135f\") " pod="openshift-must-gather-nmppv/perf-node-gather-daemonset-f7bmt"
Jul 22 14:34:06.472271 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:06.472249    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mz6m\" (UniqueName: \"kubernetes.io/projected/0d199688-8134-4e4e-8d88-e07ba59a135f-kube-api-access-9mz6m\") pod \"perf-node-gather-daemonset-f7bmt\" (UID: \"0d199688-8134-4e4e-8d88-e07ba59a135f\") " pod="openshift-must-gather-nmppv/perf-node-gather-daemonset-f7bmt"
Jul 22 14:34:06.526147 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:06.526111    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nmppv/perf-node-gather-daemonset-f7bmt"
Jul 22 14:34:06.660761 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:06.660616    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nmppv/perf-node-gather-daemonset-f7bmt"]
Jul 22 14:34:06.663532 ip-10-0-129-134 kubenswrapper[2571]: W0722 14:34:06.663502    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0d199688_8134_4e4e_8d88_e07ba59a135f.slice/crio-b5dbd0414bd3e424494929527c959f5a06e87d030169cae04b582c556c82d677 WatchSource:0}: Error finding container b5dbd0414bd3e424494929527c959f5a06e87d030169cae04b582c556c82d677: Status 404 returned error can't find the container with id b5dbd0414bd3e424494929527c959f5a06e87d030169cae04b582c556c82d677
Jul 22 14:34:06.938302 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:06.938266    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nmppv/perf-node-gather-daemonset-f7bmt" event={"ID":"0d199688-8134-4e4e-8d88-e07ba59a135f","Type":"ContainerStarted","Data":"fe14747d52c4085c97de6526157dd29c9063e369077001c07c290c168e4a3ad5"}
Jul 22 14:34:06.938472 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:06.938317    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nmppv/perf-node-gather-daemonset-f7bmt" event={"ID":"0d199688-8134-4e4e-8d88-e07ba59a135f","Type":"ContainerStarted","Data":"b5dbd0414bd3e424494929527c959f5a06e87d030169cae04b582c556c82d677"}
Jul 22 14:34:06.938472 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:06.938348    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-nmppv/perf-node-gather-daemonset-f7bmt"
Jul 22 14:34:06.959530 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:06.959473    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-nmppv/perf-node-gather-daemonset-f7bmt" podStartSLOduration=0.959451234 podStartE2EDuration="959.451234ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 14:34:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 14:34:06.958088651 +0000 UTC m=+2857.012865327" watchObservedRunningTime="2026-07-22 14:34:06.959451234 +0000 UTC m=+2857.014227910"
Jul 22 14:34:07.734633 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:07.734605    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-86b5568d9b-ssrgk_bd80c2db-b18a-4eb5-9ec8-e00e6d720712/console/0.log"
Jul 22 14:34:07.772841 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:07.772809    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-qtfwp_b39f28a3-7295-4632-a3f0-c0b8525cba01/download-server/0.log"
Jul 22 14:34:09.317648 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:09.317618    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-87d25_c9b21c6d-4ef7-4362-9b59-54cba94ec969/dns/0.log"
Jul 22 14:34:09.340970 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:09.340924    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-87d25_c9b21c6d-4ef7-4362-9b59-54cba94ec969/kube-rbac-proxy/0.log"
Jul 22 14:34:09.460001 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:09.459964    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7njvq_ca3f3ac1-a31f-42c8-927c-fca4c9c77f9d/dns-node-resolver/0.log"
Jul 22 14:34:10.099101 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:10.099067    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nqwc8_fc26b8c7-376d-4d8c-ba98-ee3f2fe3fb6d/node-ca/0.log"
Jul 22 14:34:11.246346 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:11.246310    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6cd5b47b7c-22b2j_aa75070f-78a1-42ae-966a-a489d3a50117/kube-auth-proxy/0.log"
Jul 22 14:34:12.194237 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:12.194202    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lxfbl_4c25882a-b837-4e4b-884c-be514d536810/serve-healthcheck-canary/0.log"
Jul 22 14:34:12.696292 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:12.696248    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5kzh9_c8e78e65-8e84-49f4-b376-e3d7576e4cfb/kube-rbac-proxy/0.log"
Jul 22 14:34:12.716092 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:12.716059    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5kzh9_c8e78e65-8e84-49f4-b376-e3d7576e4cfb/exporter/0.log"
Jul 22 14:34:12.738609 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:12.738579    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5kzh9_c8e78e65-8e84-49f4-b376-e3d7576e4cfb/extractor/0.log"
Jul 22 14:34:12.954014 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:12.953938    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-nmppv/perf-node-gather-daemonset-f7bmt"
Jul 22 14:34:15.460210 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:15.460179    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-65657c6f45-mtkf6_528a3944-350d-4dff-a282-f1d19603ce58/manager/0.log"
Jul 22 14:34:15.478898 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:15.478869    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-65657c6f45-mtkf6_528a3944-350d-4dff-a282-f1d19603ce58/copy-manifests/0.log"
Jul 22 14:34:16.740131 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:16.740034    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6cd5b47b7c-22b2j_aa75070f-78a1-42ae-966a-a489d3a50117/kube-auth-proxy/0.log"
Jul 22 14:34:16.878662 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:16.878635    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-85c77b7bd5-2xbhr_16981286-7314-462c-9c73-fc4e7833cd35/manager/0.log"
Jul 22 14:34:18.305398 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:18.305353    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6cd5b47b7c-22b2j_aa75070f-78a1-42ae-966a-a489d3a50117/kube-auth-proxy/0.log"
Jul 22 14:34:23.368869 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:23.368833    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-9b5t7_2143f777-15e0-47a1-b828-8a1729e26771/kube-multus/0.log"
Jul 22 14:34:23.685807 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:23.685781    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fphwm_76bf4e1c-a08a-48d5-965c-19c62daf827b/kube-multus-additional-cni-plugins/0.log"
Jul 22 14:34:23.706719 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:23.706690    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fphwm_76bf4e1c-a08a-48d5-965c-19c62daf827b/egress-router-binary-copy/0.log"
Jul 22 14:34:23.725333 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:23.725301    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fphwm_76bf4e1c-a08a-48d5-965c-19c62daf827b/cni-plugins/0.log"
Jul 22 14:34:23.743294 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:23.743268    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fphwm_76bf4e1c-a08a-48d5-965c-19c62daf827b/bond-cni-plugin/0.log"
Jul 22 14:34:23.764844 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:23.764818    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fphwm_76bf4e1c-a08a-48d5-965c-19c62daf827b/routeoverride-cni/0.log"
Jul 22 14:34:23.783754 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:23.783727    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fphwm_76bf4e1c-a08a-48d5-965c-19c62daf827b/whereabouts-cni-bincopy/0.log"
Jul 22 14:34:23.804880 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:23.804856    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fphwm_76bf4e1c-a08a-48d5-965c-19c62daf827b/whereabouts-cni/0.log"
Jul 22 14:34:23.994376 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:23.994289    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-tjsf5_fd1bdec0-2890-4b8e-8be8-521df53174ac/network-metrics-daemon/0.log"
Jul 22 14:34:24.011580 ip-10-0-129-134 kubenswrapper[2571]: I0722 14:34:24.011552    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-tjsf5_fd1bdec0-2890-4b8e-8be8-521df53174ac/kube-rbac-proxy/0.log"