Jul 07 16:23:17.796701 ip-10-0-129-6 systemd[1]: Starting Kubernetes Kubelet...
Jul 07 16:23:18.300283 ip-10-0-129-6 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 16:23:18.300283 ip-10-0-129-6 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 07 16:23:18.300283 ip-10-0-129-6 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 16:23:18.300283 ip-10-0-129-6 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 07 16:23:18.300283 ip-10-0-129-6 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 16:23:18.300283 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.217581    2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 07 16:23:18.300283 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222465    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 16:23:18.300283 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222483    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 16:23:18.300283 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222488    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 16:23:18.300283 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222492    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 16:23:18.300283 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222497    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 16:23:18.300283 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222500    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 16:23:18.300283 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222503    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 16:23:18.300283 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222507    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 16:23:18.301720 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222510    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 16:23:18.301720 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222513    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 16:23:18.301720 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222524    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 16:23:18.301720 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222528    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 16:23:18.301720 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222532    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 16:23:18.301720 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222535    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 16:23:18.301720 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222538    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 16:23:18.301720 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222541    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 16:23:18.301720 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222544    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 16:23:18.301720 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222547    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 16:23:18.301720 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222550    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 16:23:18.301720 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222553    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 16:23:18.301720 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222556    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 16:23:18.301720 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222559    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 16:23:18.301720 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222562    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 16:23:18.301720 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222565    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 16:23:18.301720 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222567    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 16:23:18.301720 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222570    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 16:23:18.301720 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222573    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 16:23:18.301720 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222576    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 16:23:18.302406 ip-10-0-129-6 systemd[1]: Started Kubernetes Kubelet.
Jul 07 16:23:18.302752 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222578    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 16:23:18.302752 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222581    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 16:23:18.302752 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222584    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 16:23:18.302752 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222587    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 16:23:18.302752 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222589    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 16:23:18.302752 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222592    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 16:23:18.302752 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222595    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 16:23:18.302752 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222597    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 16:23:18.302752 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222601    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 16:23:18.302752 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222604    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 16:23:18.302752 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222607    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 16:23:18.302752 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222610    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 16:23:18.302752 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222613    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 16:23:18.302752 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222616    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 16:23:18.302752 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222620    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 16:23:18.302752 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222624    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 16:23:18.302752 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222628    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 16:23:18.302752 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222631    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 16:23:18.302752 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222634    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 16:23:18.303756 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222637    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 16:23:18.303756 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222640    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 16:23:18.303756 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222642    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 16:23:18.303756 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222645    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 16:23:18.303756 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222648    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 16:23:18.303756 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222651    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 16:23:18.303756 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222654    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 16:23:18.303756 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222657    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 16:23:18.303756 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222662    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 16:23:18.303756 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222667    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 16:23:18.303756 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222672    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 16:23:18.303756 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222675    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 16:23:18.303756 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222679    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 16:23:18.303756 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222682    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 16:23:18.303756 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222685    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 16:23:18.303756 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222688    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 16:23:18.303756 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222691    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 16:23:18.303756 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222695    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 16:23:18.303756 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222698    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 16:23:18.305447 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222701    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 16:23:18.305447 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222704    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 16:23:18.305447 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222707    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 16:23:18.305447 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222711    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 16:23:18.305447 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222713    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 16:23:18.305447 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222717    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 16:23:18.305447 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222719    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 16:23:18.305447 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222722    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 16:23:18.305447 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222725    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 16:23:18.305447 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222728    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 16:23:18.305447 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222731    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 16:23:18.305447 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222734    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 16:23:18.305447 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222736    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 16:23:18.305447 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222739    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 16:23:18.305447 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222742    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 16:23:18.305447 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222745    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 16:23:18.305447 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222747    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 16:23:18.305447 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222750    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 16:23:18.305447 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222752    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 16:23:18.305447 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222756    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 16:23:18.306310 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222760    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 16:23:18.306310 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222763    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 16:23:18.306310 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222766    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 16:23:18.306310 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222768    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 16:23:18.306310 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222771    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 16:23:18.306310 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222774    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 16:23:18.306310 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222777    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 16:23:18.306310 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222780    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 16:23:18.306310 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222782    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 16:23:18.306310 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222787    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 16:23:18.306310 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222790    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 16:23:18.306310 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222794    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 16:23:18.306310 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.222797    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 16:23:18.306310 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223687    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 16:23:18.306310 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223696    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 16:23:18.306310 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223699    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 16:23:18.306310 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223703    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 16:23:18.306310 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223706    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 16:23:18.306310 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223710    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 16:23:18.306310 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223713    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 16:23:18.307310 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223717    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 16:23:18.307310 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223719    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 16:23:18.307310 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223723    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 16:23:18.307310 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223726    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 16:23:18.307310 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223729    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 16:23:18.307310 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223733    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 16:23:18.307310 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223736    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 16:23:18.307310 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223739    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 16:23:18.307310 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223742    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 16:23:18.307310 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223744    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 16:23:18.307310 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223747    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 16:23:18.307310 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223750    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 16:23:18.307310 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223753    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 16:23:18.307310 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223755    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 16:23:18.307310 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223758    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 16:23:18.307310 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223761    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 16:23:18.307310 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223764    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 16:23:18.307310 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223768    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 16:23:18.307310 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223773    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 16:23:18.308089 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223777    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 16:23:18.308089 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223780    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 16:23:18.308089 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223784    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 16:23:18.308089 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223787    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 16:23:18.308089 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223790    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 16:23:18.308089 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223793    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 16:23:18.308089 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223796    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 16:23:18.308089 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223799    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 16:23:18.308089 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223802    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 16:23:18.308089 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223805    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 16:23:18.308089 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223808    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 16:23:18.308089 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223811    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 16:23:18.308089 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223815    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 16:23:18.308089 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223818    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 16:23:18.308089 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223822    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 16:23:18.308089 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223825    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 16:23:18.308089 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223827    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 16:23:18.308089 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223831    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 16:23:18.308089 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223834    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 16:23:18.308089 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223837    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 16:23:18.308761 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223840    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 16:23:18.308761 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223843    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 16:23:18.308761 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223846    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 16:23:18.308761 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223849    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 16:23:18.308761 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223852    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 16:23:18.308761 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223855    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 16:23:18.308761 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223858    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 16:23:18.308761 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223860    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 16:23:18.308761 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223863    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 16:23:18.308761 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223867    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 16:23:18.308761 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223874    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 16:23:18.308761 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223877    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 16:23:18.308761 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223880    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 16:23:18.308761 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223883    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 16:23:18.308761 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223888    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 16:23:18.308761 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223891    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 16:23:18.308761 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223895    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 16:23:18.308761 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223898    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 16:23:18.308761 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223901    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 16:23:18.308761 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223904    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 16:23:18.309435 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223907    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 16:23:18.309435 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223910    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 16:23:18.309435 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223913    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 16:23:18.309435 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223916    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 16:23:18.309435 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223919    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 16:23:18.309435 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223923    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 16:23:18.309435 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223926    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 16:23:18.309435 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223929    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 16:23:18.309435 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223932    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 16:23:18.309435 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223935    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 16:23:18.309435 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223938    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 16:23:18.309435 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223940    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 16:23:18.309435 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223943    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 16:23:18.309435 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223946    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 16:23:18.309435 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223949    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 16:23:18.309435 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223951    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 16:23:18.309435 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223954    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 16:23:18.309435 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223957    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 16:23:18.309435 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223961    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 16:23:18.310169 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223965    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 16:23:18.310169 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223968    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 16:23:18.310169 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223971    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 16:23:18.310169 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223976    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 16:23:18.310169 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223979    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 16:23:18.310169 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223982    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 16:23:18.310169 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223984    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 16:23:18.310169 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223987    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 16:23:18.310169 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223990    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 16:23:18.310169 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223993    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 16:23:18.310169 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223996    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 16:23:18.310169 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.223999    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 16:23:18.310169 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224002    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 16:23:18.310169 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224005    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 16:23:18.310169 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224507    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 16:23:18.310169 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224514    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 16:23:18.310169 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224518    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 16:23:18.310169 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224521    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 16:23:18.310169 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224525    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 16:23:18.310169 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224528    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 16:23:18.310809 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224531    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 16:23:18.310809 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224534    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 16:23:18.310809 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224538    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 16:23:18.310809 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224541    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 16:23:18.310809 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224543    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 16:23:18.310809 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224546    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 16:23:18.310809 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224549    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 16:23:18.310809 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224551    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 16:23:18.310809 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224554    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 16:23:18.310809 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224557    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 16:23:18.310809 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224560    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 16:23:18.310809 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224562    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 16:23:18.310809 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224565    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 16:23:18.310809 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224568    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 16:23:18.310809 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224571    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 16:23:18.310809 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224576    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 16:23:18.310809 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224579    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 16:23:18.310809 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224582    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 16:23:18.310809 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224585    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 16:23:18.412115 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224588    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 16:23:18.412115 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224591    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 16:23:18.412115 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224593    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 16:23:18.412115 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224596    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 16:23:18.412115 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224599    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 16:23:18.412115 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224602    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 16:23:18.412115 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224604    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 16:23:18.412115 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224607    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 16:23:18.412115 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224610    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 16:23:18.412115 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224614    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 16:23:18.412115 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224617    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 16:23:18.412115 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224620    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 16:23:18.412115 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224623    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 16:23:18.412115 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224626    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 16:23:18.412115 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224628    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 16:23:18.412115 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224631    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 16:23:18.412115 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224634    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 16:23:18.412115 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224637    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 16:23:18.412115 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224640    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 16:23:18.412115 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224643    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 16:23:18.428295 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224646    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 16:23:18.428295 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224649    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 16:23:18.428295 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224651    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 16:23:18.428295 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224654    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 16:23:18.428295 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224657    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 16:23:18.428295 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224659    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 16:23:18.428295 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224662    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 16:23:18.428295 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224665    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 16:23:18.428295 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224669    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 16:23:18.428295 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224672    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 16:23:18.428295 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224676    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 16:23:18.428295 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224679    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 16:23:18.428295 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224682    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 16:23:18.428295 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224684    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 16:23:18.428295 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224688    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 16:23:18.428295 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224691    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 16:23:18.428295 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224694    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 16:23:18.428295 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224697    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 16:23:18.428295 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224699    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 16:23:18.429274 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224702    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 16:23:18.429274 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224705    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 16:23:18.429274 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224708    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 16:23:18.429274 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224710    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 16:23:18.429274 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224713    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 16:23:18.429274 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224716    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 16:23:18.429274 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224720    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 16:23:18.429274 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224723    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 16:23:18.429274 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224726    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 16:23:18.429274 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224729    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 16:23:18.429274 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224731    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 16:23:18.429274 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224736    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 16:23:18.429274 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224739    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 16:23:18.429274 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224742    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 16:23:18.429274 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224746    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 16:23:18.429274 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224750    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 16:23:18.429274 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224753    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 16:23:18.429274 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224756    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 16:23:18.429274 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224759    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 16:23:18.430195 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224763    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 16:23:18.430195 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224766    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 16:23:18.430195 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224771    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 16:23:18.430195 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224775    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 16:23:18.430195 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224778    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 16:23:18.430195 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224781    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 16:23:18.430195 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224784    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 16:23:18.430195 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224786    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 16:23:18.430195 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224789    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 16:23:18.430195 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224792    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 16:23:18.430195 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224794    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 16:23:18.430195 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224797    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 16:23:18.430195 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224800    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 16:23:18.430195 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224807    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 16:23:18.430195 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224810    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 16:23:18.430195 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.224813    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 16:23:18.430195 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.224894    2578 flags.go:64] FLAG: --address="0.0.0.0"
Jul 07 16:23:18.430195 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.224909    2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 07 16:23:18.430195 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.224916    2578 flags.go:64] FLAG: --anonymous-auth="true"
Jul 07 16:23:18.430195 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.224921    2578 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 07 16:23:18.430195 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.224939    2578 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 07 16:23:18.430988 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.224942    2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 07 16:23:18.430988 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.224947    2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 07 16:23:18.430988 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.224951    2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 07 16:23:18.430988 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.224957    2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 07 16:23:18.430988 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.224961    2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 07 16:23:18.430988 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.224964    2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 07 16:23:18.430988 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.224968    2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 07 16:23:18.430988 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.224972    2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 07 16:23:18.430988 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.224983    2578 flags.go:64] FLAG: --cgroup-root=""
Jul 07 16:23:18.430988 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.224987    2578 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 07 16:23:18.430988 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.224990    2578 flags.go:64] FLAG: --client-ca-file=""
Jul 07 16:23:18.430988 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.224993    2578 flags.go:64] FLAG: --cloud-provider="external"
Jul 07 16:23:18.430988 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.224996    2578 flags.go:64] FLAG: --cluster-dns="[]"
Jul 07 16:23:18.430988 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225006    2578 flags.go:64] FLAG: --cluster-domain=""
Jul 07 16:23:18.430988 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225009    2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 07 16:23:18.430988 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225013    2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 07 16:23:18.430988 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225016    2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 07 16:23:18.430988 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225020    2578 flags.go:64] FLAG: --container-log-max-files="5"
Jul 07 16:23:18.430988 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225024    2578 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 07 16:23:18.430988 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225027    2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 07 16:23:18.430988 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225030    2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 07 16:23:18.430988 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225034    2578 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 07 16:23:18.430988 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225037    2578 flags.go:64] FLAG: --contention-profiling="false"
Jul 07 16:23:18.430988 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225040    2578 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 07 16:23:18.431820 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225044    2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 07 16:23:18.431820 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225047    2578 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 07 16:23:18.431820 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225050    2578 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 07 16:23:18.431820 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225055    2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 07 16:23:18.431820 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225058    2578 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 07 16:23:18.431820 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225061    2578 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 07 16:23:18.431820 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225065    2578 flags.go:64] FLAG: --enable-load-reader="false"
Jul 07 16:23:18.431820 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225068    2578 flags.go:64] FLAG: --enable-server="true"
Jul 07 16:23:18.431820 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225078    2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 07 16:23:18.431820 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225085    2578 flags.go:64] FLAG: --event-burst="100"
Jul 07 16:23:18.431820 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225088    2578 flags.go:64] FLAG: --event-qps="50"
Jul 07 16:23:18.431820 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225093    2578 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 07 16:23:18.431820 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225097    2578 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 07 16:23:18.431820 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225100    2578 flags.go:64] FLAG: --eviction-hard=""
Jul 07 16:23:18.431820 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225104    2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 07 16:23:18.431820 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225107    2578 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 07 16:23:18.431820 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225111    2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 07 16:23:18.431820 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225114    2578 flags.go:64] FLAG: --eviction-soft=""
Jul 07 16:23:18.431820 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225118    2578 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 07 16:23:18.431820 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225121    2578 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 07 16:23:18.431820 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225124    2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 07 16:23:18.431820 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225130    2578 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 07 16:23:18.431820 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225133    2578 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 07 16:23:18.431820 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225136    2578 flags.go:64] FLAG: --fail-swap-on="true"
Jul 07 16:23:18.431820 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225139    2578 flags.go:64] FLAG: --feature-gates=""
Jul 07 16:23:18.432715 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225143    2578 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 07 16:23:18.432715 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225147    2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 07 16:23:18.432715 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225151    2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 07 16:23:18.432715 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225154    2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 07 16:23:18.432715 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225158    2578 flags.go:64] FLAG: --healthz-port="10248"
Jul 07 16:23:18.432715 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225161    2578 flags.go:64] FLAG: --help="false"
Jul 07 16:23:18.432715 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225164    2578 flags.go:64] FLAG: --hostname-override="ip-10-0-129-6.ec2.internal"
Jul 07 16:23:18.432715 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225167    2578 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 07 16:23:18.432715 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225171    2578 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 07 16:23:18.432715 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225174    2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 07 16:23:18.432715 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225177    2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 07 16:23:18.432715 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225181    2578 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 07 16:23:18.432715 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225184    2578 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 07 16:23:18.432715 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225187    2578 flags.go:64] FLAG: --image-service-endpoint=""
Jul 07 16:23:18.432715 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225190    2578 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 07 16:23:18.432715 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225193    2578 flags.go:64] FLAG: --kube-api-burst="100"
Jul 07 16:23:18.432715 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225197    2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 07 16:23:18.432715 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225201    2578 flags.go:64] FLAG: --kube-api-qps="50"
Jul 07 16:23:18.432715 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225205    2578 flags.go:64] FLAG: --kube-reserved=""
Jul 07 16:23:18.432715 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225208    2578 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 07 16:23:18.432715 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225211    2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 07 16:23:18.432715 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225214    2578 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 07 16:23:18.432715 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225218    2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 07 16:23:18.432715 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225221    2578 flags.go:64] FLAG: --lock-file=""
Jul 07 16:23:18.433999 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225223    2578 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 07 16:23:18.433999 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225227    2578 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 07 16:23:18.433999 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225230    2578 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 07 16:23:18.433999 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225235    2578 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 07 16:23:18.433999 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225240    2578 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 07 16:23:18.433999 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225243    2578 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 07 16:23:18.433999 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225246    2578 flags.go:64] FLAG: --logging-format="text"
Jul 07 16:23:18.433999 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225249    2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 07 16:23:18.433999 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225252    2578 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 07 16:23:18.433999 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225256    2578 flags.go:64] FLAG: --manifest-url=""
Jul 07 16:23:18.433999 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225259    2578 flags.go:64] FLAG: --manifest-url-header=""
Jul 07 16:23:18.433999 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225264    2578 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 07 16:23:18.433999 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225267    2578 flags.go:64] FLAG: --max-open-files="1000000"
Jul 07 16:23:18.433999 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225272    2578 flags.go:64] FLAG: --max-pods="110"
Jul 07 16:23:18.433999 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225275    2578 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 07 16:23:18.433999 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225279    2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 07 16:23:18.433999 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225282    2578 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 07 16:23:18.433999 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225285    2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 07 16:23:18.433999 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225288    2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 07 16:23:18.433999 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225291    2578 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 07 16:23:18.433999 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225295    2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 07 16:23:18.433999 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225302    2578 flags.go:64] FLAG: --node-status-max-images="50"
Jul 07 16:23:18.433999 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225306    2578 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 07 16:23:18.433999 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225309    2578 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 07 16:23:18.433999 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225312    2578 flags.go:64] FLAG: --pod-cidr=""
Jul 07 16:23:18.434908 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225316    2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 07 16:23:18.434908 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225324    2578 flags.go:64] FLAG: --pod-manifest-path=""
Jul 07 16:23:18.434908 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225328    2578 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 07 16:23:18.434908 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225331    2578 flags.go:64] FLAG: --pods-per-core="0"
Jul 07 16:23:18.434908 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225335    2578 flags.go:64] FLAG: --port="10250"
Jul 07 16:23:18.434908 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225338    2578 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 07 16:23:18.434908 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225341    2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-01a441b4aedcea4c6"
Jul 07 16:23:18.434908 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225345    2578 flags.go:64] FLAG: --qos-reserved=""
Jul 07 16:23:18.434908 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225348    2578 flags.go:64] FLAG: --read-only-port="10255"
Jul 07 16:23:18.434908 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225352    2578 flags.go:64] FLAG: --register-node="true"
Jul 07 16:23:18.434908 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225355    2578 flags.go:64] FLAG: --register-with-taints=""
Jul 07 16:23:18.434908 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225359    2578 flags.go:64] FLAG: --registry-burst="10"
Jul 07 16:23:18.434908 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225364    2578 flags.go:64] FLAG: --registry-qps="5"
Jul 07 16:23:18.434908 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225367    2578 flags.go:64] FLAG: --reserved-cpus=""
Jul 07 16:23:18.434908 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225370    2578 flags.go:64] FLAG: --reserved-memory=""
Jul 07 16:23:18.434908 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225374    2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 07 16:23:18.434908 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225378    2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 07 16:23:18.434908 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225381    2578 flags.go:64] FLAG: --rotate-certificates="false"
Jul 07 16:23:18.434908 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225384    2578 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 07 16:23:18.434908 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225388    2578 flags.go:64] FLAG: --runonce="false"
Jul 07 16:23:18.434908 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225391    2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 07 16:23:18.434908 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225394    2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 07 16:23:18.434908 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225397    2578 flags.go:64] FLAG: --seccomp-default="false"
Jul 07 16:23:18.434908 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225400    2578 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 07 16:23:18.434908 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225404    2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 07 16:23:18.435802 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225407    2578 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 07 16:23:18.435802 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225410    2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 07 16:23:18.435802 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225413    2578 flags.go:64] FLAG: --storage-driver-password="root"
Jul 07 16:23:18.435802 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225430    2578 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 07 16:23:18.435802 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225441    2578 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 07 16:23:18.435802 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225446    2578 flags.go:64] FLAG: --storage-driver-user="root"
Jul 07 16:23:18.435802 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225449    2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 07 16:23:18.435802 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225452    2578 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 07 16:23:18.435802 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225458    2578 flags.go:64] FLAG: --system-cgroups=""
Jul 07 16:23:18.435802 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225461    2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 07 16:23:18.435802 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225467    2578 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 07 16:23:18.435802 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225471    2578 flags.go:64] FLAG: --tls-cert-file=""
Jul 07 16:23:18.435802 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225474    2578 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 07 16:23:18.435802 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225479    2578 flags.go:64] FLAG: --tls-min-version=""
Jul 07 16:23:18.435802 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225482    2578 flags.go:64] FLAG: --tls-private-key-file=""
Jul 07 16:23:18.435802 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225485    2578 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 07 16:23:18.435802 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225489    2578 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 07 16:23:18.435802 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225492    2578 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 07 16:23:18.435802 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225495    2578 flags.go:64] FLAG: --v="2"
Jul 07 16:23:18.435802 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225501    2578 flags.go:64] FLAG: --version="false"
Jul 07 16:23:18.435802 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225506    2578 flags.go:64] FLAG: --vmodule=""
Jul 07 16:23:18.435802 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225510    2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 07 16:23:18.435802 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.225514    2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 07 16:23:18.435802 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225645    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 16:23:18.435802 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225649    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 16:23:18.436682 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225652    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 16:23:18.436682 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225656    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 16:23:18.436682 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225659    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 16:23:18.436682 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225662    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 16:23:18.436682 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225665    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 16:23:18.436682 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225669    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 16:23:18.436682 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225672    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 16:23:18.436682 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225675    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 16:23:18.436682 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225678    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 16:23:18.436682 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225680    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 16:23:18.436682 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225683    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 16:23:18.436682 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225686    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 16:23:18.436682 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225689    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 16:23:18.436682 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225692    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 16:23:18.436682 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225695    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 16:23:18.436682 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225699    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 16:23:18.436682 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225703    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 16:23:18.436682 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225706    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 16:23:18.436682 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225709    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 16:23:18.436682 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225712    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 16:23:18.437345 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225715    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 16:23:18.437345 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225718    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 16:23:18.437345 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225722    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 16:23:18.437345 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225726    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 16:23:18.437345 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225730    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 16:23:18.437345 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225733    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 16:23:18.437345 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225738    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 16:23:18.437345 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225741    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 16:23:18.437345 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225744    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 16:23:18.437345 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225746    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 16:23:18.437345 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225749    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 16:23:18.437345 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225752    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 16:23:18.437345 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225755    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 16:23:18.437345 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225758    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 16:23:18.437345 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225761    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 16:23:18.437345 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225764    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 16:23:18.437345 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225767    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 16:23:18.437345 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225769    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 16:23:18.437345 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225773    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 16:23:18.438035 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225775    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 16:23:18.438035 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225778    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 16:23:18.438035 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225781    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 16:23:18.438035 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225784    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 16:23:18.438035 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225787    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 16:23:18.438035 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225789    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 16:23:18.438035 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225792    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 16:23:18.438035 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225796    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 16:23:18.438035 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225801    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 16:23:18.438035 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225804    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 16:23:18.438035 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225810    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 16:23:18.438035 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225813    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 16:23:18.438035 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225816    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 16:23:18.438035 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225819    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 16:23:18.438035 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225822    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 16:23:18.438035 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225825    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 16:23:18.438035 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225827    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 16:23:18.438035 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225830    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 16:23:18.438035 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225833    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 16:23:18.438706 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225837    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 16:23:18.438706 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225840    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 16:23:18.438706 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225842    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 16:23:18.438706 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225846    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 16:23:18.438706 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225848    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 16:23:18.438706 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225851    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 16:23:18.438706 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225854    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 16:23:18.438706 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225857    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 16:23:18.438706 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225860    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 16:23:18.438706 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225863    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 16:23:18.438706 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225865    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 16:23:18.438706 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225868    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 16:23:18.438706 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225871    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 16:23:18.438706 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225874    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 16:23:18.438706 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225877    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 16:23:18.438706 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225879    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 16:23:18.438706 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225882    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 16:23:18.438706 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225885    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 16:23:18.438706 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225888    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 16:23:18.438706 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225891    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 16:23:18.439534 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225894    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 16:23:18.439534 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225898    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 16:23:18.439534 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225901    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 16:23:18.439534 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225904    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 16:23:18.439534 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225907    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 16:23:18.439534 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225910    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 16:23:18.439534 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225913    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 16:23:18.439534 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225915    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 16:23:18.439534 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225918    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 16:23:18.439534 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225921    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 16:23:18.439534 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225924    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 16:23:18.439534 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225926    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 16:23:18.439534 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225932    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 16:23:18.439534 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225936    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 16:23:18.439534 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225939    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 16:23:18.439534 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225942    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 16:23:18.439534 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225945    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 16:23:18.439534 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225948    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 16:23:18.439534 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.225951    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 16:23:18.440486 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.226652    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 16:23:18.440486 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.234404    2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 07 16:23:18.440486 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.234441    2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 07 16:23:18.440486 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.234464    2578 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 07 16:23:18.440486 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.234470    2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 07 16:23:18.440486 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234549    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 16:23:18.440486 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234555    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 16:23:18.440486 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234559    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 16:23:18.440486 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234562    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 16:23:18.440486 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234565    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 16:23:18.440486 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234568    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 16:23:18.440486 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234571    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 16:23:18.440486 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234573    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 16:23:18.440486 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234576    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 16:23:18.441279 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234581    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 16:23:18.441279 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234586    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 16:23:18.441279 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234590    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 16:23:18.441279 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234593    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 16:23:18.441279 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234596    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 16:23:18.441279 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234601    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 16:23:18.441279 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234605    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 16:23:18.441279 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234608    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 16:23:18.441279 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234611    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 16:23:18.441279 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234614    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 16:23:18.441279 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234617    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 16:23:18.441279 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234620    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 16:23:18.441279 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234623    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 16:23:18.441279 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234626    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 16:23:18.441279 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234629    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 16:23:18.441279 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234632    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 16:23:18.441279 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234636    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 16:23:18.441279 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234639    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 16:23:18.441279 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234642    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 16:23:18.442008 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234645    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 16:23:18.442008 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234650    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 16:23:18.442008 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234653    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 16:23:18.442008 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234655    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 16:23:18.442008 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234658    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 16:23:18.442008 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234661    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 16:23:18.442008 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234664    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 16:23:18.442008 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234667    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 16:23:18.442008 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234670    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 16:23:18.442008 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234673    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 16:23:18.442008 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234675    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 16:23:18.442008 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234678    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 16:23:18.442008 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234681    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 16:23:18.442008 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234683    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 16:23:18.442008 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234686    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 16:23:18.442008 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234689    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 16:23:18.442008 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234692    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 16:23:18.442008 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234695    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 16:23:18.442008 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234698    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 16:23:18.442008 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234701    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 16:23:18.443125 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234704    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 16:23:18.443125 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234706    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 16:23:18.443125 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234711    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 16:23:18.443125 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234714    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 16:23:18.443125 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234718    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 16:23:18.443125 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234721    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 16:23:18.443125 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234724    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 16:23:18.443125 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234727    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 16:23:18.443125 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234729    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 16:23:18.443125 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234732    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 16:23:18.443125 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234735    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 16:23:18.443125 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234738    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 16:23:18.443125 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234741    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 16:23:18.443125 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234745    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 16:23:18.443125 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234748    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 16:23:18.443125 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234751    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 16:23:18.443125 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234754    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 16:23:18.443125 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234757    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 16:23:18.443125 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234760    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 16:23:18.443802 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234763    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 16:23:18.443802 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234765    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 16:23:18.443802 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234768    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 16:23:18.443802 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234771    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 16:23:18.443802 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234774    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 16:23:18.443802 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234777    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 16:23:18.443802 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234779    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 16:23:18.443802 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234782    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 16:23:18.443802 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234785    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 16:23:18.443802 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234788    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 16:23:18.443802 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234791    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 16:23:18.443802 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234794    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 16:23:18.443802 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234797    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 16:23:18.443802 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234800    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 16:23:18.443802 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234802    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 16:23:18.443802 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234805    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 16:23:18.443802 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234808    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 16:23:18.443802 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234811    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 16:23:18.443802 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234814    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 16:23:18.443802 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234816    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 16:23:18.444713 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234819    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 16:23:18.444713 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234822    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 16:23:18.444713 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234825    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 16:23:18.444713 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234828    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 16:23:18.444713 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234831    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 16:23:18.444713 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234834    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 16:23:18.444713 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234836    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 16:23:18.444713 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234839    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 16:23:18.444713 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234842    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 16:23:18.444713 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234845    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 16:23:18.444713 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234848    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 16:23:18.444713 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234850    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 16:23:18.444713 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.234856    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 16:23:18.444713 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234992    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 16:23:18.444713 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.234997    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 16:23:18.445366 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235000    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 16:23:18.445366 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235003    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 16:23:18.445366 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235006    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 16:23:18.445366 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235010    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 16:23:18.445366 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235015    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 16:23:18.445366 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235018    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 16:23:18.445366 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235021    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 16:23:18.445366 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235023    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 16:23:18.445366 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235027    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 16:23:18.445366 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235029    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 16:23:18.445366 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235032    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 16:23:18.445366 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235036    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 16:23:18.445366 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235038    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 16:23:18.445366 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235041    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 16:23:18.445366 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235044    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 16:23:18.445366 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235047    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 16:23:18.445366 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235049    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 16:23:18.445366 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235052    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 16:23:18.445366 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235055    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 16:23:18.446022 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235057    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 16:23:18.446022 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235061    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 16:23:18.446022 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235064    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 16:23:18.446022 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235067    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 16:23:18.446022 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235070    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 16:23:18.446022 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235075    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 16:23:18.446022 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235078    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 16:23:18.446022 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235082    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 16:23:18.446022 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235085    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 16:23:18.446022 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235088    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 16:23:18.446022 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235091    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 16:23:18.446022 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235094    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 16:23:18.446022 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235097    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 16:23:18.446022 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235100    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 16:23:18.446022 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235103    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 16:23:18.446022 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235109    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 16:23:18.446022 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235112    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 16:23:18.446022 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235116    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 16:23:18.446022 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235118    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 16:23:18.447339 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235121    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 16:23:18.447339 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235124    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 16:23:18.447339 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235128    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 16:23:18.447339 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235132    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 16:23:18.447339 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235134    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 16:23:18.447339 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235137    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 16:23:18.447339 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235140    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 16:23:18.447339 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235143    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 16:23:18.447339 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235145    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 16:23:18.447339 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235148    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 16:23:18.447339 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235151    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 16:23:18.447339 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235154    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 16:23:18.447339 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235156    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 16:23:18.447339 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235159    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 16:23:18.447339 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235162    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 16:23:18.447339 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235165    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 16:23:18.447339 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235168    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 16:23:18.447339 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235170    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 16:23:18.447339 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235174    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 16:23:18.447339 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235177    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 16:23:18.447997 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235179    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 16:23:18.447997 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235183    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 16:23:18.447997 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235186    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 16:23:18.447997 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235189    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 16:23:18.447997 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235192    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 16:23:18.447997 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235194    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 16:23:18.447997 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235197    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 16:23:18.447997 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235199    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 16:23:18.447997 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235204    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 16:23:18.447997 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235207    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 16:23:18.447997 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235210    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 16:23:18.447997 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235213    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 16:23:18.447997 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235215    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 16:23:18.447997 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235218    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 16:23:18.447997 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235222    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 16:23:18.447997 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235225    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 16:23:18.447997 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235228    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 16:23:18.447997 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235231    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 16:23:18.447997 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235234    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 16:23:18.447997 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235236    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 16:23:18.447997 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235239    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 16:23:18.448663 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235242    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 16:23:18.448663 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235245    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 16:23:18.448663 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235248    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 16:23:18.448663 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235250    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 16:23:18.448663 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235253    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 16:23:18.448663 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235256    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 16:23:18.448663 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235259    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 16:23:18.448663 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235261    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 16:23:18.448663 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235264    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 16:23:18.448663 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235267    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 16:23:18.448663 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235269    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 16:23:18.448663 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235272    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 16:23:18.448663 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235275    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 16:23:18.448663 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235279    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 16:23:18.448663 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235283    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 16:23:18.448663 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235286    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 16:23:18.448663 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235289    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 16:23:18.448663 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:18.235292    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 16:23:18.590058 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.235298    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 16:23:18.590058 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.235494    2578 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 07 16:23:18.590058 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.237630    2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 07 16:23:18.590058 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.239407    2578 server.go:1019] "Starting client certificate rotation"
Jul 07 16:23:18.590058 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.239535    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 16:23:18.590058 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.239616    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 16:23:18.590058 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.242132    2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 16:23:18.590058 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.249329    2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 16:23:18.590058 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.258229    2578 log.go:25] "Validated CRI v1 runtime API"
Jul 07 16:23:18.590058 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.261561    2578 log.go:25] "Validated CRI v1 image API"
Jul 07 16:23:18.590058 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.262368    2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 07 16:23:18.590058 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.265186    2578 fs.go:135] Filesystem UUIDs: map[4525b760-7224-4295-97b8-844760d5c691:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 b648842f-08b7-4c97-82e8-1b062e95ffcf:/dev/nvme0n1p3]
Jul 07 16:23:18.590714 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.265210    2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 07 16:23:18.590864 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.270897    2578 manager.go:216] Machine: {Timestamp:2026-07-07 16:23:18.270073774 +0000 UTC m=+0.357042227 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102011 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec273466a354de962d8750e65e8f4c42 SystemUUID:ec273466-a354-de96-2d87-50e65e8f4c42 BootID:b63013c4-89e1-49ea-86db-c9ca5072579d Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:0a:83:02:2e:0b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:0a:83:02:2e:0b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3e:02:0b:6c:82:aa Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 07 16:23:18.590864 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.271066    2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 07 16:23:18.590864 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.271193    2578 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 07 16:23:18.590864 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.274468    2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 07 16:23:18.590864 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.274512    2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-6.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 07 16:23:18.590864 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.275545    2578 topology_manager.go:138] "Creating topology manager with none policy"
Jul 07 16:23:18.590864 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.275561    2578 container_manager_linux.go:309] "Creating device plugin manager"
Jul 07 16:23:18.590864 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.275574    2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 16:23:18.591276 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.277402    2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 16:23:18.591276 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.282674    2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 07 16:23:18.591276 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.285865    2578 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 16:23:18.591276 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.286018    2578 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 07 16:23:18.591276 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.286875    2578 kubelet.go:486] "Attempting to sync node with API server"
Jul 07 16:23:18.591276 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.286897    2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 07 16:23:18.591276 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.286920    2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 07 16:23:18.591276 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.286931    2578 kubelet.go:398] "Adding apiserver pod source"
Jul 07 16:23:18.591276 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.286943    2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 07 16:23:18.591276 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.287404    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 16:23:18.591276 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.287444    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 16:23:18.591276 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.289844    2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 07 16:23:18.591276 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.290036    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 16:23:18.591276 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.291818    2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 07 16:23:18.591276 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.291850    2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 07 16:23:18.591276 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.293364    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 07 16:23:18.591276 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.293382    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 07 16:23:18.591276 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.293388    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 07 16:23:18.591276 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.293394    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 07 16:23:18.591276 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.293404    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 07 16:23:18.591276 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.293409    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 07 16:23:18.591276 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.293430    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 07 16:23:18.591276 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.293437    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 07 16:23:18.591276 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.293445    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 07 16:23:18.591276 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.293453    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 07 16:23:18.591276 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.293463    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 07 16:23:18.591276 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.293469    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 07 16:23:18.591276 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.294230    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 07 16:23:18.591276 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.294240    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 07 16:23:18.591276 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.297270    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-6.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 07 16:23:18.591276 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:18.297368    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 07 16:23:18.591276 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:18.297384    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-6.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 07 16:23:18.591276 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.297832    2578 server.go:1268] "Started kubelet"
Jul 07 16:23:18.591276 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.301375    2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 07 16:23:18.591276 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.301437    2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 07 16:23:18.591276 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.301489    2578 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 07 16:23:18.591276 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.303416    2578 server.go:310] "Adding debug handlers to kubelet server"
Jul 07 16:23:18.591276 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.304462    2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 07 16:23:18.591276 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:18.307696    2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 07 16:23:18.592481 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:18.308615    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-6.ec2.internal.18c00e80af443ce3  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-6.ec2.internal,UID:ip-10-0-129-6.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-6.ec2.internal,},FirstTimestamp:2026-07-07 16:23:18.297804003 +0000 UTC m=+0.384772456,LastTimestamp:2026-07-07 16:23:18.297804003 +0000 UTC m=+0.384772456,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-6.ec2.internal,}"
Jul 07 16:23:18.592481 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.310848    2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 07 16:23:18.592481 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.310854    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 07 16:23:18.592481 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:18.310987    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-6.ec2.internal\" not found"
Jul 07 16:23:18.592481 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.311506    2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 07 16:23:18.592481 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.311656    2578 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 07 16:23:18.592481 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.311674    2578 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 07 16:23:18.592481 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.311808    2578 reconstruct.go:97] "Volume reconstruction finished"
Jul 07 16:23:18.592481 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.311817    2578 reconciler.go:29] "Reconciler: start to sync state"
Jul 07 16:23:18.592481 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.311837    2578 factory.go:55] Registering systemd factory
Jul 07 16:23:18.592481 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.311854    2578 factory.go:223] Registration of the systemd container factory successfully
Jul 07 16:23:18.592481 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.312095    2578 factory.go:153] Registering CRI-O factory
Jul 07 16:23:18.592481 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.312121    2578 factory.go:223] Registration of the crio container factory successfully
Jul 07 16:23:18.592481 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.312173    2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 07 16:23:18.592481 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.312199    2578 factory.go:103] Registering Raw factory
Jul 07 16:23:18.592481 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.312214    2578 manager.go:1196] Started watching for new ooms in manager
Jul 07 16:23:18.592481 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.323503    2578 manager.go:349] Starting recovery of all containers
Jul 07 16:23:18.592481 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:18.324128    2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-6.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 07 16:23:18.592481 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:18.324486    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 07 16:23:18.592481 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.334119    2578 manager.go:354] Recovery completed
Jul 07 16:23:18.592481 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.338376    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 16:23:18.592481 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.340521    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-6.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 16:23:18.592481 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.340562    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-6.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 16:23:18.592481 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.340573    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-6.ec2.internal" event="NodeHasSufficientPID"
Jul 07 16:23:18.592481 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.341188    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 16:23:18.592481 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.341172    2578 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 07 16:23:18.592481 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.341780    2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 07 16:23:18.592481 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.341802    2578 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 16:23:18.592481 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.341965    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-6.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 16:23:18.592481 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.341994    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-6.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 16:23:18.592481 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.342005    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-6.ec2.internal" event="NodeHasSufficientPID"
Jul 07 16:23:18.592481 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.343159    2578 policy_none.go:49] "None policy: Start"
Jul 07 16:23:18.592481 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.343173    2578 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 07 16:23:18.592481 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.343186    2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 07 16:23:18.593568 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.344158    2578 policy_none.go:47] "Start"
Jul 07 16:23:18.593568 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:18.357353    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-6.ec2.internal.18c00e80b1d06b7c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-6.ec2.internal,UID:ip-10-0-129-6.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-6.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-6.ec2.internal,},FirstTimestamp:2026-07-07 16:23:18.340545404 +0000 UTC m=+0.427513856,LastTimestamp:2026-07-07 16:23:18.340545404 +0000 UTC m=+0.427513856,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-6.ec2.internal,}"
Jul 07 16:23:18.593568 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:18.371368    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-6.ec2.internal.18c00e80b1d0c03d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-6.ec2.internal,UID:ip-10-0-129-6.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-129-6.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-129-6.ec2.internal,},FirstTimestamp:2026-07-07 16:23:18.340567101 +0000 UTC m=+0.427535553,LastTimestamp:2026-07-07 16:23:18.340567101 +0000 UTC m=+0.427535553,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-6.ec2.internal,}"
Jul 07 16:23:18.593568 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:18.390652    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-6.ec2.internal.18c00e80b1d0e8dd  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-6.ec2.internal,UID:ip-10-0-129-6.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-129-6.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-129-6.ec2.internal,},FirstTimestamp:2026-07-07 16:23:18.340577501 +0000 UTC m=+0.427545952,LastTimestamp:2026-07-07 16:23:18.340577501 +0000 UTC m=+0.427545952,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-6.ec2.internal,}"
Jul 07 16:23:18.593568 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.409208    2578 manager.go:337] "Starting Device Plugin manager"
Jul 07 16:23:18.593568 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:18.409251    2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 07 16:23:18.593568 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.409264    2578 server.go:87] "Starting device plugin registration server"
Jul 07 16:23:18.593568 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.409640    2578 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 07 16:23:18.593568 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.409658    2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 07 16:23:18.593568 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.409871    2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 07 16:23:18.593568 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.409970    2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 07 16:23:18.593568 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.409980    2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 07 16:23:18.593568 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:18.410546    2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 07 16:23:18.593568 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:18.410598    2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-6.ec2.internal\" not found"
Jul 07 16:23:18.593568 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.420731    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-n8kff"
Jul 07 16:23:18.594116 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:18.426224    2578 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-129-6.ec2.internal.18c00e80b1d06b7c\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-6.ec2.internal.18c00e80b1d06b7c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-6.ec2.internal,UID:ip-10-0-129-6.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-6.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-6.ec2.internal,},FirstTimestamp:2026-07-07 16:23:18.340545404 +0000 UTC m=+0.427513856,LastTimestamp:2026-07-07 16:23:18.341977912 +0000 UTC m=+0.428946368,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-6.ec2.internal,}"
Jul 07 16:23:18.594116 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.439626    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-n8kff"
Jul 07 16:23:18.594116 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:18.440725    2578 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-129-6.ec2.internal.18c00e80b1d0c03d\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-6.ec2.internal.18c00e80b1d0c03d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-6.ec2.internal,UID:ip-10-0-129-6.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-129-6.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-129-6.ec2.internal,},FirstTimestamp:2026-07-07 16:23:18.340567101 +0000 UTC m=+0.427535553,LastTimestamp:2026-07-07 16:23:18.341999535 +0000 UTC m=+0.428967987,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-6.ec2.internal,}"
Jul 07 16:23:18.594116 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.506459    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 07 16:23:18.594116 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.508118    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 07 16:23:18.594116 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.508163    2578 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 07 16:23:18.594116 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.508191    2578 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 07 16:23:18.594116 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:18.508232    2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 07 16:23:18.594116 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.510528    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 16:23:18.594116 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.510862    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 16:23:18.594116 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.511523    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-6.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 16:23:18.594116 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.511553    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-6.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 16:23:18.594116 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.511568    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-6.ec2.internal" event="NodeHasSufficientPID"
Jul 07 16:23:18.594116 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.511599    2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-6.ec2.internal"
Jul 07 16:23:18.594116 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.523061    2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-6.ec2.internal"
Jul 07 16:23:18.594116 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:18.523090    2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-6.ec2.internal\": node \"ip-10-0-129-6.ec2.internal\" not found"
Jul 07 16:23:18.594116 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:18.556165    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-6.ec2.internal\" not found"
Jul 07 16:23:18.720560 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.608319    2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-6.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-6.ec2.internal"]
Jul 07 16:23:18.720560 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.608445    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 16:23:18.720560 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.610203    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-6.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 16:23:18.720560 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.610238    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-6.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 16:23:18.720560 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.610252    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-6.ec2.internal" event="NodeHasSufficientPID"
Jul 07 16:23:18.720560 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.611577    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 16:23:18.720560 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.611683    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-6.ec2.internal"
Jul 07 16:23:18.720560 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.611715    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 16:23:18.720560 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.612411    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-6.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 16:23:18.720560 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.612438    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-6.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 16:23:18.720560 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.612448    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-6.ec2.internal" event="NodeHasSufficientPID"
Jul 07 16:23:18.720560 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.612413    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-6.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 16:23:18.720560 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.612527    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-6.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 16:23:18.720560 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.612541    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-6.ec2.internal" event="NodeHasSufficientPID"
Jul 07 16:23:18.720560 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.613622    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-6.ec2.internal"
Jul 07 16:23:18.720560 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.613632    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ef1c54019a7929a2f27c1ddd35de351e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-6.ec2.internal\" (UID: \"ef1c54019a7929a2f27c1ddd35de351e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-6.ec2.internal"
Jul 07 16:23:18.720560 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.613653    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 16:23:18.720560 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.613663    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef1c54019a7929a2f27c1ddd35de351e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-6.ec2.internal\" (UID: \"ef1c54019a7929a2f27c1ddd35de351e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-6.ec2.internal"
Jul 07 16:23:18.720560 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.613693    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/22e77dea25ac0ea044c4bb8f6b7df505-config\") pod \"kube-apiserver-proxy-ip-10-0-129-6.ec2.internal\" (UID: \"22e77dea25ac0ea044c4bb8f6b7df505\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-6.ec2.internal"
Jul 07 16:23:18.720560 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.614445    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-6.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 16:23:18.720560 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.614478    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-6.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 16:23:18.720560 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.614494    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-6.ec2.internal" event="NodeHasSufficientPID"
Jul 07 16:23:18.720560 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:18.634231    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-6.ec2.internal\" not found" node="ip-10-0-129-6.ec2.internal"
Jul 07 16:23:18.720560 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:18.639528    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-6.ec2.internal\" not found" node="ip-10-0-129-6.ec2.internal"
Jul 07 16:23:18.720560 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:18.656334    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-6.ec2.internal\" not found"
Jul 07 16:23:18.722612 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.722459    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ef1c54019a7929a2f27c1ddd35de351e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-6.ec2.internal\" (UID: \"ef1c54019a7929a2f27c1ddd35de351e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-6.ec2.internal"
Jul 07 16:23:18.722612 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.722488    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef1c54019a7929a2f27c1ddd35de351e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-6.ec2.internal\" (UID: \"ef1c54019a7929a2f27c1ddd35de351e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-6.ec2.internal"
Jul 07 16:23:18.722612 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.722508    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/22e77dea25ac0ea044c4bb8f6b7df505-config\") pod \"kube-apiserver-proxy-ip-10-0-129-6.ec2.internal\" (UID: \"22e77dea25ac0ea044c4bb8f6b7df505\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-6.ec2.internal"
Jul 07 16:23:18.722612 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.722576    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ef1c54019a7929a2f27c1ddd35de351e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-6.ec2.internal\" (UID: \"ef1c54019a7929a2f27c1ddd35de351e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-6.ec2.internal"
Jul 07 16:23:18.722892 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.722580    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/22e77dea25ac0ea044c4bb8f6b7df505-config\") pod \"kube-apiserver-proxy-ip-10-0-129-6.ec2.internal\" (UID: \"22e77dea25ac0ea044c4bb8f6b7df505\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-6.ec2.internal"
Jul 07 16:23:18.722892 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.722581    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef1c54019a7929a2f27c1ddd35de351e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-6.ec2.internal\" (UID: \"ef1c54019a7929a2f27c1ddd35de351e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-6.ec2.internal"
Jul 07 16:23:18.876805 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:18.756824    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-6.ec2.internal\" not found"
Jul 07 16:23:18.876805 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:18.859548    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-6.ec2.internal\" not found"
Jul 07 16:23:19.049700 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.937843    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-6.ec2.internal"
Jul 07 16:23:19.049700 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:18.942597    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-6.ec2.internal"
Jul 07 16:23:19.049700 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:18.960043    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-6.ec2.internal\" not found"
Jul 07 16:23:19.201337 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:19.061078    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-6.ec2.internal\" not found"
Jul 07 16:23:19.201337 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:19.163149    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-6.ec2.internal\" not found"
Jul 07 16:23:19.378076 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:19.238889    2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 07 16:23:19.378076 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:19.239066    2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 07 16:23:19.378076 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:19.263978    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-6.ec2.internal\" not found"
Jul 07 16:23:19.378076 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:19.364889    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-6.ec2.internal\" not found"
Jul 07 16:23:19.503194 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:19.423849    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 16:23:19.503194 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:19.425698    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-6.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 16:23:19.503194 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:19.425731    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-6.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 16:23:19.503194 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:19.425745    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-6.ec2.internal" event="NodeHasSufficientPID"
Jul 07 16:23:19.503194 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:19.442125    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 16:18:18 +0000 UTC" deadline="2028-03-08 00:33:40.604810134 +0000 UTC"
Jul 07 16:23:19.503194 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:19.442157    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14624h10m21.162657403s"
Jul 07 16:23:19.503194 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:19.485046    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-6.ec2.internal\" not found"
Jul 07 16:23:19.630186 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:19.548853    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef1c54019a7929a2f27c1ddd35de351e.slice/crio-37f9779a78edb501a1b858e59bc253d6b667b95e40f2dd2aabed2dd0c57a53a0 WatchSource:0}: Error finding container 37f9779a78edb501a1b858e59bc253d6b667b95e40f2dd2aabed2dd0c57a53a0: Status 404 returned error can't find the container with id 37f9779a78edb501a1b858e59bc253d6b667b95e40f2dd2aabed2dd0c57a53a0
Jul 07 16:23:19.630186 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:19.549146    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22e77dea25ac0ea044c4bb8f6b7df505.slice/crio-697ae6114ce0b3d86acfbdd51ddd169c563d1ab6f1e9c7bff2939e032b3b6799 WatchSource:0}: Error finding container 697ae6114ce0b3d86acfbdd51ddd169c563d1ab6f1e9c7bff2939e032b3b6799: Status 404 returned error can't find the container with id 697ae6114ce0b3d86acfbdd51ddd169c563d1ab6f1e9c7bff2939e032b3b6799
Jul 07 16:23:19.630186 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:19.553370    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 16:23:19.630186 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:19.585514    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-6.ec2.internal\" not found"
Jul 07 16:23:19.630186 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:19.596150    2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 16:23:19.630186 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:19.611309    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-6.ec2.internal"
Jul 07 16:23:19.632299 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:19.632156    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 16:23:19.633926 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:19.633907    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-6.ec2.internal"
Jul 07 16:23:19.644540 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:19.644522    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 16:23:19.694558 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:19.694523    2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 16:23:19.776210 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:19.776174    2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 16:23:20.287992 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.287739    2578 apiserver.go:52] "Watching apiserver"
Jul 07 16:23:20.301566 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.300300    2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 07 16:23:20.301566 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.300997    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-qhrbs","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-px22l","openshift-cluster-node-tuning-operator/tuned-h7454","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-6.ec2.internal","openshift-multus/multus-additional-cni-plugins-m6bqj","openshift-multus/multus-xxmq2","openshift-multus/network-metrics-daemon-9sc2w","openshift-ovn-kubernetes/ovnkube-node-brlwz","kube-system/konnectivity-agent-zcqml","kube-system/kube-apiserver-proxy-ip-10-0-129-6.ec2.internal","openshift-dns/node-resolver-xpjlg","openshift-image-registry/node-ca-nk4br","openshift-network-diagnostics/network-check-target-9489w","openshift-network-operator/iptables-alerter-mw8j6"]
Jul 07 16:23:20.303427 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.302813    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-brlwz"
Jul 07 16:23:20.305344 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.304586    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-px22l"
Jul 07 16:23:20.305565 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.305553    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 07 16:23:20.306279 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.306102    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 07 16:23:20.306878 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.306530    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 07 16:23:20.306878 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.306695    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 07 16:23:20.306878 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.306762    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 07 16:23:20.307096 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.306879    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-qdj57\""
Jul 07 16:23:20.307096 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.307081    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 07 16:23:20.307196 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.307151    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-h7454"
Jul 07 16:23:20.309308 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.307738    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 07 16:23:20.309308 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.308239    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 07 16:23:20.309308 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.308285    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-rxp2x\""
Jul 07 16:23:20.309308 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.308453    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 07 16:23:20.309308 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.308729    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mw8j6"
Jul 07 16:23:20.316859 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.310655    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7bmlt\""
Jul 07 16:23:20.316859 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.310930    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 07 16:23:20.316859 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.311117    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 07 16:23:20.316859 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.311632    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-cb54p\""
Jul 07 16:23:20.316859 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.311927    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 07 16:23:20.316859 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.311955    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9489w"
Jul 07 16:23:20.316859 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:20.312040    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9489w" podUID="9dffb5de-b5f8-4349-895d-9e01c494eff1"
Jul 07 16:23:20.316859 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.312100    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 07 16:23:20.316859 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.312103    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xpjlg"
Jul 07 16:23:20.316859 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.312371    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 07 16:23:20.316859 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.312503    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 07 16:23:20.316859 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.314312    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9sc2w"
Jul 07 16:23:20.316859 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:20.314405    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9sc2w" podUID="a5e94c63-e554-402d-9215-06cd6525019a"
Jul 07 16:23:20.316859 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.315221    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5lwz9\""
Jul 07 16:23:20.316859 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.315505    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 07 16:23:20.316859 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.315706    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 07 16:23:20.316859 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.315904    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhrbs"
Jul 07 16:23:20.316859 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:20.315960    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhrbs" podUID="01b7d29e-fb29-4aae-9f8c-eb6403a682cb"
Jul 07 16:23:20.317878 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.317624    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zcqml"
Jul 07 16:23:20.320310 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.319656    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xxmq2"
Jul 07 16:23:20.321948 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.320801    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 07 16:23:20.321948 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.320967    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 07 16:23:20.321948 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.321124    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-wf9lr\""
Jul 07 16:23:20.321948 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.321131    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nk4br"
Jul 07 16:23:20.322987 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.322966    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 07 16:23:20.323161 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.323132    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-m6bqj"
Jul 07 16:23:20.323298 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.323225    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 07 16:23:20.324988 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.323479    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-lbgbr\""
Jul 07 16:23:20.324988 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.323786    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 07 16:23:20.324988 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.324524    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-gvp8m\""
Jul 07 16:23:20.324988 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.324601    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 07 16:23:20.324988 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.324685    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 07 16:23:20.324988 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.324688    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 07 16:23:20.324988 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.324767    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 07 16:23:20.326609 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.326588    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 07 16:23:20.326936 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.326915    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 07 16:23:20.327656 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.327636    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-745zh\""
Jul 07 16:23:20.327972 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.327942    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 16:23:20.338852 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.338538    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9efcfd27-d237-43ca-a158-bf2ef8dffb3b-host-cni-bin\") pod \"ovnkube-node-brlwz\" (UID: \"9efcfd27-d237-43ca-a158-bf2ef8dffb3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-brlwz"
Jul 07 16:23:20.338852 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.338579    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/98c9a652-a9eb-42c9-beb7-953a08807fef-etc-sysctl-d\") pod \"tuned-h7454\" (UID: \"98c9a652-a9eb-42c9-beb7-953a08807fef\") " pod="openshift-cluster-node-tuning-operator/tuned-h7454"
Jul 07 16:23:20.338852 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.338607    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/98c9a652-a9eb-42c9-beb7-953a08807fef-etc-sysctl-conf\") pod \"tuned-h7454\" (UID: \"98c9a652-a9eb-42c9-beb7-953a08807fef\") " pod="openshift-cluster-node-tuning-operator/tuned-h7454"
Jul 07 16:23:20.338852 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.338635    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nsk9\" (UniqueName: \"kubernetes.io/projected/9dffb5de-b5f8-4349-895d-9e01c494eff1-kube-api-access-7nsk9\") pod \"network-check-target-9489w\" (UID: \"9dffb5de-b5f8-4349-895d-9e01c494eff1\") " pod="openshift-network-diagnostics/network-check-target-9489w"
Jul 07 16:23:20.338852 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.338666    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f87tx\" (UniqueName: \"kubernetes.io/projected/a5e94c63-e554-402d-9215-06cd6525019a-kube-api-access-f87tx\") pod \"network-metrics-daemon-9sc2w\" (UID: \"a5e94c63-e554-402d-9215-06cd6525019a\") " pod="openshift-multus/network-metrics-daemon-9sc2w"
Jul 07 16:23:20.338852 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.338690    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9efcfd27-d237-43ca-a158-bf2ef8dffb3b-host-slash\") pod \"ovnkube-node-brlwz\" (UID: \"9efcfd27-d237-43ca-a158-bf2ef8dffb3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-brlwz"
Jul 07 16:23:20.338852 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.338714    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9efcfd27-d237-43ca-a158-bf2ef8dffb3b-node-log\") pod \"ovnkube-node-brlwz\" (UID: \"9efcfd27-d237-43ca-a158-bf2ef8dffb3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-brlwz"
Jul 07 16:23:20.338852 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.338739    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/98c9a652-a9eb-42c9-beb7-953a08807fef-etc-systemd\") pod \"tuned-h7454\" (UID: \"98c9a652-a9eb-42c9-beb7-953a08807fef\") " pod="openshift-cluster-node-tuning-operator/tuned-h7454"
Jul 07 16:23:20.338852 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.338764    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5jb4\" (UniqueName: \"kubernetes.io/projected/92a59c06-08c5-471c-943f-7f378028262c-kube-api-access-m5jb4\") pod \"node-resolver-xpjlg\" (UID: \"92a59c06-08c5-471c-943f-7f378028262c\") " pod="openshift-dns/node-resolver-xpjlg"
Jul 07 16:23:20.338852 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.338788    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9efcfd27-d237-43ca-a158-bf2ef8dffb3b-host-kubelet\") pod \"ovnkube-node-brlwz\" (UID: \"9efcfd27-d237-43ca-a158-bf2ef8dffb3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-brlwz"
Jul 07 16:23:20.338852 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.338814    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6b04c831-cc37-4394-b42f-96d79b2a684a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-px22l\" (UID: \"6b04c831-cc37-4394-b42f-96d79b2a684a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-px22l"
Jul 07 16:23:20.339521 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.338878    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6b04c831-cc37-4394-b42f-96d79b2a684a-etc-selinux\") pod \"aws-ebs-csi-driver-node-px22l\" (UID: \"6b04c831-cc37-4394-b42f-96d79b2a684a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-px22l"
Jul 07 16:23:20.339521 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.338993    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9efcfd27-d237-43ca-a158-bf2ef8dffb3b-log-socket\") pod \"ovnkube-node-brlwz\" (UID: \"9efcfd27-d237-43ca-a158-bf2ef8dffb3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-brlwz"
Jul 07 16:23:20.339521 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.339032    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9efcfd27-d237-43ca-a158-bf2ef8dffb3b-host-run-ovn-kubernetes\") pod \"ovnkube-node-brlwz\" (UID: \"9efcfd27-d237-43ca-a158-bf2ef8dffb3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-brlwz"
Jul 07 16:23:20.339521 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.339060    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9efcfd27-d237-43ca-a158-bf2ef8dffb3b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-brlwz\" (UID: \"9efcfd27-d237-43ca-a158-bf2ef8dffb3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-brlwz"
Jul 07 16:23:20.339521 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.339087    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9efcfd27-d237-43ca-a158-bf2ef8dffb3b-ovn-node-metrics-cert\") pod \"ovnkube-node-brlwz\" (UID: \"9efcfd27-d237-43ca-a158-bf2ef8dffb3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-brlwz"
Jul 07 16:23:20.339521 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.339112    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9efcfd27-d237-43ca-a158-bf2ef8dffb3b-env-overrides\") pod \"ovnkube-node-brlwz\" (UID: \"9efcfd27-d237-43ca-a158-bf2ef8dffb3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-brlwz"
Jul 07 16:23:20.339521 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.339150    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9efcfd27-d237-43ca-a158-bf2ef8dffb3b-ovnkube-script-lib\") pod \"ovnkube-node-brlwz\" (UID: \"9efcfd27-d237-43ca-a158-bf2ef8dffb3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-brlwz"
Jul 07 16:23:20.339521 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.339177    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mww7w\" (UniqueName: \"kubernetes.io/projected/9efcfd27-d237-43ca-a158-bf2ef8dffb3b-kube-api-access-mww7w\") pod \"ovnkube-node-brlwz\" (UID: \"9efcfd27-d237-43ca-a158-bf2ef8dffb3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-brlwz"
Jul 07 16:23:20.339521 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.339215    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/98c9a652-a9eb-42c9-beb7-953a08807fef-etc-tuned\") pod \"tuned-h7454\" (UID: \"98c9a652-a9eb-42c9-beb7-953a08807fef\") " pod="openshift-cluster-node-tuning-operator/tuned-h7454"
Jul 07 16:23:20.339521 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.339261    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7wmb\" (UniqueName: \"kubernetes.io/projected/8f80c277-c52b-4c80-b091-a9f6cdd68428-kube-api-access-b7wmb\") pod \"iptables-alerter-mw8j6\" (UID: \"8f80c277-c52b-4c80-b091-a9f6cdd68428\") " pod="openshift-network-operator/iptables-alerter-mw8j6"
Jul 07 16:23:20.339521 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.339296    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9efcfd27-d237-43ca-a158-bf2ef8dffb3b-systemd-units\") pod \"ovnkube-node-brlwz\" (UID: \"9efcfd27-d237-43ca-a158-bf2ef8dffb3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-brlwz"
Jul 07 16:23:20.339521 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.339335    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6b04c831-cc37-4394-b42f-96d79b2a684a-device-dir\") pod \"aws-ebs-csi-driver-node-px22l\" (UID: \"6b04c831-cc37-4394-b42f-96d79b2a684a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-px22l"
Jul 07 16:23:20.339521 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.339372    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6b04c831-cc37-4394-b42f-96d79b2a684a-sys-fs\") pod \"aws-ebs-csi-driver-node-px22l\" (UID: \"6b04c831-cc37-4394-b42f-96d79b2a684a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-px22l"
Jul 07 16:23:20.340257 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.339405    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9efcfd27-d237-43ca-a158-bf2ef8dffb3b-host-run-netns\") pod \"ovnkube-node-brlwz\" (UID: \"9efcfd27-d237-43ca-a158-bf2ef8dffb3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-brlwz"
Jul 07 16:23:20.340257 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.339447    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/98c9a652-a9eb-42c9-beb7-953a08807fef-etc-kubernetes\") pod \"tuned-h7454\" (UID: \"98c9a652-a9eb-42c9-beb7-953a08807fef\") " pod="openshift-cluster-node-tuning-operator/tuned-h7454"
Jul 07 16:23:20.340257 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.339483    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/98c9a652-a9eb-42c9-beb7-953a08807fef-var-lib-kubelet\") pod \"tuned-h7454\" (UID: \"98c9a652-a9eb-42c9-beb7-953a08807fef\") " pod="openshift-cluster-node-tuning-operator/tuned-h7454"
Jul 07 16:23:20.340257 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.339509    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8f80c277-c52b-4c80-b091-a9f6cdd68428-host-slash\") pod \"iptables-alerter-mw8j6\" (UID: \"8f80c277-c52b-4c80-b091-a9f6cdd68428\") " pod="openshift-network-operator/iptables-alerter-mw8j6"
Jul 07 16:23:20.340257 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.339533    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92a59c06-08c5-471c-943f-7f378028262c-tmp-dir\") pod \"node-resolver-xpjlg\" (UID: \"92a59c06-08c5-471c-943f-7f378028262c\") " pod="openshift-dns/node-resolver-xpjlg"
Jul 07 16:23:20.340257 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.339559    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/98c9a652-a9eb-42c9-beb7-953a08807fef-run\") pod \"tuned-h7454\" (UID: \"98c9a652-a9eb-42c9-beb7-953a08807fef\") " pod="openshift-cluster-node-tuning-operator/tuned-h7454"
Jul 07 16:23:20.340257 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.339584    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/98c9a652-a9eb-42c9-beb7-953a08807fef-lib-modules\") pod \"tuned-h7454\" (UID: \"98c9a652-a9eb-42c9-beb7-953a08807fef\") " pod="openshift-cluster-node-tuning-operator/tuned-h7454"
Jul 07 16:23:20.340257 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.339609    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7kvk\" (UniqueName: \"kubernetes.io/projected/98c9a652-a9eb-42c9-beb7-953a08807fef-kube-api-access-r7kvk\") pod \"tuned-h7454\" (UID: \"98c9a652-a9eb-42c9-beb7-953a08807fef\") " pod="openshift-cluster-node-tuning-operator/tuned-h7454"
Jul 07 16:23:20.340257 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.339636    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8f80c277-c52b-4c80-b091-a9f6cdd68428-iptables-alerter-script\") pod \"iptables-alerter-mw8j6\" (UID: \"8f80c277-c52b-4c80-b091-a9f6cdd68428\") " pod="openshift-network-operator/iptables-alerter-mw8j6"
Jul 07 16:23:20.340257 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.339661    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5e94c63-e554-402d-9215-06cd6525019a-metrics-certs\") pod \"network-metrics-daemon-9sc2w\" (UID: \"a5e94c63-e554-402d-9215-06cd6525019a\") " pod="openshift-multus/network-metrics-daemon-9sc2w"
Jul 07 16:23:20.340257 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.339701    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6b04c831-cc37-4394-b42f-96d79b2a684a-socket-dir\") pod \"aws-ebs-csi-driver-node-px22l\" (UID: \"6b04c831-cc37-4394-b42f-96d79b2a684a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-px22l"
Jul 07 16:23:20.340257 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.339730    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9efcfd27-d237-43ca-a158-bf2ef8dffb3b-run-ovn\") pod \"ovnkube-node-brlwz\" (UID: \"9efcfd27-d237-43ca-a158-bf2ef8dffb3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-brlwz"
Jul 07 16:23:20.340257 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.339755    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/98c9a652-a9eb-42c9-beb7-953a08807fef-etc-modprobe-d\") pod \"tuned-h7454\" (UID: \"98c9a652-a9eb-42c9-beb7-953a08807fef\") " pod="openshift-cluster-node-tuning-operator/tuned-h7454"
Jul 07 16:23:20.340257 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.339777    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/98c9a652-a9eb-42c9-beb7-953a08807fef-host\") pod \"tuned-h7454\" (UID: \"98c9a652-a9eb-42c9-beb7-953a08807fef\") " pod="openshift-cluster-node-tuning-operator/tuned-h7454"
Jul 07 16:23:20.340995 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.339801    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/92a59c06-08c5-471c-943f-7f378028262c-hosts-file\") pod \"node-resolver-xpjlg\" (UID: \"92a59c06-08c5-471c-943f-7f378028262c\") " pod="openshift-dns/node-resolver-xpjlg"
Jul 07 16:23:20.340995 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.339825    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6b04c831-cc37-4394-b42f-96d79b2a684a-registration-dir\") pod \"aws-ebs-csi-driver-node-px22l\" (UID: \"6b04c831-cc37-4394-b42f-96d79b2a684a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-px22l"
Jul 07 16:23:20.340995 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.339857    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcffs\" (UniqueName: \"kubernetes.io/projected/6b04c831-cc37-4394-b42f-96d79b2a684a-kube-api-access-dcffs\") pod \"aws-ebs-csi-driver-node-px22l\" (UID: \"6b04c831-cc37-4394-b42f-96d79b2a684a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-px22l"
Jul 07 16:23:20.340995 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.339896    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9efcfd27-d237-43ca-a158-bf2ef8dffb3b-etc-openvswitch\") pod \"ovnkube-node-brlwz\" (UID: \"9efcfd27-d237-43ca-a158-bf2ef8dffb3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-brlwz"
Jul 07 16:23:20.340995 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.339937    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9efcfd27-d237-43ca-a158-bf2ef8dffb3b-run-openvswitch\") pod \"ovnkube-node-brlwz\" (UID: \"9efcfd27-d237-43ca-a158-bf2ef8dffb3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-brlwz"
Jul 07 16:23:20.340995 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.339964    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9efcfd27-d237-43ca-a158-bf2ef8dffb3b-ovnkube-config\") pod \"ovnkube-node-brlwz\" (UID: \"9efcfd27-d237-43ca-a158-bf2ef8dffb3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-brlwz"
Jul 07 16:23:20.340995 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.339988    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/98c9a652-a9eb-42c9-beb7-953a08807fef-etc-sysconfig\") pod \"tuned-h7454\" (UID: \"98c9a652-a9eb-42c9-beb7-953a08807fef\") " pod="openshift-cluster-node-tuning-operator/tuned-h7454"
Jul 07 16:23:20.340995 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.340013    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/98c9a652-a9eb-42c9-beb7-953a08807fef-sys\") pod \"tuned-h7454\" (UID: \"98c9a652-a9eb-42c9-beb7-953a08807fef\") " pod="openshift-cluster-node-tuning-operator/tuned-h7454"
Jul 07 16:23:20.340995 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.340047    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/98c9a652-a9eb-42c9-beb7-953a08807fef-tmp\") pod \"tuned-h7454\" (UID: \"98c9a652-a9eb-42c9-beb7-953a08807fef\") " pod="openshift-cluster-node-tuning-operator/tuned-h7454"
Jul 07 16:23:20.340995 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.340084    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9efcfd27-d237-43ca-a158-bf2ef8dffb3b-host-cni-netd\") pod \"ovnkube-node-brlwz\" (UID: \"9efcfd27-d237-43ca-a158-bf2ef8dffb3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-brlwz"
Jul 07 16:23:20.340995 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.340134    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9efcfd27-d237-43ca-a158-bf2ef8dffb3b-run-systemd\") pod \"ovnkube-node-brlwz\" (UID: \"9efcfd27-d237-43ca-a158-bf2ef8dffb3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-brlwz"
Jul 07 16:23:20.340995 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.340159    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9efcfd27-d237-43ca-a158-bf2ef8dffb3b-var-lib-openvswitch\") pod \"ovnkube-node-brlwz\" (UID: \"9efcfd27-d237-43ca-a158-bf2ef8dffb3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-brlwz"
Jul 07 16:23:20.344996 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.344969    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-pg675"
Jul 07 16:23:20.359815 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.359776    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-pg675"
Jul 07 16:23:20.412823 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.412739    2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 07 16:23:20.441409 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.441348    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9efcfd27-d237-43ca-a158-bf2ef8dffb3b-run-ovn\") pod \"ovnkube-node-brlwz\" (UID: \"9efcfd27-d237-43ca-a158-bf2ef8dffb3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-brlwz"
Jul 07 16:23:20.441609 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.441418    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9-multus-conf-dir\") pod \"multus-xxmq2\" (UID: \"9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9\") " pod="openshift-multus/multus-xxmq2"
Jul 07 16:23:20.441609 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.441448    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bdcf0b66-ef82-404c-80cf-256ace23452f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-m6bqj\" (UID: \"bdcf0b66-ef82-404c-80cf-256ace23452f\") " pod="openshift-multus/multus-additional-cni-plugins-m6bqj"
Jul 07 16:23:20.441609 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.441473    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/01b7d29e-fb29-4aae-9f8c-eb6403a682cb-dbus\") pod \"global-pull-secret-syncer-qhrbs\" (UID: \"01b7d29e-fb29-4aae-9f8c-eb6403a682cb\") " pod="kube-system/global-pull-secret-syncer-qhrbs"
Jul 07 16:23:20.441609 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.441502    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6b04c831-cc37-4394-b42f-96d79b2a684a-registration-dir\") pod \"aws-ebs-csi-driver-node-px22l\" (UID: \"6b04c831-cc37-4394-b42f-96d79b2a684a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-px22l"
Jul 07 16:23:20.441609 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.441534    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcffs\" (UniqueName: \"kubernetes.io/projected/6b04c831-cc37-4394-b42f-96d79b2a684a-kube-api-access-dcffs\") pod \"aws-ebs-csi-driver-node-px22l\" (UID: \"6b04c831-cc37-4394-b42f-96d79b2a684a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-px22l"
Jul 07 16:23:20.441609 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.441559    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/98c9a652-a9eb-42c9-beb7-953a08807fef-etc-sysconfig\") pod \"tuned-h7454\" (UID: \"98c9a652-a9eb-42c9-beb7-953a08807fef\") " pod="openshift-cluster-node-tuning-operator/tuned-h7454"
Jul 07 16:23:20.441609 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.441588    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nsk9\" (UniqueName: \"kubernetes.io/projected/9dffb5de-b5f8-4349-895d-9e01c494eff1-kube-api-access-7nsk9\") pod \"network-check-target-9489w\" (UID: \"9dffb5de-b5f8-4349-895d-9e01c494eff1\") " pod="openshift-network-diagnostics/network-check-target-9489w"
Jul 07 16:23:20.442009 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.441614    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bdcf0b66-ef82-404c-80cf-256ace23452f-os-release\") pod \"multus-additional-cni-plugins-m6bqj\" (UID: \"bdcf0b66-ef82-404c-80cf-256ace23452f\") " pod="openshift-multus/multus-additional-cni-plugins-m6bqj"
Jul 07 16:23:20.442009 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.441640    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5jb4\" (UniqueName: \"kubernetes.io/projected/92a59c06-08c5-471c-943f-7f378028262c-kube-api-access-m5jb4\") pod \"node-resolver-xpjlg\" (UID: \"92a59c06-08c5-471c-943f-7f378028262c\") " pod="openshift-dns/node-resolver-xpjlg"
Jul 07 16:23:20.442009 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.441685    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9efcfd27-d237-43ca-a158-bf2ef8dffb3b-run-systemd\") pod \"ovnkube-node-brlwz\" (UID: \"9efcfd27-d237-43ca-a158-bf2ef8dffb3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-brlwz"
Jul 07 16:23:20.442009 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.441705    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9efcfd27-d237-43ca-a158-bf2ef8dffb3b-run-ovn\") pod \"ovnkube-node-brlwz\" (UID: \"9efcfd27-d237-43ca-a158-bf2ef8dffb3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-brlwz"
Jul 07 16:23:20.442009 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.441734    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9efcfd27-d237-43ca-a158-bf2ef8dffb3b-var-lib-openvswitch\") pod \"ovnkube-node-brlwz\" (UID: \"9efcfd27-d237-43ca-a158-bf2ef8dffb3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-brlwz"
Jul 07 16:23:20.442009 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.441739    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/98c9a652-a9eb-42c9-beb7-953a08807fef-etc-sysconfig\") pod \"tuned-h7454\" (UID: \"98c9a652-a9eb-42c9-beb7-953a08807fef\") " pod="openshift-cluster-node-tuning-operator/tuned-h7454"
Jul 07 16:23:20.442009 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.441765    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9efcfd27-d237-43ca-a158-bf2ef8dffb3b-host-cni-bin\") pod \"ovnkube-node-brlwz\" (UID: \"9efcfd27-d237-43ca-a158-bf2ef8dffb3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-brlwz"
Jul 07 16:23:20.442009 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.441794    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9-system-cni-dir\") pod \"multus-xxmq2\" (UID: \"9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9\") " pod="openshift-multus/multus-xxmq2"
Jul 07 16:23:20.442009 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.441830    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9-host-var-lib-kubelet\") pod \"multus-xxmq2\" (UID: \"9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9\") " pod="openshift-multus/multus-xxmq2"
Jul 07 16:23:20.442009 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.441888    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6b04c831-cc37-4394-b42f-96d79b2a684a-registration-dir\") pod \"aws-ebs-csi-driver-node-px22l\" (UID: \"6b04c831-cc37-4394-b42f-96d79b2a684a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-px22l"
Jul 07 16:23:20.442009 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.441893    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bdcf0b66-ef82-404c-80cf-256ace23452f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-m6bqj\" (UID: \"bdcf0b66-ef82-404c-80cf-256ace23452f\") " pod="openshift-multus/multus-additional-cni-plugins-m6bqj"
Jul 07 16:23:20.442009 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.441952    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9efcfd27-d237-43ca-a158-bf2ef8dffb3b-var-lib-openvswitch\") pod \"ovnkube-node-brlwz\" (UID: \"9efcfd27-d237-43ca-a158-bf2ef8dffb3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-brlwz"
Jul 07 16:23:20.442009 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.442016    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9efcfd27-d237-43ca-a158-bf2ef8dffb3b-node-log\") pod \"ovnkube-node-brlwz\" (UID: \"9efcfd27-d237-43ca-a158-bf2ef8dffb3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-brlwz"
Jul 07 16:23:20.442798 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.442020    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9efcfd27-d237-43ca-a158-bf2ef8dffb3b-run-systemd\") pod \"ovnkube-node-brlwz\" (UID: \"9efcfd27-d237-43ca-a158-bf2ef8dffb3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-brlwz"
Jul 07 16:23:20.442798 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.442049    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9efcfd27-d237-43ca-a158-bf2ef8dffb3b-host-cni-bin\") pod \"ovnkube-node-brlwz\" (UID: \"9efcfd27-d237-43ca-a158-bf2ef8dffb3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-brlwz"
Jul 07 16:23:20.442798 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.442053    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/98c9a652-a9eb-42c9-beb7-953a08807fef-etc-systemd\") pod \"tuned-h7454\" (UID: \"98c9a652-a9eb-42c9-beb7-953a08807fef\") " pod="openshift-cluster-node-tuning-operator/tuned-h7454"
Jul 07 16:23:20.442798 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.442081    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9efcfd27-d237-43ca-a158-bf2ef8dffb3b-node-log\") pod \"ovnkube-node-brlwz\" (UID: \"9efcfd27-d237-43ca-a158-bf2ef8dffb3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-brlwz"
Jul 07 16:23:20.442798 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.442099    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dbe86d02-ec4b-4424-a88f-098ee332c985-konnectivity-ca\") pod \"konnectivity-agent-zcqml\" (UID: \"dbe86d02-ec4b-4424-a88f-098ee332c985\") " pod="kube-system/konnectivity-agent-zcqml"
Jul 07 16:23:20.442798 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.442133    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/98c9a652-a9eb-42c9-beb7-953a08807fef-etc-systemd\") pod \"tuned-h7454\" (UID: \"98c9a652-a9eb-42c9-beb7-953a08807fef\") " pod="openshift-cluster-node-tuning-operator/tuned-h7454"
Jul 07 16:23:20.442798 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.442134    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9efcfd27-d237-43ca-a158-bf2ef8dffb3b-host-kubelet\") pod \"ovnkube-node-brlwz\" (UID: \"9efcfd27-d237-43ca-a158-bf2ef8dffb3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-brlwz"
Jul 07 16:23:20.442798 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.442164    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9efcfd27-d237-43ca-a158-bf2ef8dffb3b-host-kubelet\") pod \"ovnkube-node-brlwz\" (UID: \"9efcfd27-d237-43ca-a158-bf2ef8dffb3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-brlwz"
Jul 07 16:23:20.442798 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.442177    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6b04c831-cc37-4394-b42f-96d79b2a684a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-px22l\" (UID: \"6b04c831-cc37-4394-b42f-96d79b2a684a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-px22l"
Jul 07 16:23:20.442798 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.442207    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6b04c831-cc37-4394-b42f-96d79b2a684a-etc-selinux\") pod \"aws-ebs-csi-driver-node-px22l\" (UID: \"6b04c831-cc37-4394-b42f-96d79b2a684a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-px22l"
Jul 07 16:23:20.442798 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.442235    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/98c9a652-a9eb-42c9-beb7-953a08807fef-etc-tuned\") pod \"tuned-h7454\" (UID: \"98c9a652-a9eb-42c9-beb7-953a08807fef\") " pod="openshift-cluster-node-tuning-operator/tuned-h7454"
Jul 07 16:23:20.442798 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.442262    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9-cni-binary-copy\") pod \"multus-xxmq2\" (UID: \"9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9\") " pod="openshift-multus/multus-xxmq2"
Jul 07 16:23:20.442798 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.442289    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6b04c831-cc37-4394-b42f-96d79b2a684a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-px22l\" (UID: \"6b04c831-cc37-4394-b42f-96d79b2a684a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-px22l"
Jul 07 16:23:20.442798 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.442291    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9-host-var-lib-cni-multus\") pod \"multus-xxmq2\" (UID: \"9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9\") " pod="openshift-multus/multus-xxmq2"
Jul 07 16:23:20.443591 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.442336    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9efcfd27-d237-43ca-a158-bf2ef8dffb3b-env-overrides\") pod \"ovnkube-node-brlwz\" (UID: \"9efcfd27-d237-43ca-a158-bf2ef8dffb3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-brlwz"
Jul 07 16:23:20.443591 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.442339    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6b04c831-cc37-4394-b42f-96d79b2a684a-etc-selinux\") pod \"aws-ebs-csi-driver-node-px22l\" (UID: \"6b04c831-cc37-4394-b42f-96d79b2a684a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-px22l"
Jul 07 16:23:20.443591 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.442474    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mww7w\" (UniqueName: \"kubernetes.io/projected/9efcfd27-d237-43ca-a158-bf2ef8dffb3b-kube-api-access-mww7w\") pod \"ovnkube-node-brlwz\" (UID: \"9efcfd27-d237-43ca-a158-bf2ef8dffb3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-brlwz"
Jul 07 16:23:20.443591 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.442551    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7wmb\" (UniqueName: \"kubernetes.io/projected/8f80c277-c52b-4c80-b091-a9f6cdd68428-kube-api-access-b7wmb\") pod \"iptables-alerter-mw8j6\" (UID: \"8f80c277-c52b-4c80-b091-a9f6cdd68428\") " pod="openshift-network-operator/iptables-alerter-mw8j6"
Jul 07 16:23:20.443591 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.442582    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bdcf0b66-ef82-404c-80cf-256ace23452f-system-cni-dir\") pod \"multus-additional-cni-plugins-m6bqj\" (UID: \"bdcf0b66-ef82-404c-80cf-256ace23452f\") " pod="openshift-multus/multus-additional-cni-plugins-m6bqj"
Jul 07 16:23:20.443591 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.442702    2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 07 16:23:20.443591 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.442853    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9efcfd27-d237-43ca-a158-bf2ef8dffb3b-systemd-units\") pod \"ovnkube-node-brlwz\" (UID: \"9efcfd27-d237-43ca-a158-bf2ef8dffb3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-brlwz"
Jul 07 16:23:20.443591 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.442882    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9efcfd27-d237-43ca-a158-bf2ef8dffb3b-host-run-netns\") pod \"ovnkube-node-brlwz\" (UID: \"9efcfd27-d237-43ca-a158-bf2ef8dffb3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-brlwz"
Jul 07 16:23:20.443591 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.442910    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/98c9a652-a9eb-42c9-beb7-953a08807fef-etc-kubernetes\") pod \"tuned-h7454\" (UID: \"98c9a652-a9eb-42c9-beb7-953a08807fef\") " pod="openshift-cluster-node-tuning-operator/tuned-h7454"
Jul 07 16:23:20.443591 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.442935    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/98c9a652-a9eb-42c9-beb7-953a08807fef-var-lib-kubelet\") pod \"tuned-h7454\" (UID: \"98c9a652-a9eb-42c9-beb7-953a08807fef\") " pod="openshift-cluster-node-tuning-operator/tuned-h7454"
Jul 07 16:23:20.443591 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.442945    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9efcfd27-d237-43ca-a158-bf2ef8dffb3b-env-overrides\") pod \"ovnkube-node-brlwz\" (UID: \"9efcfd27-d237-43ca-a158-bf2ef8dffb3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-brlwz"
Jul 07 16:23:20.443591 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.442962    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8f80c277-c52b-4c80-b091-a9f6cdd68428-host-slash\") pod \"iptables-alerter-mw8j6\" (UID: \"8f80c277-c52b-4c80-b091-a9f6cdd68428\") " pod="openshift-network-operator/iptables-alerter-mw8j6"
Jul 07 16:23:20.443591 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.443001    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92a59c06-08c5-471c-943f-7f378028262c-tmp-dir\") pod \"node-resolver-xpjlg\" (UID: \"92a59c06-08c5-471c-943f-7f378028262c\") " pod="openshift-dns/node-resolver-xpjlg"
Jul 07 16:23:20.443591 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.443036    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9efcfd27-d237-43ca-a158-bf2ef8dffb3b-host-run-netns\") pod \"ovnkube-node-brlwz\" (UID: \"9efcfd27-d237-43ca-a158-bf2ef8dffb3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-brlwz"
Jul 07 16:23:20.443591 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.443048    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9-cnibin\") pod \"multus-xxmq2\" (UID: \"9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9\") " pod="openshift-multus/multus-xxmq2"
Jul 07 16:23:20.444391 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.443300    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9efcfd27-d237-43ca-a158-bf2ef8dffb3b-systemd-units\") pod \"ovnkube-node-brlwz\" (UID: \"9efcfd27-d237-43ca-a158-bf2ef8dffb3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-brlwz"
Jul 07 16:23:20.444391 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.443325    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92a59c06-08c5-471c-943f-7f378028262c-tmp-dir\") pod \"node-resolver-xpjlg\" (UID: \"92a59c06-08c5-471c-943f-7f378028262c\") " pod="openshift-dns/node-resolver-xpjlg"
Jul 07 16:23:20.444391 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.443340    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/98c9a652-a9eb-42c9-beb7-953a08807fef-run\") pod \"tuned-h7454\" (UID: \"98c9a652-a9eb-42c9-beb7-953a08807fef\") " pod="openshift-cluster-node-tuning-operator/tuned-h7454"
Jul 07 16:23:20.444391 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.443367    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/98c9a652-a9eb-42c9-beb7-953a08807fef-lib-modules\") pod \"tuned-h7454\" (UID: \"98c9a652-a9eb-42c9-beb7-953a08807fef\") " pod="openshift-cluster-node-tuning-operator/tuned-h7454"
Jul 07 16:23:20.444391 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.443392    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/98c9a652-a9eb-42c9-beb7-953a08807fef-etc-kubernetes\") pod \"tuned-h7454\" (UID: \"98c9a652-a9eb-42c9-beb7-953a08807fef\") " pod="openshift-cluster-node-tuning-operator/tuned-h7454"
Jul 07 16:23:20.444391 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.443396    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8f80c277-c52b-4c80-b091-a9f6cdd68428-iptables-alerter-script\") pod \"iptables-alerter-mw8j6\" (UID: \"8f80c277-c52b-4c80-b091-a9f6cdd68428\") " pod="openshift-network-operator/iptables-alerter-mw8j6"
Jul 07 16:23:20.444391 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.443459    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2d6c0087-96b8-4c36-bc5b-e6f2ab2d179f-host\") pod \"node-ca-nk4br\" (UID: \"2d6c0087-96b8-4c36-bc5b-e6f2ab2d179f\") " pod="openshift-image-registry/node-ca-nk4br"
Jul 07 16:23:20.444391 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.443487    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5e94c63-e554-402d-9215-06cd6525019a-metrics-certs\") pod \"network-metrics-daemon-9sc2w\" (UID: \"a5e94c63-e554-402d-9215-06cd6525019a\") " pod="openshift-multus/network-metrics-daemon-9sc2w"
Jul 07 16:23:20.444391 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.443520    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6b04c831-cc37-4394-b42f-96d79b2a684a-socket-dir\") pod \"aws-ebs-csi-driver-node-px22l\" (UID: \"6b04c831-cc37-4394-b42f-96d79b2a684a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-px22l"
Jul 07 16:23:20.444391 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.443525    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/98c9a652-a9eb-42c9-beb7-953a08807fef-run\") pod \"tuned-h7454\" (UID: \"98c9a652-a9eb-42c9-beb7-953a08807fef\") " pod="openshift-cluster-node-tuning-operator/tuned-h7454"
Jul 07 16:23:20.444391 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.443560    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/98c9a652-a9eb-42c9-beb7-953a08807fef-etc-modprobe-d\") pod \"tuned-h7454\" (UID: \"98c9a652-a9eb-42c9-beb7-953a08807fef\") " pod="openshift-cluster-node-tuning-operator/tuned-h7454"
Jul 07 16:23:20.444391 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.443611    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/98c9a652-a9eb-42c9-beb7-953a08807fef-var-lib-kubelet\") pod \"tuned-h7454\" (UID: \"98c9a652-a9eb-42c9-beb7-953a08807fef\") " pod="openshift-cluster-node-tuning-operator/tuned-h7454"
Jul 07 16:23:20.444391 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.443663    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/98c9a652-a9eb-42c9-beb7-953a08807fef-etc-modprobe-d\") pod \"tuned-h7454\" (UID: \"98c9a652-a9eb-42c9-beb7-953a08807fef\") " pod="openshift-cluster-node-tuning-operator/tuned-h7454"
Jul 07 16:23:20.444391 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.443489    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8f80c277-c52b-4c80-b091-a9f6cdd68428-host-slash\") pod \"iptables-alerter-mw8j6\" (UID: \"8f80c277-c52b-4c80-b091-a9f6cdd68428\") " pod="openshift-network-operator/iptables-alerter-mw8j6"
Jul 07 16:23:20.444391 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.443701    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/98c9a652-a9eb-42c9-beb7-953a08807fef-lib-modules\") pod \"tuned-h7454\" (UID: \"98c9a652-a9eb-42c9-beb7-953a08807fef\") " pod="openshift-cluster-node-tuning-operator/tuned-h7454"
Jul 07 16:23:20.445236 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.443703    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/98c9a652-a9eb-42c9-beb7-953a08807fef-host\") pod \"tuned-h7454\" (UID: \"98c9a652-a9eb-42c9-beb7-953a08807fef\") " pod="openshift-cluster-node-tuning-operator/tuned-h7454"
Jul 07 16:23:20.445236 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.443738    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/92a59c06-08c5-471c-943f-7f378028262c-hosts-file\") pod \"node-resolver-xpjlg\" (UID: \"92a59c06-08c5-471c-943f-7f378028262c\") " pod="openshift-dns/node-resolver-xpjlg"
Jul 07 16:23:20.445236 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.443764    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9-multus-cni-dir\") pod \"multus-xxmq2\" (UID: \"9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9\") " pod="openshift-multus/multus-xxmq2"
Jul 07 16:23:20.445236 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.443811    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6b04c831-cc37-4394-b42f-96d79b2a684a-socket-dir\") pod \"aws-ebs-csi-driver-node-px22l\" (UID: \"6b04c831-cc37-4394-b42f-96d79b2a684a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-px22l"
Jul 07 16:23:20.445236 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.443817    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9efcfd27-d237-43ca-a158-bf2ef8dffb3b-etc-openvswitch\") pod \"ovnkube-node-brlwz\" (UID: \"9efcfd27-d237-43ca-a158-bf2ef8dffb3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-brlwz"
Jul 07 16:23:20.445236 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.443867    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9efcfd27-d237-43ca-a158-bf2ef8dffb3b-run-openvswitch\") pod \"ovnkube-node-brlwz\" (UID: \"9efcfd27-d237-43ca-a158-bf2ef8dffb3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-brlwz"
Jul 07 16:23:20.445236 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.443899    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9efcfd27-d237-43ca-a158-bf2ef8dffb3b-ovnkube-config\") pod \"ovnkube-node-brlwz\" (UID: \"9efcfd27-d237-43ca-a158-bf2ef8dffb3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-brlwz"
Jul 07 16:23:20.445236 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:20.443924    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 16:23:20.445236 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.443932    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/98c9a652-a9eb-42c9-beb7-953a08807fef-sys\") pod \"tuned-h7454\" (UID: \"98c9a652-a9eb-42c9-beb7-953a08807fef\") " pod="openshift-cluster-node-tuning-operator/tuned-h7454"
Jul 07 16:23:20.445236 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:20.444051    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5e94c63-e554-402d-9215-06cd6525019a-metrics-certs podName:a5e94c63-e554-402d-9215-06cd6525019a nodeName:}" failed. No retries permitted until 2026-07-07 16:23:20.944028296 +0000 UTC m=+3.030996753 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a5e94c63-e554-402d-9215-06cd6525019a-metrics-certs") pod "network-metrics-daemon-9sc2w" (UID: "a5e94c63-e554-402d-9215-06cd6525019a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 16:23:20.445236 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.444070    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/98c9a652-a9eb-42c9-beb7-953a08807fef-tmp\") pod \"tuned-h7454\" (UID: \"98c9a652-a9eb-42c9-beb7-953a08807fef\") " pod="openshift-cluster-node-tuning-operator/tuned-h7454"
Jul 07 16:23:20.445236 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.444106    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/98c9a652-a9eb-42c9-beb7-953a08807fef-sys\") pod \"tuned-h7454\" (UID: \"98c9a652-a9eb-42c9-beb7-953a08807fef\") " pod="openshift-cluster-node-tuning-operator/tuned-h7454"
Jul 07 16:23:20.445236 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.444135    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9-os-release\") pod \"multus-xxmq2\" (UID: \"9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9\") " pod="openshift-multus/multus-xxmq2"
Jul 07 16:23:20.445236 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.444163    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9-multus-socket-dir-parent\") pod \"multus-xxmq2\" (UID: \"9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9\") " pod="openshift-multus/multus-xxmq2"
Jul 07 16:23:20.445961 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.444191    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/01b7d29e-fb29-4aae-9f8c-eb6403a682cb-original-pull-secret\") pod \"global-pull-secret-syncer-qhrbs\" (UID: \"01b7d29e-fb29-4aae-9f8c-eb6403a682cb\") " pod="kube-system/global-pull-secret-syncer-qhrbs"
Jul 07 16:23:20.445961 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.444234    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9efcfd27-d237-43ca-a158-bf2ef8dffb3b-host-cni-netd\") pod \"ovnkube-node-brlwz\" (UID: \"9efcfd27-d237-43ca-a158-bf2ef8dffb3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-brlwz"
Jul 07 16:23:20.445961 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.444264    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/98c9a652-a9eb-42c9-beb7-953a08807fef-etc-sysctl-d\") pod \"tuned-h7454\" (UID: \"98c9a652-a9eb-42c9-beb7-953a08807fef\") " pod="openshift-cluster-node-tuning-operator/tuned-h7454"
Jul 07 16:23:20.445961 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.444426    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/98c9a652-a9eb-42c9-beb7-953a08807fef-etc-sysctl-conf\") pod \"tuned-h7454\" (UID: \"98c9a652-a9eb-42c9-beb7-953a08807fef\") " pod="openshift-cluster-node-tuning-operator/tuned-h7454"
Jul 07 16:23:20.445961 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.444481    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9-hostroot\") pod \"multus-xxmq2\" (UID: \"9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9\") " pod="openshift-multus/multus-xxmq2"
Jul 07 16:23:20.445961 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.444509    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f87tx\" (UniqueName: \"kubernetes.io/projected/a5e94c63-e554-402d-9215-06cd6525019a-kube-api-access-f87tx\") pod \"network-metrics-daemon-9sc2w\" (UID: \"a5e94c63-e554-402d-9215-06cd6525019a\") " pod="openshift-multus/network-metrics-daemon-9sc2w"
Jul 07 16:23:20.445961 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.444559    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9efcfd27-d237-43ca-a158-bf2ef8dffb3b-host-slash\") pod \"ovnkube-node-brlwz\" (UID: \"9efcfd27-d237-43ca-a158-bf2ef8dffb3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-brlwz"
Jul 07 16:23:20.445961 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.444607    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nl6jt\" (UniqueName: \"kubernetes.io/projected/9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9-kube-api-access-nl6jt\") pod \"multus-xxmq2\" (UID: \"9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9\") " pod="openshift-multus/multus-xxmq2"
Jul 07 16:23:20.445961 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.444634    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2d6c0087-96b8-4c36-bc5b-e6f2ab2d179f-serviceca\") pod \"node-ca-nk4br\" (UID: \"2d6c0087-96b8-4c36-bc5b-e6f2ab2d179f\") " pod="openshift-image-registry/node-ca-nk4br"
Jul 07 16:23:20.445961 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.444665    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9efcfd27-d237-43ca-a158-bf2ef8dffb3b-log-socket\") pod \"ovnkube-node-brlwz\" (UID: \"9efcfd27-d237-43ca-a158-bf2ef8dffb3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-brlwz"
Jul 07 16:23:20.445961 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.444694    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9efcfd27-d237-43ca-a158-bf2ef8dffb3b-host-run-ovn-kubernetes\") pod \"ovnkube-node-brlwz\" (UID: \"9efcfd27-d237-43ca-a158-bf2ef8dffb3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-brlwz"
Jul 07 16:23:20.445961 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.444723    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9efcfd27-d237-43ca-a158-bf2ef8dffb3b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-brlwz\" (UID: \"9efcfd27-d237-43ca-a158-bf2ef8dffb3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-brlwz"
Jul 07 16:23:20.445961 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.444746    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9efcfd27-d237-43ca-a158-bf2ef8dffb3b-ovn-node-metrics-cert\") pod \"ovnkube-node-brlwz\" (UID: \"9efcfd27-d237-43ca-a158-bf2ef8dffb3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-brlwz"
Jul 07 16:23:20.445961 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.444768    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9-host-var-lib-cni-bin\") pod \"multus-xxmq2\" (UID: \"9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9\") " pod="openshift-multus/multus-xxmq2"
Jul 07 16:23:20.446685 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.444797    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9-multus-daemon-config\") pod \"multus-xxmq2\" (UID: \"9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9\") " pod="openshift-multus/multus-xxmq2"
Jul 07 16:23:20.446685 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.444949    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9-host-run-multus-certs\") pod \"multus-xxmq2\" (UID: \"9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9\") " pod="openshift-multus/multus-xxmq2"
Jul 07 16:23:20.446685 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.444979    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9efcfd27-d237-43ca-a158-bf2ef8dffb3b-ovnkube-script-lib\") pod \"ovnkube-node-brlwz\" (UID: \"9efcfd27-d237-43ca-a158-bf2ef8dffb3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-brlwz"
Jul 07 16:23:20.446685 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.445004    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/01b7d29e-fb29-4aae-9f8c-eb6403a682cb-kubelet-config\") pod \"global-pull-secret-syncer-qhrbs\" (UID: \"01b7d29e-fb29-4aae-9f8c-eb6403a682cb\") " pod="kube-system/global-pull-secret-syncer-qhrbs"
Jul 07 16:23:20.446685 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.445026    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9-etc-kubernetes\") pod \"multus-xxmq2\" (UID: \"9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9\") " pod="openshift-multus/multus-xxmq2"
Jul 07 16:23:20.446685 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.445057    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bdcf0b66-ef82-404c-80cf-256ace23452f-cni-binary-copy\") pod \"multus-additional-cni-plugins-m6bqj\" (UID: \"bdcf0b66-ef82-404c-80cf-256ace23452f\") " pod="openshift-multus/multus-additional-cni-plugins-m6bqj"
Jul 07 16:23:20.446685 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.445079    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgtdt\" (UniqueName: \"kubernetes.io/projected/bdcf0b66-ef82-404c-80cf-256ace23452f-kube-api-access-hgtdt\") pod \"multus-additional-cni-plugins-m6bqj\" (UID: \"bdcf0b66-ef82-404c-80cf-256ace23452f\") " pod="openshift-multus/multus-additional-cni-plugins-m6bqj"
Jul 07 16:23:20.446685 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.445108    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6b04c831-cc37-4394-b42f-96d79b2a684a-device-dir\") pod \"aws-ebs-csi-driver-node-px22l\" (UID: \"6b04c831-cc37-4394-b42f-96d79b2a684a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-px22l"
Jul 07 16:23:20.446685 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.445138    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6b04c831-cc37-4394-b42f-96d79b2a684a-sys-fs\") pod \"aws-ebs-csi-driver-node-px22l\" (UID: \"6b04c831-cc37-4394-b42f-96d79b2a684a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-px22l"
Jul 07 16:23:20.446685 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.445158    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dbe86d02-ec4b-4424-a88f-098ee332c985-agent-certs\") pod \"konnectivity-agent-zcqml\" (UID: \"dbe86d02-ec4b-4424-a88f-098ee332c985\") " pod="kube-system/konnectivity-agent-zcqml"
Jul 07 16:23:20.446685 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.445191    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bdcf0b66-ef82-404c-80cf-256ace23452f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-m6bqj\" (UID: \"bdcf0b66-ef82-404c-80cf-256ace23452f\") " pod="openshift-multus/multus-additional-cni-plugins-m6bqj"
Jul 07 16:23:20.446685 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.445224    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7kvk\" (UniqueName: \"kubernetes.io/projected/98c9a652-a9eb-42c9-beb7-953a08807fef-kube-api-access-r7kvk\") pod \"tuned-h7454\" (UID: \"98c9a652-a9eb-42c9-beb7-953a08807fef\") " pod="openshift-cluster-node-tuning-operator/tuned-h7454"
Jul 07 16:23:20.446685 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.445248    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9-host-run-k8s-cni-cncf-io\") pod \"multus-xxmq2\" (UID: \"9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9\") " pod="openshift-multus/multus-xxmq2"
Jul 07 16:23:20.446685 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.445280    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9-host-run-netns\") pod \"multus-xxmq2\" (UID: \"9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9\") " pod="openshift-multus/multus-xxmq2"
Jul 07 16:23:20.447395 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.445302    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmzpz\" (UniqueName: \"kubernetes.io/projected/2d6c0087-96b8-4c36-bc5b-e6f2ab2d179f-kube-api-access-bmzpz\") pod \"node-ca-nk4br\" (UID: \"2d6c0087-96b8-4c36-bc5b-e6f2ab2d179f\") " pod="openshift-image-registry/node-ca-nk4br"
Jul 07 16:23:20.447395 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.445324    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bdcf0b66-ef82-404c-80cf-256ace23452f-cnibin\") pod \"multus-additional-cni-plugins-m6bqj\" (UID: \"bdcf0b66-ef82-404c-80cf-256ace23452f\") " pod="openshift-multus/multus-additional-cni-plugins-m6bqj"
Jul 07 16:23:20.447395 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.445519    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/98c9a652-a9eb-42c9-beb7-953a08807fef-etc-sysctl-d\") pod \"tuned-h7454\" (UID: \"98c9a652-a9eb-42c9-beb7-953a08807fef\") " pod="openshift-cluster-node-tuning-operator/tuned-h7454"
Jul 07 16:23:20.447395 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.445584    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/98c9a652-a9eb-42c9-beb7-953a08807fef-host\") pod \"tuned-h7454\" (UID: \"98c9a652-a9eb-42c9-beb7-953a08807fef\") " pod="openshift-cluster-node-tuning-operator/tuned-h7454"
Jul 07 16:23:20.447395 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.445628    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/92a59c06-08c5-471c-943f-7f378028262c-hosts-file\") pod \"node-resolver-xpjlg\" (UID: \"92a59c06-08c5-471c-943f-7f378028262c\") " pod="openshift-dns/node-resolver-xpjlg"
Jul 07 16:23:20.447395 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.445670    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9efcfd27-d237-43ca-a158-bf2ef8dffb3b-etc-openvswitch\") pod \"ovnkube-node-brlwz\" (UID: \"9efcfd27-d237-43ca-a158-bf2ef8dffb3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-brlwz"
Jul 07 16:23:20.447395 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.445720    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9efcfd27-d237-43ca-a158-bf2ef8dffb3b-run-openvswitch\") pod \"ovnkube-node-brlwz\" (UID: \"9efcfd27-d237-43ca-a158-bf2ef8dffb3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-brlwz"
Jul 07 16:23:20.447395 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.445764    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9efcfd27-d237-43ca-a158-bf2ef8dffb3b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-brlwz\" (UID: \"9efcfd27-d237-43ca-a158-bf2ef8dffb3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-brlwz"
Jul 07 16:23:20.447395 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.446044    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/98c9a652-a9eb-42c9-beb7-953a08807fef-etc-sysctl-conf\") pod \"tuned-h7454\" (UID: \"98c9a652-a9eb-42c9-beb7-953a08807fef\") " pod="openshift-cluster-node-tuning-operator/tuned-h7454"
Jul 07 16:23:20.447395 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.446648    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8f80c277-c52b-4c80-b091-a9f6cdd68428-iptables-alerter-script\") pod \"iptables-alerter-mw8j6\" (UID: \"8f80c277-c52b-4c80-b091-a9f6cdd68428\") " pod="openshift-network-operator/iptables-alerter-mw8j6"
Jul 07 16:23:20.447395 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.446659    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9efcfd27-d237-43ca-a158-bf2ef8dffb3b-ovnkube-config\") pod \"ovnkube-node-brlwz\" (UID: \"9efcfd27-d237-43ca-a158-bf2ef8dffb3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-brlwz"
Jul 07 16:23:20.447395 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.446781    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9efcfd27-d237-43ca-a158-bf2ef8dffb3b-host-slash\") pod \"ovnkube-node-brlwz\" (UID: \"9efcfd27-d237-43ca-a158-bf2ef8dffb3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-brlwz"
Jul 07 16:23:20.447395 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.446831    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9efcfd27-d237-43ca-a158-bf2ef8dffb3b-log-socket\") pod \"ovnkube-node-brlwz\" (UID: \"9efcfd27-d237-43ca-a158-bf2ef8dffb3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-brlwz"
Jul 07 16:23:20.447395 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.446868    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9efcfd27-d237-43ca-a158-bf2ef8dffb3b-host-run-ovn-kubernetes\") pod \"ovnkube-node-brlwz\" (UID: \"9efcfd27-d237-43ca-a158-bf2ef8dffb3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-brlwz"
Jul 07 16:23:20.448136 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.447026    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6b04c831-cc37-4394-b42f-96d79b2a684a-device-dir\") pod \"aws-ebs-csi-driver-node-px22l\" (UID: \"6b04c831-cc37-4394-b42f-96d79b2a684a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-px22l"
Jul 07 16:23:20.448136 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.447116    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6b04c831-cc37-4394-b42f-96d79b2a684a-sys-fs\") pod \"aws-ebs-csi-driver-node-px22l\" (UID: \"6b04c831-cc37-4394-b42f-96d79b2a684a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-px22l"
Jul 07 16:23:20.448136 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.447218    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9efcfd27-d237-43ca-a158-bf2ef8dffb3b-host-cni-netd\") pod \"ovnkube-node-brlwz\" (UID: \"9efcfd27-d237-43ca-a158-bf2ef8dffb3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-brlwz"
Jul 07 16:23:20.448136 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.447658    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9efcfd27-d237-43ca-a158-bf2ef8dffb3b-ovnkube-script-lib\") pod \"ovnkube-node-brlwz\" (UID: \"9efcfd27-d237-43ca-a158-bf2ef8dffb3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-brlwz"
Jul 07 16:23:20.449659 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.449602    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/98c9a652-a9eb-42c9-beb7-953a08807fef-tmp\") pod \"tuned-h7454\" (UID: \"98c9a652-a9eb-42c9-beb7-953a08807fef\") " pod="openshift-cluster-node-tuning-operator/tuned-h7454"
Jul 07 16:23:20.450520 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.450487    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9efcfd27-d237-43ca-a158-bf2ef8dffb3b-ovn-node-metrics-cert\") pod \"ovnkube-node-brlwz\" (UID: \"9efcfd27-d237-43ca-a158-bf2ef8dffb3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-brlwz"
Jul 07 16:23:20.450713 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.450666    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/98c9a652-a9eb-42c9-beb7-953a08807fef-etc-tuned\") pod \"tuned-h7454\" (UID: \"98c9a652-a9eb-42c9-beb7-953a08807fef\") " pod="openshift-cluster-node-tuning-operator/tuned-h7454"
Jul 07 16:23:20.457329 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:20.456379    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 16:23:20.457329 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:20.456409    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 16:23:20.457329 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:20.456424    2578 projected.go:196] Error preparing data for projected volume kube-api-access-7nsk9 for pod openshift-network-diagnostics/network-check-target-9489w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 16:23:20.457329 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:20.456523    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9dffb5de-b5f8-4349-895d-9e01c494eff1-kube-api-access-7nsk9 podName:9dffb5de-b5f8-4349-895d-9e01c494eff1 nodeName:}" failed. No retries permitted until 2026-07-07 16:23:20.956496613 +0000 UTC m=+3.043465068 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7nsk9" (UniqueName: "kubernetes.io/projected/9dffb5de-b5f8-4349-895d-9e01c494eff1-kube-api-access-7nsk9") pod "network-check-target-9489w" (UID: "9dffb5de-b5f8-4349-895d-9e01c494eff1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 16:23:20.465829 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.464022    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5jb4\" (UniqueName: \"kubernetes.io/projected/92a59c06-08c5-471c-943f-7f378028262c-kube-api-access-m5jb4\") pod \"node-resolver-xpjlg\" (UID: \"92a59c06-08c5-471c-943f-7f378028262c\") " pod="openshift-dns/node-resolver-xpjlg"
Jul 07 16:23:20.465829 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.464755    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7kvk\" (UniqueName: \"kubernetes.io/projected/98c9a652-a9eb-42c9-beb7-953a08807fef-kube-api-access-r7kvk\") pod \"tuned-h7454\" (UID: \"98c9a652-a9eb-42c9-beb7-953a08807fef\") " pod="openshift-cluster-node-tuning-operator/tuned-h7454"
Jul 07 16:23:20.465829 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.465245    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mww7w\" (UniqueName: \"kubernetes.io/projected/9efcfd27-d237-43ca-a158-bf2ef8dffb3b-kube-api-access-mww7w\") pod \"ovnkube-node-brlwz\" (UID: \"9efcfd27-d237-43ca-a158-bf2ef8dffb3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-brlwz"
Jul 07 16:23:20.465829 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.465764    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcffs\" (UniqueName: \"kubernetes.io/projected/6b04c831-cc37-4394-b42f-96d79b2a684a-kube-api-access-dcffs\") pod \"aws-ebs-csi-driver-node-px22l\" (UID: \"6b04c831-cc37-4394-b42f-96d79b2a684a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-px22l"
Jul 07 16:23:20.466169 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.466019    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7wmb\" (UniqueName: \"kubernetes.io/projected/8f80c277-c52b-4c80-b091-a9f6cdd68428-kube-api-access-b7wmb\") pod \"iptables-alerter-mw8j6\" (UID: \"8f80c277-c52b-4c80-b091-a9f6cdd68428\") " pod="openshift-network-operator/iptables-alerter-mw8j6"
Jul 07 16:23:20.466169 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.466027    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f87tx\" (UniqueName: \"kubernetes.io/projected/a5e94c63-e554-402d-9215-06cd6525019a-kube-api-access-f87tx\") pod \"network-metrics-daemon-9sc2w\" (UID: \"a5e94c63-e554-402d-9215-06cd6525019a\") " pod="openshift-multus/network-metrics-daemon-9sc2w"
Jul 07 16:23:20.513177 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.513068    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-6.ec2.internal" event={"ID":"ef1c54019a7929a2f27c1ddd35de351e","Type":"ContainerStarted","Data":"37f9779a78edb501a1b858e59bc253d6b667b95e40f2dd2aabed2dd0c57a53a0"}
Jul 07 16:23:20.514205 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.514168    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-6.ec2.internal" event={"ID":"22e77dea25ac0ea044c4bb8f6b7df505","Type":"ContainerStarted","Data":"697ae6114ce0b3d86acfbdd51ddd169c563d1ab6f1e9c7bff2939e032b3b6799"}
Jul 07 16:23:20.545920 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.545810    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9-system-cni-dir\") pod \"multus-xxmq2\" (UID: \"9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9\") " pod="openshift-multus/multus-xxmq2"
Jul 07 16:23:20.545920 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.545879    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9-host-var-lib-kubelet\") pod \"multus-xxmq2\" (UID: \"9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9\") " pod="openshift-multus/multus-xxmq2"
Jul 07 16:23:20.545920 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.545909    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bdcf0b66-ef82-404c-80cf-256ace23452f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-m6bqj\" (UID: \"bdcf0b66-ef82-404c-80cf-256ace23452f\") " pod="openshift-multus/multus-additional-cni-plugins-m6bqj"
Jul 07 16:23:20.546227 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.545941    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dbe86d02-ec4b-4424-a88f-098ee332c985-konnectivity-ca\") pod \"konnectivity-agent-zcqml\" (UID: \"dbe86d02-ec4b-4424-a88f-098ee332c985\") " pod="kube-system/konnectivity-agent-zcqml"
Jul 07 16:23:20.546227 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.545962    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9-system-cni-dir\") pod \"multus-xxmq2\" (UID: \"9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9\") " pod="openshift-multus/multus-xxmq2"
Jul 07 16:23:20.546227 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.545972    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9-cni-binary-copy\") pod \"multus-xxmq2\" (UID: \"9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9\") " pod="openshift-multus/multus-xxmq2"
Jul 07 16:23:20.546227 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.546039    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9-host-var-lib-cni-multus\") pod \"multus-xxmq2\" (UID: \"9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9\") " pod="openshift-multus/multus-xxmq2"
Jul 07 16:23:20.546227 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.546076    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bdcf0b66-ef82-404c-80cf-256ace23452f-system-cni-dir\") pod \"multus-additional-cni-plugins-m6bqj\" (UID: \"bdcf0b66-ef82-404c-80cf-256ace23452f\") " pod="openshift-multus/multus-additional-cni-plugins-m6bqj"
Jul 07 16:23:20.546227 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.546108    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9-cnibin\") pod \"multus-xxmq2\" (UID: \"9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9\") " pod="openshift-multus/multus-xxmq2"
Jul 07 16:23:20.546227 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.546134    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2d6c0087-96b8-4c36-bc5b-e6f2ab2d179f-host\") pod \"node-ca-nk4br\" (UID: \"2d6c0087-96b8-4c36-bc5b-e6f2ab2d179f\") " pod="openshift-image-registry/node-ca-nk4br"
Jul 07 16:23:20.546227 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.546182    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9-multus-cni-dir\") pod \"multus-xxmq2\" (UID: \"9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9\") " pod="openshift-multus/multus-xxmq2"
Jul 07 16:23:20.546227 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.546214    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9-os-release\") pod \"multus-xxmq2\" (UID: \"9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9\") " pod="openshift-multus/multus-xxmq2"
Jul 07 16:23:20.546715 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.546240    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9-multus-socket-dir-parent\") pod \"multus-xxmq2\" (UID: \"9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9\") " pod="openshift-multus/multus-xxmq2"
Jul 07 16:23:20.546715 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.546268    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/01b7d29e-fb29-4aae-9f8c-eb6403a682cb-original-pull-secret\") pod \"global-pull-secret-syncer-qhrbs\" (UID: \"01b7d29e-fb29-4aae-9f8c-eb6403a682cb\") " pod="kube-system/global-pull-secret-syncer-qhrbs"
Jul 07 16:23:20.546715 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.546298    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9-hostroot\") pod \"multus-xxmq2\" (UID: \"9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9\") " pod="openshift-multus/multus-xxmq2"
Jul 07 16:23:20.546715 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.546327    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nl6jt\" (UniqueName: \"kubernetes.io/projected/9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9-kube-api-access-nl6jt\") pod \"multus-xxmq2\" (UID: \"9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9\") " pod="openshift-multus/multus-xxmq2"
Jul 07 16:23:20.546715 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.546351    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2d6c0087-96b8-4c36-bc5b-e6f2ab2d179f-serviceca\") pod \"node-ca-nk4br\" (UID: \"2d6c0087-96b8-4c36-bc5b-e6f2ab2d179f\") " pod="openshift-image-registry/node-ca-nk4br"
Jul 07 16:23:20.546715 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.546404    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9-host-var-lib-cni-bin\") pod \"multus-xxmq2\" (UID: \"9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9\") " pod="openshift-multus/multus-xxmq2"
Jul 07 16:23:20.546715 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.546430    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9-multus-daemon-config\") pod \"multus-xxmq2\" (UID: \"9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9\") " pod="openshift-multus/multus-xxmq2"
Jul 07 16:23:20.546715 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.546457    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9-host-run-multus-certs\") pod \"multus-xxmq2\" (UID: \"9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9\") " pod="openshift-multus/multus-xxmq2"
Jul 07 16:23:20.546715 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.546485    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/01b7d29e-fb29-4aae-9f8c-eb6403a682cb-kubelet-config\") pod \"global-pull-secret-syncer-qhrbs\" (UID: \"01b7d29e-fb29-4aae-9f8c-eb6403a682cb\") " pod="kube-system/global-pull-secret-syncer-qhrbs"
Jul 07 16:23:20.546715 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.546511    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9-etc-kubernetes\") pod \"multus-xxmq2\" (UID: \"9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9\") " pod="openshift-multus/multus-xxmq2"
Jul 07 16:23:20.546715 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.546537    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bdcf0b66-ef82-404c-80cf-256ace23452f-cni-binary-copy\") pod \"multus-additional-cni-plugins-m6bqj\" (UID: \"bdcf0b66-ef82-404c-80cf-256ace23452f\") " pod="openshift-multus/multus-additional-cni-plugins-m6bqj"
Jul 07 16:23:20.546715 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.546586    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgtdt\" (UniqueName: \"kubernetes.io/projected/bdcf0b66-ef82-404c-80cf-256ace23452f-kube-api-access-hgtdt\") pod \"multus-additional-cni-plugins-m6bqj\" (UID: \"bdcf0b66-ef82-404c-80cf-256ace23452f\") " pod="openshift-multus/multus-additional-cni-plugins-m6bqj"
Jul 07 16:23:20.546715 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.546618    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dbe86d02-ec4b-4424-a88f-098ee332c985-agent-certs\") pod \"konnectivity-agent-zcqml\" (UID: \"dbe86d02-ec4b-4424-a88f-098ee332c985\") " pod="kube-system/konnectivity-agent-zcqml"
Jul 07 16:23:20.546715 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.546635    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bdcf0b66-ef82-404c-80cf-256ace23452f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-m6bqj\" (UID: \"bdcf0b66-ef82-404c-80cf-256ace23452f\") " pod="openshift-multus/multus-additional-cni-plugins-m6bqj"
Jul 07 16:23:20.547403 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.546646    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bdcf0b66-ef82-404c-80cf-256ace23452f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-m6bqj\" (UID: \"bdcf0b66-ef82-404c-80cf-256ace23452f\") " pod="openshift-multus/multus-additional-cni-plugins-m6bqj"
Jul 07 16:23:20.547403 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.546672    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9-cni-binary-copy\") pod \"multus-xxmq2\" (UID: \"9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9\") " pod="openshift-multus/multus-xxmq2"
Jul 07 16:23:20.547403 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.546680    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9-host-run-k8s-cni-cncf-io\") pod \"multus-xxmq2\" (UID: \"9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9\") " pod="openshift-multus/multus-xxmq2"
Jul 07 16:23:20.547403 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.546704    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9-host-var-lib-kubelet\") pod \"multus-xxmq2\" (UID: \"9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9\") " pod="openshift-multus/multus-xxmq2"
Jul 07 16:23:20.547403 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.546711    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9-host-run-netns\") pod \"multus-xxmq2\" (UID: \"9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9\") " pod="openshift-multus/multus-xxmq2"
Jul 07 16:23:20.547403 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.546746    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmzpz\" (UniqueName: \"kubernetes.io/projected/2d6c0087-96b8-4c36-bc5b-e6f2ab2d179f-kube-api-access-bmzpz\") pod \"node-ca-nk4br\" (UID: \"2d6c0087-96b8-4c36-bc5b-e6f2ab2d179f\") " pod="openshift-image-registry/node-ca-nk4br"
Jul 07 16:23:20.547403 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.546760    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9-host-var-lib-cni-multus\") pod \"multus-xxmq2\" (UID: \"9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9\") " pod="openshift-multus/multus-xxmq2"
Jul 07 16:23:20.547403 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.546766    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bdcf0b66-ef82-404c-80cf-256ace23452f-cnibin\") pod \"multus-additional-cni-plugins-m6bqj\" (UID: \"bdcf0b66-ef82-404c-80cf-256ace23452f\") " pod="openshift-multus/multus-additional-cni-plugins-m6bqj"
Jul 07 16:23:20.547403 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.546799    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bdcf0b66-ef82-404c-80cf-256ace23452f-cnibin\") pod \"multus-additional-cni-plugins-m6bqj\" (UID: \"bdcf0b66-ef82-404c-80cf-256ace23452f\") " pod="openshift-multus/multus-additional-cni-plugins-m6bqj"
Jul 07 16:23:20.547403 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.546805    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9-multus-conf-dir\") pod \"multus-xxmq2\" (UID: \"9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9\") " pod="openshift-multus/multus-xxmq2"
Jul 07 16:23:20.547403 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.546853    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bdcf0b66-ef82-404c-80cf-256ace23452f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-m6bqj\" (UID: \"bdcf0b66-ef82-404c-80cf-256ace23452f\") " pod="openshift-multus/multus-additional-cni-plugins-m6bqj"
Jul 07 16:23:20.547403 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.546884    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/01b7d29e-fb29-4aae-9f8c-eb6403a682cb-dbus\") pod \"global-pull-secret-syncer-qhrbs\" (UID: \"01b7d29e-fb29-4aae-9f8c-eb6403a682cb\") " pod="kube-system/global-pull-secret-syncer-qhrbs"
Jul 07 16:23:20.547403 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.546932    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bdcf0b66-ef82-404c-80cf-256ace23452f-os-release\") pod \"multus-additional-cni-plugins-m6bqj\" (UID: \"bdcf0b66-ef82-404c-80cf-256ace23452f\") " pod="openshift-multus/multus-additional-cni-plugins-m6bqj"
Jul 07 16:23:20.547403 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.547032    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bdcf0b66-ef82-404c-80cf-256ace23452f-os-release\") pod \"multus-additional-cni-plugins-m6bqj\" (UID: \"bdcf0b66-ef82-404c-80cf-256ace23452f\") " pod="openshift-multus/multus-additional-cni-plugins-m6bqj"
Jul 07 16:23:20.548146 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.547079    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bdcf0b66-ef82-404c-80cf-256ace23452f-system-cni-dir\") pod \"multus-additional-cni-plugins-m6bqj\" (UID: \"bdcf0b66-ef82-404c-80cf-256ace23452f\") " pod="openshift-multus/multus-additional-cni-plugins-m6bqj"
Jul 07 16:23:20.548146 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.547133    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9-cnibin\") pod \"multus-xxmq2\" (UID: \"9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9\") " pod="openshift-multus/multus-xxmq2"
Jul 07 16:23:20.548146 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.547177    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2d6c0087-96b8-4c36-bc5b-e6f2ab2d179f-host\") pod \"node-ca-nk4br\" (UID: \"2d6c0087-96b8-4c36-bc5b-e6f2ab2d179f\") " pod="openshift-image-registry/node-ca-nk4br"
Jul 07 16:23:20.548146 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.547233    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dbe86d02-ec4b-4424-a88f-098ee332c985-konnectivity-ca\") pod \"konnectivity-agent-zcqml\" (UID: \"dbe86d02-ec4b-4424-a88f-098ee332c985\") " pod="kube-system/konnectivity-agent-zcqml"
Jul 07 16:23:20.548146 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.547291    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9-host-run-netns\") pod \"multus-xxmq2\" (UID: \"9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9\") " pod="openshift-multus/multus-xxmq2"
Jul 07 16:23:20.548146 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.547320    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9-multus-cni-dir\") pod \"multus-xxmq2\" (UID: \"9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9\") " pod="openshift-multus/multus-xxmq2"
Jul 07 16:23:20.548146 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.547346    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/01b7d29e-fb29-4aae-9f8c-eb6403a682cb-kubelet-config\") pod \"global-pull-secret-syncer-qhrbs\" (UID: \"01b7d29e-fb29-4aae-9f8c-eb6403a682cb\") " pod="kube-system/global-pull-secret-syncer-qhrbs"
Jul 07 16:23:20.548146 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.547362    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9-etc-kubernetes\") pod \"multus-xxmq2\" (UID: \"9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9\") " pod="openshift-multus/multus-xxmq2"
Jul 07 16:23:20.548146 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.547410    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9-os-release\") pod \"multus-xxmq2\" (UID: \"9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9\") " pod="openshift-multus/multus-xxmq2"
Jul 07 16:23:20.548146 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.547484    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9-multus-socket-dir-parent\") pod \"multus-xxmq2\" (UID: \"9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9\") " pod="openshift-multus/multus-xxmq2"
Jul 07 16:23:20.548146 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:20.547571    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 16:23:20.548146 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:20.547638    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01b7d29e-fb29-4aae-9f8c-eb6403a682cb-original-pull-secret podName:01b7d29e-fb29-4aae-9f8c-eb6403a682cb nodeName:}" failed. No retries permitted until 2026-07-07 16:23:21.047615879 +0000 UTC m=+3.134584329 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/01b7d29e-fb29-4aae-9f8c-eb6403a682cb-original-pull-secret") pod "global-pull-secret-syncer-qhrbs" (UID: "01b7d29e-fb29-4aae-9f8c-eb6403a682cb") : object "kube-system"/"original-pull-secret" not registered
Jul 07 16:23:20.548146 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.547843    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9-hostroot\") pod \"multus-xxmq2\" (UID: \"9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9\") " pod="openshift-multus/multus-xxmq2"
Jul 07 16:23:20.548146 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.547884    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bdcf0b66-ef82-404c-80cf-256ace23452f-cni-binary-copy\") pod \"multus-additional-cni-plugins-m6bqj\" (UID: \"bdcf0b66-ef82-404c-80cf-256ace23452f\") " pod="openshift-multus/multus-additional-cni-plugins-m6bqj"
Jul 07 16:23:20.548898 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.548520    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2d6c0087-96b8-4c36-bc5b-e6f2ab2d179f-serviceca\") pod \"node-ca-nk4br\" (UID: \"2d6c0087-96b8-4c36-bc5b-e6f2ab2d179f\") " pod="openshift-image-registry/node-ca-nk4br"
Jul 07 16:23:20.548898 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.548555    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9-multus-conf-dir\") pod \"multus-xxmq2\" (UID: \"9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9\") " pod="openshift-multus/multus-xxmq2"
Jul 07 16:23:20.548898 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.548583    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9-host-var-lib-cni-bin\") pod \"multus-xxmq2\" (UID: \"9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9\") " pod="openshift-multus/multus-xxmq2"
Jul 07 16:23:20.548898 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.548638    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9-host-run-multus-certs\") pod \"multus-xxmq2\" (UID: \"9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9\") " pod="openshift-multus/multus-xxmq2"
Jul 07 16:23:20.548898 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.548740    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bdcf0b66-ef82-404c-80cf-256ace23452f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-m6bqj\" (UID: \"bdcf0b66-ef82-404c-80cf-256ace23452f\") " pod="openshift-multus/multus-additional-cni-plugins-m6bqj"
Jul 07 16:23:20.548898 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.548790    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9-host-run-k8s-cni-cncf-io\") pod \"multus-xxmq2\" (UID: \"9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9\") " pod="openshift-multus/multus-xxmq2"
Jul 07 16:23:20.548898 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.548797    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/01b7d29e-fb29-4aae-9f8c-eb6403a682cb-dbus\") pod \"global-pull-secret-syncer-qhrbs\" (UID: \"01b7d29e-fb29-4aae-9f8c-eb6403a682cb\") " pod="kube-system/global-pull-secret-syncer-qhrbs"
Jul 07 16:23:20.549255 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.549082    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bdcf0b66-ef82-404c-80cf-256ace23452f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-m6bqj\" (UID: \"bdcf0b66-ef82-404c-80cf-256ace23452f\") " pod="openshift-multus/multus-additional-cni-plugins-m6bqj"
Jul 07 16:23:20.549255 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.549133    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9-multus-daemon-config\") pod \"multus-xxmq2\" (UID: \"9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9\") " pod="openshift-multus/multus-xxmq2"
Jul 07 16:23:20.551076 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.551028    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dbe86d02-ec4b-4424-a88f-098ee332c985-agent-certs\") pod \"konnectivity-agent-zcqml\" (UID: \"dbe86d02-ec4b-4424-a88f-098ee332c985\") " pod="kube-system/konnectivity-agent-zcqml"
Jul 07 16:23:20.559494 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.559461    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmzpz\" (UniqueName: \"kubernetes.io/projected/2d6c0087-96b8-4c36-bc5b-e6f2ab2d179f-kube-api-access-bmzpz\") pod \"node-ca-nk4br\" (UID: \"2d6c0087-96b8-4c36-bc5b-e6f2ab2d179f\") " pod="openshift-image-registry/node-ca-nk4br"
Jul 07 16:23:20.560896 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.560868    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nl6jt\" (UniqueName: \"kubernetes.io/projected/9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9-kube-api-access-nl6jt\") pod \"multus-xxmq2\" (UID: \"9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9\") " pod="openshift-multus/multus-xxmq2"
Jul 07 16:23:20.561021 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.560868    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgtdt\" (UniqueName: \"kubernetes.io/projected/bdcf0b66-ef82-404c-80cf-256ace23452f-kube-api-access-hgtdt\") pod \"multus-additional-cni-plugins-m6bqj\" (UID: \"bdcf0b66-ef82-404c-80cf-256ace23452f\") " pod="openshift-multus/multus-additional-cni-plugins-m6bqj"
Jul 07 16:23:20.625651 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.625611    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-brlwz"
Jul 07 16:23:20.636950 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.636913    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-px22l"
Jul 07 16:23:20.648233 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.648192    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-h7454"
Jul 07 16:23:20.657674 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.657637    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mw8j6"
Jul 07 16:23:20.667225 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.667189    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xpjlg"
Jul 07 16:23:20.676336 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.676294    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zcqml"
Jul 07 16:23:20.693639 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.693506    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xxmq2"
Jul 07 16:23:20.701814 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.701780    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nk4br"
Jul 07 16:23:20.709807 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.709763    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-m6bqj"
Jul 07 16:23:20.832594 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.832504    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 16:23:20.950454 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:20.950409    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5e94c63-e554-402d-9215-06cd6525019a-metrics-certs\") pod \"network-metrics-daemon-9sc2w\" (UID: \"a5e94c63-e554-402d-9215-06cd6525019a\") " pod="openshift-multus/network-metrics-daemon-9sc2w"
Jul 07 16:23:20.950651 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:20.950552    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 16:23:20.950719 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:20.950656    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5e94c63-e554-402d-9215-06cd6525019a-metrics-certs podName:a5e94c63-e554-402d-9215-06cd6525019a nodeName:}" failed. No retries permitted until 2026-07-07 16:23:21.950622683 +0000 UTC m=+4.037591126 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a5e94c63-e554-402d-9215-06cd6525019a-metrics-certs") pod "network-metrics-daemon-9sc2w" (UID: "a5e94c63-e554-402d-9215-06cd6525019a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 16:23:20.967992 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:20.967781    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b04c831_cc37_4394_b42f_96d79b2a684a.slice/crio-a13995aebcf6c28132ee09566618c95bede99a74c725969ca65b7691d3bb7f07 WatchSource:0}: Error finding container a13995aebcf6c28132ee09566618c95bede99a74c725969ca65b7691d3bb7f07: Status 404 returned error can't find the container with id a13995aebcf6c28132ee09566618c95bede99a74c725969ca65b7691d3bb7f07
Jul 07 16:23:20.968602 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:20.968261    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98c9a652_a9eb_42c9_beb7_953a08807fef.slice/crio-8d7f8fdd7dac031db39b78ec3579ca40b3cd28393a8d5b7328c081034da609ce WatchSource:0}: Error finding container 8d7f8fdd7dac031db39b78ec3579ca40b3cd28393a8d5b7328c081034da609ce: Status 404 returned error can't find the container with id 8d7f8fdd7dac031db39b78ec3579ca40b3cd28393a8d5b7328c081034da609ce
Jul 07 16:23:20.971713 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:20.971685    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdcf0b66_ef82_404c_80cf_256ace23452f.slice/crio-0d25d4df5caae5ff93a0930a1081aca0126b784baa2618796e6b6cc3f18a0214 WatchSource:0}: Error finding container 0d25d4df5caae5ff93a0930a1081aca0126b784baa2618796e6b6cc3f18a0214: Status 404 returned error can't find the container with id 0d25d4df5caae5ff93a0930a1081aca0126b784baa2618796e6b6cc3f18a0214
Jul 07 16:23:20.973418 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:20.973395    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92a59c06_08c5_471c_943f_7f378028262c.slice/crio-d2aa4f1a1b3b2319aeae4550d8d6f8e0828789b8484d64b4442973ae893a5195 WatchSource:0}: Error finding container d2aa4f1a1b3b2319aeae4550d8d6f8e0828789b8484d64b4442973ae893a5195: Status 404 returned error can't find the container with id d2aa4f1a1b3b2319aeae4550d8d6f8e0828789b8484d64b4442973ae893a5195
Jul 07 16:23:20.974177 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:20.974156    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d6c0087_96b8_4c36_bc5b_e6f2ab2d179f.slice/crio-dfdf8650110da9f4951f4caadd732233b05603fc6118232d2253a45ad4581548 WatchSource:0}: Error finding container dfdf8650110da9f4951f4caadd732233b05603fc6118232d2253a45ad4581548: Status 404 returned error can't find the container with id dfdf8650110da9f4951f4caadd732233b05603fc6118232d2253a45ad4581548
Jul 07 16:23:20.976154 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:20.975926    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ec6b1d3_e3bb_40c4_be03_3ff8c0caecf9.slice/crio-3d612bfcb4f3f28de8adc9eb37d1556cdb8fbd684eaf92abea1d4e8d373783d3 WatchSource:0}: Error finding container 3d612bfcb4f3f28de8adc9eb37d1556cdb8fbd684eaf92abea1d4e8d373783d3: Status 404 returned error can't find the container with id 3d612bfcb4f3f28de8adc9eb37d1556cdb8fbd684eaf92abea1d4e8d373783d3
Jul 07 16:23:20.976517 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:20.976392    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbe86d02_ec4b_4424_a88f_098ee332c985.slice/crio-6ab44008358ff178cf0bc1e2a0429a458ee51290c73d38a20beaaf1205a53453 WatchSource:0}: Error finding container 6ab44008358ff178cf0bc1e2a0429a458ee51290c73d38a20beaaf1205a53453: Status 404 returned error can't find the container with id 6ab44008358ff178cf0bc1e2a0429a458ee51290c73d38a20beaaf1205a53453
Jul 07 16:23:20.977667 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:20.977650    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9efcfd27_d237_43ca_a158_bf2ef8dffb3b.slice/crio-7aee4b0f0aa3def976f6abca151bfff5e0ab3eae4256d372fe295761aea42c11 WatchSource:0}: Error finding container 7aee4b0f0aa3def976f6abca151bfff5e0ab3eae4256d372fe295761aea42c11: Status 404 returned error can't find the container with id 7aee4b0f0aa3def976f6abca151bfff5e0ab3eae4256d372fe295761aea42c11
Jul 07 16:23:21.050893 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:21.050844    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nsk9\" (UniqueName: \"kubernetes.io/projected/9dffb5de-b5f8-4349-895d-9e01c494eff1-kube-api-access-7nsk9\") pod \"network-check-target-9489w\" (UID: \"9dffb5de-b5f8-4349-895d-9e01c494eff1\") " pod="openshift-network-diagnostics/network-check-target-9489w"
Jul 07 16:23:21.051074 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:21.050954    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/01b7d29e-fb29-4aae-9f8c-eb6403a682cb-original-pull-secret\") pod \"global-pull-secret-syncer-qhrbs\" (UID: \"01b7d29e-fb29-4aae-9f8c-eb6403a682cb\") " pod="kube-system/global-pull-secret-syncer-qhrbs"
Jul 07 16:23:21.051146 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:21.051093    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 16:23:21.051195 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:21.051171    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01b7d29e-fb29-4aae-9f8c-eb6403a682cb-original-pull-secret podName:01b7d29e-fb29-4aae-9f8c-eb6403a682cb nodeName:}" failed. No retries permitted until 2026-07-07 16:23:22.05114804 +0000 UTC m=+4.138116493 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/01b7d29e-fb29-4aae-9f8c-eb6403a682cb-original-pull-secret") pod "global-pull-secret-syncer-qhrbs" (UID: "01b7d29e-fb29-4aae-9f8c-eb6403a682cb") : object "kube-system"/"original-pull-secret" not registered
Jul 07 16:23:21.051615 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:21.051588    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 16:23:21.051682 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:21.051626    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 16:23:21.051682 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:21.051643    2578 projected.go:196] Error preparing data for projected volume kube-api-access-7nsk9 for pod openshift-network-diagnostics/network-check-target-9489w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 16:23:21.051774 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:21.051715    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9dffb5de-b5f8-4349-895d-9e01c494eff1-kube-api-access-7nsk9 podName:9dffb5de-b5f8-4349-895d-9e01c494eff1 nodeName:}" failed. No retries permitted until 2026-07-07 16:23:22.051695648 +0000 UTC m=+4.138664122 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7nsk9" (UniqueName: "kubernetes.io/projected/9dffb5de-b5f8-4349-895d-9e01c494eff1-kube-api-access-7nsk9") pod "network-check-target-9489w" (UID: "9dffb5de-b5f8-4349-895d-9e01c494eff1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 16:23:21.362696 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:21.362409    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 16:18:20 +0000 UTC" deadline="2028-02-16 05:53:22.527773495 +0000 UTC"
Jul 07 16:23:21.362696 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:21.362687    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14125h30m1.165091844s"
Jul 07 16:23:21.508971 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:21.508839    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9sc2w"
Jul 07 16:23:21.508971 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:21.508879    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhrbs"
Jul 07 16:23:21.509578 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:21.509009    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9sc2w" podUID="a5e94c63-e554-402d-9215-06cd6525019a"
Jul 07 16:23:21.509578 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:21.509167    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhrbs" podUID="01b7d29e-fb29-4aae-9f8c-eb6403a682cb"
Jul 07 16:23:21.517870 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:21.517827    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xxmq2" event={"ID":"9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9","Type":"ContainerStarted","Data":"3d612bfcb4f3f28de8adc9eb37d1556cdb8fbd684eaf92abea1d4e8d373783d3"}
Jul 07 16:23:21.519424 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:21.519386    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nk4br" event={"ID":"2d6c0087-96b8-4c36-bc5b-e6f2ab2d179f","Type":"ContainerStarted","Data":"dfdf8650110da9f4951f4caadd732233b05603fc6118232d2253a45ad4581548"}
Jul 07 16:23:21.520525 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:21.520498    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xpjlg" event={"ID":"92a59c06-08c5-471c-943f-7f378028262c","Type":"ContainerStarted","Data":"d2aa4f1a1b3b2319aeae4550d8d6f8e0828789b8484d64b4442973ae893a5195"}
Jul 07 16:23:21.521759 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:21.521733    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-h7454" event={"ID":"98c9a652-a9eb-42c9-beb7-953a08807fef","Type":"ContainerStarted","Data":"8d7f8fdd7dac031db39b78ec3579ca40b3cd28393a8d5b7328c081034da609ce"}
Jul 07 16:23:21.522900 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:21.522880    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mw8j6" event={"ID":"8f80c277-c52b-4c80-b091-a9f6cdd68428","Type":"ContainerStarted","Data":"f0b0f8a1832278f51f4852b9d2b8b93f4da2b8c15be3eeb44c1a522557bc4c76"}
Jul 07 16:23:21.524114 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:21.524075    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-brlwz" event={"ID":"9efcfd27-d237-43ca-a158-bf2ef8dffb3b","Type":"ContainerStarted","Data":"7aee4b0f0aa3def976f6abca151bfff5e0ab3eae4256d372fe295761aea42c11"}
Jul 07 16:23:21.525138 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:21.525118    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zcqml" event={"ID":"dbe86d02-ec4b-4424-a88f-098ee332c985","Type":"ContainerStarted","Data":"6ab44008358ff178cf0bc1e2a0429a458ee51290c73d38a20beaaf1205a53453"}
Jul 07 16:23:21.526300 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:21.526259    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m6bqj" event={"ID":"bdcf0b66-ef82-404c-80cf-256ace23452f","Type":"ContainerStarted","Data":"0d25d4df5caae5ff93a0930a1081aca0126b784baa2618796e6b6cc3f18a0214"}
Jul 07 16:23:21.527401 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:21.527379    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-px22l" event={"ID":"6b04c831-cc37-4394-b42f-96d79b2a684a","Type":"ContainerStarted","Data":"a13995aebcf6c28132ee09566618c95bede99a74c725969ca65b7691d3bb7f07"}
Jul 07 16:23:21.529374 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:21.529352    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-6.ec2.internal" event={"ID":"ef1c54019a7929a2f27c1ddd35de351e","Type":"ContainerStarted","Data":"57e609f42587952ce67aab4ab8ed40b87d83065a0da4eeb820799d61d98f2e03"}
Jul 07 16:23:21.957812 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:21.957766    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5e94c63-e554-402d-9215-06cd6525019a-metrics-certs\") pod \"network-metrics-daemon-9sc2w\" (UID: \"a5e94c63-e554-402d-9215-06cd6525019a\") " pod="openshift-multus/network-metrics-daemon-9sc2w"
Jul 07 16:23:21.957990 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:21.957946    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 16:23:21.958066 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:21.958017    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5e94c63-e554-402d-9215-06cd6525019a-metrics-certs podName:a5e94c63-e554-402d-9215-06cd6525019a nodeName:}" failed. No retries permitted until 2026-07-07 16:23:23.957996879 +0000 UTC m=+6.044965341 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a5e94c63-e554-402d-9215-06cd6525019a-metrics-certs") pod "network-metrics-daemon-9sc2w" (UID: "a5e94c63-e554-402d-9215-06cd6525019a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 16:23:22.058588 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:22.058545    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/01b7d29e-fb29-4aae-9f8c-eb6403a682cb-original-pull-secret\") pod \"global-pull-secret-syncer-qhrbs\" (UID: \"01b7d29e-fb29-4aae-9f8c-eb6403a682cb\") " pod="kube-system/global-pull-secret-syncer-qhrbs"
Jul 07 16:23:22.058778 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:22.058635    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nsk9\" (UniqueName: \"kubernetes.io/projected/9dffb5de-b5f8-4349-895d-9e01c494eff1-kube-api-access-7nsk9\") pod \"network-check-target-9489w\" (UID: \"9dffb5de-b5f8-4349-895d-9e01c494eff1\") " pod="openshift-network-diagnostics/network-check-target-9489w"
Jul 07 16:23:22.058859 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:22.058832    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 16:23:22.058859 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:22.058856    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 16:23:22.058966 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:22.058870    2578 projected.go:196] Error preparing data for projected volume kube-api-access-7nsk9 for pod openshift-network-diagnostics/network-check-target-9489w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 16:23:22.059020 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:22.058966    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9dffb5de-b5f8-4349-895d-9e01c494eff1-kube-api-access-7nsk9 podName:9dffb5de-b5f8-4349-895d-9e01c494eff1 nodeName:}" failed. No retries permitted until 2026-07-07 16:23:24.058945917 +0000 UTC m=+6.145914357 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7nsk9" (UniqueName: "kubernetes.io/projected/9dffb5de-b5f8-4349-895d-9e01c494eff1-kube-api-access-7nsk9") pod "network-check-target-9489w" (UID: "9dffb5de-b5f8-4349-895d-9e01c494eff1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 16:23:22.059096 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:22.059044    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 16:23:22.059096 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:22.059083    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01b7d29e-fb29-4aae-9f8c-eb6403a682cb-original-pull-secret podName:01b7d29e-fb29-4aae-9f8c-eb6403a682cb nodeName:}" failed. No retries permitted until 2026-07-07 16:23:24.059070857 +0000 UTC m=+6.146039297 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/01b7d29e-fb29-4aae-9f8c-eb6403a682cb-original-pull-secret") pod "global-pull-secret-syncer-qhrbs" (UID: "01b7d29e-fb29-4aae-9f8c-eb6403a682cb") : object "kube-system"/"original-pull-secret" not registered
Jul 07 16:23:22.363179 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:22.363101    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 16:18:20 +0000 UTC" deadline="2027-12-11 16:13:01.240760464 +0000 UTC"
Jul 07 16:23:22.363179 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:22.363144    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12527h49m38.877620933s"
Jul 07 16:23:22.510777 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:22.510681    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9489w"
Jul 07 16:23:22.511293 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:22.510827    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9489w" podUID="9dffb5de-b5f8-4349-895d-9e01c494eff1"
Jul 07 16:23:22.542816 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:22.542769    2578 generic.go:356] "Generic (PLEG): container finished" podID="ef1c54019a7929a2f27c1ddd35de351e" containerID="57e609f42587952ce67aab4ab8ed40b87d83065a0da4eeb820799d61d98f2e03" exitCode=0
Jul 07 16:23:22.543012 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:22.542907    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-6.ec2.internal" event={"ID":"ef1c54019a7929a2f27c1ddd35de351e","Type":"ContainerDied","Data":"57e609f42587952ce67aab4ab8ed40b87d83065a0da4eeb820799d61d98f2e03"}
Jul 07 16:23:22.555859 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:22.555148    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-6.ec2.internal" event={"ID":"22e77dea25ac0ea044c4bb8f6b7df505","Type":"ContainerStarted","Data":"6ef6cbc911c58b386b570d2367664d4783cfab5f2a77c9f8fa94181532574ca5"}
Jul 07 16:23:23.508647 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:23.508590    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9sc2w"
Jul 07 16:23:23.508886 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:23.508736    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9sc2w" podUID="a5e94c63-e554-402d-9215-06cd6525019a"
Jul 07 16:23:23.509147 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:23.509129    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhrbs"
Jul 07 16:23:23.509247 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:23.509228    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhrbs" podUID="01b7d29e-fb29-4aae-9f8c-eb6403a682cb"
Jul 07 16:23:23.581746 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:23.581690    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-6.ec2.internal" event={"ID":"ef1c54019a7929a2f27c1ddd35de351e","Type":"ContainerStarted","Data":"60e6464dad83223cc43d93828b1acfd44b5d14e77162f6b9bb454e8958abcb30"}
Jul 07 16:23:23.603605 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:23.603529    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-6.ec2.internal" podStartSLOduration=4.603506619 podStartE2EDuration="4.603506619s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:23:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:23:22.599398979 +0000 UTC m=+4.686367441" watchObservedRunningTime="2026-07-07 16:23:23.603506619 +0000 UTC m=+5.690475080"
Jul 07 16:23:23.975789 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:23.975695    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5e94c63-e554-402d-9215-06cd6525019a-metrics-certs\") pod \"network-metrics-daemon-9sc2w\" (UID: \"a5e94c63-e554-402d-9215-06cd6525019a\") " pod="openshift-multus/network-metrics-daemon-9sc2w"
Jul 07 16:23:23.975952 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:23.975901    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 16:23:23.976024 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:23.975970    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5e94c63-e554-402d-9215-06cd6525019a-metrics-certs podName:a5e94c63-e554-402d-9215-06cd6525019a nodeName:}" failed. No retries permitted until 2026-07-07 16:23:27.975950288 +0000 UTC m=+10.062918798 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a5e94c63-e554-402d-9215-06cd6525019a-metrics-certs") pod "network-metrics-daemon-9sc2w" (UID: "a5e94c63-e554-402d-9215-06cd6525019a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 16:23:24.076834 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:24.076794    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/01b7d29e-fb29-4aae-9f8c-eb6403a682cb-original-pull-secret\") pod \"global-pull-secret-syncer-qhrbs\" (UID: \"01b7d29e-fb29-4aae-9f8c-eb6403a682cb\") " pod="kube-system/global-pull-secret-syncer-qhrbs"
Jul 07 16:23:24.077029 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:24.076872    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nsk9\" (UniqueName: \"kubernetes.io/projected/9dffb5de-b5f8-4349-895d-9e01c494eff1-kube-api-access-7nsk9\") pod \"network-check-target-9489w\" (UID: \"9dffb5de-b5f8-4349-895d-9e01c494eff1\") " pod="openshift-network-diagnostics/network-check-target-9489w"
Jul 07 16:23:24.077091 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:24.077025    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 16:23:24.077091 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:24.077047    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 16:23:24.077189 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:24.077110    2578 projected.go:196] Error preparing data for projected volume kube-api-access-7nsk9 for pod openshift-network-diagnostics/network-check-target-9489w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 16:23:24.077189 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:24.077182    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9dffb5de-b5f8-4349-895d-9e01c494eff1-kube-api-access-7nsk9 podName:9dffb5de-b5f8-4349-895d-9e01c494eff1 nodeName:}" failed. No retries permitted until 2026-07-07 16:23:28.077159754 +0000 UTC m=+10.164128206 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7nsk9" (UniqueName: "kubernetes.io/projected/9dffb5de-b5f8-4349-895d-9e01c494eff1-kube-api-access-7nsk9") pod "network-check-target-9489w" (UID: "9dffb5de-b5f8-4349-895d-9e01c494eff1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 16:23:24.077299 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:24.077257    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 16:23:24.077299 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:24.077290    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01b7d29e-fb29-4aae-9f8c-eb6403a682cb-original-pull-secret podName:01b7d29e-fb29-4aae-9f8c-eb6403a682cb nodeName:}" failed. No retries permitted until 2026-07-07 16:23:28.077278982 +0000 UTC m=+10.164247421 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/01b7d29e-fb29-4aae-9f8c-eb6403a682cb-original-pull-secret") pod "global-pull-secret-syncer-qhrbs" (UID: "01b7d29e-fb29-4aae-9f8c-eb6403a682cb") : object "kube-system"/"original-pull-secret" not registered
Jul 07 16:23:24.511610 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:24.511056    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9489w"
Jul 07 16:23:24.511610 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:24.511190    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9489w" podUID="9dffb5de-b5f8-4349-895d-9e01c494eff1"
Jul 07 16:23:25.509181 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:25.509140    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9sc2w"
Jul 07 16:23:25.509761 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:25.509297    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9sc2w" podUID="a5e94c63-e554-402d-9215-06cd6525019a"
Jul 07 16:23:25.509761 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:25.509723    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhrbs"
Jul 07 16:23:25.509877 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:25.509839    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhrbs" podUID="01b7d29e-fb29-4aae-9f8c-eb6403a682cb"
Jul 07 16:23:26.509495 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:26.509461    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9489w"
Jul 07 16:23:26.509907 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:26.509613    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9489w" podUID="9dffb5de-b5f8-4349-895d-9e01c494eff1"
Jul 07 16:23:27.508793 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:27.508757    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9sc2w"
Jul 07 16:23:27.508973 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:27.508758    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhrbs"
Jul 07 16:23:27.508973 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:27.508908    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9sc2w" podUID="a5e94c63-e554-402d-9215-06cd6525019a"
Jul 07 16:23:27.508973 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:27.508964    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhrbs" podUID="01b7d29e-fb29-4aae-9f8c-eb6403a682cb"
Jul 07 16:23:28.009743 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:28.009639    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5e94c63-e554-402d-9215-06cd6525019a-metrics-certs\") pod \"network-metrics-daemon-9sc2w\" (UID: \"a5e94c63-e554-402d-9215-06cd6525019a\") " pod="openshift-multus/network-metrics-daemon-9sc2w"
Jul 07 16:23:28.010186 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:28.009812    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 16:23:28.010186 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:28.009931    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5e94c63-e554-402d-9215-06cd6525019a-metrics-certs podName:a5e94c63-e554-402d-9215-06cd6525019a nodeName:}" failed. No retries permitted until 2026-07-07 16:23:36.00987394 +0000 UTC m=+18.096842376 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a5e94c63-e554-402d-9215-06cd6525019a-metrics-certs") pod "network-metrics-daemon-9sc2w" (UID: "a5e94c63-e554-402d-9215-06cd6525019a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 16:23:28.110752 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:28.110703    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nsk9\" (UniqueName: \"kubernetes.io/projected/9dffb5de-b5f8-4349-895d-9e01c494eff1-kube-api-access-7nsk9\") pod \"network-check-target-9489w\" (UID: \"9dffb5de-b5f8-4349-895d-9e01c494eff1\") " pod="openshift-network-diagnostics/network-check-target-9489w"
Jul 07 16:23:28.110950 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:28.110795    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/01b7d29e-fb29-4aae-9f8c-eb6403a682cb-original-pull-secret\") pod \"global-pull-secret-syncer-qhrbs\" (UID: \"01b7d29e-fb29-4aae-9f8c-eb6403a682cb\") " pod="kube-system/global-pull-secret-syncer-qhrbs"
Jul 07 16:23:28.110950 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:28.110911    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 16:23:28.111066 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:28.110945    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 16:23:28.111066 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:28.110973    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 16:23:28.111066 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:28.110978    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01b7d29e-fb29-4aae-9f8c-eb6403a682cb-original-pull-secret podName:01b7d29e-fb29-4aae-9f8c-eb6403a682cb nodeName:}" failed. No retries permitted until 2026-07-07 16:23:36.110959013 +0000 UTC m=+18.197927466 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/01b7d29e-fb29-4aae-9f8c-eb6403a682cb-original-pull-secret") pod "global-pull-secret-syncer-qhrbs" (UID: "01b7d29e-fb29-4aae-9f8c-eb6403a682cb") : object "kube-system"/"original-pull-secret" not registered
Jul 07 16:23:28.111066 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:28.110986    2578 projected.go:196] Error preparing data for projected volume kube-api-access-7nsk9 for pod openshift-network-diagnostics/network-check-target-9489w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 16:23:28.111066 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:28.111040    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9dffb5de-b5f8-4349-895d-9e01c494eff1-kube-api-access-7nsk9 podName:9dffb5de-b5f8-4349-895d-9e01c494eff1 nodeName:}" failed. No retries permitted until 2026-07-07 16:23:36.111023468 +0000 UTC m=+18.197991920 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7nsk9" (UniqueName: "kubernetes.io/projected/9dffb5de-b5f8-4349-895d-9e01c494eff1-kube-api-access-7nsk9") pod "network-check-target-9489w" (UID: "9dffb5de-b5f8-4349-895d-9e01c494eff1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 16:23:28.510740 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:28.510247    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9489w"
Jul 07 16:23:28.510740 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:28.510375    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9489w" podUID="9dffb5de-b5f8-4349-895d-9e01c494eff1"
Jul 07 16:23:29.509606 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:29.508927    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhrbs"
Jul 07 16:23:29.509606 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:29.509062    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhrbs" podUID="01b7d29e-fb29-4aae-9f8c-eb6403a682cb"
Jul 07 16:23:29.509606 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:29.509458    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9sc2w"
Jul 07 16:23:29.509606 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:29.509567    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9sc2w" podUID="a5e94c63-e554-402d-9215-06cd6525019a"
Jul 07 16:23:30.509960 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:30.509426    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9489w"
Jul 07 16:23:30.509960 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:30.509565    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9489w" podUID="9dffb5de-b5f8-4349-895d-9e01c494eff1"
Jul 07 16:23:31.508652 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:31.508610    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9sc2w"
Jul 07 16:23:31.508838 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:31.508739    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9sc2w" podUID="a5e94c63-e554-402d-9215-06cd6525019a"
Jul 07 16:23:31.508838 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:31.508797    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhrbs"
Jul 07 16:23:31.508998 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:31.508906    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhrbs" podUID="01b7d29e-fb29-4aae-9f8c-eb6403a682cb"
Jul 07 16:23:32.509036 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:32.509001    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9489w"
Jul 07 16:23:32.509462 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:32.509127    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9489w" podUID="9dffb5de-b5f8-4349-895d-9e01c494eff1"
Jul 07 16:23:33.508867 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:33.508834    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9sc2w"
Jul 07 16:23:33.509046 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:33.508881    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhrbs"
Jul 07 16:23:33.509046 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:33.508952    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9sc2w" podUID="a5e94c63-e554-402d-9215-06cd6525019a"
Jul 07 16:23:33.509381 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:33.509076    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhrbs" podUID="01b7d29e-fb29-4aae-9f8c-eb6403a682cb"
Jul 07 16:23:34.508667 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:34.508630    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9489w"
Jul 07 16:23:34.508842 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:34.508769    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9489w" podUID="9dffb5de-b5f8-4349-895d-9e01c494eff1"
Jul 07 16:23:35.508830 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:35.508790    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9sc2w"
Jul 07 16:23:35.509268 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:35.508790    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhrbs"
Jul 07 16:23:35.509268 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:35.508933    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9sc2w" podUID="a5e94c63-e554-402d-9215-06cd6525019a"
Jul 07 16:23:35.509268 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:35.508969    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhrbs" podUID="01b7d29e-fb29-4aae-9f8c-eb6403a682cb"
Jul 07 16:23:36.070852 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:36.070813    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5e94c63-e554-402d-9215-06cd6525019a-metrics-certs\") pod \"network-metrics-daemon-9sc2w\" (UID: \"a5e94c63-e554-402d-9215-06cd6525019a\") " pod="openshift-multus/network-metrics-daemon-9sc2w"
Jul 07 16:23:36.071031 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:36.070975    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 16:23:36.071076 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:36.071057    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5e94c63-e554-402d-9215-06cd6525019a-metrics-certs podName:a5e94c63-e554-402d-9215-06cd6525019a nodeName:}" failed. No retries permitted until 2026-07-07 16:23:52.071040551 +0000 UTC m=+34.158008988 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a5e94c63-e554-402d-9215-06cd6525019a-metrics-certs") pod "network-metrics-daemon-9sc2w" (UID: "a5e94c63-e554-402d-9215-06cd6525019a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 16:23:36.171438 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:36.171380    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/01b7d29e-fb29-4aae-9f8c-eb6403a682cb-original-pull-secret\") pod \"global-pull-secret-syncer-qhrbs\" (UID: \"01b7d29e-fb29-4aae-9f8c-eb6403a682cb\") " pod="kube-system/global-pull-secret-syncer-qhrbs"
Jul 07 16:23:36.171632 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:36.171458    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nsk9\" (UniqueName: \"kubernetes.io/projected/9dffb5de-b5f8-4349-895d-9e01c494eff1-kube-api-access-7nsk9\") pod \"network-check-target-9489w\" (UID: \"9dffb5de-b5f8-4349-895d-9e01c494eff1\") " pod="openshift-network-diagnostics/network-check-target-9489w"
Jul 07 16:23:36.171632 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:36.171544    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 16:23:36.171632 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:36.171574    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 16:23:36.171632 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:36.171588    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 16:23:36.171632 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:36.171601    2578 projected.go:196] Error preparing data for projected volume kube-api-access-7nsk9 for pod openshift-network-diagnostics/network-check-target-9489w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 16:23:36.171632 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:36.171620    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01b7d29e-fb29-4aae-9f8c-eb6403a682cb-original-pull-secret podName:01b7d29e-fb29-4aae-9f8c-eb6403a682cb nodeName:}" failed. No retries permitted until 2026-07-07 16:23:52.171600115 +0000 UTC m=+34.258568571 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/01b7d29e-fb29-4aae-9f8c-eb6403a682cb-original-pull-secret") pod "global-pull-secret-syncer-qhrbs" (UID: "01b7d29e-fb29-4aae-9f8c-eb6403a682cb") : object "kube-system"/"original-pull-secret" not registered
Jul 07 16:23:36.171632 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:36.171636    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9dffb5de-b5f8-4349-895d-9e01c494eff1-kube-api-access-7nsk9 podName:9dffb5de-b5f8-4349-895d-9e01c494eff1 nodeName:}" failed. No retries permitted until 2026-07-07 16:23:52.171625923 +0000 UTC m=+34.258594372 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7nsk9" (UniqueName: "kubernetes.io/projected/9dffb5de-b5f8-4349-895d-9e01c494eff1-kube-api-access-7nsk9") pod "network-check-target-9489w" (UID: "9dffb5de-b5f8-4349-895d-9e01c494eff1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 16:23:36.509480 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:36.509393    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9489w"
Jul 07 16:23:36.509920 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:36.509518    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9489w" podUID="9dffb5de-b5f8-4349-895d-9e01c494eff1"
Jul 07 16:23:37.508541 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:37.508500    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhrbs"
Jul 07 16:23:37.508541 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:37.508529    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9sc2w"
Jul 07 16:23:37.508780 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:37.508629    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhrbs" podUID="01b7d29e-fb29-4aae-9f8c-eb6403a682cb"
Jul 07 16:23:37.508780 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:37.508760    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9sc2w" podUID="a5e94c63-e554-402d-9215-06cd6525019a"
Jul 07 16:23:38.510093 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:38.510060    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9489w"
Jul 07 16:23:38.510535 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:38.510159    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9489w" podUID="9dffb5de-b5f8-4349-895d-9e01c494eff1"
Jul 07 16:23:39.508612 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:39.508577    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9sc2w"
Jul 07 16:23:39.508806 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:39.508718    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9sc2w" podUID="a5e94c63-e554-402d-9215-06cd6525019a"
Jul 07 16:23:39.508806 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:39.508775    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhrbs"
Jul 07 16:23:39.508916 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:39.508896    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhrbs" podUID="01b7d29e-fb29-4aae-9f8c-eb6403a682cb"
Jul 07 16:23:40.508918 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:40.508587    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9489w"
Jul 07 16:23:40.509824 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:40.509005    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9489w" podUID="9dffb5de-b5f8-4349-895d-9e01c494eff1"
Jul 07 16:23:40.622427 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:40.622384    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xxmq2" event={"ID":"9ec6b1d3-e3bb-40c4-be03-3ff8c0caecf9","Type":"ContainerStarted","Data":"9b676f9189313d8019ffc6588b0f451d6110ab2d84e85e9b8953c51f65ddac9f"}
Jul 07 16:23:40.623774 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:40.623744    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nk4br" event={"ID":"2d6c0087-96b8-4c36-bc5b-e6f2ab2d179f","Type":"ContainerStarted","Data":"702d62d7ec8d4f0d08eb3cbfad13ae5e0b4da26ee0bb9c60fbf4ca51acaf0639"}
Jul 07 16:23:40.625406 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:40.625377    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xpjlg" event={"ID":"92a59c06-08c5-471c-943f-7f378028262c","Type":"ContainerStarted","Data":"6921dbbb891363efcaca6b11bbd6e57f49e62f28250352229db0ba914a6832df"}
Jul 07 16:23:40.627263 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:40.627145    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-h7454" event={"ID":"98c9a652-a9eb-42c9-beb7-953a08807fef","Type":"ContainerStarted","Data":"51472b213052de6713ae70975d2a49821fac85303a744b23952027d45eca94a9"}
Jul 07 16:23:40.629757 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:40.629712    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-brlwz" event={"ID":"9efcfd27-d237-43ca-a158-bf2ef8dffb3b","Type":"ContainerStarted","Data":"8fd75e0251649cc07ca9ff2c30e601238de9a0942d15b8d10adb52301f387470"}
Jul 07 16:23:40.632367 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:40.630151    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-brlwz" event={"ID":"9efcfd27-d237-43ca-a158-bf2ef8dffb3b","Type":"ContainerStarted","Data":"ee6c5515cb8fd560b0d770993f5a1114d88ae0c3db89cc579e7a9076af35f3c6"}
Jul 07 16:23:40.635639 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:40.635606    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zcqml" event={"ID":"dbe86d02-ec4b-4424-a88f-098ee332c985","Type":"ContainerStarted","Data":"1adc07549f876eefca34cd83a0267af46b0c6aaef5d6fa1dec254afedbd7085e"}
Jul 07 16:23:40.637717 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:40.637606    2578 generic.go:356] "Generic (PLEG): container finished" podID="bdcf0b66-ef82-404c-80cf-256ace23452f" containerID="eab404e0e323570d07c70f7ff2d162cba7b1152937ab70c8ee0924d4a9d729bd" exitCode=0
Jul 07 16:23:40.637717 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:40.637692    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m6bqj" event={"ID":"bdcf0b66-ef82-404c-80cf-256ace23452f","Type":"ContainerDied","Data":"eab404e0e323570d07c70f7ff2d162cba7b1152937ab70c8ee0924d4a9d729bd"}
Jul 07 16:23:40.639716 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:40.639692    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-px22l" event={"ID":"6b04c831-cc37-4394-b42f-96d79b2a684a","Type":"ContainerStarted","Data":"bf988e108810eee2a5a33a1e77278510a1eae7c5a86564cef7e317ca96485d78"}
Jul 07 16:23:40.641436 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:40.641397    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-6.ec2.internal" podStartSLOduration=21.64138343 podStartE2EDuration="21.64138343s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:23:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:23:23.604119547 +0000 UTC m=+5.691088005" watchObservedRunningTime="2026-07-07 16:23:40.64138343 +0000 UTC m=+22.728351888"
Jul 07 16:23:40.641576 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:40.641554    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-xxmq2" podStartSLOduration=2.294559764 podStartE2EDuration="21.641547466s" totalImagesPullingTime="19.346987702s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:23:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:23:40.641100784 +0000 UTC m=+22.728069255" watchObservedRunningTime="2026-07-07 16:23:40.641547466 +0000 UTC m=+22.728515924"
Jul 07 16:23:40.682454 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:40.682267    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-xpjlg" podStartSLOduration=3.483260886 podStartE2EDuration="22.682245705s" totalImagesPullingTime="19.198984819s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:23:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:23:40.659023938 +0000 UTC m=+22.745992400" watchObservedRunningTime="2026-07-07 16:23:40.682245705 +0000 UTC m=+22.769214165"
Jul 07 16:23:40.698366 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:40.698304    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-h7454" podStartSLOduration=3.406713478 podStartE2EDuration="22.698289052s" totalImagesPullingTime="19.291575574s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:23:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:23:40.698200872 +0000 UTC m=+22.785169342" watchObservedRunningTime="2026-07-07 16:23:40.698289052 +0000 UTC m=+22.785257510"
Jul 07 16:23:40.713203 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:40.713161    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-zcqml" podStartSLOduration=6.4384192129999995 podStartE2EDuration="21.713138669s" totalImagesPullingTime="15.274719456s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:23:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:23:40.713100154 +0000 UTC m=+22.800068612" watchObservedRunningTime="2026-07-07 16:23:40.713138669 +0000 UTC m=+22.800107127"
Jul 07 16:23:40.729701 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:40.729645    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-nk4br" podStartSLOduration=2.44434643 podStartE2EDuration="21.729626957s" totalImagesPullingTime="19.285280527s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:23:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:23:40.729198833 +0000 UTC m=+22.816167292" watchObservedRunningTime="2026-07-07 16:23:40.729626957 +0000 UTC m=+22.816595438"
Jul 07 16:23:41.463440 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:41.463405    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-zcqml"
Jul 07 16:23:41.464123 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:41.464095    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-zcqml"
Jul 07 16:23:41.509228 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:41.509195    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9sc2w"
Jul 07 16:23:41.509649 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:41.509308    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9sc2w" podUID="a5e94c63-e554-402d-9215-06cd6525019a"
Jul 07 16:23:41.509649 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:41.509366    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhrbs"
Jul 07 16:23:41.509649 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:41.509453    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhrbs" podUID="01b7d29e-fb29-4aae-9f8c-eb6403a682cb"
Jul 07 16:23:41.643801 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:41.643777    2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 07 16:23:41.645541 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:41.645511    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-brlwz" event={"ID":"9efcfd27-d237-43ca-a158-bf2ef8dffb3b","Type":"ContainerStarted","Data":"2d69f20f888179e29556e917f5b0dce1d120368779d0ad1120cefe7e6fb0d47d"}
Jul 07 16:23:41.645652 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:41.645582    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-brlwz" event={"ID":"9efcfd27-d237-43ca-a158-bf2ef8dffb3b","Type":"ContainerStarted","Data":"c594c4dc568d9731280449134e5b9729bb7359c3029e908c5ab42a6f2d1f34da"}
Jul 07 16:23:41.645652 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:41.645619    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-brlwz" event={"ID":"9efcfd27-d237-43ca-a158-bf2ef8dffb3b","Type":"ContainerStarted","Data":"b49d0e478c750c29fc3b4d9b482871356a0ee054aa87a05605cb2cc73cc704a3"}
Jul 07 16:23:41.645652 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:41.645650    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-brlwz" event={"ID":"9efcfd27-d237-43ca-a158-bf2ef8dffb3b","Type":"ContainerStarted","Data":"99336cfb3d46923c7c30ba9ef1ac2c379ce27df759d6e5133b5ab725dfa62645"}
Jul 07 16:23:41.647168 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:41.647139    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-px22l" event={"ID":"6b04c831-cc37-4394-b42f-96d79b2a684a","Type":"ContainerStarted","Data":"0dfd80061328b75906b9a581edabd4e2a2805a5d572f2881d9e6e93ca6f8eec5"}
Jul 07 16:23:41.648033 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:41.648014    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-zcqml"
Jul 07 16:23:41.648266 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:41.648251    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-zcqml"
Jul 07 16:23:42.422537 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:42.422417    2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T16:23:41.643793704Z","UUID":"24a7b009-1473-4ce3-910e-bec53588844f","Handler":null,"Name":"","Endpoint":""}
Jul 07 16:23:42.424714 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:42.424678    2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 07 16:23:42.424895 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:42.424723    2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 07 16:23:42.509332 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:42.509295    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9489w"
Jul 07 16:23:42.509814 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:42.509458    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9489w" podUID="9dffb5de-b5f8-4349-895d-9e01c494eff1"
Jul 07 16:23:42.651452 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:42.651401    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mw8j6" event={"ID":"8f80c277-c52b-4c80-b091-a9f6cdd68428","Type":"ContainerStarted","Data":"e71ba772017bffa5769d2f78aefae93a2b115e325f8a9d92b75952afa2c9ab89"}
Jul 07 16:23:43.509312 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:43.509229    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9sc2w"
Jul 07 16:23:43.509513 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:43.509242    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhrbs"
Jul 07 16:23:43.509513 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:43.509385    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9sc2w" podUID="a5e94c63-e554-402d-9215-06cd6525019a"
Jul 07 16:23:43.509513 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:43.509440    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhrbs" podUID="01b7d29e-fb29-4aae-9f8c-eb6403a682cb"
Jul 07 16:23:43.658520 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:43.658261    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-brlwz" event={"ID":"9efcfd27-d237-43ca-a158-bf2ef8dffb3b","Type":"ContainerStarted","Data":"894ada16bee4f8daa5fb9e3edb5117ca4bd323fe065f1f1d66ed10f1f48e15ed"}
Jul 07 16:23:43.660769 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:43.660733    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-px22l" event={"ID":"6b04c831-cc37-4394-b42f-96d79b2a684a","Type":"ContainerStarted","Data":"fe4f3a7d687e504456027b01b94257a08a30df765d7d44dbd9bcc538c9fb6ed7"}
Jul 07 16:23:43.681697 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:43.681638    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-px22l" podStartSLOduration=4.076969456 podStartE2EDuration="25.681620755s" totalImagesPullingTime="21.604651299s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:23:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:23:43.68154931 +0000 UTC m=+25.768517770" watchObservedRunningTime="2026-07-07 16:23:43.681620755 +0000 UTC m=+25.768589213"
Jul 07 16:23:43.682308 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:43.682274    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-mw8j6" podStartSLOduration=6.388462882 podStartE2EDuration="25.68226229s" totalImagesPullingTime="19.293799408s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:23:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:23:42.668324063 +0000 UTC m=+24.755292526" watchObservedRunningTime="2026-07-07 16:23:43.68226229 +0000 UTC m=+25.769230816"
Jul 07 16:23:44.508763 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:44.508728    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9489w"
Jul 07 16:23:44.508949 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:44.508867    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9489w" podUID="9dffb5de-b5f8-4349-895d-9e01c494eff1"
Jul 07 16:23:45.509188 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:45.509102    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9sc2w"
Jul 07 16:23:45.509188 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:45.509134    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhrbs"
Jul 07 16:23:45.509828 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:45.509238    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9sc2w" podUID="a5e94c63-e554-402d-9215-06cd6525019a"
Jul 07 16:23:45.509828 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:45.509392    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhrbs" podUID="01b7d29e-fb29-4aae-9f8c-eb6403a682cb"
Jul 07 16:23:46.508725 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:46.508457    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9489w"
Jul 07 16:23:46.508915 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:46.508829    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9489w" podUID="9dffb5de-b5f8-4349-895d-9e01c494eff1"
Jul 07 16:23:46.676063 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:46.676023    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-brlwz" event={"ID":"9efcfd27-d237-43ca-a158-bf2ef8dffb3b","Type":"ContainerStarted","Data":"1667509559ff2751861d963261c797c884f56c722dc9525535c5b734d68b5d81"}
Jul 07 16:23:46.676945 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:46.676325    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-brlwz"
Jul 07 16:23:46.678068 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:46.678042    2578 generic.go:356] "Generic (PLEG): container finished" podID="bdcf0b66-ef82-404c-80cf-256ace23452f" containerID="e95108de359c564e6cf31ca24de7ab1f2067e882296e9bf405d37586e733ef73" exitCode=0
Jul 07 16:23:46.678187 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:46.678096    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m6bqj" event={"ID":"bdcf0b66-ef82-404c-80cf-256ace23452f","Type":"ContainerDied","Data":"e95108de359c564e6cf31ca24de7ab1f2067e882296e9bf405d37586e733ef73"}
Jul 07 16:23:46.693516 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:46.693488    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-brlwz"
Jul 07 16:23:46.715518 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:46.715464    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-brlwz" podStartSLOduration=9.43277588 podStartE2EDuration="28.71544978s" totalImagesPullingTime="19.2826739s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:23:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:23:46.715243645 +0000 UTC m=+28.802212102" watchObservedRunningTime="2026-07-07 16:23:46.71544978 +0000 UTC m=+28.802418238"
Jul 07 16:23:47.509266 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:47.509228    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9sc2w"
Jul 07 16:23:47.509745 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:47.509362    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9sc2w" podUID="a5e94c63-e554-402d-9215-06cd6525019a"
Jul 07 16:23:47.509745 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:47.509376    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhrbs"
Jul 07 16:23:47.509745 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:47.509483    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhrbs" podUID="01b7d29e-fb29-4aae-9f8c-eb6403a682cb"
Jul 07 16:23:47.683698 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:47.683589    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m6bqj" event={"ID":"bdcf0b66-ef82-404c-80cf-256ace23452f","Type":"ContainerStarted","Data":"3730fb0bf4a7873057183be97db51c3f49f4d232ecb782b9ce62c8ee809841b4"}
Jul 07 16:23:47.684212 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:47.684184    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-brlwz"
Jul 07 16:23:47.684324 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:47.684265    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-brlwz"
Jul 07 16:23:47.700483 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:47.700454    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-brlwz"
Jul 07 16:23:47.825062 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:47.824979    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9sc2w"]
Jul 07 16:23:47.825195 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:47.825107    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9sc2w"
Jul 07 16:23:47.825231 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:47.825208    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9sc2w" podUID="a5e94c63-e554-402d-9215-06cd6525019a"
Jul 07 16:23:47.827485 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:47.827459    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qhrbs"]
Jul 07 16:23:47.827601 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:47.827556    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhrbs"
Jul 07 16:23:47.827657 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:47.827631    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhrbs" podUID="01b7d29e-fb29-4aae-9f8c-eb6403a682cb"
Jul 07 16:23:47.842869 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:47.842842    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9489w"]
Jul 07 16:23:47.842992 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:47.842934    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9489w"
Jul 07 16:23:47.843037 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:47.843017    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9489w" podUID="9dffb5de-b5f8-4349-895d-9e01c494eff1"
Jul 07 16:23:48.687879 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:48.687637    2578 generic.go:356] "Generic (PLEG): container finished" podID="bdcf0b66-ef82-404c-80cf-256ace23452f" containerID="3730fb0bf4a7873057183be97db51c3f49f4d232ecb782b9ce62c8ee809841b4" exitCode=0
Jul 07 16:23:48.688304 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:48.687718    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m6bqj" event={"ID":"bdcf0b66-ef82-404c-80cf-256ace23452f","Type":"ContainerDied","Data":"3730fb0bf4a7873057183be97db51c3f49f4d232ecb782b9ce62c8ee809841b4"}
Jul 07 16:23:49.509308 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:49.509264    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhrbs"
Jul 07 16:23:49.509575 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:49.509280    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9489w"
Jul 07 16:23:49.509575 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:49.509393    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9sc2w"
Jul 07 16:23:49.509575 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:49.509386    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhrbs" podUID="01b7d29e-fb29-4aae-9f8c-eb6403a682cb"
Jul 07 16:23:49.509575 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:49.509476    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9489w" podUID="9dffb5de-b5f8-4349-895d-9e01c494eff1"
Jul 07 16:23:49.509575 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:49.509535    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9sc2w" podUID="a5e94c63-e554-402d-9215-06cd6525019a"
Jul 07 16:23:50.696089 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:50.696052    2578 generic.go:356] "Generic (PLEG): container finished" podID="bdcf0b66-ef82-404c-80cf-256ace23452f" containerID="4324f2f1110992ead8df66260cd9dadca7c41264d91b76beebb1cc61e8cbb83a" exitCode=0
Jul 07 16:23:50.696753 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:50.696109    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m6bqj" event={"ID":"bdcf0b66-ef82-404c-80cf-256ace23452f","Type":"ContainerDied","Data":"4324f2f1110992ead8df66260cd9dadca7c41264d91b76beebb1cc61e8cbb83a"}
Jul 07 16:23:51.508852 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:51.508820    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9sc2w"
Jul 07 16:23:51.508852 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:51.508843    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9489w"
Jul 07 16:23:51.509121 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:51.508834    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhrbs"
Jul 07 16:23:51.509121 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:51.508980    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9sc2w" podUID="a5e94c63-e554-402d-9215-06cd6525019a"
Jul 07 16:23:51.509121 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:51.509078    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9489w" podUID="9dffb5de-b5f8-4349-895d-9e01c494eff1"
Jul 07 16:23:51.509283 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:51.509173    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhrbs" podUID="01b7d29e-fb29-4aae-9f8c-eb6403a682cb"
Jul 07 16:23:52.086980 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:52.086940    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5e94c63-e554-402d-9215-06cd6525019a-metrics-certs\") pod \"network-metrics-daemon-9sc2w\" (UID: \"a5e94c63-e554-402d-9215-06cd6525019a\") " pod="openshift-multus/network-metrics-daemon-9sc2w"
Jul 07 16:23:52.087532 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:52.087085    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 16:23:52.087532 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:52.087147    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5e94c63-e554-402d-9215-06cd6525019a-metrics-certs podName:a5e94c63-e554-402d-9215-06cd6525019a nodeName:}" failed. No retries permitted until 2026-07-07 16:24:24.087128768 +0000 UTC m=+66.174097223 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a5e94c63-e554-402d-9215-06cd6525019a-metrics-certs") pod "network-metrics-daemon-9sc2w" (UID: "a5e94c63-e554-402d-9215-06cd6525019a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 16:23:52.188271 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:52.188192    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/01b7d29e-fb29-4aae-9f8c-eb6403a682cb-original-pull-secret\") pod \"global-pull-secret-syncer-qhrbs\" (UID: \"01b7d29e-fb29-4aae-9f8c-eb6403a682cb\") " pod="kube-system/global-pull-secret-syncer-qhrbs"
Jul 07 16:23:52.188271 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:52.188250    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nsk9\" (UniqueName: \"kubernetes.io/projected/9dffb5de-b5f8-4349-895d-9e01c494eff1-kube-api-access-7nsk9\") pod \"network-check-target-9489w\" (UID: \"9dffb5de-b5f8-4349-895d-9e01c494eff1\") " pod="openshift-network-diagnostics/network-check-target-9489w"
Jul 07 16:23:52.188651 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:52.188384    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 16:23:52.188651 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:52.188401    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 16:23:52.188651 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:52.188420    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 16:23:52.188651 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:52.188432    2578 projected.go:196] Error preparing data for projected volume kube-api-access-7nsk9 for pod openshift-network-diagnostics/network-check-target-9489w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 16:23:52.188651 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:52.188470    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01b7d29e-fb29-4aae-9f8c-eb6403a682cb-original-pull-secret podName:01b7d29e-fb29-4aae-9f8c-eb6403a682cb nodeName:}" failed. No retries permitted until 2026-07-07 16:24:24.188448723 +0000 UTC m=+66.275417164 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/01b7d29e-fb29-4aae-9f8c-eb6403a682cb-original-pull-secret") pod "global-pull-secret-syncer-qhrbs" (UID: "01b7d29e-fb29-4aae-9f8c-eb6403a682cb") : object "kube-system"/"original-pull-secret" not registered
Jul 07 16:23:52.188651 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:52.188490    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9dffb5de-b5f8-4349-895d-9e01c494eff1-kube-api-access-7nsk9 podName:9dffb5de-b5f8-4349-895d-9e01c494eff1 nodeName:}" failed. No retries permitted until 2026-07-07 16:24:24.188479886 +0000 UTC m=+66.275448327 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-7nsk9" (UniqueName: "kubernetes.io/projected/9dffb5de-b5f8-4349-895d-9e01c494eff1-kube-api-access-7nsk9") pod "network-check-target-9489w" (UID: "9dffb5de-b5f8-4349-895d-9e01c494eff1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 16:23:53.509359 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:53.509310    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9sc2w"
Jul 07 16:23:53.509824 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:53.509362    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9489w"
Jul 07 16:23:53.509824 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:53.509459    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9sc2w" podUID="a5e94c63-e554-402d-9215-06cd6525019a"
Jul 07 16:23:53.509824 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:53.509509    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9489w" podUID="9dffb5de-b5f8-4349-895d-9e01c494eff1"
Jul 07 16:23:53.509824 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:53.509567    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhrbs"
Jul 07 16:23:53.509824 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:53.509647    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhrbs" podUID="01b7d29e-fb29-4aae-9f8c-eb6403a682cb"
Jul 07 16:23:54.117186 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:54.117154    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-6.ec2.internal" event="NodeReady"
Jul 07 16:23:54.117384 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:54.117297    2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 07 16:23:54.189311 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:54.189268    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-m7n9j"]
Jul 07 16:23:54.192068 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:54.192039    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-m7n9j"
Jul 07 16:23:54.196013 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:54.195982    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-kxns9"]
Jul 07 16:23:54.197524 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:54.197496    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 07 16:23:54.197720 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:54.197696    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7f9fh\""
Jul 07 16:23:54.197800 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:54.197764    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 07 16:23:54.198154 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:54.198134    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kxns9"
Jul 07 16:23:54.200745 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:54.200602    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 07 16:23:54.200745 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:54.200602    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 07 16:23:54.200745 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:54.200656    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 07 16:23:54.200745 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:54.200701    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-f8xb4\""
Jul 07 16:23:54.209301 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:54.209222    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-m7n9j"]
Jul 07 16:23:54.213198 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:54.213167    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kxns9"]
Jul 07 16:23:54.301599 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:54.301563    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97c7d1d5-ed8a-4785-b56e-e76a83166958-metrics-tls\") pod \"dns-default-m7n9j\" (UID: \"97c7d1d5-ed8a-4785-b56e-e76a83166958\") " pod="openshift-dns/dns-default-m7n9j"
Jul 07 16:23:54.301784 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:54.301604    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgxgf\" (UniqueName: \"kubernetes.io/projected/f70a870c-9842-41b6-a874-b06704c78994-kube-api-access-wgxgf\") pod \"ingress-canary-kxns9\" (UID: \"f70a870c-9842-41b6-a874-b06704c78994\") " pod="openshift-ingress-canary/ingress-canary-kxns9"
Jul 07 16:23:54.301784 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:54.301667    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97c7d1d5-ed8a-4785-b56e-e76a83166958-tmp-dir\") pod \"dns-default-m7n9j\" (UID: \"97c7d1d5-ed8a-4785-b56e-e76a83166958\") " pod="openshift-dns/dns-default-m7n9j"
Jul 07 16:23:54.301784 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:54.301694    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mc8zk\" (UniqueName: \"kubernetes.io/projected/97c7d1d5-ed8a-4785-b56e-e76a83166958-kube-api-access-mc8zk\") pod \"dns-default-m7n9j\" (UID: \"97c7d1d5-ed8a-4785-b56e-e76a83166958\") " pod="openshift-dns/dns-default-m7n9j"
Jul 07 16:23:54.301784 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:54.301767    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f70a870c-9842-41b6-a874-b06704c78994-cert\") pod \"ingress-canary-kxns9\" (UID: \"f70a870c-9842-41b6-a874-b06704c78994\") " pod="openshift-ingress-canary/ingress-canary-kxns9"
Jul 07 16:23:54.301962 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:54.301796    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/97c7d1d5-ed8a-4785-b56e-e76a83166958-config-volume\") pod \"dns-default-m7n9j\" (UID: \"97c7d1d5-ed8a-4785-b56e-e76a83166958\") " pod="openshift-dns/dns-default-m7n9j"
Jul 07 16:23:54.402672 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:54.402583    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f70a870c-9842-41b6-a874-b06704c78994-cert\") pod \"ingress-canary-kxns9\" (UID: \"f70a870c-9842-41b6-a874-b06704c78994\") " pod="openshift-ingress-canary/ingress-canary-kxns9"
Jul 07 16:23:54.402672 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:54.402627    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/97c7d1d5-ed8a-4785-b56e-e76a83166958-config-volume\") pod \"dns-default-m7n9j\" (UID: \"97c7d1d5-ed8a-4785-b56e-e76a83166958\") " pod="openshift-dns/dns-default-m7n9j"
Jul 07 16:23:54.402889 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:54.402690    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97c7d1d5-ed8a-4785-b56e-e76a83166958-metrics-tls\") pod \"dns-default-m7n9j\" (UID: \"97c7d1d5-ed8a-4785-b56e-e76a83166958\") " pod="openshift-dns/dns-default-m7n9j"
Jul 07 16:23:54.402889 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:54.402722    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgxgf\" (UniqueName: \"kubernetes.io/projected/f70a870c-9842-41b6-a874-b06704c78994-kube-api-access-wgxgf\") pod \"ingress-canary-kxns9\" (UID: \"f70a870c-9842-41b6-a874-b06704c78994\") " pod="openshift-ingress-canary/ingress-canary-kxns9"
Jul 07 16:23:54.402889 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:54.402755    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97c7d1d5-ed8a-4785-b56e-e76a83166958-tmp-dir\") pod \"dns-default-m7n9j\" (UID: \"97c7d1d5-ed8a-4785-b56e-e76a83166958\") " pod="openshift-dns/dns-default-m7n9j"
Jul 07 16:23:54.402889 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:54.402778    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mc8zk\" (UniqueName: \"kubernetes.io/projected/97c7d1d5-ed8a-4785-b56e-e76a83166958-kube-api-access-mc8zk\") pod \"dns-default-m7n9j\" (UID: \"97c7d1d5-ed8a-4785-b56e-e76a83166958\") " pod="openshift-dns/dns-default-m7n9j"
Jul 07 16:23:54.402889 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:54.402820    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 16:23:54.403126 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:54.402894    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97c7d1d5-ed8a-4785-b56e-e76a83166958-metrics-tls podName:97c7d1d5-ed8a-4785-b56e-e76a83166958 nodeName:}" failed. No retries permitted until 2026-07-07 16:23:54.902871484 +0000 UTC m=+36.989839937 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/97c7d1d5-ed8a-4785-b56e-e76a83166958-metrics-tls") pod "dns-default-m7n9j" (UID: "97c7d1d5-ed8a-4785-b56e-e76a83166958") : secret "dns-default-metrics-tls" not found
Jul 07 16:23:54.403289 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:54.403268    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97c7d1d5-ed8a-4785-b56e-e76a83166958-tmp-dir\") pod \"dns-default-m7n9j\" (UID: \"97c7d1d5-ed8a-4785-b56e-e76a83166958\") " pod="openshift-dns/dns-default-m7n9j"
Jul 07 16:23:54.403525 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:54.403505    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/97c7d1d5-ed8a-4785-b56e-e76a83166958-config-volume\") pod \"dns-default-m7n9j\" (UID: \"97c7d1d5-ed8a-4785-b56e-e76a83166958\") " pod="openshift-dns/dns-default-m7n9j"
Jul 07 16:23:54.407413 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:54.407389    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f70a870c-9842-41b6-a874-b06704c78994-cert\") pod \"ingress-canary-kxns9\" (UID: \"f70a870c-9842-41b6-a874-b06704c78994\") " pod="openshift-ingress-canary/ingress-canary-kxns9"
Jul 07 16:23:54.414267 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:54.414243    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mc8zk\" (UniqueName: \"kubernetes.io/projected/97c7d1d5-ed8a-4785-b56e-e76a83166958-kube-api-access-mc8zk\") pod \"dns-default-m7n9j\" (UID: \"97c7d1d5-ed8a-4785-b56e-e76a83166958\") " pod="openshift-dns/dns-default-m7n9j"
Jul 07 16:23:54.414538 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:54.414517    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgxgf\" (UniqueName: \"kubernetes.io/projected/f70a870c-9842-41b6-a874-b06704c78994-kube-api-access-wgxgf\") pod \"ingress-canary-kxns9\" (UID: \"f70a870c-9842-41b6-a874-b06704c78994\") " pod="openshift-ingress-canary/ingress-canary-kxns9"
Jul 07 16:23:54.513883 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:54.513855    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kxns9"
Jul 07 16:23:54.906227 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:54.906186    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97c7d1d5-ed8a-4785-b56e-e76a83166958-metrics-tls\") pod \"dns-default-m7n9j\" (UID: \"97c7d1d5-ed8a-4785-b56e-e76a83166958\") " pod="openshift-dns/dns-default-m7n9j"
Jul 07 16:23:54.906402 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:54.906312    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 16:23:54.906402 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:54.906388    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97c7d1d5-ed8a-4785-b56e-e76a83166958-metrics-tls podName:97c7d1d5-ed8a-4785-b56e-e76a83166958 nodeName:}" failed. No retries permitted until 2026-07-07 16:23:55.906373432 +0000 UTC m=+37.993341869 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/97c7d1d5-ed8a-4785-b56e-e76a83166958-metrics-tls") pod "dns-default-m7n9j" (UID: "97c7d1d5-ed8a-4785-b56e-e76a83166958") : secret "dns-default-metrics-tls" not found
Jul 07 16:23:55.045137 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:55.044956    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kxns9"]
Jul 07 16:23:55.048863 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:23:55.048832    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf70a870c_9842_41b6_a874_b06704c78994.slice/crio-eecb8cc9e115aa3964ecdb9605a775e3fb218c908d58b3cbb81f538ba74d4429 WatchSource:0}: Error finding container eecb8cc9e115aa3964ecdb9605a775e3fb218c908d58b3cbb81f538ba74d4429: Status 404 returned error can't find the container with id eecb8cc9e115aa3964ecdb9605a775e3fb218c908d58b3cbb81f538ba74d4429
Jul 07 16:23:55.509440 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:55.509336    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9sc2w"
Jul 07 16:23:55.509657 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:55.509358    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9489w"
Jul 07 16:23:55.509657 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:55.509545    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhrbs"
Jul 07 16:23:55.512209 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:55.512179    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 16:23:55.513275 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:55.513240    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sncwv\""
Jul 07 16:23:55.513452 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:55.513277    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 16:23:55.513452 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:55.513339    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lkpxx\""
Jul 07 16:23:55.513452 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:55.513425    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 07 16:23:55.513452 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:55.513433    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 07 16:23:55.711756 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:55.711721    2578 generic.go:356] "Generic (PLEG): container finished" podID="bdcf0b66-ef82-404c-80cf-256ace23452f" containerID="2a8689fa4a3121e1bd9c8aac65dcf211d22f8947ac841a32f4a2b9820e56d705" exitCode=0
Jul 07 16:23:55.712206 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:55.711810    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m6bqj" event={"ID":"bdcf0b66-ef82-404c-80cf-256ace23452f","Type":"ContainerDied","Data":"2a8689fa4a3121e1bd9c8aac65dcf211d22f8947ac841a32f4a2b9820e56d705"}
Jul 07 16:23:55.713559 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:55.713529    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kxns9" event={"ID":"f70a870c-9842-41b6-a874-b06704c78994","Type":"ContainerStarted","Data":"eecb8cc9e115aa3964ecdb9605a775e3fb218c908d58b3cbb81f538ba74d4429"}
Jul 07 16:23:55.913308 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:55.913275    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97c7d1d5-ed8a-4785-b56e-e76a83166958-metrics-tls\") pod \"dns-default-m7n9j\" (UID: \"97c7d1d5-ed8a-4785-b56e-e76a83166958\") " pod="openshift-dns/dns-default-m7n9j"
Jul 07 16:23:55.913504 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:55.913435    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 16:23:55.913580 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:55.913512    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97c7d1d5-ed8a-4785-b56e-e76a83166958-metrics-tls podName:97c7d1d5-ed8a-4785-b56e-e76a83166958 nodeName:}" failed. No retries permitted until 2026-07-07 16:23:57.913493991 +0000 UTC m=+40.000462431 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/97c7d1d5-ed8a-4785-b56e-e76a83166958-metrics-tls") pod "dns-default-m7n9j" (UID: "97c7d1d5-ed8a-4785-b56e-e76a83166958") : secret "dns-default-metrics-tls" not found
Jul 07 16:23:56.719925 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:56.719886    2578 generic.go:356] "Generic (PLEG): container finished" podID="bdcf0b66-ef82-404c-80cf-256ace23452f" containerID="ad763ebc29682da3c352911273b39eb80e6442eb058e9fa95de81fd5f64bb4b6" exitCode=0
Jul 07 16:23:56.720387 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:56.719933    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m6bqj" event={"ID":"bdcf0b66-ef82-404c-80cf-256ace23452f","Type":"ContainerDied","Data":"ad763ebc29682da3c352911273b39eb80e6442eb058e9fa95de81fd5f64bb4b6"}
Jul 07 16:23:57.725513 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:57.725481    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m6bqj" event={"ID":"bdcf0b66-ef82-404c-80cf-256ace23452f","Type":"ContainerStarted","Data":"fcefa72c6309b73c1a72d7f991eeef189d5ae5cc0d76bf0ca5595b82b5400729"}
Jul 07 16:23:57.727042 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:57.727018    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kxns9" event={"ID":"f70a870c-9842-41b6-a874-b06704c78994","Type":"ContainerStarted","Data":"c8bb7f7ad3d552fb17e2a1862ea74def35d95d853f559d24eef5a6810306b715"}
Jul 07 16:23:57.752235 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:57.752179    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-m6bqj" podStartSLOduration=8.23697458 podStartE2EDuration="38.752158796s" totalImagesPullingTime="30.515184216s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:23:19 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:23:57.750767864 +0000 UTC m=+39.837736347" watchObservedRunningTime="2026-07-07 16:23:57.752158796 +0000 UTC m=+39.839127251"
Jul 07 16:23:57.777172 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:57.777107    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-kxns9" podStartSLOduration=1.513706088 podStartE2EDuration="3.777085531s" totalImagesPullingTime="2.263379443s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:23:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:23:57.775595021 +0000 UTC m=+39.862563481" watchObservedRunningTime="2026-07-07 16:23:57.777085531 +0000 UTC m=+39.864053989"
Jul 07 16:23:57.930447 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:23:57.930410    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97c7d1d5-ed8a-4785-b56e-e76a83166958-metrics-tls\") pod \"dns-default-m7n9j\" (UID: \"97c7d1d5-ed8a-4785-b56e-e76a83166958\") " pod="openshift-dns/dns-default-m7n9j"
Jul 07 16:23:57.930631 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:57.930532    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 16:23:57.930631 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:23:57.930589    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97c7d1d5-ed8a-4785-b56e-e76a83166958-metrics-tls podName:97c7d1d5-ed8a-4785-b56e-e76a83166958 nodeName:}" failed. No retries permitted until 2026-07-07 16:24:01.930572335 +0000 UTC m=+44.017540776 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/97c7d1d5-ed8a-4785-b56e-e76a83166958-metrics-tls") pod "dns-default-m7n9j" (UID: "97c7d1d5-ed8a-4785-b56e-e76a83166958") : secret "dns-default-metrics-tls" not found
Jul 07 16:24:01.958706 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:24:01.958663    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97c7d1d5-ed8a-4785-b56e-e76a83166958-metrics-tls\") pod \"dns-default-m7n9j\" (UID: \"97c7d1d5-ed8a-4785-b56e-e76a83166958\") " pod="openshift-dns/dns-default-m7n9j"
Jul 07 16:24:01.959134 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:24:01.958790    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 16:24:01.959134 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:24:01.958842    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97c7d1d5-ed8a-4785-b56e-e76a83166958-metrics-tls podName:97c7d1d5-ed8a-4785-b56e-e76a83166958 nodeName:}" failed. No retries permitted until 2026-07-07 16:24:09.958828653 +0000 UTC m=+52.045797089 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/97c7d1d5-ed8a-4785-b56e-e76a83166958-metrics-tls") pod "dns-default-m7n9j" (UID: "97c7d1d5-ed8a-4785-b56e-e76a83166958") : secret "dns-default-metrics-tls" not found
Jul 07 16:24:10.016606 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:24:10.016565    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97c7d1d5-ed8a-4785-b56e-e76a83166958-metrics-tls\") pod \"dns-default-m7n9j\" (UID: \"97c7d1d5-ed8a-4785-b56e-e76a83166958\") " pod="openshift-dns/dns-default-m7n9j"
Jul 07 16:24:10.017102 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:24:10.016728    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 16:24:10.017102 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:24:10.016792    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97c7d1d5-ed8a-4785-b56e-e76a83166958-metrics-tls podName:97c7d1d5-ed8a-4785-b56e-e76a83166958 nodeName:}" failed. No retries permitted until 2026-07-07 16:24:26.016777286 +0000 UTC m=+68.103745726 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/97c7d1d5-ed8a-4785-b56e-e76a83166958-metrics-tls") pod "dns-default-m7n9j" (UID: "97c7d1d5-ed8a-4785-b56e-e76a83166958") : secret "dns-default-metrics-tls" not found
Jul 07 16:24:19.711751 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:24:19.711723    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-brlwz"
Jul 07 16:24:24.113833 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:24:24.113784    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5e94c63-e554-402d-9215-06cd6525019a-metrics-certs\") pod \"network-metrics-daemon-9sc2w\" (UID: \"a5e94c63-e554-402d-9215-06cd6525019a\") " pod="openshift-multus/network-metrics-daemon-9sc2w"
Jul 07 16:24:24.116516 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:24:24.116494    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 16:24:24.125059 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:24:24.125031    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 07 16:24:24.125121 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:24:24.125109    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5e94c63-e554-402d-9215-06cd6525019a-metrics-certs podName:a5e94c63-e554-402d-9215-06cd6525019a nodeName:}" failed. No retries permitted until 2026-07-07 16:25:28.125086739 +0000 UTC m=+130.212055181 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a5e94c63-e554-402d-9215-06cd6525019a-metrics-certs") pod "network-metrics-daemon-9sc2w" (UID: "a5e94c63-e554-402d-9215-06cd6525019a") : secret "metrics-daemon-secret" not found
Jul 07 16:24:24.214888 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:24:24.214844    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nsk9\" (UniqueName: \"kubernetes.io/projected/9dffb5de-b5f8-4349-895d-9e01c494eff1-kube-api-access-7nsk9\") pod \"network-check-target-9489w\" (UID: \"9dffb5de-b5f8-4349-895d-9e01c494eff1\") " pod="openshift-network-diagnostics/network-check-target-9489w"
Jul 07 16:24:24.214962 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:24:24.214915    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/01b7d29e-fb29-4aae-9f8c-eb6403a682cb-original-pull-secret\") pod \"global-pull-secret-syncer-qhrbs\" (UID: \"01b7d29e-fb29-4aae-9f8c-eb6403a682cb\") " pod="kube-system/global-pull-secret-syncer-qhrbs"
Jul 07 16:24:24.217866 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:24:24.217835    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 07 16:24:24.217866 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:24:24.217862    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 16:24:24.228093 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:24:24.228061    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 07 16:24:24.229518 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:24:24.229486    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/01b7d29e-fb29-4aae-9f8c-eb6403a682cb-original-pull-secret\") pod \"global-pull-secret-syncer-qhrbs\" (UID: \"01b7d29e-fb29-4aae-9f8c-eb6403a682cb\") " pod="kube-system/global-pull-secret-syncer-qhrbs"
Jul 07 16:24:24.239042 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:24:24.239007    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nsk9\" (UniqueName: \"kubernetes.io/projected/9dffb5de-b5f8-4349-895d-9e01c494eff1-kube-api-access-7nsk9\") pod \"network-check-target-9489w\" (UID: \"9dffb5de-b5f8-4349-895d-9e01c494eff1\") " pod="openshift-network-diagnostics/network-check-target-9489w"
Jul 07 16:24:24.333050 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:24:24.333015    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lkpxx\""
Jul 07 16:24:24.338274 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:24:24.338254    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhrbs"
Jul 07 16:24:24.340567 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:24:24.340543    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9489w"
Jul 07 16:24:24.480771 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:24:24.480736    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9489w"]
Jul 07 16:24:24.483542 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:24:24.483518    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9dffb5de_b5f8_4349_895d_9e01c494eff1.slice/crio-c80567daa4ed7241efa8904a5a0e2b40e8143c63179881c742cd1e0b502794fa WatchSource:0}: Error finding container c80567daa4ed7241efa8904a5a0e2b40e8143c63179881c742cd1e0b502794fa: Status 404 returned error can't find the container with id c80567daa4ed7241efa8904a5a0e2b40e8143c63179881c742cd1e0b502794fa
Jul 07 16:24:24.493867 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:24:24.493840    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qhrbs"]
Jul 07 16:24:24.497131 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:24:24.497098    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01b7d29e_fb29_4aae_9f8c_eb6403a682cb.slice/crio-b355d9fcceea0ab384a6d0e6c3cff81186a205fa8c60986ab84be55201b8bd81 WatchSource:0}: Error finding container b355d9fcceea0ab384a6d0e6c3cff81186a205fa8c60986ab84be55201b8bd81: Status 404 returned error can't find the container with id b355d9fcceea0ab384a6d0e6c3cff81186a205fa8c60986ab84be55201b8bd81
Jul 07 16:24:24.793469 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:24:24.793373    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9489w" event={"ID":"9dffb5de-b5f8-4349-895d-9e01c494eff1","Type":"ContainerStarted","Data":"c80567daa4ed7241efa8904a5a0e2b40e8143c63179881c742cd1e0b502794fa"}
Jul 07 16:24:24.794495 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:24:24.794471    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qhrbs" event={"ID":"01b7d29e-fb29-4aae-9f8c-eb6403a682cb","Type":"ContainerStarted","Data":"b355d9fcceea0ab384a6d0e6c3cff81186a205fa8c60986ab84be55201b8bd81"}
Jul 07 16:24:26.026556 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:24:26.026517    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97c7d1d5-ed8a-4785-b56e-e76a83166958-metrics-tls\") pod \"dns-default-m7n9j\" (UID: \"97c7d1d5-ed8a-4785-b56e-e76a83166958\") " pod="openshift-dns/dns-default-m7n9j"
Jul 07 16:24:26.027033 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:24:26.026668    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 16:24:26.027033 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:24:26.026737    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97c7d1d5-ed8a-4785-b56e-e76a83166958-metrics-tls podName:97c7d1d5-ed8a-4785-b56e-e76a83166958 nodeName:}" failed. No retries permitted until 2026-07-07 16:24:58.026716945 +0000 UTC m=+100.113685404 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/97c7d1d5-ed8a-4785-b56e-e76a83166958-metrics-tls") pod "dns-default-m7n9j" (UID: "97c7d1d5-ed8a-4785-b56e-e76a83166958") : secret "dns-default-metrics-tls" not found
Jul 07 16:24:29.809123 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:24:29.809085    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9489w" event={"ID":"9dffb5de-b5f8-4349-895d-9e01c494eff1","Type":"ContainerStarted","Data":"b5e41c8e497ed17e0b537dbc2409732c40241d84ce937a41745179e8300b9514"}
Jul 07 16:24:29.809634 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:24:29.809262    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-9489w"
Jul 07 16:24:29.810600 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:24:29.810578    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qhrbs" event={"ID":"01b7d29e-fb29-4aae-9f8c-eb6403a682cb","Type":"ContainerStarted","Data":"c36e2915b6c10a67de30bf6e991e04e087d7f324c3667ce6aca95d953364bcb1"}
Jul 07 16:24:29.833389 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:24:29.833314    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-9489w" podStartSLOduration=67.202739822 podStartE2EDuration="1m11.833299301s" totalImagesPullingTime="4.630559479s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:23:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:24:29.831616599 +0000 UTC m=+71.918585059" watchObservedRunningTime="2026-07-07 16:24:29.833299301 +0000 UTC m=+71.920267758"
Jul 07 16:24:37.771363 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:24:37.771295    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-qhrbs" podStartSLOduration=74.151326356 podStartE2EDuration="1m18.771276313s" totalImagesPullingTime="4.619949957s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:23:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:24:29.866289278 +0000 UTC m=+71.953257737" watchObservedRunningTime="2026-07-07 16:24:37.771276313 +0000 UTC m=+79.858244750"
Jul 07 16:24:37.772096 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:24:37.772078    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-795fdcb45d-gqhxj"]
Jul 07 16:24:37.773680 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:24:37.773665    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-795fdcb45d-gqhxj"
Jul 07 16:24:37.777992 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:24:37.777928    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 07 16:24:37.778220 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:24:37.778060    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-mkjk8\""
Jul 07 16:24:37.778220 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:24:37.778064    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 07 16:24:37.778220 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:24:37.778133    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 07 16:24:37.778220 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:24:37.778176    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 07 16:24:37.793541 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:24:37.793507    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-795fdcb45d-gqhxj"]
Jul 07 16:24:37.810657 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:24:37.810619    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/55e38965-9a61-4b20-9fbd-f163edf78884-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-795fdcb45d-gqhxj\" (UID: \"55e38965-9a61-4b20-9fbd-f163edf78884\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-795fdcb45d-gqhxj"
Jul 07 16:24:37.810657 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:24:37.810657    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtfxv\" (UniqueName: \"kubernetes.io/projected/55e38965-9a61-4b20-9fbd-f163edf78884-kube-api-access-rtfxv\") pod \"managed-serviceaccount-addon-agent-795fdcb45d-gqhxj\" (UID: \"55e38965-9a61-4b20-9fbd-f163edf78884\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-795fdcb45d-gqhxj"
Jul 07 16:24:37.910901 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:24:37.910859    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/55e38965-9a61-4b20-9fbd-f163edf78884-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-795fdcb45d-gqhxj\" (UID: \"55e38965-9a61-4b20-9fbd-f163edf78884\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-795fdcb45d-gqhxj"
Jul 07 16:24:37.910901 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:24:37.910901    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtfxv\" (UniqueName: \"kubernetes.io/projected/55e38965-9a61-4b20-9fbd-f163edf78884-kube-api-access-rtfxv\") pod \"managed-serviceaccount-addon-agent-795fdcb45d-gqhxj\" (UID: \"55e38965-9a61-4b20-9fbd-f163edf78884\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-795fdcb45d-gqhxj"
Jul 07 16:24:37.913592 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:24:37.913558    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/55e38965-9a61-4b20-9fbd-f163edf78884-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-795fdcb45d-gqhxj\" (UID: \"55e38965-9a61-4b20-9fbd-f163edf78884\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-795fdcb45d-gqhxj"
Jul 07 16:24:37.920534 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:24:37.920508    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtfxv\" (UniqueName: \"kubernetes.io/projected/55e38965-9a61-4b20-9fbd-f163edf78884-kube-api-access-rtfxv\") pod \"managed-serviceaccount-addon-agent-795fdcb45d-gqhxj\" (UID: \"55e38965-9a61-4b20-9fbd-f163edf78884\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-795fdcb45d-gqhxj"
Jul 07 16:24:38.099844 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:24:38.099808    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-795fdcb45d-gqhxj"
Jul 07 16:24:38.239667 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:24:38.239618    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-795fdcb45d-gqhxj"]
Jul 07 16:24:38.244035 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:24:38.244005    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod55e38965_9a61_4b20_9fbd_f163edf78884.slice/crio-a62b7a165657a64aab92c1fdc7fd8c1922cd73ae0fe66885aa01bc72314e7f44 WatchSource:0}: Error finding container a62b7a165657a64aab92c1fdc7fd8c1922cd73ae0fe66885aa01bc72314e7f44: Status 404 returned error can't find the container with id a62b7a165657a64aab92c1fdc7fd8c1922cd73ae0fe66885aa01bc72314e7f44
Jul 07 16:24:38.833080 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:24:38.833031    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-795fdcb45d-gqhxj" event={"ID":"55e38965-9a61-4b20-9fbd-f163edf78884","Type":"ContainerStarted","Data":"a62b7a165657a64aab92c1fdc7fd8c1922cd73ae0fe66885aa01bc72314e7f44"}
Jul 07 16:24:40.839402 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:24:40.839367    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-795fdcb45d-gqhxj" event={"ID":"55e38965-9a61-4b20-9fbd-f163edf78884","Type":"ContainerStarted","Data":"2d2d1ff884dc587da4dacd59cdcb5461e41282926e9bd0e35b744072fe4d620a"}
Jul 07 16:24:40.875687 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:24:40.875628    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-795fdcb45d-gqhxj" podStartSLOduration=1.7599382559999999 podStartE2EDuration="3.875610899s" totalImagesPullingTime="2.115672643s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:24:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:24:40.875418906 +0000 UTC m=+82.962387365" watchObservedRunningTime="2026-07-07 16:24:40.875610899 +0000 UTC m=+82.962579356"
Jul 07 16:24:58.056590 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:24:58.056534    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97c7d1d5-ed8a-4785-b56e-e76a83166958-metrics-tls\") pod \"dns-default-m7n9j\" (UID: \"97c7d1d5-ed8a-4785-b56e-e76a83166958\") " pod="openshift-dns/dns-default-m7n9j"
Jul 07 16:24:58.056993 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:24:58.056664    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 16:24:58.056993 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:24:58.056720    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97c7d1d5-ed8a-4785-b56e-e76a83166958-metrics-tls podName:97c7d1d5-ed8a-4785-b56e-e76a83166958 nodeName:}" failed. No retries permitted until 2026-07-07 16:26:02.056707252 +0000 UTC m=+164.143675688 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/97c7d1d5-ed8a-4785-b56e-e76a83166958-metrics-tls") pod "dns-default-m7n9j" (UID: "97c7d1d5-ed8a-4785-b56e-e76a83166958") : secret "dns-default-metrics-tls" not found
Jul 07 16:25:00.815466 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:25:00.815426    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-9489w"
Jul 07 16:25:28.166522 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:25:28.166467    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5e94c63-e554-402d-9215-06cd6525019a-metrics-certs\") pod \"network-metrics-daemon-9sc2w\" (UID: \"a5e94c63-e554-402d-9215-06cd6525019a\") " pod="openshift-multus/network-metrics-daemon-9sc2w"
Jul 07 16:25:28.167020 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:25:28.166609    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 07 16:25:28.167020 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:25:28.166681    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5e94c63-e554-402d-9215-06cd6525019a-metrics-certs podName:a5e94c63-e554-402d-9215-06cd6525019a nodeName:}" failed. No retries permitted until 2026-07-07 16:27:30.166663932 +0000 UTC m=+252.253632372 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a5e94c63-e554-402d-9215-06cd6525019a-metrics-certs") pod "network-metrics-daemon-9sc2w" (UID: "a5e94c63-e554-402d-9215-06cd6525019a") : secret "metrics-daemon-secret" not found
Jul 07 16:25:57.205647 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:25:57.205588    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-m7n9j" podUID="97c7d1d5-ed8a-4785-b56e-e76a83166958"
Jul 07 16:25:58.024572 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:25:58.024542    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-m7n9j"
Jul 07 16:25:58.522777 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:25:58.522732    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-9sc2w" podUID="a5e94c63-e554-402d-9215-06cd6525019a"
Jul 07 16:26:02.105233 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:26:02.105189    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97c7d1d5-ed8a-4785-b56e-e76a83166958-metrics-tls\") pod \"dns-default-m7n9j\" (UID: \"97c7d1d5-ed8a-4785-b56e-e76a83166958\") " pod="openshift-dns/dns-default-m7n9j"
Jul 07 16:26:02.105638 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:26:02.105297    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 16:26:02.105638 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:26:02.105369    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97c7d1d5-ed8a-4785-b56e-e76a83166958-metrics-tls podName:97c7d1d5-ed8a-4785-b56e-e76a83166958 nodeName:}" failed. No retries permitted until 2026-07-07 16:28:04.105335627 +0000 UTC m=+286.192304067 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/97c7d1d5-ed8a-4785-b56e-e76a83166958-metrics-tls") pod "dns-default-m7n9j" (UID: "97c7d1d5-ed8a-4785-b56e-e76a83166958") : secret "dns-default-metrics-tls" not found
Jul 07 16:26:13.508832 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:26:13.508731    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9sc2w"
Jul 07 16:26:41.134718 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:26:41.134681    2578 generic.go:356] "Generic (PLEG): container finished" podID="55e38965-9a61-4b20-9fbd-f163edf78884" containerID="2d2d1ff884dc587da4dacd59cdcb5461e41282926e9bd0e35b744072fe4d620a" exitCode=255
Jul 07 16:26:41.135167 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:26:41.134744    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-795fdcb45d-gqhxj" event={"ID":"55e38965-9a61-4b20-9fbd-f163edf78884","Type":"ContainerDied","Data":"2d2d1ff884dc587da4dacd59cdcb5461e41282926e9bd0e35b744072fe4d620a"}
Jul 07 16:26:41.140379 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:26:41.140338    2578 scope.go:117] "RemoveContainer" containerID="2d2d1ff884dc587da4dacd59cdcb5461e41282926e9bd0e35b744072fe4d620a"
Jul 07 16:26:42.138905 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:26:42.138868    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-795fdcb45d-gqhxj" event={"ID":"55e38965-9a61-4b20-9fbd-f163edf78884","Type":"ContainerStarted","Data":"823a65847cdfc2edefd2cea20705af1f4aa5789c8f6847251aa09ca941e8f1c5"}
Jul 07 16:27:30.207803 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:30.207760    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5e94c63-e554-402d-9215-06cd6525019a-metrics-certs\") pod \"network-metrics-daemon-9sc2w\" (UID: \"a5e94c63-e554-402d-9215-06cd6525019a\") " pod="openshift-multus/network-metrics-daemon-9sc2w"
Jul 07 16:27:30.208303 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:27:30.207894    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 07 16:27:30.208303 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:27:30.207948    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5e94c63-e554-402d-9215-06cd6525019a-metrics-certs podName:a5e94c63-e554-402d-9215-06cd6525019a nodeName:}" failed. No retries permitted until 2026-07-07 16:29:32.2079343 +0000 UTC m=+374.294902736 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a5e94c63-e554-402d-9215-06cd6525019a-metrics-certs") pod "network-metrics-daemon-9sc2w" (UID: "a5e94c63-e554-402d-9215-06cd6525019a") : secret "metrics-daemon-secret" not found
Jul 07 16:27:42.571768 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.571684    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-76b5464cf7-q8skn"]
Jul 07 16:27:42.574803 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.574782    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-76b5464cf7-q8skn"
Jul 07 16:27:42.579043 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.579021    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 07 16:27:42.579198 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.579128    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 07 16:27:42.579870 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.579844    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 07 16:27:42.580005 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.579876    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 07 16:27:42.581769 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.581751    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 07 16:27:42.583854 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.583834    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 07 16:27:42.587729 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.587708    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-b2kxs\""
Jul 07 16:27:42.600752 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.600725    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-76b5464cf7-q8skn"]
Jul 07 16:27:42.657070 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.657042    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-khhhg"]
Jul 07 16:27:42.659881 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.659861    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-khhhg"
Jul 07 16:27:42.662522 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.662494    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 07 16:27:42.662698 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.662527    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 07 16:27:42.662769 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.662694    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 07 16:27:42.662769 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.662729    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-p5sjq\""
Jul 07 16:27:42.662887 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.662858    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 07 16:27:42.671213 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.671185    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xr746"]
Jul 07 16:27:42.673993 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.673972    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-d9d6b4cbf-xmnvf"]
Jul 07 16:27:42.674108 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.674092    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xr746"
Jul 07 16:27:42.676862 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.676837    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d9d6b4cbf-xmnvf"
Jul 07 16:27:42.678527 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.678500    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-khhhg"]
Jul 07 16:27:42.678527 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.678523    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 07 16:27:42.678844 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.678822    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 07 16:27:42.679943 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.679924    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 07 16:27:42.682599 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.682370    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 07 16:27:42.682599 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.682456    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 07 16:27:42.682599 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.682479    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-47hf8\""
Jul 07 16:27:42.682818 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.682731    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-dhsq7\""
Jul 07 16:27:42.683050 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.683022    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 07 16:27:42.683644 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.683625    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 07 16:27:42.688434 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.688411    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 07 16:27:42.694294 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.694268    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83acc011-1498-4b7f-ba25-6aba7588b38e-metrics-certs\") pod \"router-default-76b5464cf7-q8skn\" (UID: \"83acc011-1498-4b7f-ba25-6aba7588b38e\") " pod="openshift-ingress/router-default-76b5464cf7-q8skn"
Jul 07 16:27:42.694486 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.694361    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83acc011-1498-4b7f-ba25-6aba7588b38e-service-ca-bundle\") pod \"router-default-76b5464cf7-q8skn\" (UID: \"83acc011-1498-4b7f-ba25-6aba7588b38e\") " pod="openshift-ingress/router-default-76b5464cf7-q8skn"
Jul 07 16:27:42.694550 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.694533    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/83acc011-1498-4b7f-ba25-6aba7588b38e-default-certificate\") pod \"router-default-76b5464cf7-q8skn\" (UID: \"83acc011-1498-4b7f-ba25-6aba7588b38e\") " pod="openshift-ingress/router-default-76b5464cf7-q8skn"
Jul 07 16:27:42.694923 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.694646    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/83acc011-1498-4b7f-ba25-6aba7588b38e-stats-auth\") pod \"router-default-76b5464cf7-q8skn\" (UID: \"83acc011-1498-4b7f-ba25-6aba7588b38e\") " pod="openshift-ingress/router-default-76b5464cf7-q8skn"
Jul 07 16:27:42.694923 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.694712    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snwrm\" (UniqueName: \"kubernetes.io/projected/83acc011-1498-4b7f-ba25-6aba7588b38e-kube-api-access-snwrm\") pod \"router-default-76b5464cf7-q8skn\" (UID: \"83acc011-1498-4b7f-ba25-6aba7588b38e\") " pod="openshift-ingress/router-default-76b5464cf7-q8skn"
Jul 07 16:27:42.695530 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.695507    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xr746"]
Jul 07 16:27:42.696672 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.696650    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-d9d6b4cbf-xmnvf"]
Jul 07 16:27:42.795715 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.795679    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qkcb\" (UniqueName: \"kubernetes.io/projected/740adb53-e810-41c9-856a-0954705c32c0-kube-api-access-5qkcb\") pod \"cluster-monitoring-operator-64786d9cbb-xr746\" (UID: \"740adb53-e810-41c9-856a-0954705c32c0\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xr746"
Jul 07 16:27:42.795715 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.795721    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/34272f85-199c-456f-a0ff-f7fad01b6d33-registry-tls\") pod \"image-registry-d9d6b4cbf-xmnvf\" (UID: \"34272f85-199c-456f-a0ff-f7fad01b6d33\") " pod="openshift-image-registry/image-registry-d9d6b4cbf-xmnvf"
Jul 07 16:27:42.795991 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.795743    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvbqx\" (UniqueName: \"kubernetes.io/projected/c010fafb-ad1d-4c66-a040-4618b49c012c-kube-api-access-jvbqx\") pod \"service-ca-operator-5d46d9ffd4-khhhg\" (UID: \"c010fafb-ad1d-4c66-a040-4618b49c012c\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-khhhg"
Jul 07 16:27:42.795991 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.795785    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/83acc011-1498-4b7f-ba25-6aba7588b38e-default-certificate\") pod \"router-default-76b5464cf7-q8skn\" (UID: \"83acc011-1498-4b7f-ba25-6aba7588b38e\") " pod="openshift-ingress/router-default-76b5464cf7-q8skn"
Jul 07 16:27:42.795991 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.795802    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c010fafb-ad1d-4c66-a040-4618b49c012c-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-khhhg\" (UID: \"c010fafb-ad1d-4c66-a040-4618b49c012c\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-khhhg"
Jul 07 16:27:42.795991 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.795817    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c010fafb-ad1d-4c66-a040-4618b49c012c-config\") pod \"service-ca-operator-5d46d9ffd4-khhhg\" (UID: \"c010fafb-ad1d-4c66-a040-4618b49c012c\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-khhhg"
Jul 07 16:27:42.795991 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.795837    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/740adb53-e810-41c9-856a-0954705c32c0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-xr746\" (UID: \"740adb53-e810-41c9-856a-0954705c32c0\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xr746"
Jul 07 16:27:42.795991 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.795854    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/34272f85-199c-456f-a0ff-f7fad01b6d33-ca-trust-extracted\") pod \"image-registry-d9d6b4cbf-xmnvf\" (UID: \"34272f85-199c-456f-a0ff-f7fad01b6d33\") " pod="openshift-image-registry/image-registry-d9d6b4cbf-xmnvf"
Jul 07 16:27:42.795991 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.795933    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/34272f85-199c-456f-a0ff-f7fad01b6d33-image-registry-private-configuration\") pod \"image-registry-d9d6b4cbf-xmnvf\" (UID: \"34272f85-199c-456f-a0ff-f7fad01b6d33\") " pod="openshift-image-registry/image-registry-d9d6b4cbf-xmnvf"
Jul 07 16:27:42.796312 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.796010    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83acc011-1498-4b7f-ba25-6aba7588b38e-service-ca-bundle\") pod \"router-default-76b5464cf7-q8skn\" (UID: \"83acc011-1498-4b7f-ba25-6aba7588b38e\") " pod="openshift-ingress/router-default-76b5464cf7-q8skn"
Jul 07 16:27:42.796312 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.796051    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/34272f85-199c-456f-a0ff-f7fad01b6d33-registry-certificates\") pod \"image-registry-d9d6b4cbf-xmnvf\" (UID: \"34272f85-199c-456f-a0ff-f7fad01b6d33\") " pod="openshift-image-registry/image-registry-d9d6b4cbf-xmnvf"
Jul 07 16:27:42.796312 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.796078    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/34272f85-199c-456f-a0ff-f7fad01b6d33-trusted-ca\") pod \"image-registry-d9d6b4cbf-xmnvf\" (UID: \"34272f85-199c-456f-a0ff-f7fad01b6d33\") " pod="openshift-image-registry/image-registry-d9d6b4cbf-xmnvf"
Jul 07 16:27:42.796312 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.796110    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/34272f85-199c-456f-a0ff-f7fad01b6d33-bound-sa-token\") pod \"image-registry-d9d6b4cbf-xmnvf\" (UID: \"34272f85-199c-456f-a0ff-f7fad01b6d33\") " pod="openshift-image-registry/image-registry-d9d6b4cbf-xmnvf"
Jul 07 16:27:42.796312 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.796131    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/83acc011-1498-4b7f-ba25-6aba7588b38e-stats-auth\") pod \"router-default-76b5464cf7-q8skn\" (UID: \"83acc011-1498-4b7f-ba25-6aba7588b38e\") " pod="openshift-ingress/router-default-76b5464cf7-q8skn"
Jul 07 16:27:42.796312 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:27:42.796161    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/83acc011-1498-4b7f-ba25-6aba7588b38e-service-ca-bundle podName:83acc011-1498-4b7f-ba25-6aba7588b38e nodeName:}" failed. No retries permitted until 2026-07-07 16:27:43.296145254 +0000 UTC m=+265.383113695 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/83acc011-1498-4b7f-ba25-6aba7588b38e-service-ca-bundle") pod "router-default-76b5464cf7-q8skn" (UID: "83acc011-1498-4b7f-ba25-6aba7588b38e") : configmap references non-existent config key: service-ca.crt
Jul 07 16:27:42.796312 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.796182    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snwrm\" (UniqueName: \"kubernetes.io/projected/83acc011-1498-4b7f-ba25-6aba7588b38e-kube-api-access-snwrm\") pod \"router-default-76b5464cf7-q8skn\" (UID: \"83acc011-1498-4b7f-ba25-6aba7588b38e\") " pod="openshift-ingress/router-default-76b5464cf7-q8skn"
Jul 07 16:27:42.796312 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.796296    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/740adb53-e810-41c9-856a-0954705c32c0-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-xr746\" (UID: \"740adb53-e810-41c9-856a-0954705c32c0\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xr746"
Jul 07 16:27:42.796641 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.796327    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83acc011-1498-4b7f-ba25-6aba7588b38e-metrics-certs\") pod \"router-default-76b5464cf7-q8skn\" (UID: \"83acc011-1498-4b7f-ba25-6aba7588b38e\") " pod="openshift-ingress/router-default-76b5464cf7-q8skn"
Jul 07 16:27:42.796641 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.796381    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwvxj\" (UniqueName: \"kubernetes.io/projected/34272f85-199c-456f-a0ff-f7fad01b6d33-kube-api-access-nwvxj\") pod \"image-registry-d9d6b4cbf-xmnvf\" (UID: \"34272f85-199c-456f-a0ff-f7fad01b6d33\") " pod="openshift-image-registry/image-registry-d9d6b4cbf-xmnvf"
Jul 07 16:27:42.796641 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:27:42.796478    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 16:27:42.796641 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.796490    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/34272f85-199c-456f-a0ff-f7fad01b6d33-installation-pull-secrets\") pod \"image-registry-d9d6b4cbf-xmnvf\" (UID: \"34272f85-199c-456f-a0ff-f7fad01b6d33\") " pod="openshift-image-registry/image-registry-d9d6b4cbf-xmnvf"
Jul 07 16:27:42.796641 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:27:42.796535    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83acc011-1498-4b7f-ba25-6aba7588b38e-metrics-certs podName:83acc011-1498-4b7f-ba25-6aba7588b38e nodeName:}" failed. No retries permitted until 2026-07-07 16:27:43.296519062 +0000 UTC m=+265.383487498 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/83acc011-1498-4b7f-ba25-6aba7588b38e-metrics-certs") pod "router-default-76b5464cf7-q8skn" (UID: "83acc011-1498-4b7f-ba25-6aba7588b38e") : secret "router-metrics-certs-default" not found
Jul 07 16:27:42.798506 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.798479    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/83acc011-1498-4b7f-ba25-6aba7588b38e-stats-auth\") pod \"router-default-76b5464cf7-q8skn\" (UID: \"83acc011-1498-4b7f-ba25-6aba7588b38e\") " pod="openshift-ingress/router-default-76b5464cf7-q8skn"
Jul 07 16:27:42.798611 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.798533    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/83acc011-1498-4b7f-ba25-6aba7588b38e-default-certificate\") pod \"router-default-76b5464cf7-q8skn\" (UID: \"83acc011-1498-4b7f-ba25-6aba7588b38e\") " pod="openshift-ingress/router-default-76b5464cf7-q8skn"
Jul 07 16:27:42.807875 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.807847    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-snwrm\" (UniqueName: \"kubernetes.io/projected/83acc011-1498-4b7f-ba25-6aba7588b38e-kube-api-access-snwrm\") pod \"router-default-76b5464cf7-q8skn\" (UID: \"83acc011-1498-4b7f-ba25-6aba7588b38e\") " pod="openshift-ingress/router-default-76b5464cf7-q8skn"
Jul 07 16:27:42.897737 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.897703    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/740adb53-e810-41c9-856a-0954705c32c0-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-xr746\" (UID: \"740adb53-e810-41c9-856a-0954705c32c0\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xr746"
Jul 07 16:27:42.897929 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.897752    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwvxj\" (UniqueName: \"kubernetes.io/projected/34272f85-199c-456f-a0ff-f7fad01b6d33-kube-api-access-nwvxj\") pod \"image-registry-d9d6b4cbf-xmnvf\" (UID: \"34272f85-199c-456f-a0ff-f7fad01b6d33\") " pod="openshift-image-registry/image-registry-d9d6b4cbf-xmnvf"
Jul 07 16:27:42.897929 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.897769    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/34272f85-199c-456f-a0ff-f7fad01b6d33-installation-pull-secrets\") pod \"image-registry-d9d6b4cbf-xmnvf\" (UID: \"34272f85-199c-456f-a0ff-f7fad01b6d33\") " pod="openshift-image-registry/image-registry-d9d6b4cbf-xmnvf"
Jul 07 16:27:42.897929 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.897836    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qkcb\" (UniqueName: \"kubernetes.io/projected/740adb53-e810-41c9-856a-0954705c32c0-kube-api-access-5qkcb\") pod \"cluster-monitoring-operator-64786d9cbb-xr746\" (UID: \"740adb53-e810-41c9-856a-0954705c32c0\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xr746"
Jul 07 16:27:42.897929 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.897883    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/34272f85-199c-456f-a0ff-f7fad01b6d33-registry-tls\") pod \"image-registry-d9d6b4cbf-xmnvf\" (UID: \"34272f85-199c-456f-a0ff-f7fad01b6d33\") " pod="openshift-image-registry/image-registry-d9d6b4cbf-xmnvf"
Jul 07 16:27:42.897929 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.897906    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvbqx\" (UniqueName: \"kubernetes.io/projected/c010fafb-ad1d-4c66-a040-4618b49c012c-kube-api-access-jvbqx\") pod \"service-ca-operator-5d46d9ffd4-khhhg\" (UID: \"c010fafb-ad1d-4c66-a040-4618b49c012c\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-khhhg"
Jul 07 16:27:42.898188 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.897948    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c010fafb-ad1d-4c66-a040-4618b49c012c-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-khhhg\" (UID: \"c010fafb-ad1d-4c66-a040-4618b49c012c\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-khhhg"
Jul 07 16:27:42.898188 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.897970    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c010fafb-ad1d-4c66-a040-4618b49c012c-config\") pod \"service-ca-operator-5d46d9ffd4-khhhg\" (UID: \"c010fafb-ad1d-4c66-a040-4618b49c012c\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-khhhg"
Jul 07 16:27:42.898188 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:27:42.898040    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 16:27:42.898188 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:27:42.898061    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d9d6b4cbf-xmnvf: secret "image-registry-tls" not found
Jul 07 16:27:42.898188 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.898106    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/740adb53-e810-41c9-856a-0954705c32c0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-xr746\" (UID: \"740adb53-e810-41c9-856a-0954705c32c0\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xr746"
Jul 07 16:27:42.898188 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:27:42.898117    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34272f85-199c-456f-a0ff-f7fad01b6d33-registry-tls podName:34272f85-199c-456f-a0ff-f7fad01b6d33 nodeName:}" failed. No retries permitted until 2026-07-07 16:27:43.398097271 +0000 UTC m=+265.485065713 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/34272f85-199c-456f-a0ff-f7fad01b6d33-registry-tls") pod "image-registry-d9d6b4cbf-xmnvf" (UID: "34272f85-199c-456f-a0ff-f7fad01b6d33") : secret "image-registry-tls" not found
Jul 07 16:27:42.898188 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.898147    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/34272f85-199c-456f-a0ff-f7fad01b6d33-ca-trust-extracted\") pod \"image-registry-d9d6b4cbf-xmnvf\" (UID: \"34272f85-199c-456f-a0ff-f7fad01b6d33\") " pod="openshift-image-registry/image-registry-d9d6b4cbf-xmnvf"
Jul 07 16:27:42.898188 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.898192    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/34272f85-199c-456f-a0ff-f7fad01b6d33-image-registry-private-configuration\") pod \"image-registry-d9d6b4cbf-xmnvf\" (UID: \"34272f85-199c-456f-a0ff-f7fad01b6d33\") " pod="openshift-image-registry/image-registry-d9d6b4cbf-xmnvf"
Jul 07 16:27:42.898635 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.898250    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/34272f85-199c-456f-a0ff-f7fad01b6d33-registry-certificates\") pod \"image-registry-d9d6b4cbf-xmnvf\" (UID: \"34272f85-199c-456f-a0ff-f7fad01b6d33\") " pod="openshift-image-registry/image-registry-d9d6b4cbf-xmnvf"
Jul 07 16:27:42.898635 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.898277    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/34272f85-199c-456f-a0ff-f7fad01b6d33-trusted-ca\") pod \"image-registry-d9d6b4cbf-xmnvf\" (UID: \"34272f85-199c-456f-a0ff-f7fad01b6d33\") " pod="openshift-image-registry/image-registry-d9d6b4cbf-xmnvf"
Jul 07 16:27:42.898635 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.898314    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/34272f85-199c-456f-a0ff-f7fad01b6d33-bound-sa-token\") pod \"image-registry-d9d6b4cbf-xmnvf\" (UID: \"34272f85-199c-456f-a0ff-f7fad01b6d33\") " pod="openshift-image-registry/image-registry-d9d6b4cbf-xmnvf"
Jul 07 16:27:42.898635 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:27:42.898251    2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 07 16:27:42.898635 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.898618    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c010fafb-ad1d-4c66-a040-4618b49c012c-config\") pod \"service-ca-operator-5d46d9ffd4-khhhg\" (UID: \"c010fafb-ad1d-4c66-a040-4618b49c012c\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-khhhg"
Jul 07 16:27:42.898635 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.898625    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/34272f85-199c-456f-a0ff-f7fad01b6d33-ca-trust-extracted\") pod \"image-registry-d9d6b4cbf-xmnvf\" (UID: \"34272f85-199c-456f-a0ff-f7fad01b6d33\") " pod="openshift-image-registry/image-registry-d9d6b4cbf-xmnvf"
Jul 07 16:27:42.898937 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:27:42.898643    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/740adb53-e810-41c9-856a-0954705c32c0-cluster-monitoring-operator-tls podName:740adb53-e810-41c9-856a-0954705c32c0 nodeName:}" failed. No retries permitted until 2026-07-07 16:27:43.398625382 +0000 UTC m=+265.485593821 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/740adb53-e810-41c9-856a-0954705c32c0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-xr746" (UID: "740adb53-e810-41c9-856a-0954705c32c0") : secret "cluster-monitoring-operator-tls" not found
Jul 07 16:27:42.898937 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.898704    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/740adb53-e810-41c9-856a-0954705c32c0-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-xr746\" (UID: \"740adb53-e810-41c9-856a-0954705c32c0\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xr746"
Jul 07 16:27:42.899492 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.899468    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/34272f85-199c-456f-a0ff-f7fad01b6d33-trusted-ca\") pod \"image-registry-d9d6b4cbf-xmnvf\" (UID: \"34272f85-199c-456f-a0ff-f7fad01b6d33\") " pod="openshift-image-registry/image-registry-d9d6b4cbf-xmnvf"
Jul 07 16:27:42.899643 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.899531    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/34272f85-199c-456f-a0ff-f7fad01b6d33-registry-certificates\") pod \"image-registry-d9d6b4cbf-xmnvf\" (UID: \"34272f85-199c-456f-a0ff-f7fad01b6d33\") " pod="openshift-image-registry/image-registry-d9d6b4cbf-xmnvf"
Jul 07 16:27:42.900497 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.900469    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/34272f85-199c-456f-a0ff-f7fad01b6d33-installation-pull-secrets\") pod \"image-registry-d9d6b4cbf-xmnvf\" (UID: \"34272f85-199c-456f-a0ff-f7fad01b6d33\") " pod="openshift-image-registry/image-registry-d9d6b4cbf-xmnvf"
Jul 07 16:27:42.900742 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.900720    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c010fafb-ad1d-4c66-a040-4618b49c012c-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-khhhg\" (UID: \"c010fafb-ad1d-4c66-a040-4618b49c012c\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-khhhg"
Jul 07 16:27:42.901094 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.901078    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/34272f85-199c-456f-a0ff-f7fad01b6d33-image-registry-private-configuration\") pod \"image-registry-d9d6b4cbf-xmnvf\" (UID: \"34272f85-199c-456f-a0ff-f7fad01b6d33\") " pod="openshift-image-registry/image-registry-d9d6b4cbf-xmnvf"
Jul 07 16:27:42.913743 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.913711    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/34272f85-199c-456f-a0ff-f7fad01b6d33-bound-sa-token\") pod \"image-registry-d9d6b4cbf-xmnvf\" (UID: \"34272f85-199c-456f-a0ff-f7fad01b6d33\") " pod="openshift-image-registry/image-registry-d9d6b4cbf-xmnvf"
Jul 07 16:27:42.916226 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.916196    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qkcb\" (UniqueName: \"kubernetes.io/projected/740adb53-e810-41c9-856a-0954705c32c0-kube-api-access-5qkcb\") pod \"cluster-monitoring-operator-64786d9cbb-xr746\" (UID: \"740adb53-e810-41c9-856a-0954705c32c0\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xr746"
Jul 07 16:27:42.916371 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.916229    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwvxj\" (UniqueName: \"kubernetes.io/projected/34272f85-199c-456f-a0ff-f7fad01b6d33-kube-api-access-nwvxj\") pod \"image-registry-d9d6b4cbf-xmnvf\" (UID: \"34272f85-199c-456f-a0ff-f7fad01b6d33\") " pod="openshift-image-registry/image-registry-d9d6b4cbf-xmnvf"
Jul 07 16:27:42.920396 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.920372    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvbqx\" (UniqueName: \"kubernetes.io/projected/c010fafb-ad1d-4c66-a040-4618b49c012c-kube-api-access-jvbqx\") pod \"service-ca-operator-5d46d9ffd4-khhhg\" (UID: \"c010fafb-ad1d-4c66-a040-4618b49c012c\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-khhhg"
Jul 07 16:27:42.969382 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:42.969326    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-khhhg"
Jul 07 16:27:43.102692 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:43.102656    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-khhhg"]
Jul 07 16:27:43.105799 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:27:43.105767    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc010fafb_ad1d_4c66_a040_4618b49c012c.slice/crio-00f0a91e2fc5dc30bd33f4cd186a1a775bde6de79b76537a8da3008cfbb7251c WatchSource:0}: Error finding container 00f0a91e2fc5dc30bd33f4cd186a1a775bde6de79b76537a8da3008cfbb7251c: Status 404 returned error can't find the container with id 00f0a91e2fc5dc30bd33f4cd186a1a775bde6de79b76537a8da3008cfbb7251c
Jul 07 16:27:43.291804 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:43.291707    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-khhhg" event={"ID":"c010fafb-ad1d-4c66-a040-4618b49c012c","Type":"ContainerStarted","Data":"00f0a91e2fc5dc30bd33f4cd186a1a775bde6de79b76537a8da3008cfbb7251c"}
Jul 07 16:27:43.302143 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:43.302107    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83acc011-1498-4b7f-ba25-6aba7588b38e-service-ca-bundle\") pod \"router-default-76b5464cf7-q8skn\" (UID: \"83acc011-1498-4b7f-ba25-6aba7588b38e\") " pod="openshift-ingress/router-default-76b5464cf7-q8skn"
Jul 07 16:27:43.302285 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:43.302177    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83acc011-1498-4b7f-ba25-6aba7588b38e-metrics-certs\") pod \"router-default-76b5464cf7-q8skn\" (UID: \"83acc011-1498-4b7f-ba25-6aba7588b38e\") " pod="openshift-ingress/router-default-76b5464cf7-q8skn"
Jul 07 16:27:43.302285 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:27:43.302272    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/83acc011-1498-4b7f-ba25-6aba7588b38e-service-ca-bundle podName:83acc011-1498-4b7f-ba25-6aba7588b38e nodeName:}" failed. No retries permitted until 2026-07-07 16:27:44.302255392 +0000 UTC m=+266.389223831 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/83acc011-1498-4b7f-ba25-6aba7588b38e-service-ca-bundle") pod "router-default-76b5464cf7-q8skn" (UID: "83acc011-1498-4b7f-ba25-6aba7588b38e") : configmap references non-existent config key: service-ca.crt
Jul 07 16:27:43.302431 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:27:43.302314    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 16:27:43.302431 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:27:43.302400    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83acc011-1498-4b7f-ba25-6aba7588b38e-metrics-certs podName:83acc011-1498-4b7f-ba25-6aba7588b38e nodeName:}" failed. No retries permitted until 2026-07-07 16:27:44.302382417 +0000 UTC m=+266.389350873 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/83acc011-1498-4b7f-ba25-6aba7588b38e-metrics-certs") pod "router-default-76b5464cf7-q8skn" (UID: "83acc011-1498-4b7f-ba25-6aba7588b38e") : secret "router-metrics-certs-default" not found
Jul 07 16:27:43.403261 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:43.403219    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/34272f85-199c-456f-a0ff-f7fad01b6d33-registry-tls\") pod \"image-registry-d9d6b4cbf-xmnvf\" (UID: \"34272f85-199c-456f-a0ff-f7fad01b6d33\") " pod="openshift-image-registry/image-registry-d9d6b4cbf-xmnvf"
Jul 07 16:27:43.403463 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:43.403274    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/740adb53-e810-41c9-856a-0954705c32c0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-xr746\" (UID: \"740adb53-e810-41c9-856a-0954705c32c0\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xr746"
Jul 07 16:27:43.403463 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:27:43.403398    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 16:27:43.403463 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:27:43.403419    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d9d6b4cbf-xmnvf: secret "image-registry-tls" not found
Jul 07 16:27:43.403463 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:27:43.403419    2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 07 16:27:43.403665 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:27:43.403471    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/740adb53-e810-41c9-856a-0954705c32c0-cluster-monitoring-operator-tls podName:740adb53-e810-41c9-856a-0954705c32c0 nodeName:}" failed. No retries permitted until 2026-07-07 16:27:44.403456906 +0000 UTC m=+266.490425345 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/740adb53-e810-41c9-856a-0954705c32c0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-xr746" (UID: "740adb53-e810-41c9-856a-0954705c32c0") : secret "cluster-monitoring-operator-tls" not found
Jul 07 16:27:43.403665 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:27:43.403484    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34272f85-199c-456f-a0ff-f7fad01b6d33-registry-tls podName:34272f85-199c-456f-a0ff-f7fad01b6d33 nodeName:}" failed. No retries permitted until 2026-07-07 16:27:44.403478947 +0000 UTC m=+266.490447383 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/34272f85-199c-456f-a0ff-f7fad01b6d33-registry-tls") pod "image-registry-d9d6b4cbf-xmnvf" (UID: "34272f85-199c-456f-a0ff-f7fad01b6d33") : secret "image-registry-tls" not found
Jul 07 16:27:44.310638 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:44.310605    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83acc011-1498-4b7f-ba25-6aba7588b38e-metrics-certs\") pod \"router-default-76b5464cf7-q8skn\" (UID: \"83acc011-1498-4b7f-ba25-6aba7588b38e\") " pod="openshift-ingress/router-default-76b5464cf7-q8skn"
Jul 07 16:27:44.311046 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:44.310688    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83acc011-1498-4b7f-ba25-6aba7588b38e-service-ca-bundle\") pod \"router-default-76b5464cf7-q8skn\" (UID: \"83acc011-1498-4b7f-ba25-6aba7588b38e\") " pod="openshift-ingress/router-default-76b5464cf7-q8skn"
Jul 07 16:27:44.311046 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:27:44.310759    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 16:27:44.311046 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:27:44.310802    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/83acc011-1498-4b7f-ba25-6aba7588b38e-service-ca-bundle podName:83acc011-1498-4b7f-ba25-6aba7588b38e nodeName:}" failed. No retries permitted until 2026-07-07 16:27:46.310788438 +0000 UTC m=+268.397756874 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/83acc011-1498-4b7f-ba25-6aba7588b38e-service-ca-bundle") pod "router-default-76b5464cf7-q8skn" (UID: "83acc011-1498-4b7f-ba25-6aba7588b38e") : configmap references non-existent config key: service-ca.crt
Jul 07 16:27:44.311046 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:27:44.310817    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83acc011-1498-4b7f-ba25-6aba7588b38e-metrics-certs podName:83acc011-1498-4b7f-ba25-6aba7588b38e nodeName:}" failed. No retries permitted until 2026-07-07 16:27:46.310811559 +0000 UTC m=+268.397779994 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/83acc011-1498-4b7f-ba25-6aba7588b38e-metrics-certs") pod "router-default-76b5464cf7-q8skn" (UID: "83acc011-1498-4b7f-ba25-6aba7588b38e") : secret "router-metrics-certs-default" not found
Jul 07 16:27:44.411572 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:44.411515    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/34272f85-199c-456f-a0ff-f7fad01b6d33-registry-tls\") pod \"image-registry-d9d6b4cbf-xmnvf\" (UID: \"34272f85-199c-456f-a0ff-f7fad01b6d33\") " pod="openshift-image-registry/image-registry-d9d6b4cbf-xmnvf"
Jul 07 16:27:44.411797 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:44.411589    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/740adb53-e810-41c9-856a-0954705c32c0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-xr746\" (UID: \"740adb53-e810-41c9-856a-0954705c32c0\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xr746"
Jul 07 16:27:44.411797 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:27:44.411672    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 16:27:44.411797 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:27:44.411694    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d9d6b4cbf-xmnvf: secret "image-registry-tls" not found
Jul 07 16:27:44.411797 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:27:44.411694    2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 07 16:27:44.411797 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:27:44.411750    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/740adb53-e810-41c9-856a-0954705c32c0-cluster-monitoring-operator-tls podName:740adb53-e810-41c9-856a-0954705c32c0 nodeName:}" failed. No retries permitted until 2026-07-07 16:27:46.411732886 +0000 UTC m=+268.498701325 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/740adb53-e810-41c9-856a-0954705c32c0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-xr746" (UID: "740adb53-e810-41c9-856a-0954705c32c0") : secret "cluster-monitoring-operator-tls" not found
Jul 07 16:27:44.411797 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:27:44.411767    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34272f85-199c-456f-a0ff-f7fad01b6d33-registry-tls podName:34272f85-199c-456f-a0ff-f7fad01b6d33 nodeName:}" failed. No retries permitted until 2026-07-07 16:27:46.411759639 +0000 UTC m=+268.498728074 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/34272f85-199c-456f-a0ff-f7fad01b6d33-registry-tls") pod "image-registry-d9d6b4cbf-xmnvf" (UID: "34272f85-199c-456f-a0ff-f7fad01b6d33") : secret "image-registry-tls" not found
Jul 07 16:27:46.301105 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:46.301070    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-khhhg" event={"ID":"c010fafb-ad1d-4c66-a040-4618b49c012c","Type":"ContainerStarted","Data":"1a66b6c8fefb0ee565bef41be284278e1b188cdec4b63db2df7e97b9ce8fdb1a"}
Jul 07 16:27:46.320033 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:46.319981    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-khhhg" podStartSLOduration=1.609793112 podStartE2EDuration="4.319963779s" totalImagesPullingTime="2.710170667s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:27:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:27:46.319502502 +0000 UTC m=+268.406470960" watchObservedRunningTime="2026-07-07 16:27:46.319963779 +0000 UTC m=+268.406932236"
Jul 07 16:27:46.326000 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:46.325967    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83acc011-1498-4b7f-ba25-6aba7588b38e-metrics-certs\") pod \"router-default-76b5464cf7-q8skn\" (UID: \"83acc011-1498-4b7f-ba25-6aba7588b38e\") " pod="openshift-ingress/router-default-76b5464cf7-q8skn"
Jul 07 16:27:46.326167 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:27:46.326126    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 16:27:46.326167 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:46.326147    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83acc011-1498-4b7f-ba25-6aba7588b38e-service-ca-bundle\") pod \"router-default-76b5464cf7-q8skn\" (UID: \"83acc011-1498-4b7f-ba25-6aba7588b38e\") " pod="openshift-ingress/router-default-76b5464cf7-q8skn"
Jul 07 16:27:46.326292 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:27:46.326197    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83acc011-1498-4b7f-ba25-6aba7588b38e-metrics-certs podName:83acc011-1498-4b7f-ba25-6aba7588b38e nodeName:}" failed. No retries permitted until 2026-07-07 16:27:50.326177623 +0000 UTC m=+272.413146076 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/83acc011-1498-4b7f-ba25-6aba7588b38e-metrics-certs") pod "router-default-76b5464cf7-q8skn" (UID: "83acc011-1498-4b7f-ba25-6aba7588b38e") : secret "router-metrics-certs-default" not found
Jul 07 16:27:46.326292 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:27:46.326244    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/83acc011-1498-4b7f-ba25-6aba7588b38e-service-ca-bundle podName:83acc011-1498-4b7f-ba25-6aba7588b38e nodeName:}" failed. No retries permitted until 2026-07-07 16:27:50.326231291 +0000 UTC m=+272.413199737 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/83acc011-1498-4b7f-ba25-6aba7588b38e-service-ca-bundle") pod "router-default-76b5464cf7-q8skn" (UID: "83acc011-1498-4b7f-ba25-6aba7588b38e") : configmap references non-existent config key: service-ca.crt
Jul 07 16:27:46.426604 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:46.426568    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/34272f85-199c-456f-a0ff-f7fad01b6d33-registry-tls\") pod \"image-registry-d9d6b4cbf-xmnvf\" (UID: \"34272f85-199c-456f-a0ff-f7fad01b6d33\") " pod="openshift-image-registry/image-registry-d9d6b4cbf-xmnvf"
Jul 07 16:27:46.426791 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:46.426624    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/740adb53-e810-41c9-856a-0954705c32c0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-xr746\" (UID: \"740adb53-e810-41c9-856a-0954705c32c0\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xr746"
Jul 07 16:27:46.426791 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:27:46.426712    2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 07 16:27:46.426791 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:27:46.426770    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/740adb53-e810-41c9-856a-0954705c32c0-cluster-monitoring-operator-tls podName:740adb53-e810-41c9-856a-0954705c32c0 nodeName:}" failed. No retries permitted until 2026-07-07 16:27:50.426756545 +0000 UTC m=+272.513724986 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/740adb53-e810-41c9-856a-0954705c32c0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-xr746" (UID: "740adb53-e810-41c9-856a-0954705c32c0") : secret "cluster-monitoring-operator-tls" not found
Jul 07 16:27:46.426925 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:27:46.426716    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 16:27:46.426925 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:27:46.426811    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d9d6b4cbf-xmnvf: secret "image-registry-tls" not found
Jul 07 16:27:46.426925 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:27:46.426852    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34272f85-199c-456f-a0ff-f7fad01b6d33-registry-tls podName:34272f85-199c-456f-a0ff-f7fad01b6d33 nodeName:}" failed. No retries permitted until 2026-07-07 16:27:50.426840885 +0000 UTC m=+272.513809325 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/34272f85-199c-456f-a0ff-f7fad01b6d33-registry-tls") pod "image-registry-d9d6b4cbf-xmnvf" (UID: "34272f85-199c-456f-a0ff-f7fad01b6d33") : secret "image-registry-tls" not found
Jul 07 16:27:48.257900 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:48.257862    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ks8pq"]
Jul 07 16:27:48.260996 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:48.260977    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ks8pq"
Jul 07 16:27:48.267514 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:48.267490    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 07 16:27:48.267654 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:48.267535    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 07 16:27:48.274196 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:48.274171    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 07 16:27:48.274525 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:48.274508    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 07 16:27:48.274629 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:48.274614    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2w8q7\""
Jul 07 16:27:48.284673 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:48.284642    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ks8pq"]
Jul 07 16:27:48.342389 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:48.342334    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9ad40b4c-1d31-421e-a343-4162c9575748-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ks8pq\" (UID: \"9ad40b4c-1d31-421e-a343-4162c9575748\") " pod="openshift-insights/insights-runtime-extractor-ks8pq"
Jul 07 16:27:48.342669 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:48.342641    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9ad40b4c-1d31-421e-a343-4162c9575748-data-volume\") pod \"insights-runtime-extractor-ks8pq\" (UID: \"9ad40b4c-1d31-421e-a343-4162c9575748\") " pod="openshift-insights/insights-runtime-extractor-ks8pq"
Jul 07 16:27:48.342810 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:48.342689    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9ad40b4c-1d31-421e-a343-4162c9575748-crio-socket\") pod \"insights-runtime-extractor-ks8pq\" (UID: \"9ad40b4c-1d31-421e-a343-4162c9575748\") " pod="openshift-insights/insights-runtime-extractor-ks8pq"
Jul 07 16:27:48.342810 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:48.342713    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfz5n\" (UniqueName: \"kubernetes.io/projected/9ad40b4c-1d31-421e-a343-4162c9575748-kube-api-access-rfz5n\") pod \"insights-runtime-extractor-ks8pq\" (UID: \"9ad40b4c-1d31-421e-a343-4162c9575748\") " pod="openshift-insights/insights-runtime-extractor-ks8pq"
Jul 07 16:27:48.342810 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:48.342767    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9ad40b4c-1d31-421e-a343-4162c9575748-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ks8pq\" (UID: \"9ad40b4c-1d31-421e-a343-4162c9575748\") " pod="openshift-insights/insights-runtime-extractor-ks8pq"
Jul 07 16:27:48.443536 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:48.443493    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9ad40b4c-1d31-421e-a343-4162c9575748-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ks8pq\" (UID: \"9ad40b4c-1d31-421e-a343-4162c9575748\") " pod="openshift-insights/insights-runtime-extractor-ks8pq"
Jul 07 16:27:48.443691 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:48.443597    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9ad40b4c-1d31-421e-a343-4162c9575748-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ks8pq\" (UID: \"9ad40b4c-1d31-421e-a343-4162c9575748\") " pod="openshift-insights/insights-runtime-extractor-ks8pq"
Jul 07 16:27:48.443691 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:48.443622    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9ad40b4c-1d31-421e-a343-4162c9575748-data-volume\") pod \"insights-runtime-extractor-ks8pq\" (UID: \"9ad40b4c-1d31-421e-a343-4162c9575748\") " pod="openshift-insights/insights-runtime-extractor-ks8pq"
Jul 07 16:27:48.443691 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:48.443650    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9ad40b4c-1d31-421e-a343-4162c9575748-crio-socket\") pod \"insights-runtime-extractor-ks8pq\" (UID: \"9ad40b4c-1d31-421e-a343-4162c9575748\") " pod="openshift-insights/insights-runtime-extractor-ks8pq"
Jul 07 16:27:48.443691 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:48.443667    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfz5n\" (UniqueName: \"kubernetes.io/projected/9ad40b4c-1d31-421e-a343-4162c9575748-kube-api-access-rfz5n\") pod \"insights-runtime-extractor-ks8pq\" (UID: \"9ad40b4c-1d31-421e-a343-4162c9575748\") " pod="openshift-insights/insights-runtime-extractor-ks8pq"
Jul 07 16:27:48.443691 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:27:48.443622    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 16:27:48.443918 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:27:48.443691    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 16:27:48.443918 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:48.443761    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9ad40b4c-1d31-421e-a343-4162c9575748-crio-socket\") pod \"insights-runtime-extractor-ks8pq\" (UID: \"9ad40b4c-1d31-421e-a343-4162c9575748\") " pod="openshift-insights/insights-runtime-extractor-ks8pq"
Jul 07 16:27:48.443918 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:27:48.443768    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ad40b4c-1d31-421e-a343-4162c9575748-insights-runtime-extractor-tls podName:9ad40b4c-1d31-421e-a343-4162c9575748 nodeName:}" failed. No retries permitted until 2026-07-07 16:27:48.943749812 +0000 UTC m=+271.030718248 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9ad40b4c-1d31-421e-a343-4162c9575748-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ks8pq" (UID: "9ad40b4c-1d31-421e-a343-4162c9575748") : secret "insights-runtime-extractor-tls" not found
Jul 07 16:27:48.443918 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:27:48.443820    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9ad40b4c-1d31-421e-a343-4162c9575748-kube-rbac-proxy-cm podName:9ad40b4c-1d31-421e-a343-4162c9575748 nodeName:}" failed. No retries permitted until 2026-07-07 16:27:48.943801147 +0000 UTC m=+271.030769594 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9ad40b4c-1d31-421e-a343-4162c9575748-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ks8pq" (UID: "9ad40b4c-1d31-421e-a343-4162c9575748") : configmap "kube-rbac-proxy" not found
Jul 07 16:27:48.444058 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:48.443971    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9ad40b4c-1d31-421e-a343-4162c9575748-data-volume\") pod \"insights-runtime-extractor-ks8pq\" (UID: \"9ad40b4c-1d31-421e-a343-4162c9575748\") " pod="openshift-insights/insights-runtime-extractor-ks8pq"
Jul 07 16:27:48.458894 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:48.458865    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfz5n\" (UniqueName: \"kubernetes.io/projected/9ad40b4c-1d31-421e-a343-4162c9575748-kube-api-access-rfz5n\") pod \"insights-runtime-extractor-ks8pq\" (UID: \"9ad40b4c-1d31-421e-a343-4162c9575748\") " pod="openshift-insights/insights-runtime-extractor-ks8pq"
Jul 07 16:27:48.948326 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:48.948286    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9ad40b4c-1d31-421e-a343-4162c9575748-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ks8pq\" (UID: \"9ad40b4c-1d31-421e-a343-4162c9575748\") " pod="openshift-insights/insights-runtime-extractor-ks8pq"
Jul 07 16:27:48.948557 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:48.948366    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9ad40b4c-1d31-421e-a343-4162c9575748-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ks8pq\" (UID: \"9ad40b4c-1d31-421e-a343-4162c9575748\") " pod="openshift-insights/insights-runtime-extractor-ks8pq"
Jul 07 16:27:48.948557 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:27:48.948436    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 16:27:48.948557 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:27:48.948451    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 16:27:48.948557 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:27:48.948506    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ad40b4c-1d31-421e-a343-4162c9575748-insights-runtime-extractor-tls podName:9ad40b4c-1d31-421e-a343-4162c9575748 nodeName:}" failed. No retries permitted until 2026-07-07 16:27:49.948490102 +0000 UTC m=+272.035458542 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9ad40b4c-1d31-421e-a343-4162c9575748-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ks8pq" (UID: "9ad40b4c-1d31-421e-a343-4162c9575748") : secret "insights-runtime-extractor-tls" not found
Jul 07 16:27:48.948557 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:27:48.948523    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9ad40b4c-1d31-421e-a343-4162c9575748-kube-rbac-proxy-cm podName:9ad40b4c-1d31-421e-a343-4162c9575748 nodeName:}" failed. No retries permitted until 2026-07-07 16:27:49.948515645 +0000 UTC m=+272.035484081 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9ad40b4c-1d31-421e-a343-4162c9575748-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ks8pq" (UID: "9ad40b4c-1d31-421e-a343-4162c9575748") : configmap "kube-rbac-proxy" not found
Jul 07 16:27:49.956455 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:49.956414    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9ad40b4c-1d31-421e-a343-4162c9575748-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ks8pq\" (UID: \"9ad40b4c-1d31-421e-a343-4162c9575748\") " pod="openshift-insights/insights-runtime-extractor-ks8pq"
Jul 07 16:27:49.956857 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:49.956521    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9ad40b4c-1d31-421e-a343-4162c9575748-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ks8pq\" (UID: \"9ad40b4c-1d31-421e-a343-4162c9575748\") " pod="openshift-insights/insights-runtime-extractor-ks8pq"
Jul 07 16:27:49.956857 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:27:49.956548    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 16:27:49.956857 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:27:49.956609    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 16:27:49.956857 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:27:49.956618    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9ad40b4c-1d31-421e-a343-4162c9575748-kube-rbac-proxy-cm podName:9ad40b4c-1d31-421e-a343-4162c9575748 nodeName:}" failed. No retries permitted until 2026-07-07 16:27:51.956599955 +0000 UTC m=+274.043568395 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9ad40b4c-1d31-421e-a343-4162c9575748-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ks8pq" (UID: "9ad40b4c-1d31-421e-a343-4162c9575748") : configmap "kube-rbac-proxy" not found
Jul 07 16:27:49.956857 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:27:49.956658    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ad40b4c-1d31-421e-a343-4162c9575748-insights-runtime-extractor-tls podName:9ad40b4c-1d31-421e-a343-4162c9575748 nodeName:}" failed. No retries permitted until 2026-07-07 16:27:51.956646749 +0000 UTC m=+274.043615188 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9ad40b4c-1d31-421e-a343-4162c9575748-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ks8pq" (UID: "9ad40b4c-1d31-421e-a343-4162c9575748") : secret "insights-runtime-extractor-tls" not found
Jul 07 16:27:50.358400 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:50.358367    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83acc011-1498-4b7f-ba25-6aba7588b38e-service-ca-bundle\") pod \"router-default-76b5464cf7-q8skn\" (UID: \"83acc011-1498-4b7f-ba25-6aba7588b38e\") " pod="openshift-ingress/router-default-76b5464cf7-q8skn"
Jul 07 16:27:50.358550 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:50.358448    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83acc011-1498-4b7f-ba25-6aba7588b38e-metrics-certs\") pod \"router-default-76b5464cf7-q8skn\" (UID: \"83acc011-1498-4b7f-ba25-6aba7588b38e\") " pod="openshift-ingress/router-default-76b5464cf7-q8skn"
Jul 07 16:27:50.358602 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:27:50.358545    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/83acc011-1498-4b7f-ba25-6aba7588b38e-service-ca-bundle podName:83acc011-1498-4b7f-ba25-6aba7588b38e nodeName:}" failed. No retries permitted until 2026-07-07 16:27:58.358526107 +0000 UTC m=+280.445494563 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/83acc011-1498-4b7f-ba25-6aba7588b38e-service-ca-bundle") pod "router-default-76b5464cf7-q8skn" (UID: "83acc011-1498-4b7f-ba25-6aba7588b38e") : configmap references non-existent config key: service-ca.crt
Jul 07 16:27:50.358602 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:27:50.358570    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 16:27:50.358677 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:27:50.358603    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83acc011-1498-4b7f-ba25-6aba7588b38e-metrics-certs podName:83acc011-1498-4b7f-ba25-6aba7588b38e nodeName:}" failed. No retries permitted until 2026-07-07 16:27:58.358592913 +0000 UTC m=+280.445561356 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/83acc011-1498-4b7f-ba25-6aba7588b38e-metrics-certs") pod "router-default-76b5464cf7-q8skn" (UID: "83acc011-1498-4b7f-ba25-6aba7588b38e") : secret "router-metrics-certs-default" not found
Jul 07 16:27:50.459610 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:50.459568    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/34272f85-199c-456f-a0ff-f7fad01b6d33-registry-tls\") pod \"image-registry-d9d6b4cbf-xmnvf\" (UID: \"34272f85-199c-456f-a0ff-f7fad01b6d33\") " pod="openshift-image-registry/image-registry-d9d6b4cbf-xmnvf"
Jul 07 16:27:50.459788 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:27:50.459691    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 16:27:50.459788 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:27:50.459712    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d9d6b4cbf-xmnvf: secret "image-registry-tls" not found
Jul 07 16:27:50.459788 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:27:50.459757    2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 07 16:27:50.459788 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:50.459695    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/740adb53-e810-41c9-856a-0954705c32c0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-xr746\" (UID: \"740adb53-e810-41c9-856a-0954705c32c0\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xr746"
Jul 07 16:27:50.460028 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:27:50.459762    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34272f85-199c-456f-a0ff-f7fad01b6d33-registry-tls podName:34272f85-199c-456f-a0ff-f7fad01b6d33 nodeName:}" failed. No retries permitted until 2026-07-07 16:27:58.459746018 +0000 UTC m=+280.546714454 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/34272f85-199c-456f-a0ff-f7fad01b6d33-registry-tls") pod "image-registry-d9d6b4cbf-xmnvf" (UID: "34272f85-199c-456f-a0ff-f7fad01b6d33") : secret "image-registry-tls" not found
Jul 07 16:27:50.460028 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:27:50.459836    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/740adb53-e810-41c9-856a-0954705c32c0-cluster-monitoring-operator-tls podName:740adb53-e810-41c9-856a-0954705c32c0 nodeName:}" failed. No retries permitted until 2026-07-07 16:27:58.459820754 +0000 UTC m=+280.546789194 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/740adb53-e810-41c9-856a-0954705c32c0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-xr746" (UID: "740adb53-e810-41c9-856a-0954705c32c0") : secret "cluster-monitoring-operator-tls" not found
Jul 07 16:27:51.193333 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:51.193307    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xpjlg_92a59c06-08c5-471c-943f-7f378028262c/dns-node-resolver/0.log"
Jul 07 16:27:51.972099 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:51.972055    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9ad40b4c-1d31-421e-a343-4162c9575748-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ks8pq\" (UID: \"9ad40b4c-1d31-421e-a343-4162c9575748\") " pod="openshift-insights/insights-runtime-extractor-ks8pq"
Jul 07 16:27:51.972283 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:27:51.972189    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 16:27:51.972283 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:51.972227    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9ad40b4c-1d31-421e-a343-4162c9575748-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ks8pq\" (UID: \"9ad40b4c-1d31-421e-a343-4162c9575748\") " pod="openshift-insights/insights-runtime-extractor-ks8pq"
Jul 07 16:27:51.972283 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:27:51.972259    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9ad40b4c-1d31-421e-a343-4162c9575748-kube-rbac-proxy-cm podName:9ad40b4c-1d31-421e-a343-4162c9575748 nodeName:}" failed. No retries permitted until 2026-07-07 16:27:55.972241167 +0000 UTC m=+278.059209606 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9ad40b4c-1d31-421e-a343-4162c9575748-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ks8pq" (UID: "9ad40b4c-1d31-421e-a343-4162c9575748") : configmap "kube-rbac-proxy" not found
Jul 07 16:27:51.972425 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:27:51.972303    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 16:27:51.972425 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:27:51.972365    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ad40b4c-1d31-421e-a343-4162c9575748-insights-runtime-extractor-tls podName:9ad40b4c-1d31-421e-a343-4162c9575748 nodeName:}" failed. No retries permitted until 2026-07-07 16:27:55.972333318 +0000 UTC m=+278.059301753 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9ad40b4c-1d31-421e-a343-4162c9575748-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ks8pq" (UID: "9ad40b4c-1d31-421e-a343-4162c9575748") : secret "insights-runtime-extractor-tls" not found
Jul 07 16:27:51.994883 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:51.994856    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nk4br_2d6c0087-96b8-4c36-bc5b-e6f2ab2d179f/node-ca/0.log"
Jul 07 16:27:52.602569 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:52.602539    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kxns9_f70a870c-9842-41b6-a874-b06704c78994/serve-healthcheck-canary/0.log"
Jul 07 16:27:56.007010 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:56.006958    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9ad40b4c-1d31-421e-a343-4162c9575748-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ks8pq\" (UID: \"9ad40b4c-1d31-421e-a343-4162c9575748\") " pod="openshift-insights/insights-runtime-extractor-ks8pq"
Jul 07 16:27:56.007470 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:56.007044    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9ad40b4c-1d31-421e-a343-4162c9575748-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ks8pq\" (UID: \"9ad40b4c-1d31-421e-a343-4162c9575748\") " pod="openshift-insights/insights-runtime-extractor-ks8pq"
Jul 07 16:27:56.007470 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:27:56.007112    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 16:27:56.007470 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:27:56.007153    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 16:27:56.007470 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:27:56.007182    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ad40b4c-1d31-421e-a343-4162c9575748-insights-runtime-extractor-tls podName:9ad40b4c-1d31-421e-a343-4162c9575748 nodeName:}" failed. No retries permitted until 2026-07-07 16:28:04.007166959 +0000 UTC m=+286.094135400 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9ad40b4c-1d31-421e-a343-4162c9575748-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ks8pq" (UID: "9ad40b4c-1d31-421e-a343-4162c9575748") : secret "insights-runtime-extractor-tls" not found
Jul 07 16:27:56.007470 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:27:56.007203    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9ad40b4c-1d31-421e-a343-4162c9575748-kube-rbac-proxy-cm podName:9ad40b4c-1d31-421e-a343-4162c9575748 nodeName:}" failed. No retries permitted until 2026-07-07 16:28:04.007190778 +0000 UTC m=+286.094159218 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9ad40b4c-1d31-421e-a343-4162c9575748-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ks8pq" (UID: "9ad40b4c-1d31-421e-a343-4162c9575748") : configmap "kube-rbac-proxy" not found
Jul 07 16:27:58.429227 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:58.429187    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83acc011-1498-4b7f-ba25-6aba7588b38e-service-ca-bundle\") pod \"router-default-76b5464cf7-q8skn\" (UID: \"83acc011-1498-4b7f-ba25-6aba7588b38e\") " pod="openshift-ingress/router-default-76b5464cf7-q8skn"
Jul 07 16:27:58.429690 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:58.429286    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83acc011-1498-4b7f-ba25-6aba7588b38e-metrics-certs\") pod \"router-default-76b5464cf7-q8skn\" (UID: \"83acc011-1498-4b7f-ba25-6aba7588b38e\") " pod="openshift-ingress/router-default-76b5464cf7-q8skn"
Jul 07 16:27:58.429690 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:27:58.429423    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/83acc011-1498-4b7f-ba25-6aba7588b38e-service-ca-bundle podName:83acc011-1498-4b7f-ba25-6aba7588b38e nodeName:}" failed. No retries permitted until 2026-07-07 16:28:14.429400424 +0000 UTC m=+296.516368871 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/83acc011-1498-4b7f-ba25-6aba7588b38e-service-ca-bundle") pod "router-default-76b5464cf7-q8skn" (UID: "83acc011-1498-4b7f-ba25-6aba7588b38e") : configmap references non-existent config key: service-ca.crt
Jul 07 16:27:58.429690 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:27:58.429451    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 16:27:58.429690 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:27:58.429509    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83acc011-1498-4b7f-ba25-6aba7588b38e-metrics-certs podName:83acc011-1498-4b7f-ba25-6aba7588b38e nodeName:}" failed. No retries permitted until 2026-07-07 16:28:14.429497141 +0000 UTC m=+296.516465594 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/83acc011-1498-4b7f-ba25-6aba7588b38e-metrics-certs") pod "router-default-76b5464cf7-q8skn" (UID: "83acc011-1498-4b7f-ba25-6aba7588b38e") : secret "router-metrics-certs-default" not found
Jul 07 16:27:58.530728 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:58.530692    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/34272f85-199c-456f-a0ff-f7fad01b6d33-registry-tls\") pod \"image-registry-d9d6b4cbf-xmnvf\" (UID: \"34272f85-199c-456f-a0ff-f7fad01b6d33\") " pod="openshift-image-registry/image-registry-d9d6b4cbf-xmnvf"
Jul 07 16:27:58.530910 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:58.530746    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/740adb53-e810-41c9-856a-0954705c32c0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-xr746\" (UID: \"740adb53-e810-41c9-856a-0954705c32c0\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xr746"
Jul 07 16:27:58.530910 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:27:58.530837    2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 07 16:27:58.530910 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:27:58.530889    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/740adb53-e810-41c9-856a-0954705c32c0-cluster-monitoring-operator-tls podName:740adb53-e810-41c9-856a-0954705c32c0 nodeName:}" failed. No retries permitted until 2026-07-07 16:28:14.530875756 +0000 UTC m=+296.617844193 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/740adb53-e810-41c9-856a-0954705c32c0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-xr746" (UID: "740adb53-e810-41c9-856a-0954705c32c0") : secret "cluster-monitoring-operator-tls" not found
Jul 07 16:27:58.533218 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:58.533185    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/34272f85-199c-456f-a0ff-f7fad01b6d33-registry-tls\") pod \"image-registry-d9d6b4cbf-xmnvf\" (UID: \"34272f85-199c-456f-a0ff-f7fad01b6d33\") " pod="openshift-image-registry/image-registry-d9d6b4cbf-xmnvf"
Jul 07 16:27:58.590636 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:58.590598    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d9d6b4cbf-xmnvf"
Jul 07 16:27:58.741706 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:58.741610    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-d9d6b4cbf-xmnvf"]
Jul 07 16:27:58.745454 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:27:58.745425    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34272f85_199c_456f_a0ff_f7fad01b6d33.slice/crio-4c7e2881c5ebc3832602e5639484cf6fc35a8080aeb6bc93720b19ab7d57fa6b WatchSource:0}: Error finding container 4c7e2881c5ebc3832602e5639484cf6fc35a8080aeb6bc93720b19ab7d57fa6b: Status 404 returned error can't find the container with id 4c7e2881c5ebc3832602e5639484cf6fc35a8080aeb6bc93720b19ab7d57fa6b
Jul 07 16:27:59.341013 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:59.340974    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d9d6b4cbf-xmnvf" event={"ID":"34272f85-199c-456f-a0ff-f7fad01b6d33","Type":"ContainerStarted","Data":"ac36b1b052c2429bf3f2707b5421ed59860dc376a0dd19b57e3db44f88570b47"}
Jul 07 16:27:59.341209 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:59.341050    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d9d6b4cbf-xmnvf" event={"ID":"34272f85-199c-456f-a0ff-f7fad01b6d33","Type":"ContainerStarted","Data":"4c7e2881c5ebc3832602e5639484cf6fc35a8080aeb6bc93720b19ab7d57fa6b"}
Jul 07 16:27:59.341209 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:59.341108    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-d9d6b4cbf-xmnvf"
Jul 07 16:27:59.395796 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:27:59.395749    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-d9d6b4cbf-xmnvf" podStartSLOduration=17.395732835 podStartE2EDuration="17.395732835s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:27:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:27:59.395531859 +0000 UTC m=+281.482500316" watchObservedRunningTime="2026-07-07 16:27:59.395732835 +0000 UTC m=+281.482701307"
Jul 07 16:28:01.025263 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:28:01.025219    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-m7n9j" podUID="97c7d1d5-ed8a-4785-b56e-e76a83166958"
Jul 07 16:28:01.346878 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:01.346842    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-m7n9j"
Jul 07 16:28:04.075620 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:04.075565    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9ad40b4c-1d31-421e-a343-4162c9575748-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ks8pq\" (UID: \"9ad40b4c-1d31-421e-a343-4162c9575748\") " pod="openshift-insights/insights-runtime-extractor-ks8pq"
Jul 07 16:28:04.076040 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:04.075666    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9ad40b4c-1d31-421e-a343-4162c9575748-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ks8pq\" (UID: \"9ad40b4c-1d31-421e-a343-4162c9575748\") " pod="openshift-insights/insights-runtime-extractor-ks8pq"
Jul 07 16:28:04.076040 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:28:04.075724    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 16:28:04.076040 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:28:04.075803    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ad40b4c-1d31-421e-a343-4162c9575748-insights-runtime-extractor-tls podName:9ad40b4c-1d31-421e-a343-4162c9575748 nodeName:}" failed. No retries permitted until 2026-07-07 16:28:20.075786388 +0000 UTC m=+302.162754827 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9ad40b4c-1d31-421e-a343-4162c9575748-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ks8pq" (UID: "9ad40b4c-1d31-421e-a343-4162c9575748") : secret "insights-runtime-extractor-tls" not found
Jul 07 16:28:04.076202 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:04.076184    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9ad40b4c-1d31-421e-a343-4162c9575748-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ks8pq\" (UID: \"9ad40b4c-1d31-421e-a343-4162c9575748\") " pod="openshift-insights/insights-runtime-extractor-ks8pq"
Jul 07 16:28:04.176522 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:04.176483    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97c7d1d5-ed8a-4785-b56e-e76a83166958-metrics-tls\") pod \"dns-default-m7n9j\" (UID: \"97c7d1d5-ed8a-4785-b56e-e76a83166958\") " pod="openshift-dns/dns-default-m7n9j"
Jul 07 16:28:04.178937 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:04.178898    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97c7d1d5-ed8a-4785-b56e-e76a83166958-metrics-tls\") pod \"dns-default-m7n9j\" (UID: \"97c7d1d5-ed8a-4785-b56e-e76a83166958\") " pod="openshift-dns/dns-default-m7n9j"
Jul 07 16:28:04.352013 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:04.351984    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7f9fh\""
Jul 07 16:28:04.358894 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:04.358854    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-m7n9j"
Jul 07 16:28:04.518290 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:04.518260    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-m7n9j"]
Jul 07 16:28:04.521476 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:28:04.521445    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97c7d1d5_ed8a_4785_b56e_e76a83166958.slice/crio-09a05de54f34939e046ffbe8f9a90ad4bcb1dcace9af065a41ed4260427ef196 WatchSource:0}: Error finding container 09a05de54f34939e046ffbe8f9a90ad4bcb1dcace9af065a41ed4260427ef196: Status 404 returned error can't find the container with id 09a05de54f34939e046ffbe8f9a90ad4bcb1dcace9af065a41ed4260427ef196
Jul 07 16:28:05.362302 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:05.362263    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-m7n9j" event={"ID":"97c7d1d5-ed8a-4785-b56e-e76a83166958","Type":"ContainerStarted","Data":"09a05de54f34939e046ffbe8f9a90ad4bcb1dcace9af065a41ed4260427ef196"}
Jul 07 16:28:06.368218 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:06.368139    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-m7n9j" event={"ID":"97c7d1d5-ed8a-4785-b56e-e76a83166958","Type":"ContainerStarted","Data":"0c5cb0d67a5289996df631dab5e01b84ec688a8a2438474fb7ff4b21a5f9ae05"}
Jul 07 16:28:07.372577 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:07.372545    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-m7n9j" event={"ID":"97c7d1d5-ed8a-4785-b56e-e76a83166958","Type":"ContainerStarted","Data":"c5aff3e571b50d957dae6be034f88d574b754d4278cb9002c68cb2abf67a31ee"}
Jul 07 16:28:07.372979 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:07.372677    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-m7n9j"
Jul 07 16:28:07.397019 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:07.396973    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-m7n9j" podStartSLOduration=251.687664881 podStartE2EDuration="4m13.396958619s" totalImagesPullingTime="1.709293738s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:23:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:28:07.396588311 +0000 UTC m=+289.483556770" watchObservedRunningTime="2026-07-07 16:28:07.396958619 +0000 UTC m=+289.483927077"
Jul 07 16:28:14.460202 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:14.460158    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83acc011-1498-4b7f-ba25-6aba7588b38e-metrics-certs\") pod \"router-default-76b5464cf7-q8skn\" (UID: \"83acc011-1498-4b7f-ba25-6aba7588b38e\") " pod="openshift-ingress/router-default-76b5464cf7-q8skn"
Jul 07 16:28:14.460707 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:14.460249    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83acc011-1498-4b7f-ba25-6aba7588b38e-service-ca-bundle\") pod \"router-default-76b5464cf7-q8skn\" (UID: \"83acc011-1498-4b7f-ba25-6aba7588b38e\") " pod="openshift-ingress/router-default-76b5464cf7-q8skn"
Jul 07 16:28:14.460954 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:14.460935    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83acc011-1498-4b7f-ba25-6aba7588b38e-service-ca-bundle\") pod \"router-default-76b5464cf7-q8skn\" (UID: \"83acc011-1498-4b7f-ba25-6aba7588b38e\") " pod="openshift-ingress/router-default-76b5464cf7-q8skn"
Jul 07 16:28:14.462687 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:14.462667    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83acc011-1498-4b7f-ba25-6aba7588b38e-metrics-certs\") pod \"router-default-76b5464cf7-q8skn\" (UID: \"83acc011-1498-4b7f-ba25-6aba7588b38e\") " pod="openshift-ingress/router-default-76b5464cf7-q8skn"
Jul 07 16:28:14.560890 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:14.560835    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/740adb53-e810-41c9-856a-0954705c32c0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-xr746\" (UID: \"740adb53-e810-41c9-856a-0954705c32c0\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xr746"
Jul 07 16:28:14.563250 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:14.563216    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/740adb53-e810-41c9-856a-0954705c32c0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-xr746\" (UID: \"740adb53-e810-41c9-856a-0954705c32c0\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xr746"
Jul 07 16:28:14.684384 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:14.684321    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-76b5464cf7-q8skn"
Jul 07 16:28:14.784682 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:14.784652    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xr746"
Jul 07 16:28:14.823161 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:14.823127    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-76b5464cf7-q8skn"]
Jul 07 16:28:14.827132 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:28:14.827097    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83acc011_1498_4b7f_ba25_6aba7588b38e.slice/crio-1fb95b5be1fcc2055a4236e78e51e783a71c2403c13f1be5e6bc54290c80113a WatchSource:0}: Error finding container 1fb95b5be1fcc2055a4236e78e51e783a71c2403c13f1be5e6bc54290c80113a: Status 404 returned error can't find the container with id 1fb95b5be1fcc2055a4236e78e51e783a71c2403c13f1be5e6bc54290c80113a
Jul 07 16:28:14.923893 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:14.923859    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xr746"]
Jul 07 16:28:14.927188 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:28:14.927142    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod740adb53_e810_41c9_856a_0954705c32c0.slice/crio-8b0f594b172605e82f61f87918f5c0e107d61d60403f94a256f2f35290378107 WatchSource:0}: Error finding container 8b0f594b172605e82f61f87918f5c0e107d61d60403f94a256f2f35290378107: Status 404 returned error can't find the container with id 8b0f594b172605e82f61f87918f5c0e107d61d60403f94a256f2f35290378107
Jul 07 16:28:15.398784 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:15.398750    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-76b5464cf7-q8skn" event={"ID":"83acc011-1498-4b7f-ba25-6aba7588b38e","Type":"ContainerStarted","Data":"43dafd18b72408e2a143cb81c18868579aa3972c929010e9fbdfe7783aec771a"}
Jul 07 16:28:15.398989 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:15.398798    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-76b5464cf7-q8skn" event={"ID":"83acc011-1498-4b7f-ba25-6aba7588b38e","Type":"ContainerStarted","Data":"1fb95b5be1fcc2055a4236e78e51e783a71c2403c13f1be5e6bc54290c80113a"}
Jul 07 16:28:15.399872 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:15.399844    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xr746" event={"ID":"740adb53-e810-41c9-856a-0954705c32c0","Type":"ContainerStarted","Data":"8b0f594b172605e82f61f87918f5c0e107d61d60403f94a256f2f35290378107"}
Jul 07 16:28:15.437761 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:15.437714    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-76b5464cf7-q8skn" podStartSLOduration=33.437697753 podStartE2EDuration="33.437697753s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:27:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:28:15.436834497 +0000 UTC m=+297.523802958" watchObservedRunningTime="2026-07-07 16:28:15.437697753 +0000 UTC m=+297.524666212"
Jul 07 16:28:15.685264 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:15.685176    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-76b5464cf7-q8skn"
Jul 07 16:28:15.688075 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:15.688051    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-76b5464cf7-q8skn"
Jul 07 16:28:16.402720 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:16.402689    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-76b5464cf7-q8skn"
Jul 07 16:28:16.403982 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:16.403959    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-76b5464cf7-q8skn"
Jul 07 16:28:16.509409 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:28:16.509366    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-9sc2w" podUID="a5e94c63-e554-402d-9215-06cd6525019a"
Jul 07 16:28:17.377783 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:17.377750    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-m7n9j"
Jul 07 16:28:17.407208 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:17.407164    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xr746" event={"ID":"740adb53-e810-41c9-856a-0954705c32c0","Type":"ContainerStarted","Data":"5fb434efc24320403fc96a1554767239bf41c6de910055dc3be50c15a4a2f085"}
Jul 07 16:28:17.430558 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:17.430496    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xr746" podStartSLOduration=33.329952668 podStartE2EDuration="35.430472023s" totalImagesPullingTime="2.100519355s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:27:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:28:17.429232763 +0000 UTC m=+299.516201222" watchObservedRunningTime="2026-07-07 16:28:17.430472023 +0000 UTC m=+299.517440482"
Jul 07 16:28:17.736097 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:17.736064    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-wvkw2"]
Jul 07 16:28:17.739049 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:17.739024    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-wvkw2"
Jul 07 16:28:17.742060 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:17.741973    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 07 16:28:17.742728 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:17.742698    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-fwx5d\""
Jul 07 16:28:17.743903 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:17.743879    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-d9d6b4cbf-xmnvf"]
Jul 07 16:28:17.750032 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:17.749997    2578 patch_prober.go:28] interesting pod/image-registry-d9d6b4cbf-xmnvf container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 07 16:28:17.750178 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:17.750059    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-d9d6b4cbf-xmnvf" podUID="34272f85-199c-456f-a0ff-f7fad01b6d33" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 07 16:28:17.755592 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:17.755560    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-wvkw2"]
Jul 07 16:28:17.886249 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:17.886215    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6cc646db48-pv5v6"]
Jul 07 16:28:17.889210 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:17.889192    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cc646db48-pv5v6"
Jul 07 16:28:17.890889 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:17.890854    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8f7c0bc0-b716-4bff-92b9-5333825b6734-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-wvkw2\" (UID: \"8f7c0bc0-b716-4bff-92b9-5333825b6734\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-wvkw2"
Jul 07 16:28:17.915688 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:17.915658    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6cc646db48-pv5v6"]
Jul 07 16:28:17.991380 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:17.991272    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8f7c0bc0-b716-4bff-92b9-5333825b6734-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-wvkw2\" (UID: \"8f7c0bc0-b716-4bff-92b9-5333825b6734\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-wvkw2"
Jul 07 16:28:17.991380 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:17.991312    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bcc5fcc5-aec1-49d7-abc9-4e23b61c1dcf-ca-trust-extracted\") pod \"image-registry-6cc646db48-pv5v6\" (UID: \"bcc5fcc5-aec1-49d7-abc9-4e23b61c1dcf\") " pod="openshift-image-registry/image-registry-6cc646db48-pv5v6"
Jul 07 16:28:17.991380 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:17.991370    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bcc5fcc5-aec1-49d7-abc9-4e23b61c1dcf-registry-certificates\") pod \"image-registry-6cc646db48-pv5v6\" (UID: \"bcc5fcc5-aec1-49d7-abc9-4e23b61c1dcf\") " pod="openshift-image-registry/image-registry-6cc646db48-pv5v6"
Jul 07 16:28:17.991596 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:17.991393    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bcc5fcc5-aec1-49d7-abc9-4e23b61c1dcf-bound-sa-token\") pod \"image-registry-6cc646db48-pv5v6\" (UID: \"bcc5fcc5-aec1-49d7-abc9-4e23b61c1dcf\") " pod="openshift-image-registry/image-registry-6cc646db48-pv5v6"
Jul 07 16:28:17.991596 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:17.991412    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bcc5fcc5-aec1-49d7-abc9-4e23b61c1dcf-installation-pull-secrets\") pod \"image-registry-6cc646db48-pv5v6\" (UID: \"bcc5fcc5-aec1-49d7-abc9-4e23b61c1dcf\") " pod="openshift-image-registry/image-registry-6cc646db48-pv5v6"
Jul 07 16:28:17.991596 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:17.991531    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bcc5fcc5-aec1-49d7-abc9-4e23b61c1dcf-trusted-ca\") pod \"image-registry-6cc646db48-pv5v6\" (UID: \"bcc5fcc5-aec1-49d7-abc9-4e23b61c1dcf\") " pod="openshift-image-registry/image-registry-6cc646db48-pv5v6"
Jul 07 16:28:17.991596 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:17.991582    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bcc5fcc5-aec1-49d7-abc9-4e23b61c1dcf-image-registry-private-configuration\") pod \"image-registry-6cc646db48-pv5v6\" (UID: \"bcc5fcc5-aec1-49d7-abc9-4e23b61c1dcf\") " pod="openshift-image-registry/image-registry-6cc646db48-pv5v6"
Jul 07 16:28:17.991736 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:17.991608    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bcc5fcc5-aec1-49d7-abc9-4e23b61c1dcf-registry-tls\") pod \"image-registry-6cc646db48-pv5v6\" (UID: \"bcc5fcc5-aec1-49d7-abc9-4e23b61c1dcf\") " pod="openshift-image-registry/image-registry-6cc646db48-pv5v6"
Jul 07 16:28:17.991736 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:17.991633    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnh54\" (UniqueName: \"kubernetes.io/projected/bcc5fcc5-aec1-49d7-abc9-4e23b61c1dcf-kube-api-access-qnh54\") pod \"image-registry-6cc646db48-pv5v6\" (UID: \"bcc5fcc5-aec1-49d7-abc9-4e23b61c1dcf\") " pod="openshift-image-registry/image-registry-6cc646db48-pv5v6"
Jul 07 16:28:17.993854 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:17.993826    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8f7c0bc0-b716-4bff-92b9-5333825b6734-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-wvkw2\" (UID: \"8f7c0bc0-b716-4bff-92b9-5333825b6734\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-wvkw2"
Jul 07 16:28:18.051197 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:18.051150    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-wvkw2"
Jul 07 16:28:18.092429 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:18.092397    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bcc5fcc5-aec1-49d7-abc9-4e23b61c1dcf-registry-certificates\") pod \"image-registry-6cc646db48-pv5v6\" (UID: \"bcc5fcc5-aec1-49d7-abc9-4e23b61c1dcf\") " pod="openshift-image-registry/image-registry-6cc646db48-pv5v6"
Jul 07 16:28:18.092429 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:18.092435    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bcc5fcc5-aec1-49d7-abc9-4e23b61c1dcf-bound-sa-token\") pod \"image-registry-6cc646db48-pv5v6\" (UID: \"bcc5fcc5-aec1-49d7-abc9-4e23b61c1dcf\") " pod="openshift-image-registry/image-registry-6cc646db48-pv5v6"
Jul 07 16:28:18.092685 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:18.092458    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bcc5fcc5-aec1-49d7-abc9-4e23b61c1dcf-installation-pull-secrets\") pod \"image-registry-6cc646db48-pv5v6\" (UID: \"bcc5fcc5-aec1-49d7-abc9-4e23b61c1dcf\") " pod="openshift-image-registry/image-registry-6cc646db48-pv5v6"
Jul 07 16:28:18.092685 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:18.092499    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bcc5fcc5-aec1-49d7-abc9-4e23b61c1dcf-trusted-ca\") pod \"image-registry-6cc646db48-pv5v6\" (UID: \"bcc5fcc5-aec1-49d7-abc9-4e23b61c1dcf\") " pod="openshift-image-registry/image-registry-6cc646db48-pv5v6"
Jul 07 16:28:18.092685 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:18.092528    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bcc5fcc5-aec1-49d7-abc9-4e23b61c1dcf-image-registry-private-configuration\") pod \"image-registry-6cc646db48-pv5v6\" (UID: \"bcc5fcc5-aec1-49d7-abc9-4e23b61c1dcf\") " pod="openshift-image-registry/image-registry-6cc646db48-pv5v6"
Jul 07 16:28:18.092685 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:18.092547    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bcc5fcc5-aec1-49d7-abc9-4e23b61c1dcf-registry-tls\") pod \"image-registry-6cc646db48-pv5v6\" (UID: \"bcc5fcc5-aec1-49d7-abc9-4e23b61c1dcf\") " pod="openshift-image-registry/image-registry-6cc646db48-pv5v6"
Jul 07 16:28:18.092685 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:18.092570    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnh54\" (UniqueName: \"kubernetes.io/projected/bcc5fcc5-aec1-49d7-abc9-4e23b61c1dcf-kube-api-access-qnh54\") pod \"image-registry-6cc646db48-pv5v6\" (UID: \"bcc5fcc5-aec1-49d7-abc9-4e23b61c1dcf\") " pod="openshift-image-registry/image-registry-6cc646db48-pv5v6"
Jul 07 16:28:18.092685 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:18.092605    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bcc5fcc5-aec1-49d7-abc9-4e23b61c1dcf-ca-trust-extracted\") pod \"image-registry-6cc646db48-pv5v6\" (UID: \"bcc5fcc5-aec1-49d7-abc9-4e23b61c1dcf\") " pod="openshift-image-registry/image-registry-6cc646db48-pv5v6"
Jul 07 16:28:18.093207 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:18.093184    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bcc5fcc5-aec1-49d7-abc9-4e23b61c1dcf-ca-trust-extracted\") pod \"image-registry-6cc646db48-pv5v6\" (UID: \"bcc5fcc5-aec1-49d7-abc9-4e23b61c1dcf\") " pod="openshift-image-registry/image-registry-6cc646db48-pv5v6"
Jul 07 16:28:18.093368 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:18.093331    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bcc5fcc5-aec1-49d7-abc9-4e23b61c1dcf-registry-certificates\") pod \"image-registry-6cc646db48-pv5v6\" (UID: \"bcc5fcc5-aec1-49d7-abc9-4e23b61c1dcf\") " pod="openshift-image-registry/image-registry-6cc646db48-pv5v6"
Jul 07 16:28:18.093607 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:18.093584    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bcc5fcc5-aec1-49d7-abc9-4e23b61c1dcf-trusted-ca\") pod \"image-registry-6cc646db48-pv5v6\" (UID: \"bcc5fcc5-aec1-49d7-abc9-4e23b61c1dcf\") " pod="openshift-image-registry/image-registry-6cc646db48-pv5v6"
Jul 07 16:28:18.095228 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:18.095205    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bcc5fcc5-aec1-49d7-abc9-4e23b61c1dcf-installation-pull-secrets\") pod \"image-registry-6cc646db48-pv5v6\" (UID: \"bcc5fcc5-aec1-49d7-abc9-4e23b61c1dcf\") " pod="openshift-image-registry/image-registry-6cc646db48-pv5v6"
Jul 07 16:28:18.095412 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:18.095394    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bcc5fcc5-aec1-49d7-abc9-4e23b61c1dcf-registry-tls\") pod \"image-registry-6cc646db48-pv5v6\" (UID: \"bcc5fcc5-aec1-49d7-abc9-4e23b61c1dcf\") " pod="openshift-image-registry/image-registry-6cc646db48-pv5v6"
Jul 07 16:28:18.095914 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:18.095895    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bcc5fcc5-aec1-49d7-abc9-4e23b61c1dcf-image-registry-private-configuration\") pod \"image-registry-6cc646db48-pv5v6\" (UID: \"bcc5fcc5-aec1-49d7-abc9-4e23b61c1dcf\") " pod="openshift-image-registry/image-registry-6cc646db48-pv5v6"
Jul 07 16:28:18.102107 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:18.102076    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bcc5fcc5-aec1-49d7-abc9-4e23b61c1dcf-bound-sa-token\") pod \"image-registry-6cc646db48-pv5v6\" (UID: \"bcc5fcc5-aec1-49d7-abc9-4e23b61c1dcf\") " pod="openshift-image-registry/image-registry-6cc646db48-pv5v6"
Jul 07 16:28:18.104041 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:18.103987    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnh54\" (UniqueName: \"kubernetes.io/projected/bcc5fcc5-aec1-49d7-abc9-4e23b61c1dcf-kube-api-access-qnh54\") pod \"image-registry-6cc646db48-pv5v6\" (UID: \"bcc5fcc5-aec1-49d7-abc9-4e23b61c1dcf\") " pod="openshift-image-registry/image-registry-6cc646db48-pv5v6"
Jul 07 16:28:18.191085 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:18.191057    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-wvkw2"]
Jul 07 16:28:18.193431 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:28:18.193403    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f7c0bc0_b716_4bff_92b9_5333825b6734.slice/crio-ee608ebfcf146577dd046dc2d38a8b6db716fd1674ea2d1be5129090fc66a77d WatchSource:0}: Error finding container ee608ebfcf146577dd046dc2d38a8b6db716fd1674ea2d1be5129090fc66a77d: Status 404 returned error can't find the container with id ee608ebfcf146577dd046dc2d38a8b6db716fd1674ea2d1be5129090fc66a77d
Jul 07 16:28:18.198187 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:18.198155    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cc646db48-pv5v6"
Jul 07 16:28:18.329731 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:18.329709    2578 kubelet.go:1648] "Image garbage collection succeeded"
Jul 07 16:28:18.336253 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:18.336220    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6cc646db48-pv5v6"]
Jul 07 16:28:18.340762 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:28:18.340734    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcc5fcc5_aec1_49d7_abc9_4e23b61c1dcf.slice/crio-e7ddc4c678cd9c913f218a5bb373eeb9733451f79ac014ac0bd4015be8fd4c94 WatchSource:0}: Error finding container e7ddc4c678cd9c913f218a5bb373eeb9733451f79ac014ac0bd4015be8fd4c94: Status 404 returned error can't find the container with id e7ddc4c678cd9c913f218a5bb373eeb9733451f79ac014ac0bd4015be8fd4c94
Jul 07 16:28:18.411076 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:18.411045    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-wvkw2" event={"ID":"8f7c0bc0-b716-4bff-92b9-5333825b6734","Type":"ContainerStarted","Data":"ee608ebfcf146577dd046dc2d38a8b6db716fd1674ea2d1be5129090fc66a77d"}
Jul 07 16:28:18.412719 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:18.412581    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6cc646db48-pv5v6" event={"ID":"bcc5fcc5-aec1-49d7-abc9-4e23b61c1dcf","Type":"ContainerStarted","Data":"ca2a697334fde2a7d56970c9db12be8413d84f2cf77f4ee10426e040c4e58772"}
Jul 07 16:28:18.412719 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:18.412635    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6cc646db48-pv5v6" event={"ID":"bcc5fcc5-aec1-49d7-abc9-4e23b61c1dcf","Type":"ContainerStarted","Data":"e7ddc4c678cd9c913f218a5bb373eeb9733451f79ac014ac0bd4015be8fd4c94"}
Jul 07 16:28:18.432546 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:18.432499    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6cc646db48-pv5v6" podStartSLOduration=1.432484064 podStartE2EDuration="1.432484064s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:28:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:28:18.431511813 +0000 UTC m=+300.518480465" watchObservedRunningTime="2026-07-07 16:28:18.432484064 +0000 UTC m=+300.519452499"
Jul 07 16:28:19.416821 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:19.416730    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6cc646db48-pv5v6"
Jul 07 16:28:20.109701 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:20.109653    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9ad40b4c-1d31-421e-a343-4162c9575748-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ks8pq\" (UID: \"9ad40b4c-1d31-421e-a343-4162c9575748\") " pod="openshift-insights/insights-runtime-extractor-ks8pq"
Jul 07 16:28:20.112095 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:20.112068    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9ad40b4c-1d31-421e-a343-4162c9575748-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ks8pq\" (UID: \"9ad40b4c-1d31-421e-a343-4162c9575748\") " pod="openshift-insights/insights-runtime-extractor-ks8pq"
Jul 07 16:28:20.374656 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:20.374563    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2w8q7\""
Jul 07 16:28:20.380048 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:20.380006    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ks8pq"
Jul 07 16:28:20.420970 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:20.420936    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-wvkw2" event={"ID":"8f7c0bc0-b716-4bff-92b9-5333825b6734","Type":"ContainerStarted","Data":"03dd6bb82f2dbc2691a3b269dfc7ecfc689797d28f5cc235055c17e9c079b7ec"}
Jul 07 16:28:20.421442 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:20.421191    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-wvkw2"
Jul 07 16:28:20.425885 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:20.425859    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-wvkw2"
Jul 07 16:28:20.442384 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:20.442311    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-wvkw2" podStartSLOduration=2.230195362 podStartE2EDuration="3.442295486s" totalImagesPullingTime="1.212100124s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:28:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:28:20.441179417 +0000 UTC m=+302.528147875" watchObservedRunningTime="2026-07-07 16:28:20.442295486 +0000 UTC m=+302.529263943"
Jul 07 16:28:20.527752 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:20.527723    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ks8pq"]
Jul 07 16:28:20.531055 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:28:20.531029    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ad40b4c_1d31_421e_a343_4162c9575748.slice/crio-d0ae6568093a0dead2c28535dce6d797f33750d67ccb8d5af3bb425d434b2e77 WatchSource:0}: Error finding container d0ae6568093a0dead2c28535dce6d797f33750d67ccb8d5af3bb425d434b2e77: Status 404 returned error can't find the container with id d0ae6568093a0dead2c28535dce6d797f33750d67ccb8d5af3bb425d434b2e77
Jul 07 16:28:20.532490 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:20.532464    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 16:28:20.731701 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:20.731620    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-zczcb"]
Jul 07 16:28:20.735942 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:20.735925    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-zczcb"
Jul 07 16:28:20.746600 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:20.746577    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 07 16:28:20.746732 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:20.746654    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-8l5pn\""
Jul 07 16:28:20.746784 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:20.746773    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 07 16:28:20.747176 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:20.747162    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 07 16:28:20.752763 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:20.752740    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-zczcb"]
Jul 07 16:28:20.815357 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:20.815314    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cca6e33b-7e40-456e-8f80-c5c8d81c98d8-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-zczcb\" (UID: \"cca6e33b-7e40-456e-8f80-c5c8d81c98d8\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-zczcb"
Jul 07 16:28:20.815357 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:20.815360    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smtgq\" (UniqueName: \"kubernetes.io/projected/cca6e33b-7e40-456e-8f80-c5c8d81c98d8-kube-api-access-smtgq\") pod \"prometheus-operator-567f7b8b7c-zczcb\" (UID: \"cca6e33b-7e40-456e-8f80-c5c8d81c98d8\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-zczcb"
Jul 07 16:28:20.815557 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:20.815414    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cca6e33b-7e40-456e-8f80-c5c8d81c98d8-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-zczcb\" (UID: \"cca6e33b-7e40-456e-8f80-c5c8d81c98d8\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-zczcb"
Jul 07 16:28:20.815557 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:20.815436    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/cca6e33b-7e40-456e-8f80-c5c8d81c98d8-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-zczcb\" (UID: \"cca6e33b-7e40-456e-8f80-c5c8d81c98d8\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-zczcb"
Jul 07 16:28:20.916223 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:20.916192    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cca6e33b-7e40-456e-8f80-c5c8d81c98d8-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-zczcb\" (UID: \"cca6e33b-7e40-456e-8f80-c5c8d81c98d8\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-zczcb"
Jul 07 16:28:20.916223 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:20.916229    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smtgq\" (UniqueName: \"kubernetes.io/projected/cca6e33b-7e40-456e-8f80-c5c8d81c98d8-kube-api-access-smtgq\") pod \"prometheus-operator-567f7b8b7c-zczcb\" (UID: \"cca6e33b-7e40-456e-8f80-c5c8d81c98d8\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-zczcb"
Jul 07 16:28:20.916484 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:20.916255    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cca6e33b-7e40-456e-8f80-c5c8d81c98d8-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-zczcb\" (UID: \"cca6e33b-7e40-456e-8f80-c5c8d81c98d8\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-zczcb"
Jul 07 16:28:20.916484 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:20.916458    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/cca6e33b-7e40-456e-8f80-c5c8d81c98d8-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-zczcb\" (UID: \"cca6e33b-7e40-456e-8f80-c5c8d81c98d8\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-zczcb"
Jul 07 16:28:20.916613 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:28:20.916589    2578 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 07 16:28:20.916683 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:28:20.916671    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cca6e33b-7e40-456e-8f80-c5c8d81c98d8-prometheus-operator-tls podName:cca6e33b-7e40-456e-8f80-c5c8d81c98d8 nodeName:}" failed. No retries permitted until 2026-07-07 16:28:21.416648657 +0000 UTC m=+303.503617093 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/cca6e33b-7e40-456e-8f80-c5c8d81c98d8-prometheus-operator-tls") pod "prometheus-operator-567f7b8b7c-zczcb" (UID: "cca6e33b-7e40-456e-8f80-c5c8d81c98d8") : secret "prometheus-operator-tls" not found
Jul 07 16:28:20.917039 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:20.917023    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cca6e33b-7e40-456e-8f80-c5c8d81c98d8-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-zczcb\" (UID: \"cca6e33b-7e40-456e-8f80-c5c8d81c98d8\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-zczcb"
Jul 07 16:28:20.918709 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:20.918689    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cca6e33b-7e40-456e-8f80-c5c8d81c98d8-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-zczcb\" (UID: \"cca6e33b-7e40-456e-8f80-c5c8d81c98d8\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-zczcb"
Jul 07 16:28:20.930355 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:20.930321    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-smtgq\" (UniqueName: \"kubernetes.io/projected/cca6e33b-7e40-456e-8f80-c5c8d81c98d8-kube-api-access-smtgq\") pod \"prometheus-operator-567f7b8b7c-zczcb\" (UID: \"cca6e33b-7e40-456e-8f80-c5c8d81c98d8\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-zczcb"
Jul 07 16:28:21.421675 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:21.421633    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/cca6e33b-7e40-456e-8f80-c5c8d81c98d8-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-zczcb\" (UID: \"cca6e33b-7e40-456e-8f80-c5c8d81c98d8\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-zczcb"
Jul 07 16:28:21.427658 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:21.427590    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/cca6e33b-7e40-456e-8f80-c5c8d81c98d8-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-zczcb\" (UID: \"cca6e33b-7e40-456e-8f80-c5c8d81c98d8\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-zczcb"
Jul 07 16:28:21.429507 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:21.429474    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ks8pq" event={"ID":"9ad40b4c-1d31-421e-a343-4162c9575748","Type":"ContainerStarted","Data":"d0ae6568093a0dead2c28535dce6d797f33750d67ccb8d5af3bb425d434b2e77"}
Jul 07 16:28:21.644556 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:21.644520    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-zczcb"
Jul 07 16:28:21.809770 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:21.809740    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-zczcb"]
Jul 07 16:28:21.811261 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:28:21.811233    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcca6e33b_7e40_456e_8f80_c5c8d81c98d8.slice/crio-64d14f7549050df0363f97e1dfbd41baaeda4e9ec7f22746eab621036574dd13 WatchSource:0}: Error finding container 64d14f7549050df0363f97e1dfbd41baaeda4e9ec7f22746eab621036574dd13: Status 404 returned error can't find the container with id 64d14f7549050df0363f97e1dfbd41baaeda4e9ec7f22746eab621036574dd13
Jul 07 16:28:22.434297 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:22.434259    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-zczcb" event={"ID":"cca6e33b-7e40-456e-8f80-c5c8d81c98d8","Type":"ContainerStarted","Data":"64d14f7549050df0363f97e1dfbd41baaeda4e9ec7f22746eab621036574dd13"}
Jul 07 16:28:25.449524 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:25.449480    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ks8pq" event={"ID":"9ad40b4c-1d31-421e-a343-4162c9575748","Type":"ContainerStarted","Data":"8f6d482f9fe3db79bf3b5df4feee60b1347c2f65a9547e18f35023925af69a75"}
Jul 07 16:28:25.451819 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:25.451779    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-zczcb" event={"ID":"cca6e33b-7e40-456e-8f80-c5c8d81c98d8","Type":"ContainerStarted","Data":"8c06de9a000ae47ff1c969d1de24fadb7e017413c7e531796aa4737c8e8b762b"}
Jul 07 16:28:25.452011 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:25.451850    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-zczcb" event={"ID":"cca6e33b-7e40-456e-8f80-c5c8d81c98d8","Type":"ContainerStarted","Data":"dfe32efa47f677b56504794432f7165993d14566edfc0b33d120492e495687bd"}
Jul 07 16:28:25.489458 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:25.489319    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-zczcb" podStartSLOduration=2.161205512 podStartE2EDuration="5.489301207s" totalImagesPullingTime="3.328095695s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:28:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:28:25.486614344 +0000 UTC m=+307.573582818" watchObservedRunningTime="2026-07-07 16:28:25.489301207 +0000 UTC m=+307.576269664"
Jul 07 16:28:26.459775 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:26.459732    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ks8pq" event={"ID":"9ad40b4c-1d31-421e-a343-4162c9575748","Type":"ContainerStarted","Data":"6acf4b63eecfef02f519771d2c507313bba01928957746c596afced5112a71a3"}
Jul 07 16:28:27.561138 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:27.561098    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-s8bvv"]
Jul 07 16:28:27.569692 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:27.569668    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-s8bvv"
Jul 07 16:28:27.572262 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:27.572231    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 07 16:28:27.572432 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:27.572381    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-jxggr\""
Jul 07 16:28:27.572432 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:27.572411    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 07 16:28:27.573224 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:27.573198    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 07 16:28:27.675924 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:27.675887    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/349e522c-90e5-4667-a3f0-14208cdcb868-node-exporter-textfile\") pod \"node-exporter-s8bvv\" (UID: \"349e522c-90e5-4667-a3f0-14208cdcb868\") " pod="openshift-monitoring/node-exporter-s8bvv"
Jul 07 16:28:27.676114 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:27.675936    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/349e522c-90e5-4667-a3f0-14208cdcb868-sys\") pod \"node-exporter-s8bvv\" (UID: \"349e522c-90e5-4667-a3f0-14208cdcb868\") " pod="openshift-monitoring/node-exporter-s8bvv"
Jul 07 16:28:27.676114 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:27.676036    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9g55q\" (UniqueName: \"kubernetes.io/projected/349e522c-90e5-4667-a3f0-14208cdcb868-kube-api-access-9g55q\") pod \"node-exporter-s8bvv\" (UID: \"349e522c-90e5-4667-a3f0-14208cdcb868\") " pod="openshift-monitoring/node-exporter-s8bvv"
Jul 07 16:28:27.676114 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:27.676074    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/349e522c-90e5-4667-a3f0-14208cdcb868-node-exporter-wtmp\") pod \"node-exporter-s8bvv\" (UID: \"349e522c-90e5-4667-a3f0-14208cdcb868\") " pod="openshift-monitoring/node-exporter-s8bvv"
Jul 07 16:28:27.676286 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:27.676113    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/349e522c-90e5-4667-a3f0-14208cdcb868-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s8bvv\" (UID: \"349e522c-90e5-4667-a3f0-14208cdcb868\") " pod="openshift-monitoring/node-exporter-s8bvv"
Jul 07 16:28:27.676286 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:27.676141    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/349e522c-90e5-4667-a3f0-14208cdcb868-node-exporter-accelerators-collector-config\") pod \"node-exporter-s8bvv\" (UID: \"349e522c-90e5-4667-a3f0-14208cdcb868\") " pod="openshift-monitoring/node-exporter-s8bvv"
Jul 07 16:28:27.676286 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:27.676171    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/349e522c-90e5-4667-a3f0-14208cdcb868-node-exporter-tls\") pod \"node-exporter-s8bvv\" (UID: \"349e522c-90e5-4667-a3f0-14208cdcb868\") " pod="openshift-monitoring/node-exporter-s8bvv"
Jul 07 16:28:27.676286 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:27.676221    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/349e522c-90e5-4667-a3f0-14208cdcb868-root\") pod \"node-exporter-s8bvv\" (UID: \"349e522c-90e5-4667-a3f0-14208cdcb868\") " pod="openshift-monitoring/node-exporter-s8bvv"
Jul 07 16:28:27.676286 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:27.676277    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/349e522c-90e5-4667-a3f0-14208cdcb868-metrics-client-ca\") pod \"node-exporter-s8bvv\" (UID: \"349e522c-90e5-4667-a3f0-14208cdcb868\") " pod="openshift-monitoring/node-exporter-s8bvv"
Jul 07 16:28:27.749688 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:27.749662    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-d9d6b4cbf-xmnvf"
Jul 07 16:28:27.777578 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:27.777539    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/349e522c-90e5-4667-a3f0-14208cdcb868-node-exporter-tls\") pod \"node-exporter-s8bvv\" (UID: \"349e522c-90e5-4667-a3f0-14208cdcb868\") " pod="openshift-monitoring/node-exporter-s8bvv"
Jul 07 16:28:27.777760 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:27.777694    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/349e522c-90e5-4667-a3f0-14208cdcb868-root\") pod \"node-exporter-s8bvv\" (UID: \"349e522c-90e5-4667-a3f0-14208cdcb868\") " pod="openshift-monitoring/node-exporter-s8bvv"
Jul 07 16:28:27.777837 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:27.777787    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/349e522c-90e5-4667-a3f0-14208cdcb868-root\") pod \"node-exporter-s8bvv\" (UID: \"349e522c-90e5-4667-a3f0-14208cdcb868\") " pod="openshift-monitoring/node-exporter-s8bvv"
Jul 07 16:28:27.777837 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:27.777820    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/349e522c-90e5-4667-a3f0-14208cdcb868-metrics-client-ca\") pod \"node-exporter-s8bvv\" (UID: \"349e522c-90e5-4667-a3f0-14208cdcb868\") " pod="openshift-monitoring/node-exporter-s8bvv"
Jul 07 16:28:27.777941 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:27.777854    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/349e522c-90e5-4667-a3f0-14208cdcb868-node-exporter-textfile\") pod \"node-exporter-s8bvv\" (UID: \"349e522c-90e5-4667-a3f0-14208cdcb868\") " pod="openshift-monitoring/node-exporter-s8bvv"
Jul 07 16:28:27.777941 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:27.777874    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/349e522c-90e5-4667-a3f0-14208cdcb868-sys\") pod \"node-exporter-s8bvv\" (UID: \"349e522c-90e5-4667-a3f0-14208cdcb868\") " pod="openshift-monitoring/node-exporter-s8bvv"
Jul 07 16:28:27.777941 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:27.777920    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9g55q\" (UniqueName: \"kubernetes.io/projected/349e522c-90e5-4667-a3f0-14208cdcb868-kube-api-access-9g55q\") pod \"node-exporter-s8bvv\" (UID: \"349e522c-90e5-4667-a3f0-14208cdcb868\") " pod="openshift-monitoring/node-exporter-s8bvv"
Jul 07 16:28:27.778090 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:27.777945    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/349e522c-90e5-4667-a3f0-14208cdcb868-node-exporter-wtmp\") pod \"node-exporter-s8bvv\" (UID: \"349e522c-90e5-4667-a3f0-14208cdcb868\") " pod="openshift-monitoring/node-exporter-s8bvv"
Jul 07 16:28:27.778090 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:27.778004    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/349e522c-90e5-4667-a3f0-14208cdcb868-sys\") pod \"node-exporter-s8bvv\" (UID: \"349e522c-90e5-4667-a3f0-14208cdcb868\") " pod="openshift-monitoring/node-exporter-s8bvv"
Jul 07 16:28:27.778090 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:27.778061    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/349e522c-90e5-4667-a3f0-14208cdcb868-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s8bvv\" (UID: \"349e522c-90e5-4667-a3f0-14208cdcb868\") " pod="openshift-monitoring/node-exporter-s8bvv"
Jul 07 16:28:27.778233 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:27.778091    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/349e522c-90e5-4667-a3f0-14208cdcb868-node-exporter-wtmp\") pod \"node-exporter-s8bvv\" (UID: \"349e522c-90e5-4667-a3f0-14208cdcb868\") " pod="openshift-monitoring/node-exporter-s8bvv"
Jul 07 16:28:27.778233 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:27.778093    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/349e522c-90e5-4667-a3f0-14208cdcb868-node-exporter-accelerators-collector-config\") pod \"node-exporter-s8bvv\" (UID: \"349e522c-90e5-4667-a3f0-14208cdcb868\") " pod="openshift-monitoring/node-exporter-s8bvv"
Jul 07 16:28:27.778377 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:27.778266    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/349e522c-90e5-4667-a3f0-14208cdcb868-node-exporter-textfile\") pod \"node-exporter-s8bvv\" (UID: \"349e522c-90e5-4667-a3f0-14208cdcb868\") " pod="openshift-monitoring/node-exporter-s8bvv"
Jul 07 16:28:27.778515 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:27.778463    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/349e522c-90e5-4667-a3f0-14208cdcb868-metrics-client-ca\") pod \"node-exporter-s8bvv\" (UID: \"349e522c-90e5-4667-a3f0-14208cdcb868\") " pod="openshift-monitoring/node-exporter-s8bvv"
Jul 07 16:28:27.778659 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:27.778612    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/349e522c-90e5-4667-a3f0-14208cdcb868-node-exporter-accelerators-collector-config\") pod \"node-exporter-s8bvv\" (UID: \"349e522c-90e5-4667-a3f0-14208cdcb868\") " pod="openshift-monitoring/node-exporter-s8bvv"
Jul 07 16:28:27.780275 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:27.780253    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/349e522c-90e5-4667-a3f0-14208cdcb868-node-exporter-tls\") pod \"node-exporter-s8bvv\" (UID: \"349e522c-90e5-4667-a3f0-14208cdcb868\") " pod="openshift-monitoring/node-exporter-s8bvv"
Jul 07 16:28:27.780592 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:27.780568    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/349e522c-90e5-4667-a3f0-14208cdcb868-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s8bvv\" (UID: \"349e522c-90e5-4667-a3f0-14208cdcb868\") " pod="openshift-monitoring/node-exporter-s8bvv"
Jul 07 16:28:27.794107 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:27.794074    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9g55q\" (UniqueName: \"kubernetes.io/projected/349e522c-90e5-4667-a3f0-14208cdcb868-kube-api-access-9g55q\") pod \"node-exporter-s8bvv\" (UID: \"349e522c-90e5-4667-a3f0-14208cdcb868\") " pod="openshift-monitoring/node-exporter-s8bvv"
Jul 07 16:28:27.880937 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:27.880899    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-s8bvv"
Jul 07 16:28:28.085329 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:28:28.085289    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod349e522c_90e5_4667_a3f0_14208cdcb868.slice/crio-b84ac66eec4e236c1203f0f7ecea10ef0164486896e5588642d02215bf7ac59d WatchSource:0}: Error finding container b84ac66eec4e236c1203f0f7ecea10ef0164486896e5588642d02215bf7ac59d: Status 404 returned error can't find the container with id b84ac66eec4e236c1203f0f7ecea10ef0164486896e5588642d02215bf7ac59d
Jul 07 16:28:28.470391 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:28.470279    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ks8pq" event={"ID":"9ad40b4c-1d31-421e-a343-4162c9575748","Type":"ContainerStarted","Data":"f5cd6cf0a32449d722d0a10c7db700da31194b6dcc587cced9f21b10f1c74a9d"}
Jul 07 16:28:28.471547 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:28.471518    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s8bvv" event={"ID":"349e522c-90e5-4667-a3f0-14208cdcb868","Type":"ContainerStarted","Data":"b84ac66eec4e236c1203f0f7ecea10ef0164486896e5588642d02215bf7ac59d"}
Jul 07 16:28:28.519535 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:28.519472    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ks8pq" podStartSLOduration=33.063482637 podStartE2EDuration="40.519452568s" totalImagesPullingTime="7.455969931s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:27:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:28:28.517886023 +0000 UTC m=+310.604854484" watchObservedRunningTime="2026-07-07 16:28:28.519452568 +0000 UTC m=+310.606421027"
Jul 07 16:28:29.477524 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:29.477487    2578 generic.go:356] "Generic (PLEG): container finished" podID="349e522c-90e5-4667-a3f0-14208cdcb868" containerID="2bc81adfb801340fe27d235a73650eb37db1b272af250f20834c19f39b2b626c" exitCode=0
Jul 07 16:28:29.478051 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:29.477562    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s8bvv" event={"ID":"349e522c-90e5-4667-a3f0-14208cdcb868","Type":"ContainerDied","Data":"2bc81adfb801340fe27d235a73650eb37db1b272af250f20834c19f39b2b626c"}
Jul 07 16:28:29.508380 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:29.508339    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9sc2w"
Jul 07 16:28:30.483056 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:30.483015    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s8bvv" event={"ID":"349e522c-90e5-4667-a3f0-14208cdcb868","Type":"ContainerStarted","Data":"4074d4377d17fea73ca78055b17995c0c0f3f9df327c6cc1eaa2b91da90413c7"}
Jul 07 16:28:30.483475 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:30.483081    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s8bvv" event={"ID":"349e522c-90e5-4667-a3f0-14208cdcb868","Type":"ContainerStarted","Data":"fa53937943f1951c9ca0839e18abcabfd98d98fc140811c5695c4f7d695407f9"}
Jul 07 16:28:30.543902 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:30.543823    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-s8bvv" podStartSLOduration=2.314962582 podStartE2EDuration="3.543804592s" totalImagesPullingTime="1.161160972s" totalInitContainerRuntime="67.681038ms" isStatefulPod=true podCreationTimestamp="2026-07-07 16:28:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:28:30.543330345 +0000 UTC m=+312.630298803" watchObservedRunningTime="2026-07-07 16:28:30.543804592 +0000 UTC m=+312.630773049"
Jul 07 16:28:31.963980 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:31.963948    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-84cct"]
Jul 07 16:28:31.967246 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:31.967228    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-84cct"
Jul 07 16:28:31.972100 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:31.972072    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 07 16:28:31.972268 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:31.972174    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-sx9fs\""
Jul 07 16:28:31.999608 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:31.999566    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-84cct"]
Jul 07 16:28:32.114393 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:32.114332    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2x5k\" (UniqueName: \"kubernetes.io/projected/f7defa20-fc0d-4ff6-bf3f-5553b40961f0-kube-api-access-v2x5k\") pod \"monitoring-plugin-d5dcff7cf-84cct\" (UID: \"f7defa20-fc0d-4ff6-bf3f-5553b40961f0\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-84cct"
Jul 07 16:28:32.114578 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:32.114467    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f7defa20-fc0d-4ff6-bf3f-5553b40961f0-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-84cct\" (UID: \"f7defa20-fc0d-4ff6-bf3f-5553b40961f0\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-84cct"
Jul 07 16:28:32.215131 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:32.215035    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2x5k\" (UniqueName: \"kubernetes.io/projected/f7defa20-fc0d-4ff6-bf3f-5553b40961f0-kube-api-access-v2x5k\") pod \"monitoring-plugin-d5dcff7cf-84cct\" (UID: \"f7defa20-fc0d-4ff6-bf3f-5553b40961f0\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-84cct"
Jul 07 16:28:32.215131 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:32.215105    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f7defa20-fc0d-4ff6-bf3f-5553b40961f0-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-84cct\" (UID: \"f7defa20-fc0d-4ff6-bf3f-5553b40961f0\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-84cct"
Jul 07 16:28:32.217540 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:32.217507    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f7defa20-fc0d-4ff6-bf3f-5553b40961f0-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-84cct\" (UID: \"f7defa20-fc0d-4ff6-bf3f-5553b40961f0\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-84cct"
Jul 07 16:28:32.241402 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:32.241366    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2x5k\" (UniqueName: \"kubernetes.io/projected/f7defa20-fc0d-4ff6-bf3f-5553b40961f0-kube-api-access-v2x5k\") pod \"monitoring-plugin-d5dcff7cf-84cct\" (UID: \"f7defa20-fc0d-4ff6-bf3f-5553b40961f0\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-84cct"
Jul 07 16:28:32.276448 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:32.276409    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-84cct"
Jul 07 16:28:32.437030 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:32.436992    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-84cct"]
Jul 07 16:28:32.440096 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:28:32.440062    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7defa20_fc0d_4ff6_bf3f_5553b40961f0.slice/crio-af0bd2066dc5f0bd7308556ec8066b00e58b2c0f32801931dfd488ab31dc4223 WatchSource:0}: Error finding container af0bd2066dc5f0bd7308556ec8066b00e58b2c0f32801931dfd488ab31dc4223: Status 404 returned error can't find the container with id af0bd2066dc5f0bd7308556ec8066b00e58b2c0f32801931dfd488ab31dc4223
Jul 07 16:28:32.490439 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:32.490331    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-84cct" event={"ID":"f7defa20-fc0d-4ff6-bf3f-5553b40961f0","Type":"ContainerStarted","Data":"af0bd2066dc5f0bd7308556ec8066b00e58b2c0f32801931dfd488ab31dc4223"}
Jul 07 16:28:34.499547 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.499454    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-84cct" event={"ID":"f7defa20-fc0d-4ff6-bf3f-5553b40961f0","Type":"ContainerStarted","Data":"fb33414b15ee5f4b4e46f1eb7a1c7d57fbcfee1a65e3ba673d21aa412a85369d"}
Jul 07 16:28:34.500083 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.499617    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-84cct"
Jul 07 16:28:34.504834 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.504802    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-84cct"
Jul 07 16:28:34.534759 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.534702    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-84cct" podStartSLOduration=1.75012051 podStartE2EDuration="3.534686452s" totalImagesPullingTime="1.784565942s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:28:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:28:34.534164147 +0000 UTC m=+316.621132617" watchObservedRunningTime="2026-07-07 16:28:34.534686452 +0000 UTC m=+316.621654910"
Jul 07 16:28:34.673425 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.673380    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 16:28:34.677138 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.677108    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:28:34.683845 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.683190    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 07 16:28:34.683845 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.683374    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 07 16:28:34.683845 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.683462    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 07 16:28:34.683845 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.683597    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 07 16:28:34.683845 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.683662    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 07 16:28:34.683845 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.683842    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 07 16:28:34.684262 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.684002    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 07 16:28:34.684262 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.684059    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-bnsshpukssp67\""
Jul 07 16:28:34.684262 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.684073    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 07 16:28:34.684262 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.684123    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 07 16:28:34.685124 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.684893    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 07 16:28:34.685124 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.684909    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 07 16:28:34.685124 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.684942    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 07 16:28:34.685124 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.685015    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-jm6rn\""
Jul 07 16:28:34.686976 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.686908    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 07 16:28:34.693110 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.693088    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 07 16:28:34.693327 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.693311    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 07 16:28:34.709839 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.709799    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 16:28:34.837476 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.837435    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a2916de3-ae2c-4839-8a1c-94866aabb272-config\") pod \"prometheus-k8s-0\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:28:34.837476 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.837480    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a2916de3-ae2c-4839-8a1c-94866aabb272-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:28:34.837714 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.837507    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a2916de3-ae2c-4839-8a1c-94866aabb272-config-out\") pod \"prometheus-k8s-0\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:28:34.837714 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.837606    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a2916de3-ae2c-4839-8a1c-94866aabb272-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:28:34.837714 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.837657    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a2916de3-ae2c-4839-8a1c-94866aabb272-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:28:34.837714 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.837683    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a2916de3-ae2c-4839-8a1c-94866aabb272-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:28:34.837885 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.837715    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a2916de3-ae2c-4839-8a1c-94866aabb272-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:28:34.837885 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.837742    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a2916de3-ae2c-4839-8a1c-94866aabb272-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:28:34.837885 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.837780    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2916de3-ae2c-4839-8a1c-94866aabb272-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:28:34.837885 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.837810    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2916de3-ae2c-4839-8a1c-94866aabb272-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:28:34.837885 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.837834    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a2916de3-ae2c-4839-8a1c-94866aabb272-web-config\") pod \"prometheus-k8s-0\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:28:34.837885 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.837866    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2916de3-ae2c-4839-8a1c-94866aabb272-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:28:34.838147 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.837929    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a2916de3-ae2c-4839-8a1c-94866aabb272-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:28:34.838147 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.837976    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a2916de3-ae2c-4839-8a1c-94866aabb272-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:28:34.838147 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.838004    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a2916de3-ae2c-4839-8a1c-94866aabb272-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:28:34.838147 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.838029    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a2916de3-ae2c-4839-8a1c-94866aabb272-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:28:34.838147 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.838124    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7985f\" (UniqueName: \"kubernetes.io/projected/a2916de3-ae2c-4839-8a1c-94866aabb272-kube-api-access-7985f\") pod \"prometheus-k8s-0\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:28:34.838308 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.838153    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a2916de3-ae2c-4839-8a1c-94866aabb272-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:28:34.838308 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.838169    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a2916de3-ae2c-4839-8a1c-94866aabb272-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:28:34.838308 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.838194    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a2916de3-ae2c-4839-8a1c-94866aabb272-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:28:34.939694 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.939634    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a2916de3-ae2c-4839-8a1c-94866aabb272-config\") pod \"prometheus-k8s-0\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:28:34.939867 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.939700    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a2916de3-ae2c-4839-8a1c-94866aabb272-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:28:34.939867 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.939728    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a2916de3-ae2c-4839-8a1c-94866aabb272-config-out\") pod \"prometheus-k8s-0\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:28:34.939867 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.939780    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a2916de3-ae2c-4839-8a1c-94866aabb272-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:28:34.939867 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.939823    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a2916de3-ae2c-4839-8a1c-94866aabb272-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:28:34.939867 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.939849    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a2916de3-ae2c-4839-8a1c-94866aabb272-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:28:34.940584 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.939877    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a2916de3-ae2c-4839-8a1c-94866aabb272-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:28:34.940584 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.939904    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a2916de3-ae2c-4839-8a1c-94866aabb272-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:28:34.940584 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.939933    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2916de3-ae2c-4839-8a1c-94866aabb272-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:28:34.940584 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.939957    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2916de3-ae2c-4839-8a1c-94866aabb272-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:28:34.940584 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.939980    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a2916de3-ae2c-4839-8a1c-94866aabb272-web-config\") pod \"prometheus-k8s-0\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:28:34.940584 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.940008    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2916de3-ae2c-4839-8a1c-94866aabb272-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:28:34.940584 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.940042    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a2916de3-ae2c-4839-8a1c-94866aabb272-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:28:34.940584 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.940073    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a2916de3-ae2c-4839-8a1c-94866aabb272-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:28:34.940584 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.940100    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a2916de3-ae2c-4839-8a1c-94866aabb272-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:28:34.940584 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.940125    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a2916de3-ae2c-4839-8a1c-94866aabb272-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:28:34.940584 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.940175    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7985f\" (UniqueName: \"kubernetes.io/projected/a2916de3-ae2c-4839-8a1c-94866aabb272-kube-api-access-7985f\") pod \"prometheus-k8s-0\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:28:34.940584 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.940204    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a2916de3-ae2c-4839-8a1c-94866aabb272-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:28:34.940584 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.940202    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a2916de3-ae2c-4839-8a1c-94866aabb272-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:28:34.940584 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.940226    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a2916de3-ae2c-4839-8a1c-94866aabb272-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:28:34.941288 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.940255    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a2916de3-ae2c-4839-8a1c-94866aabb272-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:28:34.941288 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.940856    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a2916de3-ae2c-4839-8a1c-94866aabb272-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:28:34.945373 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.943179    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2916de3-ae2c-4839-8a1c-94866aabb272-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:28:34.945373 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.943523    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a2916de3-ae2c-4839-8a1c-94866aabb272-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:28:34.945373 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.943860    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2916de3-ae2c-4839-8a1c-94866aabb272-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:28:34.945373 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.944647    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a2916de3-ae2c-4839-8a1c-94866aabb272-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:28:34.945373 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.944874    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2916de3-ae2c-4839-8a1c-94866aabb272-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:28:34.945373 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.945102    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a2916de3-ae2c-4839-8a1c-94866aabb272-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:28:34.945373 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.945285    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a2916de3-ae2c-4839-8a1c-94866aabb272-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:28:34.945822 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.945570    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a2916de3-ae2c-4839-8a1c-94866aabb272-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:28:34.945874 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.945835    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a2916de3-ae2c-4839-8a1c-94866aabb272-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:28:34.945975 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.945953    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a2916de3-ae2c-4839-8a1c-94866aabb272-config-out\") pod \"prometheus-k8s-0\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:28:34.946995 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.946451    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a2916de3-ae2c-4839-8a1c-94866aabb272-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:28:34.946995 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.946950    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a2916de3-ae2c-4839-8a1c-94866aabb272-config\") pod \"prometheus-k8s-0\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:28:34.947971 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.947947    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a2916de3-ae2c-4839-8a1c-94866aabb272-web-config\") pod \"prometheus-k8s-0\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:28:34.948317 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.948291    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a2916de3-ae2c-4839-8a1c-94866aabb272-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:28:34.948317 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.948308    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a2916de3-ae2c-4839-8a1c-94866aabb272-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:28:34.948963 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.948937    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a2916de3-ae2c-4839-8a1c-94866aabb272-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:28:34.949045 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.949023    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a2916de3-ae2c-4839-8a1c-94866aabb272-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:28:34.958115 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.957785    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7985f\" (UniqueName: \"kubernetes.io/projected/a2916de3-ae2c-4839-8a1c-94866aabb272-kube-api-access-7985f\") pod \"prometheus-k8s-0\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:28:34.990179 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:34.990077    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:28:35.161104 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:35.161080    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 16:28:35.161729 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:28:35.161706    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2916de3_ae2c_4839_8a1c_94866aabb272.slice/crio-cea45afa7f01b299d96679734645f0b85d48b2ff581398cbe8dd03cb8c268331 WatchSource:0}: Error finding container cea45afa7f01b299d96679734645f0b85d48b2ff581398cbe8dd03cb8c268331: Status 404 returned error can't find the container with id cea45afa7f01b299d96679734645f0b85d48b2ff581398cbe8dd03cb8c268331
Jul 07 16:28:35.504635 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:35.504545    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a2916de3-ae2c-4839-8a1c-94866aabb272","Type":"ContainerStarted","Data":"cea45afa7f01b299d96679734645f0b85d48b2ff581398cbe8dd03cb8c268331"}
Jul 07 16:28:37.514335 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:37.514296    2578 generic.go:356] "Generic (PLEG): container finished" podID="a2916de3-ae2c-4839-8a1c-94866aabb272" containerID="3bbfc2aaf5ef7d32494a3b8f59fb59e8cd7439ce01036d728fd62446aef67daf" exitCode=0
Jul 07 16:28:37.514732 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:37.514383    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a2916de3-ae2c-4839-8a1c-94866aabb272","Type":"ContainerDied","Data":"3bbfc2aaf5ef7d32494a3b8f59fb59e8cd7439ce01036d728fd62446aef67daf"}
Jul 07 16:28:40.427792 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:40.427762    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6cc646db48-pv5v6"
Jul 07 16:28:41.533109 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:41.533017    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a2916de3-ae2c-4839-8a1c-94866aabb272","Type":"ContainerStarted","Data":"1092ee7562686dff831e782f147d03d8a34d16bf2c217685ee5e7c252b8d3150"}
Jul 07 16:28:41.533109 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:41.533098    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a2916de3-ae2c-4839-8a1c-94866aabb272","Type":"ContainerStarted","Data":"043e1868ed9db5734766434354d8a0a75b3c8fdd6ac970139e19dee1d210320c"}
Jul 07 16:28:42.769934 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:42.769887    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-d9d6b4cbf-xmnvf" podUID="34272f85-199c-456f-a0ff-f7fad01b6d33" containerName="registry" containerID="cri-o://ac36b1b052c2429bf3f2707b5421ed59860dc376a0dd19b57e3db44f88570b47" gracePeriod=30
Jul 07 16:28:43.047208 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:43.047175    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d9d6b4cbf-xmnvf"
Jul 07 16:28:43.110856 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:43.110775    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/34272f85-199c-456f-a0ff-f7fad01b6d33-ca-trust-extracted\") pod \"34272f85-199c-456f-a0ff-f7fad01b6d33\" (UID: \"34272f85-199c-456f-a0ff-f7fad01b6d33\") "
Jul 07 16:28:43.110856 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:43.110829    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nwvxj\" (UniqueName: \"kubernetes.io/projected/34272f85-199c-456f-a0ff-f7fad01b6d33-kube-api-access-nwvxj\") pod \"34272f85-199c-456f-a0ff-f7fad01b6d33\" (UID: \"34272f85-199c-456f-a0ff-f7fad01b6d33\") "
Jul 07 16:28:43.111107 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:43.110870    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/34272f85-199c-456f-a0ff-f7fad01b6d33-trusted-ca\") pod \"34272f85-199c-456f-a0ff-f7fad01b6d33\" (UID: \"34272f85-199c-456f-a0ff-f7fad01b6d33\") "
Jul 07 16:28:43.111107 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:43.110910    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/34272f85-199c-456f-a0ff-f7fad01b6d33-registry-certificates\") pod \"34272f85-199c-456f-a0ff-f7fad01b6d33\" (UID: \"34272f85-199c-456f-a0ff-f7fad01b6d33\") "
Jul 07 16:28:43.111107 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:43.110967    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/34272f85-199c-456f-a0ff-f7fad01b6d33-registry-tls\") pod \"34272f85-199c-456f-a0ff-f7fad01b6d33\" (UID: \"34272f85-199c-456f-a0ff-f7fad01b6d33\") "
Jul 07 16:28:43.111107 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:43.111000    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/34272f85-199c-456f-a0ff-f7fad01b6d33-image-registry-private-configuration\") pod \"34272f85-199c-456f-a0ff-f7fad01b6d33\" (UID: \"34272f85-199c-456f-a0ff-f7fad01b6d33\") "
Jul 07 16:28:43.111107 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:43.111022    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/34272f85-199c-456f-a0ff-f7fad01b6d33-bound-sa-token\") pod \"34272f85-199c-456f-a0ff-f7fad01b6d33\" (UID: \"34272f85-199c-456f-a0ff-f7fad01b6d33\") "
Jul 07 16:28:43.111854 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:43.111394    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34272f85-199c-456f-a0ff-f7fad01b6d33-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "34272f85-199c-456f-a0ff-f7fad01b6d33" (UID: "34272f85-199c-456f-a0ff-f7fad01b6d33"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 16:28:43.111854 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:43.111443    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/34272f85-199c-456f-a0ff-f7fad01b6d33-installation-pull-secrets\") pod \"34272f85-199c-456f-a0ff-f7fad01b6d33\" (UID: \"34272f85-199c-456f-a0ff-f7fad01b6d33\") "
Jul 07 16:28:43.111854 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:43.111493    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34272f85-199c-456f-a0ff-f7fad01b6d33-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "34272f85-199c-456f-a0ff-f7fad01b6d33" (UID: "34272f85-199c-456f-a0ff-f7fad01b6d33"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 16:28:43.111854 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:43.111795    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/34272f85-199c-456f-a0ff-f7fad01b6d33-trusted-ca\") on node \"ip-10-0-129-6.ec2.internal\" DevicePath \"\""
Jul 07 16:28:43.111854 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:43.111817    2578 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/34272f85-199c-456f-a0ff-f7fad01b6d33-registry-certificates\") on node \"ip-10-0-129-6.ec2.internal\" DevicePath \"\""
Jul 07 16:28:43.114014 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:43.113982    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34272f85-199c-456f-a0ff-f7fad01b6d33-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "34272f85-199c-456f-a0ff-f7fad01b6d33" (UID: "34272f85-199c-456f-a0ff-f7fad01b6d33"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:28:43.114143 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:43.114030    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34272f85-199c-456f-a0ff-f7fad01b6d33-kube-api-access-nwvxj" (OuterVolumeSpecName: "kube-api-access-nwvxj") pod "34272f85-199c-456f-a0ff-f7fad01b6d33" (UID: "34272f85-199c-456f-a0ff-f7fad01b6d33"). InnerVolumeSpecName "kube-api-access-nwvxj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:28:43.114143 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:43.114029    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34272f85-199c-456f-a0ff-f7fad01b6d33-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "34272f85-199c-456f-a0ff-f7fad01b6d33" (UID: "34272f85-199c-456f-a0ff-f7fad01b6d33"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:28:43.114597 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:43.114568    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34272f85-199c-456f-a0ff-f7fad01b6d33-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "34272f85-199c-456f-a0ff-f7fad01b6d33" (UID: "34272f85-199c-456f-a0ff-f7fad01b6d33"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:28:43.114854 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:43.114816    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34272f85-199c-456f-a0ff-f7fad01b6d33-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "34272f85-199c-456f-a0ff-f7fad01b6d33" (UID: "34272f85-199c-456f-a0ff-f7fad01b6d33"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:28:43.122449 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:43.122402    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34272f85-199c-456f-a0ff-f7fad01b6d33-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "34272f85-199c-456f-a0ff-f7fad01b6d33" (UID: "34272f85-199c-456f-a0ff-f7fad01b6d33"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:28:43.212716 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:43.212679    2578 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/34272f85-199c-456f-a0ff-f7fad01b6d33-ca-trust-extracted\") on node \"ip-10-0-129-6.ec2.internal\" DevicePath \"\""
Jul 07 16:28:43.212716 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:43.212711    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nwvxj\" (UniqueName: \"kubernetes.io/projected/34272f85-199c-456f-a0ff-f7fad01b6d33-kube-api-access-nwvxj\") on node \"ip-10-0-129-6.ec2.internal\" DevicePath \"\""
Jul 07 16:28:43.212716 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:43.212721    2578 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/34272f85-199c-456f-a0ff-f7fad01b6d33-registry-tls\") on node \"ip-10-0-129-6.ec2.internal\" DevicePath \"\""
Jul 07 16:28:43.213033 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:43.212730    2578 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/34272f85-199c-456f-a0ff-f7fad01b6d33-image-registry-private-configuration\") on node \"ip-10-0-129-6.ec2.internal\" DevicePath \"\""
Jul 07 16:28:43.213033 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:43.212741    2578 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/34272f85-199c-456f-a0ff-f7fad01b6d33-bound-sa-token\") on node \"ip-10-0-129-6.ec2.internal\" DevicePath \"\""
Jul 07 16:28:43.213033 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:43.212755    2578 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/34272f85-199c-456f-a0ff-f7fad01b6d33-installation-pull-secrets\") on node \"ip-10-0-129-6.ec2.internal\" DevicePath \"\""
Jul 07 16:28:43.542708 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:43.542676    2578 generic.go:356] "Generic (PLEG): container finished" podID="34272f85-199c-456f-a0ff-f7fad01b6d33" containerID="ac36b1b052c2429bf3f2707b5421ed59860dc376a0dd19b57e3db44f88570b47" exitCode=0
Jul 07 16:28:43.542917 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:43.542731    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d9d6b4cbf-xmnvf"
Jul 07 16:28:43.542917 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:43.542733    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d9d6b4cbf-xmnvf" event={"ID":"34272f85-199c-456f-a0ff-f7fad01b6d33","Type":"ContainerDied","Data":"ac36b1b052c2429bf3f2707b5421ed59860dc376a0dd19b57e3db44f88570b47"}
Jul 07 16:28:43.542917 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:43.542850    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d9d6b4cbf-xmnvf" event={"ID":"34272f85-199c-456f-a0ff-f7fad01b6d33","Type":"ContainerDied","Data":"4c7e2881c5ebc3832602e5639484cf6fc35a8080aeb6bc93720b19ab7d57fa6b"}
Jul 07 16:28:43.542917 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:43.542889    2578 scope.go:117] "RemoveContainer" containerID="ac36b1b052c2429bf3f2707b5421ed59860dc376a0dd19b57e3db44f88570b47"
Jul 07 16:28:43.567073 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:43.567037    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-d9d6b4cbf-xmnvf"]
Jul 07 16:28:43.573001 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:43.572957    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-d9d6b4cbf-xmnvf"]
Jul 07 16:28:43.844322 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:43.844247    2578 scope.go:117] "RemoveContainer" containerID="ac36b1b052c2429bf3f2707b5421ed59860dc376a0dd19b57e3db44f88570b47"
Jul 07 16:28:43.844697 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:28:43.844635    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac36b1b052c2429bf3f2707b5421ed59860dc376a0dd19b57e3db44f88570b47\": container with ID starting with ac36b1b052c2429bf3f2707b5421ed59860dc376a0dd19b57e3db44f88570b47 not found: ID does not exist" containerID="ac36b1b052c2429bf3f2707b5421ed59860dc376a0dd19b57e3db44f88570b47"
Jul 07 16:28:43.844772 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:43.844667    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac36b1b052c2429bf3f2707b5421ed59860dc376a0dd19b57e3db44f88570b47"} err="failed to get container status \"ac36b1b052c2429bf3f2707b5421ed59860dc376a0dd19b57e3db44f88570b47\": rpc error: code = NotFound desc = could not find container \"ac36b1b052c2429bf3f2707b5421ed59860dc376a0dd19b57e3db44f88570b47\": container with ID starting with ac36b1b052c2429bf3f2707b5421ed59860dc376a0dd19b57e3db44f88570b47 not found: ID does not exist"
Jul 07 16:28:44.513925 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:44.513848    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34272f85-199c-456f-a0ff-f7fad01b6d33" path="/var/lib/kubelet/pods/34272f85-199c-456f-a0ff-f7fad01b6d33/volumes"
Jul 07 16:28:44.550220 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:44.550185    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a2916de3-ae2c-4839-8a1c-94866aabb272","Type":"ContainerStarted","Data":"b08cc378046bcded5dc2765aef38f9031cb41bc11f360ae812d784242f245f26"}
Jul 07 16:28:44.550384 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:44.550263    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a2916de3-ae2c-4839-8a1c-94866aabb272","Type":"ContainerStarted","Data":"f1a9cd9cce1a62c602635a1241d4df604875fd5f2680dc033a79d56b419f36bd"}
Jul 07 16:28:44.550384 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:44.550310    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a2916de3-ae2c-4839-8a1c-94866aabb272","Type":"ContainerStarted","Data":"ce675c50801ad1f4f27e098d464af6e76f6b227b69c2dae5d4c5b2fdd200dacc"}
Jul 07 16:28:44.550384 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:44.550366    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a2916de3-ae2c-4839-8a1c-94866aabb272","Type":"ContainerStarted","Data":"11779dca5c82bae289df48e812d9a602d6a2b6e57b7cca6b890bf3eb60cff840"}
Jul 07 16:28:44.595759 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:44.595652    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.919062163 podStartE2EDuration="10.595631048s" totalImagesPullingTime="7.656347618s" totalInitContainerRuntime="20.221267ms" isStatefulPod=false podCreationTimestamp="2026-07-07 16:28:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:28:44.594311463 +0000 UTC m=+326.681279958" watchObservedRunningTime="2026-07-07 16:28:44.595631048 +0000 UTC m=+326.682599507"
Jul 07 16:28:44.990931 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:28:44.990889    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:29:07.635588 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:07.635553    2578 generic.go:356] "Generic (PLEG): container finished" podID="c010fafb-ad1d-4c66-a040-4618b49c012c" containerID="1a66b6c8fefb0ee565bef41be284278e1b188cdec4b63db2df7e97b9ce8fdb1a" exitCode=0
Jul 07 16:29:07.636014 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:07.635628    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-khhhg" event={"ID":"c010fafb-ad1d-4c66-a040-4618b49c012c","Type":"ContainerDied","Data":"1a66b6c8fefb0ee565bef41be284278e1b188cdec4b63db2df7e97b9ce8fdb1a"}
Jul 07 16:29:07.636014 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:07.635980    2578 scope.go:117] "RemoveContainer" containerID="1a66b6c8fefb0ee565bef41be284278e1b188cdec4b63db2df7e97b9ce8fdb1a"
Jul 07 16:29:08.641236 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:08.641193    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-khhhg" event={"ID":"c010fafb-ad1d-4c66-a040-4618b49c012c","Type":"ContainerStarted","Data":"d510422dad05beabcd0141c6753e9f7d4c768e998dd13f6d711ff99fef1ace92"}
Jul 07 16:29:32.260405 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:32.260330    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5e94c63-e554-402d-9215-06cd6525019a-metrics-certs\") pod \"network-metrics-daemon-9sc2w\" (UID: \"a5e94c63-e554-402d-9215-06cd6525019a\") " pod="openshift-multus/network-metrics-daemon-9sc2w"
Jul 07 16:29:32.262741 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:32.262714    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5e94c63-e554-402d-9215-06cd6525019a-metrics-certs\") pod \"network-metrics-daemon-9sc2w\" (UID: \"a5e94c63-e554-402d-9215-06cd6525019a\") " pod="openshift-multus/network-metrics-daemon-9sc2w"
Jul 07 16:29:32.511605 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:32.511530    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sncwv\""
Jul 07 16:29:32.519848 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:32.519817    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9sc2w"
Jul 07 16:29:32.662387 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:32.662222    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9sc2w"]
Jul 07 16:29:32.665097 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:29:32.665065    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5e94c63_e554_402d_9215_06cd6525019a.slice/crio-7255422d293f64ce07c17984d3388604920282576487d9f7e3fc0aefcacc748a WatchSource:0}: Error finding container 7255422d293f64ce07c17984d3388604920282576487d9f7e3fc0aefcacc748a: Status 404 returned error can't find the container with id 7255422d293f64ce07c17984d3388604920282576487d9f7e3fc0aefcacc748a
Jul 07 16:29:32.731271 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:32.731239    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9sc2w" event={"ID":"a5e94c63-e554-402d-9215-06cd6525019a","Type":"ContainerStarted","Data":"7255422d293f64ce07c17984d3388604920282576487d9f7e3fc0aefcacc748a"}
Jul 07 16:29:33.737186 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:33.737156    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9sc2w" event={"ID":"a5e94c63-e554-402d-9215-06cd6525019a","Type":"ContainerStarted","Data":"71b6596144529339d00e7a904d0e4b5dffe65d223d64cf6372d4eca1e2b6eaed"}
Jul 07 16:29:33.737635 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:33.737236    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9sc2w" event={"ID":"a5e94c63-e554-402d-9215-06cd6525019a","Type":"ContainerStarted","Data":"d60a2ab3578d06295d955839526b0f06e19926d69bf2a45b60f493e417cdda16"}
Jul 07 16:29:33.759526 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:33.759473    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-9sc2w" podStartSLOduration=373.877864306 podStartE2EDuration="6m14.759454762s" totalImagesPullingTime="881.590456ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:23:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:29:33.758547536 +0000 UTC m=+375.845515997" watchObservedRunningTime="2026-07-07 16:29:33.759454762 +0000 UTC m=+375.846423219"
Jul 07 16:29:34.990976 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:34.990939    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:29:35.007186 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:35.007158    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:29:35.760790 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:35.760762    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:29:53.190367 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.190313    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 16:29:53.190864 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.190636    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a2916de3-ae2c-4839-8a1c-94866aabb272" containerName="prometheus" containerID="cri-o://043e1868ed9db5734766434354d8a0a75b3c8fdd6ac970139e19dee1d210320c" gracePeriod=600
Jul 07 16:29:53.190864 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.190660    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a2916de3-ae2c-4839-8a1c-94866aabb272" containerName="kube-rbac-proxy" containerID="cri-o://f1a9cd9cce1a62c602635a1241d4df604875fd5f2680dc033a79d56b419f36bd" gracePeriod=600
Jul 07 16:29:53.190864 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.190713    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a2916de3-ae2c-4839-8a1c-94866aabb272" containerName="kube-rbac-proxy-thanos" containerID="cri-o://b08cc378046bcded5dc2765aef38f9031cb41bc11f360ae812d784242f245f26" gracePeriod=600
Jul 07 16:29:53.190864 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.190725    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a2916de3-ae2c-4839-8a1c-94866aabb272" containerName="kube-rbac-proxy-web" containerID="cri-o://ce675c50801ad1f4f27e098d464af6e76f6b227b69c2dae5d4c5b2fdd200dacc" gracePeriod=600
Jul 07 16:29:53.190864 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.190762    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a2916de3-ae2c-4839-8a1c-94866aabb272" containerName="config-reloader" containerID="cri-o://1092ee7562686dff831e782f147d03d8a34d16bf2c217685ee5e7c252b8d3150" gracePeriod=600
Jul 07 16:29:53.190864 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.190720    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a2916de3-ae2c-4839-8a1c-94866aabb272" containerName="thanos-sidecar" containerID="cri-o://11779dca5c82bae289df48e812d9a602d6a2b6e57b7cca6b890bf3eb60cff840" gracePeriod=600
Jul 07 16:29:53.459279 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.459246    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:29:53.544446 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.544411    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a2916de3-ae2c-4839-8a1c-94866aabb272-secret-prometheus-k8s-tls\") pod \"a2916de3-ae2c-4839-8a1c-94866aabb272\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") "
Jul 07 16:29:53.544446 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.544449    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a2916de3-ae2c-4839-8a1c-94866aabb272-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"a2916de3-ae2c-4839-8a1c-94866aabb272\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") "
Jul 07 16:29:53.544679 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.544470    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a2916de3-ae2c-4839-8a1c-94866aabb272-secret-kube-rbac-proxy\") pod \"a2916de3-ae2c-4839-8a1c-94866aabb272\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") "
Jul 07 16:29:53.544679 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.544491    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a2916de3-ae2c-4839-8a1c-94866aabb272-web-config\") pod \"a2916de3-ae2c-4839-8a1c-94866aabb272\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") "
Jul 07 16:29:53.544679 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.544507    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a2916de3-ae2c-4839-8a1c-94866aabb272-tls-assets\") pod \"a2916de3-ae2c-4839-8a1c-94866aabb272\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") "
Jul 07 16:29:53.544679 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.544665    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7985f\" (UniqueName: \"kubernetes.io/projected/a2916de3-ae2c-4839-8a1c-94866aabb272-kube-api-access-7985f\") pod \"a2916de3-ae2c-4839-8a1c-94866aabb272\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") "
Jul 07 16:29:53.544883 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.544750    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a2916de3-ae2c-4839-8a1c-94866aabb272-config-out\") pod \"a2916de3-ae2c-4839-8a1c-94866aabb272\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") "
Jul 07 16:29:53.544883 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.544778    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a2916de3-ae2c-4839-8a1c-94866aabb272-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"a2916de3-ae2c-4839-8a1c-94866aabb272\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") "
Jul 07 16:29:53.544883 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.544809    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2916de3-ae2c-4839-8a1c-94866aabb272-prometheus-trusted-ca-bundle\") pod \"a2916de3-ae2c-4839-8a1c-94866aabb272\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") "
Jul 07 16:29:53.544883 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.544836    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a2916de3-ae2c-4839-8a1c-94866aabb272-configmap-metrics-client-ca\") pod \"a2916de3-ae2c-4839-8a1c-94866aabb272\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") "
Jul 07 16:29:53.544883 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.544867    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a2916de3-ae2c-4839-8a1c-94866aabb272-thanos-prometheus-http-client-file\") pod \"a2916de3-ae2c-4839-8a1c-94866aabb272\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") "
Jul 07 16:29:53.545124 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.544892    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a2916de3-ae2c-4839-8a1c-94866aabb272-secret-metrics-client-certs\") pod \"a2916de3-ae2c-4839-8a1c-94866aabb272\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") "
Jul 07 16:29:53.545124 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.544925    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a2916de3-ae2c-4839-8a1c-94866aabb272-prometheus-k8s-rulefiles-0\") pod \"a2916de3-ae2c-4839-8a1c-94866aabb272\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") "
Jul 07 16:29:53.545124 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.544958    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a2916de3-ae2c-4839-8a1c-94866aabb272-prometheus-k8s-rulefiles-1\") pod \"a2916de3-ae2c-4839-8a1c-94866aabb272\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") "
Jul 07 16:29:53.545124 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.544996    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a2916de3-ae2c-4839-8a1c-94866aabb272-prometheus-k8s-rulefiles-2\") pod \"a2916de3-ae2c-4839-8a1c-94866aabb272\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") "
Jul 07 16:29:53.545124 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.545054    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2916de3-ae2c-4839-8a1c-94866aabb272-configmap-serving-certs-ca-bundle\") pod \"a2916de3-ae2c-4839-8a1c-94866aabb272\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") "
Jul 07 16:29:53.545124 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.545085    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a2916de3-ae2c-4839-8a1c-94866aabb272-secret-grpc-tls\") pod \"a2916de3-ae2c-4839-8a1c-94866aabb272\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") "
Jul 07 16:29:53.545435 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.545161    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2916de3-ae2c-4839-8a1c-94866aabb272-configmap-kubelet-serving-ca-bundle\") pod \"a2916de3-ae2c-4839-8a1c-94866aabb272\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") "
Jul 07 16:29:53.545435 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.545193    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a2916de3-ae2c-4839-8a1c-94866aabb272-prometheus-k8s-db\") pod \"a2916de3-ae2c-4839-8a1c-94866aabb272\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") "
Jul 07 16:29:53.545435 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.545226    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a2916de3-ae2c-4839-8a1c-94866aabb272-config\") pod \"a2916de3-ae2c-4839-8a1c-94866aabb272\" (UID: \"a2916de3-ae2c-4839-8a1c-94866aabb272\") "
Jul 07 16:29:53.545435 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.545281    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2916de3-ae2c-4839-8a1c-94866aabb272-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "a2916de3-ae2c-4839-8a1c-94866aabb272" (UID: "a2916de3-ae2c-4839-8a1c-94866aabb272"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 16:29:53.545622 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.545511    2578 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a2916de3-ae2c-4839-8a1c-94866aabb272-configmap-metrics-client-ca\") on node \"ip-10-0-129-6.ec2.internal\" DevicePath \"\""
Jul 07 16:29:53.547330 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.547290    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2916de3-ae2c-4839-8a1c-94866aabb272-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "a2916de3-ae2c-4839-8a1c-94866aabb272" (UID: "a2916de3-ae2c-4839-8a1c-94866aabb272"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:29:53.548681 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.547608    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2916de3-ae2c-4839-8a1c-94866aabb272-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "a2916de3-ae2c-4839-8a1c-94866aabb272" (UID: "a2916de3-ae2c-4839-8a1c-94866aabb272"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:29:53.548681 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.547943    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2916de3-ae2c-4839-8a1c-94866aabb272-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "a2916de3-ae2c-4839-8a1c-94866aabb272" (UID: "a2916de3-ae2c-4839-8a1c-94866aabb272"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:29:53.548681 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.548178    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2916de3-ae2c-4839-8a1c-94866aabb272-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "a2916de3-ae2c-4839-8a1c-94866aabb272" (UID: "a2916de3-ae2c-4839-8a1c-94866aabb272"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 16:29:53.548681 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.548511    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2916de3-ae2c-4839-8a1c-94866aabb272-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "a2916de3-ae2c-4839-8a1c-94866aabb272" (UID: "a2916de3-ae2c-4839-8a1c-94866aabb272"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 16:29:53.548961 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.548800    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2916de3-ae2c-4839-8a1c-94866aabb272-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "a2916de3-ae2c-4839-8a1c-94866aabb272" (UID: "a2916de3-ae2c-4839-8a1c-94866aabb272"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:29:53.548961 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.548927    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2916de3-ae2c-4839-8a1c-94866aabb272-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "a2916de3-ae2c-4839-8a1c-94866aabb272" (UID: "a2916de3-ae2c-4839-8a1c-94866aabb272"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 16:29:53.549409 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.549383    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2916de3-ae2c-4839-8a1c-94866aabb272-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "a2916de3-ae2c-4839-8a1c-94866aabb272" (UID: "a2916de3-ae2c-4839-8a1c-94866aabb272"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 16:29:53.549525 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.549480    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2916de3-ae2c-4839-8a1c-94866aabb272-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "a2916de3-ae2c-4839-8a1c-94866aabb272" (UID: "a2916de3-ae2c-4839-8a1c-94866aabb272"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 16:29:53.549824 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.549744    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2916de3-ae2c-4839-8a1c-94866aabb272-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "a2916de3-ae2c-4839-8a1c-94866aabb272" (UID: "a2916de3-ae2c-4839-8a1c-94866aabb272"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 16:29:53.549901 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.549854    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2916de3-ae2c-4839-8a1c-94866aabb272-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "a2916de3-ae2c-4839-8a1c-94866aabb272" (UID: "a2916de3-ae2c-4839-8a1c-94866aabb272"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:29:53.549901 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.549881    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2916de3-ae2c-4839-8a1c-94866aabb272-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "a2916de3-ae2c-4839-8a1c-94866aabb272" (UID: "a2916de3-ae2c-4839-8a1c-94866aabb272"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:29:53.550010 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.549916    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2916de3-ae2c-4839-8a1c-94866aabb272-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "a2916de3-ae2c-4839-8a1c-94866aabb272" (UID: "a2916de3-ae2c-4839-8a1c-94866aabb272"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:29:53.550086 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.550064    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2916de3-ae2c-4839-8a1c-94866aabb272-kube-api-access-7985f" (OuterVolumeSpecName: "kube-api-access-7985f") pod "a2916de3-ae2c-4839-8a1c-94866aabb272" (UID: "a2916de3-ae2c-4839-8a1c-94866aabb272"). InnerVolumeSpecName "kube-api-access-7985f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:29:53.550174 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.550149    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2916de3-ae2c-4839-8a1c-94866aabb272-config-out" (OuterVolumeSpecName: "config-out") pod "a2916de3-ae2c-4839-8a1c-94866aabb272" (UID: "a2916de3-ae2c-4839-8a1c-94866aabb272"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:29:53.551081 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.551060    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2916de3-ae2c-4839-8a1c-94866aabb272-config" (OuterVolumeSpecName: "config") pod "a2916de3-ae2c-4839-8a1c-94866aabb272" (UID: "a2916de3-ae2c-4839-8a1c-94866aabb272"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:29:53.551564 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.551538    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2916de3-ae2c-4839-8a1c-94866aabb272-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "a2916de3-ae2c-4839-8a1c-94866aabb272" (UID: "a2916de3-ae2c-4839-8a1c-94866aabb272"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:29:53.551789 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.551767    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2916de3-ae2c-4839-8a1c-94866aabb272-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "a2916de3-ae2c-4839-8a1c-94866aabb272" (UID: "a2916de3-ae2c-4839-8a1c-94866aabb272"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:29:53.560444 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.560405    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2916de3-ae2c-4839-8a1c-94866aabb272-web-config" (OuterVolumeSpecName: "web-config") pod "a2916de3-ae2c-4839-8a1c-94866aabb272" (UID: "a2916de3-ae2c-4839-8a1c-94866aabb272"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:29:53.646144 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.646102    2578 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a2916de3-ae2c-4839-8a1c-94866aabb272-config-out\") on node \"ip-10-0-129-6.ec2.internal\" DevicePath \"\""
Jul 07 16:29:53.646144 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.646137    2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a2916de3-ae2c-4839-8a1c-94866aabb272-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-129-6.ec2.internal\" DevicePath \"\""
Jul 07 16:29:53.646144 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.646151    2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2916de3-ae2c-4839-8a1c-94866aabb272-prometheus-trusted-ca-bundle\") on node \"ip-10-0-129-6.ec2.internal\" DevicePath \"\""
Jul 07 16:29:53.646432 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.646161    2578 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a2916de3-ae2c-4839-8a1c-94866aabb272-thanos-prometheus-http-client-file\") on node \"ip-10-0-129-6.ec2.internal\" DevicePath \"\""
Jul 07 16:29:53.646432 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.646171    2578 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a2916de3-ae2c-4839-8a1c-94866aabb272-secret-metrics-client-certs\") on node \"ip-10-0-129-6.ec2.internal\" DevicePath \"\""
Jul 07 16:29:53.646432 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.646180    2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a2916de3-ae2c-4839-8a1c-94866aabb272-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-129-6.ec2.internal\" DevicePath \"\""
Jul 07 16:29:53.646432 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.646189    2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a2916de3-ae2c-4839-8a1c-94866aabb272-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-129-6.ec2.internal\" DevicePath \"\""
Jul 07 16:29:53.646432 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.646197    2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a2916de3-ae2c-4839-8a1c-94866aabb272-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-129-6.ec2.internal\" DevicePath \"\""
Jul 07 16:29:53.646432 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.646204    2578 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2916de3-ae2c-4839-8a1c-94866aabb272-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-129-6.ec2.internal\" DevicePath \"\""
Jul 07 16:29:53.646432 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.646212    2578 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a2916de3-ae2c-4839-8a1c-94866aabb272-secret-grpc-tls\") on node \"ip-10-0-129-6.ec2.internal\" DevicePath \"\""
Jul 07 16:29:53.646432 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.646221    2578 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2916de3-ae2c-4839-8a1c-94866aabb272-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-129-6.ec2.internal\" DevicePath \"\""
Jul 07 16:29:53.646432 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.646229    2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a2916de3-ae2c-4839-8a1c-94866aabb272-prometheus-k8s-db\") on node \"ip-10-0-129-6.ec2.internal\" DevicePath \"\""
Jul 07 16:29:53.646432 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.646237    2578 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/a2916de3-ae2c-4839-8a1c-94866aabb272-config\") on node \"ip-10-0-129-6.ec2.internal\" DevicePath \"\""
Jul 07 16:29:53.646432 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.646245    2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a2916de3-ae2c-4839-8a1c-94866aabb272-secret-prometheus-k8s-tls\") on node \"ip-10-0-129-6.ec2.internal\" DevicePath \"\""
Jul 07 16:29:53.646432 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.646253    2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a2916de3-ae2c-4839-8a1c-94866aabb272-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-129-6.ec2.internal\" DevicePath \"\""
Jul 07 16:29:53.646432 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.646263    2578 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a2916de3-ae2c-4839-8a1c-94866aabb272-secret-kube-rbac-proxy\") on node \"ip-10-0-129-6.ec2.internal\" DevicePath \"\""
Jul 07 16:29:53.646432 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.646271    2578 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a2916de3-ae2c-4839-8a1c-94866aabb272-web-config\") on node \"ip-10-0-129-6.ec2.internal\" DevicePath \"\""
Jul 07 16:29:53.646432 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.646280    2578 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a2916de3-ae2c-4839-8a1c-94866aabb272-tls-assets\") on node \"ip-10-0-129-6.ec2.internal\" DevicePath \"\""
Jul 07 16:29:53.646432 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.646287    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7985f\" (UniqueName: \"kubernetes.io/projected/a2916de3-ae2c-4839-8a1c-94866aabb272-kube-api-access-7985f\") on node \"ip-10-0-129-6.ec2.internal\" DevicePath \"\""
Jul 07 16:29:53.823456 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.823362    2578 generic.go:356] "Generic (PLEG): container finished" podID="a2916de3-ae2c-4839-8a1c-94866aabb272" containerID="b08cc378046bcded5dc2765aef38f9031cb41bc11f360ae812d784242f245f26" exitCode=0
Jul 07 16:29:53.823456 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.823394    2578 generic.go:356] "Generic (PLEG): container finished" podID="a2916de3-ae2c-4839-8a1c-94866aabb272" containerID="f1a9cd9cce1a62c602635a1241d4df604875fd5f2680dc033a79d56b419f36bd" exitCode=0
Jul 07 16:29:53.823456 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.823401    2578 generic.go:356] "Generic (PLEG): container finished" podID="a2916de3-ae2c-4839-8a1c-94866aabb272" containerID="ce675c50801ad1f4f27e098d464af6e76f6b227b69c2dae5d4c5b2fdd200dacc" exitCode=0
Jul 07 16:29:53.823456 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.823406    2578 generic.go:356] "Generic (PLEG): container finished" podID="a2916de3-ae2c-4839-8a1c-94866aabb272" containerID="11779dca5c82bae289df48e812d9a602d6a2b6e57b7cca6b890bf3eb60cff840" exitCode=0
Jul 07 16:29:53.823456 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.823412    2578 generic.go:356] "Generic (PLEG): container finished" podID="a2916de3-ae2c-4839-8a1c-94866aabb272" containerID="1092ee7562686dff831e782f147d03d8a34d16bf2c217685ee5e7c252b8d3150" exitCode=0
Jul 07 16:29:53.823456 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.823417    2578 generic.go:356] "Generic (PLEG): container finished" podID="a2916de3-ae2c-4839-8a1c-94866aabb272" containerID="043e1868ed9db5734766434354d8a0a75b3c8fdd6ac970139e19dee1d210320c" exitCode=0
Jul 07 16:29:53.823456 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.823456    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:29:53.823890 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.823456    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a2916de3-ae2c-4839-8a1c-94866aabb272","Type":"ContainerDied","Data":"b08cc378046bcded5dc2765aef38f9031cb41bc11f360ae812d784242f245f26"}
Jul 07 16:29:53.823890 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.823565    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a2916de3-ae2c-4839-8a1c-94866aabb272","Type":"ContainerDied","Data":"f1a9cd9cce1a62c602635a1241d4df604875fd5f2680dc033a79d56b419f36bd"}
Jul 07 16:29:53.823890 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.823594    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a2916de3-ae2c-4839-8a1c-94866aabb272","Type":"ContainerDied","Data":"ce675c50801ad1f4f27e098d464af6e76f6b227b69c2dae5d4c5b2fdd200dacc"}
Jul 07 16:29:53.823890 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.823624    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a2916de3-ae2c-4839-8a1c-94866aabb272","Type":"ContainerDied","Data":"11779dca5c82bae289df48e812d9a602d6a2b6e57b7cca6b890bf3eb60cff840"}
Jul 07 16:29:53.823890 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.823633    2578 scope.go:117] "RemoveContainer" containerID="b08cc378046bcded5dc2765aef38f9031cb41bc11f360ae812d784242f245f26"
Jul 07 16:29:53.823890 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.823663    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a2916de3-ae2c-4839-8a1c-94866aabb272","Type":"ContainerDied","Data":"1092ee7562686dff831e782f147d03d8a34d16bf2c217685ee5e7c252b8d3150"}
Jul 07 16:29:53.823890 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.823701    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a2916de3-ae2c-4839-8a1c-94866aabb272","Type":"ContainerDied","Data":"043e1868ed9db5734766434354d8a0a75b3c8fdd6ac970139e19dee1d210320c"}
Jul 07 16:29:53.823890 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.823743    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a2916de3-ae2c-4839-8a1c-94866aabb272","Type":"ContainerDied","Data":"cea45afa7f01b299d96679734645f0b85d48b2ff581398cbe8dd03cb8c268331"}
Jul 07 16:29:53.832199 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.832174    2578 scope.go:117] "RemoveContainer" containerID="f1a9cd9cce1a62c602635a1241d4df604875fd5f2680dc033a79d56b419f36bd"
Jul 07 16:29:53.839429 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.839413    2578 scope.go:117] "RemoveContainer" containerID="ce675c50801ad1f4f27e098d464af6e76f6b227b69c2dae5d4c5b2fdd200dacc"
Jul 07 16:29:53.848570 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.848549    2578 scope.go:117] "RemoveContainer" containerID="11779dca5c82bae289df48e812d9a602d6a2b6e57b7cca6b890bf3eb60cff840"
Jul 07 16:29:53.850594 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.850572    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 16:29:53.856706 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.856647    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 16:29:53.856771 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.856732    2578 scope.go:117] "RemoveContainer" containerID="1092ee7562686dff831e782f147d03d8a34d16bf2c217685ee5e7c252b8d3150"
Jul 07 16:29:53.864112 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.864092    2578 scope.go:117] "RemoveContainer" containerID="043e1868ed9db5734766434354d8a0a75b3c8fdd6ac970139e19dee1d210320c"
Jul 07 16:29:53.871836 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.871801    2578 scope.go:117] "RemoveContainer" containerID="3bbfc2aaf5ef7d32494a3b8f59fb59e8cd7439ce01036d728fd62446aef67daf"
Jul 07 16:29:53.879170 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.879140    2578 scope.go:117] "RemoveContainer" containerID="b08cc378046bcded5dc2765aef38f9031cb41bc11f360ae812d784242f245f26"
Jul 07 16:29:53.879492 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:29:53.879472    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b08cc378046bcded5dc2765aef38f9031cb41bc11f360ae812d784242f245f26\": container with ID starting with b08cc378046bcded5dc2765aef38f9031cb41bc11f360ae812d784242f245f26 not found: ID does not exist" containerID="b08cc378046bcded5dc2765aef38f9031cb41bc11f360ae812d784242f245f26"
Jul 07 16:29:53.879567 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.879505    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b08cc378046bcded5dc2765aef38f9031cb41bc11f360ae812d784242f245f26"} err="failed to get container status \"b08cc378046bcded5dc2765aef38f9031cb41bc11f360ae812d784242f245f26\": rpc error: code = NotFound desc = could not find container \"b08cc378046bcded5dc2765aef38f9031cb41bc11f360ae812d784242f245f26\": container with ID starting with b08cc378046bcded5dc2765aef38f9031cb41bc11f360ae812d784242f245f26 not found: ID does not exist"
Jul 07 16:29:53.879567 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.879524    2578 scope.go:117] "RemoveContainer" containerID="f1a9cd9cce1a62c602635a1241d4df604875fd5f2680dc033a79d56b419f36bd"
Jul 07 16:29:53.879754 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:29:53.879740    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1a9cd9cce1a62c602635a1241d4df604875fd5f2680dc033a79d56b419f36bd\": container with ID starting with f1a9cd9cce1a62c602635a1241d4df604875fd5f2680dc033a79d56b419f36bd not found: ID does not exist" containerID="f1a9cd9cce1a62c602635a1241d4df604875fd5f2680dc033a79d56b419f36bd"
Jul 07 16:29:53.879794 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.879757    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1a9cd9cce1a62c602635a1241d4df604875fd5f2680dc033a79d56b419f36bd"} err="failed to get container status \"f1a9cd9cce1a62c602635a1241d4df604875fd5f2680dc033a79d56b419f36bd\": rpc error: code = NotFound desc = could not find container \"f1a9cd9cce1a62c602635a1241d4df604875fd5f2680dc033a79d56b419f36bd\": container with ID starting with f1a9cd9cce1a62c602635a1241d4df604875fd5f2680dc033a79d56b419f36bd not found: ID does not exist"
Jul 07 16:29:53.879794 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.879771    2578 scope.go:117] "RemoveContainer" containerID="ce675c50801ad1f4f27e098d464af6e76f6b227b69c2dae5d4c5b2fdd200dacc"
Jul 07 16:29:53.879973 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:29:53.879959    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce675c50801ad1f4f27e098d464af6e76f6b227b69c2dae5d4c5b2fdd200dacc\": container with ID starting with ce675c50801ad1f4f27e098d464af6e76f6b227b69c2dae5d4c5b2fdd200dacc not found: ID does not exist" containerID="ce675c50801ad1f4f27e098d464af6e76f6b227b69c2dae5d4c5b2fdd200dacc"
Jul 07 16:29:53.880016 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.879976    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce675c50801ad1f4f27e098d464af6e76f6b227b69c2dae5d4c5b2fdd200dacc"} err="failed to get container status \"ce675c50801ad1f4f27e098d464af6e76f6b227b69c2dae5d4c5b2fdd200dacc\": rpc error: code = NotFound desc = could not find container \"ce675c50801ad1f4f27e098d464af6e76f6b227b69c2dae5d4c5b2fdd200dacc\": container with ID starting with ce675c50801ad1f4f27e098d464af6e76f6b227b69c2dae5d4c5b2fdd200dacc not found: ID does not exist"
Jul 07 16:29:53.880016 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.879990    2578 scope.go:117] "RemoveContainer" containerID="11779dca5c82bae289df48e812d9a602d6a2b6e57b7cca6b890bf3eb60cff840"
Jul 07 16:29:53.880214 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:29:53.880191    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11779dca5c82bae289df48e812d9a602d6a2b6e57b7cca6b890bf3eb60cff840\": container with ID starting with 11779dca5c82bae289df48e812d9a602d6a2b6e57b7cca6b890bf3eb60cff840 not found: ID does not exist" containerID="11779dca5c82bae289df48e812d9a602d6a2b6e57b7cca6b890bf3eb60cff840"
Jul 07 16:29:53.880262 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.880222    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11779dca5c82bae289df48e812d9a602d6a2b6e57b7cca6b890bf3eb60cff840"} err="failed to get container status \"11779dca5c82bae289df48e812d9a602d6a2b6e57b7cca6b890bf3eb60cff840\": rpc error: code = NotFound desc = could not find container \"11779dca5c82bae289df48e812d9a602d6a2b6e57b7cca6b890bf3eb60cff840\": container with ID starting with 11779dca5c82bae289df48e812d9a602d6a2b6e57b7cca6b890bf3eb60cff840 not found: ID does not exist"
Jul 07 16:29:53.880262 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.880240    2578 scope.go:117] "RemoveContainer" containerID="1092ee7562686dff831e782f147d03d8a34d16bf2c217685ee5e7c252b8d3150"
Jul 07 16:29:53.880508 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:29:53.880493    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1092ee7562686dff831e782f147d03d8a34d16bf2c217685ee5e7c252b8d3150\": container with ID starting with 1092ee7562686dff831e782f147d03d8a34d16bf2c217685ee5e7c252b8d3150 not found: ID does not exist" containerID="1092ee7562686dff831e782f147d03d8a34d16bf2c217685ee5e7c252b8d3150"
Jul 07 16:29:53.880576 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.880509    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1092ee7562686dff831e782f147d03d8a34d16bf2c217685ee5e7c252b8d3150"} err="failed to get container status \"1092ee7562686dff831e782f147d03d8a34d16bf2c217685ee5e7c252b8d3150\": rpc error: code = NotFound desc = could not find container \"1092ee7562686dff831e782f147d03d8a34d16bf2c217685ee5e7c252b8d3150\": container with ID starting with 1092ee7562686dff831e782f147d03d8a34d16bf2c217685ee5e7c252b8d3150 not found: ID does not exist"
Jul 07 16:29:53.880576 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.880521    2578 scope.go:117] "RemoveContainer" containerID="043e1868ed9db5734766434354d8a0a75b3c8fdd6ac970139e19dee1d210320c"
Jul 07 16:29:53.880725 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:29:53.880704    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"043e1868ed9db5734766434354d8a0a75b3c8fdd6ac970139e19dee1d210320c\": container with ID starting with 043e1868ed9db5734766434354d8a0a75b3c8fdd6ac970139e19dee1d210320c not found: ID does not exist" containerID="043e1868ed9db5734766434354d8a0a75b3c8fdd6ac970139e19dee1d210320c"
Jul 07 16:29:53.880759 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.880728    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"043e1868ed9db5734766434354d8a0a75b3c8fdd6ac970139e19dee1d210320c"} err="failed to get container status \"043e1868ed9db5734766434354d8a0a75b3c8fdd6ac970139e19dee1d210320c\": rpc error: code = NotFound desc = could not find container \"043e1868ed9db5734766434354d8a0a75b3c8fdd6ac970139e19dee1d210320c\": container with ID starting with 043e1868ed9db5734766434354d8a0a75b3c8fdd6ac970139e19dee1d210320c not found: ID does not exist"
Jul 07 16:29:53.880759 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.880742    2578 scope.go:117] "RemoveContainer" containerID="3bbfc2aaf5ef7d32494a3b8f59fb59e8cd7439ce01036d728fd62446aef67daf"
Jul 07 16:29:53.880959 ip-10-0-129-6 kubenswrapper[2578]: E0707 16:29:53.880944    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3bbfc2aaf5ef7d32494a3b8f59fb59e8cd7439ce01036d728fd62446aef67daf\": container with ID starting with 3bbfc2aaf5ef7d32494a3b8f59fb59e8cd7439ce01036d728fd62446aef67daf not found: ID does not exist" containerID="3bbfc2aaf5ef7d32494a3b8f59fb59e8cd7439ce01036d728fd62446aef67daf"
Jul 07 16:29:53.880993 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.880963    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bbfc2aaf5ef7d32494a3b8f59fb59e8cd7439ce01036d728fd62446aef67daf"} err="failed to get container status \"3bbfc2aaf5ef7d32494a3b8f59fb59e8cd7439ce01036d728fd62446aef67daf\": rpc error: code = NotFound desc = could not find container \"3bbfc2aaf5ef7d32494a3b8f59fb59e8cd7439ce01036d728fd62446aef67daf\": container with ID starting with 3bbfc2aaf5ef7d32494a3b8f59fb59e8cd7439ce01036d728fd62446aef67daf not found: ID does not exist"
Jul 07 16:29:53.880993 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.880974    2578 scope.go:117] "RemoveContainer" containerID="b08cc378046bcded5dc2765aef38f9031cb41bc11f360ae812d784242f245f26"
Jul 07 16:29:53.881206 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.881192    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b08cc378046bcded5dc2765aef38f9031cb41bc11f360ae812d784242f245f26"} err="failed to get container status \"b08cc378046bcded5dc2765aef38f9031cb41bc11f360ae812d784242f245f26\": rpc error: code = NotFound desc = could not find container \"b08cc378046bcded5dc2765aef38f9031cb41bc11f360ae812d784242f245f26\": container with ID starting with b08cc378046bcded5dc2765aef38f9031cb41bc11f360ae812d784242f245f26 not found: ID does not exist"
Jul 07 16:29:53.881261 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.881208    2578 scope.go:117] "RemoveContainer" containerID="f1a9cd9cce1a62c602635a1241d4df604875fd5f2680dc033a79d56b419f36bd"
Jul 07 16:29:53.881428 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.881408    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1a9cd9cce1a62c602635a1241d4df604875fd5f2680dc033a79d56b419f36bd"} err="failed to get container status \"f1a9cd9cce1a62c602635a1241d4df604875fd5f2680dc033a79d56b419f36bd\": rpc error: code = NotFound desc = could not find container \"f1a9cd9cce1a62c602635a1241d4df604875fd5f2680dc033a79d56b419f36bd\": container with ID starting with f1a9cd9cce1a62c602635a1241d4df604875fd5f2680dc033a79d56b419f36bd not found: ID does not exist"
Jul 07 16:29:53.881475 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.881429    2578 scope.go:117] "RemoveContainer" containerID="ce675c50801ad1f4f27e098d464af6e76f6b227b69c2dae5d4c5b2fdd200dacc"
Jul 07 16:29:53.881623 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.881606    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce675c50801ad1f4f27e098d464af6e76f6b227b69c2dae5d4c5b2fdd200dacc"} err="failed to get container status \"ce675c50801ad1f4f27e098d464af6e76f6b227b69c2dae5d4c5b2fdd200dacc\": rpc error: code = NotFound desc = could not find container \"ce675c50801ad1f4f27e098d464af6e76f6b227b69c2dae5d4c5b2fdd200dacc\": container with ID starting with ce675c50801ad1f4f27e098d464af6e76f6b227b69c2dae5d4c5b2fdd200dacc not found: ID does not exist"
Jul 07 16:29:53.881663 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.881624    2578 scope.go:117] "RemoveContainer" containerID="11779dca5c82bae289df48e812d9a602d6a2b6e57b7cca6b890bf3eb60cff840"
Jul 07 16:29:53.881811 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.881796    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11779dca5c82bae289df48e812d9a602d6a2b6e57b7cca6b890bf3eb60cff840"} err="failed to get container status \"11779dca5c82bae289df48e812d9a602d6a2b6e57b7cca6b890bf3eb60cff840\": rpc error: code = NotFound desc = could not find container \"11779dca5c82bae289df48e812d9a602d6a2b6e57b7cca6b890bf3eb60cff840\": container with ID starting with 11779dca5c82bae289df48e812d9a602d6a2b6e57b7cca6b890bf3eb60cff840 not found: ID does not exist"
Jul 07 16:29:53.881856 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.881811    2578 scope.go:117] "RemoveContainer" containerID="1092ee7562686dff831e782f147d03d8a34d16bf2c217685ee5e7c252b8d3150"
Jul 07 16:29:53.882004 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.881986    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1092ee7562686dff831e782f147d03d8a34d16bf2c217685ee5e7c252b8d3150"} err="failed to get container status \"1092ee7562686dff831e782f147d03d8a34d16bf2c217685ee5e7c252b8d3150\": rpc error: code = NotFound desc = could not find container \"1092ee7562686dff831e782f147d03d8a34d16bf2c217685ee5e7c252b8d3150\": container with ID starting with 1092ee7562686dff831e782f147d03d8a34d16bf2c217685ee5e7c252b8d3150 not found: ID does not exist"
Jul 07 16:29:53.882050 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.882005    2578 scope.go:117] "RemoveContainer" containerID="043e1868ed9db5734766434354d8a0a75b3c8fdd6ac970139e19dee1d210320c"
Jul 07 16:29:53.882205 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.882187    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"043e1868ed9db5734766434354d8a0a75b3c8fdd6ac970139e19dee1d210320c"} err="failed to get container status \"043e1868ed9db5734766434354d8a0a75b3c8fdd6ac970139e19dee1d210320c\": rpc error: code = NotFound desc = could not find container \"043e1868ed9db5734766434354d8a0a75b3c8fdd6ac970139e19dee1d210320c\": container with ID starting with 043e1868ed9db5734766434354d8a0a75b3c8fdd6ac970139e19dee1d210320c not found: ID does not exist"
Jul 07 16:29:53.882250 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.882206    2578 scope.go:117] "RemoveContainer" containerID="3bbfc2aaf5ef7d32494a3b8f59fb59e8cd7439ce01036d728fd62446aef67daf"
Jul 07 16:29:53.882450 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.882435    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bbfc2aaf5ef7d32494a3b8f59fb59e8cd7439ce01036d728fd62446aef67daf"} err="failed to get container status \"3bbfc2aaf5ef7d32494a3b8f59fb59e8cd7439ce01036d728fd62446aef67daf\": rpc error: code = NotFound desc = could not find container \"3bbfc2aaf5ef7d32494a3b8f59fb59e8cd7439ce01036d728fd62446aef67daf\": container with ID starting with 3bbfc2aaf5ef7d32494a3b8f59fb59e8cd7439ce01036d728fd62446aef67daf not found: ID does not exist"
Jul 07 16:29:53.882510 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.882450    2578 scope.go:117] "RemoveContainer" containerID="b08cc378046bcded5dc2765aef38f9031cb41bc11f360ae812d784242f245f26"
Jul 07 16:29:53.882678 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.882658    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b08cc378046bcded5dc2765aef38f9031cb41bc11f360ae812d784242f245f26"} err="failed to get container status \"b08cc378046bcded5dc2765aef38f9031cb41bc11f360ae812d784242f245f26\": rpc error: code = NotFound desc = could not find container \"b08cc378046bcded5dc2765aef38f9031cb41bc11f360ae812d784242f245f26\": container with ID starting with b08cc378046bcded5dc2765aef38f9031cb41bc11f360ae812d784242f245f26 not found: ID does not exist"
Jul 07 16:29:53.882742 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.882680    2578 scope.go:117] "RemoveContainer" containerID="f1a9cd9cce1a62c602635a1241d4df604875fd5f2680dc033a79d56b419f36bd"
Jul 07 16:29:53.882906 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.882890    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1a9cd9cce1a62c602635a1241d4df604875fd5f2680dc033a79d56b419f36bd"} err="failed to get container status \"f1a9cd9cce1a62c602635a1241d4df604875fd5f2680dc033a79d56b419f36bd\": rpc error: code = NotFound desc = could not find container \"f1a9cd9cce1a62c602635a1241d4df604875fd5f2680dc033a79d56b419f36bd\": container with ID starting with f1a9cd9cce1a62c602635a1241d4df604875fd5f2680dc033a79d56b419f36bd not found: ID does not exist"
Jul 07 16:29:53.882950 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.882905    2578 scope.go:117] "RemoveContainer" containerID="ce675c50801ad1f4f27e098d464af6e76f6b227b69c2dae5d4c5b2fdd200dacc"
Jul 07 16:29:53.883103 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.883087    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce675c50801ad1f4f27e098d464af6e76f6b227b69c2dae5d4c5b2fdd200dacc"} err="failed to get container status \"ce675c50801ad1f4f27e098d464af6e76f6b227b69c2dae5d4c5b2fdd200dacc\": rpc error: code = NotFound desc = could not find container \"ce675c50801ad1f4f27e098d464af6e76f6b227b69c2dae5d4c5b2fdd200dacc\": container with ID starting with ce675c50801ad1f4f27e098d464af6e76f6b227b69c2dae5d4c5b2fdd200dacc not found: ID does not exist"
Jul 07 16:29:53.883143 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.883103    2578 scope.go:117] "RemoveContainer" containerID="11779dca5c82bae289df48e812d9a602d6a2b6e57b7cca6b890bf3eb60cff840"
Jul 07 16:29:53.883289 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.883271    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11779dca5c82bae289df48e812d9a602d6a2b6e57b7cca6b890bf3eb60cff840"} err="failed to get container status \"11779dca5c82bae289df48e812d9a602d6a2b6e57b7cca6b890bf3eb60cff840\": rpc error: code = NotFound desc = could not find container \"11779dca5c82bae289df48e812d9a602d6a2b6e57b7cca6b890bf3eb60cff840\": container with ID starting with 11779dca5c82bae289df48e812d9a602d6a2b6e57b7cca6b890bf3eb60cff840 not found: ID does not exist"
Jul 07 16:29:53.883289 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.883286    2578 scope.go:117] "RemoveContainer" containerID="1092ee7562686dff831e782f147d03d8a34d16bf2c217685ee5e7c252b8d3150"
Jul 07 16:29:53.883536 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.883518    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1092ee7562686dff831e782f147d03d8a34d16bf2c217685ee5e7c252b8d3150"} err="failed to get container status \"1092ee7562686dff831e782f147d03d8a34d16bf2c217685ee5e7c252b8d3150\": rpc error: code = NotFound desc = could not find container \"1092ee7562686dff831e782f147d03d8a34d16bf2c217685ee5e7c252b8d3150\": container with ID starting with 1092ee7562686dff831e782f147d03d8a34d16bf2c217685ee5e7c252b8d3150 not found: ID does not exist"
Jul 07 16:29:53.883584 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.883536    2578 scope.go:117] "RemoveContainer" containerID="043e1868ed9db5734766434354d8a0a75b3c8fdd6ac970139e19dee1d210320c"
Jul 07 16:29:53.883738 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.883723    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"043e1868ed9db5734766434354d8a0a75b3c8fdd6ac970139e19dee1d210320c"} err="failed to get container status \"043e1868ed9db5734766434354d8a0a75b3c8fdd6ac970139e19dee1d210320c\": rpc error: code = NotFound desc = could not find container \"043e1868ed9db5734766434354d8a0a75b3c8fdd6ac970139e19dee1d210320c\": container with ID starting with 043e1868ed9db5734766434354d8a0a75b3c8fdd6ac970139e19dee1d210320c not found: ID does not exist"
Jul 07 16:29:53.883793 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.883737    2578 scope.go:117] "RemoveContainer" containerID="3bbfc2aaf5ef7d32494a3b8f59fb59e8cd7439ce01036d728fd62446aef67daf"
Jul 07 16:29:53.883960 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.883940    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bbfc2aaf5ef7d32494a3b8f59fb59e8cd7439ce01036d728fd62446aef67daf"} err="failed to get container status \"3bbfc2aaf5ef7d32494a3b8f59fb59e8cd7439ce01036d728fd62446aef67daf\": rpc error: code = NotFound desc = could not find container \"3bbfc2aaf5ef7d32494a3b8f59fb59e8cd7439ce01036d728fd62446aef67daf\": container with ID starting with 3bbfc2aaf5ef7d32494a3b8f59fb59e8cd7439ce01036d728fd62446aef67daf not found: ID does not exist"
Jul 07 16:29:53.884025 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.883961    2578 scope.go:117] "RemoveContainer" containerID="b08cc378046bcded5dc2765aef38f9031cb41bc11f360ae812d784242f245f26"
Jul 07 16:29:53.884156 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.884138    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b08cc378046bcded5dc2765aef38f9031cb41bc11f360ae812d784242f245f26"} err="failed to get container status \"b08cc378046bcded5dc2765aef38f9031cb41bc11f360ae812d784242f245f26\": rpc error: code = NotFound desc = could not find container \"b08cc378046bcded5dc2765aef38f9031cb41bc11f360ae812d784242f245f26\": container with ID starting with b08cc378046bcded5dc2765aef38f9031cb41bc11f360ae812d784242f245f26 not found: ID does not exist"
Jul 07 16:29:53.884156 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.884155    2578 scope.go:117] "RemoveContainer" containerID="f1a9cd9cce1a62c602635a1241d4df604875fd5f2680dc033a79d56b419f36bd"
Jul 07 16:29:53.884418 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.884372    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1a9cd9cce1a62c602635a1241d4df604875fd5f2680dc033a79d56b419f36bd"} err="failed to get container status \"f1a9cd9cce1a62c602635a1241d4df604875fd5f2680dc033a79d56b419f36bd\": rpc error: code = NotFound desc = could not find container \"f1a9cd9cce1a62c602635a1241d4df604875fd5f2680dc033a79d56b419f36bd\": container with ID starting with f1a9cd9cce1a62c602635a1241d4df604875fd5f2680dc033a79d56b419f36bd not found: ID does not exist"
Jul 07 16:29:53.884418 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.884389    2578 scope.go:117] "RemoveContainer" containerID="ce675c50801ad1f4f27e098d464af6e76f6b227b69c2dae5d4c5b2fdd200dacc"
Jul 07 16:29:53.884647 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.884628    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce675c50801ad1f4f27e098d464af6e76f6b227b69c2dae5d4c5b2fdd200dacc"} err="failed to get container status \"ce675c50801ad1f4f27e098d464af6e76f6b227b69c2dae5d4c5b2fdd200dacc\": rpc error: code = NotFound desc = could not find container \"ce675c50801ad1f4f27e098d464af6e76f6b227b69c2dae5d4c5b2fdd200dacc\": container with ID starting with ce675c50801ad1f4f27e098d464af6e76f6b227b69c2dae5d4c5b2fdd200dacc not found: ID does not exist"
Jul 07 16:29:53.884700 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.884648    2578 scope.go:117] "RemoveContainer" containerID="11779dca5c82bae289df48e812d9a602d6a2b6e57b7cca6b890bf3eb60cff840"
Jul 07 16:29:53.884867 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.884848    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11779dca5c82bae289df48e812d9a602d6a2b6e57b7cca6b890bf3eb60cff840"} err="failed to get container status \"11779dca5c82bae289df48e812d9a602d6a2b6e57b7cca6b890bf3eb60cff840\": rpc error: code = NotFound desc = could not find container \"11779dca5c82bae289df48e812d9a602d6a2b6e57b7cca6b890bf3eb60cff840\": container with ID starting with 11779dca5c82bae289df48e812d9a602d6a2b6e57b7cca6b890bf3eb60cff840 not found: ID does not exist"
Jul 07 16:29:53.884941 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.884867    2578 scope.go:117] "RemoveContainer" containerID="1092ee7562686dff831e782f147d03d8a34d16bf2c217685ee5e7c252b8d3150"
Jul 07 16:29:53.885083 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.885066    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1092ee7562686dff831e782f147d03d8a34d16bf2c217685ee5e7c252b8d3150"} err="failed to get container status \"1092ee7562686dff831e782f147d03d8a34d16bf2c217685ee5e7c252b8d3150\": rpc error: code = NotFound desc = could not find container \"1092ee7562686dff831e782f147d03d8a34d16bf2c217685ee5e7c252b8d3150\": container with ID starting with 1092ee7562686dff831e782f147d03d8a34d16bf2c217685ee5e7c252b8d3150 not found: ID does not exist"
Jul 07 16:29:53.885132 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.885084    2578 scope.go:117] "RemoveContainer" containerID="043e1868ed9db5734766434354d8a0a75b3c8fdd6ac970139e19dee1d210320c"
Jul 07 16:29:53.885289 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.885272    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"043e1868ed9db5734766434354d8a0a75b3c8fdd6ac970139e19dee1d210320c"} err="failed to get container status \"043e1868ed9db5734766434354d8a0a75b3c8fdd6ac970139e19dee1d210320c\": rpc error: code = NotFound desc = could not find container \"043e1868ed9db5734766434354d8a0a75b3c8fdd6ac970139e19dee1d210320c\": container with ID starting with 043e1868ed9db5734766434354d8a0a75b3c8fdd6ac970139e19dee1d210320c not found: ID does not exist"
Jul 07 16:29:53.885331 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.885289    2578 scope.go:117] "RemoveContainer" containerID="3bbfc2aaf5ef7d32494a3b8f59fb59e8cd7439ce01036d728fd62446aef67daf"
Jul 07 16:29:53.885516 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.885498    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bbfc2aaf5ef7d32494a3b8f59fb59e8cd7439ce01036d728fd62446aef67daf"} err="failed to get container status \"3bbfc2aaf5ef7d32494a3b8f59fb59e8cd7439ce01036d728fd62446aef67daf\": rpc error: code = NotFound desc = could not find container \"3bbfc2aaf5ef7d32494a3b8f59fb59e8cd7439ce01036d728fd62446aef67daf\": container with ID starting with 3bbfc2aaf5ef7d32494a3b8f59fb59e8cd7439ce01036d728fd62446aef67daf not found: ID does not exist"
Jul 07 16:29:53.885578 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.885516    2578 scope.go:117] "RemoveContainer" containerID="b08cc378046bcded5dc2765aef38f9031cb41bc11f360ae812d784242f245f26"
Jul 07 16:29:53.885715 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.885699    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b08cc378046bcded5dc2765aef38f9031cb41bc11f360ae812d784242f245f26"} err="failed to get container status \"b08cc378046bcded5dc2765aef38f9031cb41bc11f360ae812d784242f245f26\": rpc error: code = NotFound desc = could not find container \"b08cc378046bcded5dc2765aef38f9031cb41bc11f360ae812d784242f245f26\": container with ID starting with b08cc378046bcded5dc2765aef38f9031cb41bc11f360ae812d784242f245f26 not found: ID does not exist"
Jul 07 16:29:53.885756 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.885714    2578 scope.go:117] "RemoveContainer" containerID="f1a9cd9cce1a62c602635a1241d4df604875fd5f2680dc033a79d56b419f36bd"
Jul 07 16:29:53.885927 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.885905    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1a9cd9cce1a62c602635a1241d4df604875fd5f2680dc033a79d56b419f36bd"} err="failed to get container status \"f1a9cd9cce1a62c602635a1241d4df604875fd5f2680dc033a79d56b419f36bd\": rpc error: code = NotFound desc = could not find container \"f1a9cd9cce1a62c602635a1241d4df604875fd5f2680dc033a79d56b419f36bd\": container with ID starting with f1a9cd9cce1a62c602635a1241d4df604875fd5f2680dc033a79d56b419f36bd not found: ID does not exist"
Jul 07 16:29:53.885977 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.885926    2578 scope.go:117] "RemoveContainer" containerID="ce675c50801ad1f4f27e098d464af6e76f6b227b69c2dae5d4c5b2fdd200dacc"
Jul 07 16:29:53.886129 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.886113    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce675c50801ad1f4f27e098d464af6e76f6b227b69c2dae5d4c5b2fdd200dacc"} err="failed to get container status \"ce675c50801ad1f4f27e098d464af6e76f6b227b69c2dae5d4c5b2fdd200dacc\": rpc error: code = NotFound desc = could not find container \"ce675c50801ad1f4f27e098d464af6e76f6b227b69c2dae5d4c5b2fdd200dacc\": container with ID starting with ce675c50801ad1f4f27e098d464af6e76f6b227b69c2dae5d4c5b2fdd200dacc not found: ID does not exist"
Jul 07 16:29:53.886129 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.886129    2578 scope.go:117] "RemoveContainer" containerID="11779dca5c82bae289df48e812d9a602d6a2b6e57b7cca6b890bf3eb60cff840"
Jul 07 16:29:53.886328 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.886313    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11779dca5c82bae289df48e812d9a602d6a2b6e57b7cca6b890bf3eb60cff840"} err="failed to get container status \"11779dca5c82bae289df48e812d9a602d6a2b6e57b7cca6b890bf3eb60cff840\": rpc error: code = NotFound desc = could not find container \"11779dca5c82bae289df48e812d9a602d6a2b6e57b7cca6b890bf3eb60cff840\": container with ID starting with 11779dca5c82bae289df48e812d9a602d6a2b6e57b7cca6b890bf3eb60cff840 not found: ID does not exist"
Jul 07 16:29:53.886328 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.886329    2578 scope.go:117] "RemoveContainer" containerID="1092ee7562686dff831e782f147d03d8a34d16bf2c217685ee5e7c252b8d3150"
Jul 07 16:29:53.886554 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.886536    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1092ee7562686dff831e782f147d03d8a34d16bf2c217685ee5e7c252b8d3150"} err="failed to get container status \"1092ee7562686dff831e782f147d03d8a34d16bf2c217685ee5e7c252b8d3150\": rpc error: code = NotFound desc = could not find container \"1092ee7562686dff831e782f147d03d8a34d16bf2c217685ee5e7c252b8d3150\": container with ID starting with 1092ee7562686dff831e782f147d03d8a34d16bf2c217685ee5e7c252b8d3150 not found: ID does not exist"
Jul 07 16:29:53.886554 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.886554    2578 scope.go:117] "RemoveContainer" containerID="043e1868ed9db5734766434354d8a0a75b3c8fdd6ac970139e19dee1d210320c"
Jul 07 16:29:53.886775 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.886754    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"043e1868ed9db5734766434354d8a0a75b3c8fdd6ac970139e19dee1d210320c"} err="failed to get container status \"043e1868ed9db5734766434354d8a0a75b3c8fdd6ac970139e19dee1d210320c\": rpc error: code = NotFound desc = could not find container \"043e1868ed9db5734766434354d8a0a75b3c8fdd6ac970139e19dee1d210320c\": container with ID starting with 043e1868ed9db5734766434354d8a0a75b3c8fdd6ac970139e19dee1d210320c not found: ID does not exist"
Jul 07 16:29:53.886818 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.886775    2578 scope.go:117] "RemoveContainer" containerID="3bbfc2aaf5ef7d32494a3b8f59fb59e8cd7439ce01036d728fd62446aef67daf"
Jul 07 16:29:53.887015 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.886997    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bbfc2aaf5ef7d32494a3b8f59fb59e8cd7439ce01036d728fd62446aef67daf"} err="failed to get container status \"3bbfc2aaf5ef7d32494a3b8f59fb59e8cd7439ce01036d728fd62446aef67daf\": rpc error: code = NotFound desc = could not find container \"3bbfc2aaf5ef7d32494a3b8f59fb59e8cd7439ce01036d728fd62446aef67daf\": container with ID starting with 3bbfc2aaf5ef7d32494a3b8f59fb59e8cd7439ce01036d728fd62446aef67daf not found: ID does not exist"
Jul 07 16:29:53.887015 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.887015    2578 scope.go:117] "RemoveContainer" containerID="b08cc378046bcded5dc2765aef38f9031cb41bc11f360ae812d784242f245f26"
Jul 07 16:29:53.887220 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.887204    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b08cc378046bcded5dc2765aef38f9031cb41bc11f360ae812d784242f245f26"} err="failed to get container status \"b08cc378046bcded5dc2765aef38f9031cb41bc11f360ae812d784242f245f26\": rpc error: code = NotFound desc = could not find container \"b08cc378046bcded5dc2765aef38f9031cb41bc11f360ae812d784242f245f26\": container with ID starting with b08cc378046bcded5dc2765aef38f9031cb41bc11f360ae812d784242f245f26 not found: ID does not exist"
Jul 07 16:29:53.887220 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.887219    2578 scope.go:117] "RemoveContainer" containerID="f1a9cd9cce1a62c602635a1241d4df604875fd5f2680dc033a79d56b419f36bd"
Jul 07 16:29:53.887463 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.887447    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1a9cd9cce1a62c602635a1241d4df604875fd5f2680dc033a79d56b419f36bd"} err="failed to get container status \"f1a9cd9cce1a62c602635a1241d4df604875fd5f2680dc033a79d56b419f36bd\": rpc error: code = NotFound desc = could not find container \"f1a9cd9cce1a62c602635a1241d4df604875fd5f2680dc033a79d56b419f36bd\": container with ID starting with f1a9cd9cce1a62c602635a1241d4df604875fd5f2680dc033a79d56b419f36bd not found: ID does not exist"
Jul 07 16:29:53.887511 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.887463    2578 scope.go:117] "RemoveContainer" containerID="ce675c50801ad1f4f27e098d464af6e76f6b227b69c2dae5d4c5b2fdd200dacc"
Jul 07 16:29:53.887676 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.887660    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce675c50801ad1f4f27e098d464af6e76f6b227b69c2dae5d4c5b2fdd200dacc"} err="failed to get container status \"ce675c50801ad1f4f27e098d464af6e76f6b227b69c2dae5d4c5b2fdd200dacc\": rpc error: code = NotFound desc = could not find container \"ce675c50801ad1f4f27e098d464af6e76f6b227b69c2dae5d4c5b2fdd200dacc\": container with ID starting with ce675c50801ad1f4f27e098d464af6e76f6b227b69c2dae5d4c5b2fdd200dacc not found: ID does not exist"
Jul 07 16:29:53.887718 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.887676    2578 scope.go:117] "RemoveContainer" containerID="11779dca5c82bae289df48e812d9a602d6a2b6e57b7cca6b890bf3eb60cff840"
Jul 07 16:29:53.887894 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.887876    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11779dca5c82bae289df48e812d9a602d6a2b6e57b7cca6b890bf3eb60cff840"} err="failed to get container status \"11779dca5c82bae289df48e812d9a602d6a2b6e57b7cca6b890bf3eb60cff840\": rpc error: code = NotFound desc = could not find container \"11779dca5c82bae289df48e812d9a602d6a2b6e57b7cca6b890bf3eb60cff840\": container with ID starting with 11779dca5c82bae289df48e812d9a602d6a2b6e57b7cca6b890bf3eb60cff840 not found: ID does not exist"
Jul 07 16:29:53.887959 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.887895    2578 scope.go:117] "RemoveContainer" containerID="1092ee7562686dff831e782f147d03d8a34d16bf2c217685ee5e7c252b8d3150"
Jul 07 16:29:53.888105 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.888088    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1092ee7562686dff831e782f147d03d8a34d16bf2c217685ee5e7c252b8d3150"} err="failed to get container status \"1092ee7562686dff831e782f147d03d8a34d16bf2c217685ee5e7c252b8d3150\": rpc error: code = NotFound desc = could not find container \"1092ee7562686dff831e782f147d03d8a34d16bf2c217685ee5e7c252b8d3150\": container with ID starting with 1092ee7562686dff831e782f147d03d8a34d16bf2c217685ee5e7c252b8d3150 not found: ID does not exist"
Jul 07 16:29:53.888168 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.888104    2578 scope.go:117] "RemoveContainer" containerID="043e1868ed9db5734766434354d8a0a75b3c8fdd6ac970139e19dee1d210320c"
Jul 07 16:29:53.888299 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.888284    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"043e1868ed9db5734766434354d8a0a75b3c8fdd6ac970139e19dee1d210320c"} err="failed to get container status \"043e1868ed9db5734766434354d8a0a75b3c8fdd6ac970139e19dee1d210320c\": rpc error: code = NotFound desc = could not find container \"043e1868ed9db5734766434354d8a0a75b3c8fdd6ac970139e19dee1d210320c\": container with ID starting with 043e1868ed9db5734766434354d8a0a75b3c8fdd6ac970139e19dee1d210320c not found: ID does not exist"
Jul 07 16:29:53.888375 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.888299    2578 scope.go:117] "RemoveContainer" containerID="3bbfc2aaf5ef7d32494a3b8f59fb59e8cd7439ce01036d728fd62446aef67daf"
Jul 07 16:29:53.888556 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.888535    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bbfc2aaf5ef7d32494a3b8f59fb59e8cd7439ce01036d728fd62446aef67daf"} err="failed to get container status \"3bbfc2aaf5ef7d32494a3b8f59fb59e8cd7439ce01036d728fd62446aef67daf\": rpc error: code = NotFound desc = could not find container \"3bbfc2aaf5ef7d32494a3b8f59fb59e8cd7439ce01036d728fd62446aef67daf\": container with ID starting with 3bbfc2aaf5ef7d32494a3b8f59fb59e8cd7439ce01036d728fd62446aef67daf not found: ID does not exist"
Jul 07 16:29:53.914216 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.914182    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 16:29:53.914501 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.914487    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2916de3-ae2c-4839-8a1c-94866aabb272" containerName="init-config-reloader"
Jul 07 16:29:53.914501 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.914501    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2916de3-ae2c-4839-8a1c-94866aabb272" containerName="init-config-reloader"
Jul 07 16:29:53.914618 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.914511    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2916de3-ae2c-4839-8a1c-94866aabb272" containerName="config-reloader"
Jul 07 16:29:53.914618 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.914519    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2916de3-ae2c-4839-8a1c-94866aabb272" containerName="config-reloader"
Jul 07 16:29:53.914618 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.914529    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2916de3-ae2c-4839-8a1c-94866aabb272" containerName="thanos-sidecar"
Jul 07 16:29:53.914618 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.914537    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2916de3-ae2c-4839-8a1c-94866aabb272" containerName="thanos-sidecar"
Jul 07 16:29:53.914618 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.914556    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34272f85-199c-456f-a0ff-f7fad01b6d33" containerName="registry"
Jul 07 16:29:53.914618 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.914564    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="34272f85-199c-456f-a0ff-f7fad01b6d33" containerName="registry"
Jul 07 16:29:53.914618 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.914574    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2916de3-ae2c-4839-8a1c-94866aabb272" containerName="kube-rbac-proxy"
Jul 07 16:29:53.914618 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.914582    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2916de3-ae2c-4839-8a1c-94866aabb272" containerName="kube-rbac-proxy"
Jul 07 16:29:53.914618 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.914591    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2916de3-ae2c-4839-8a1c-94866aabb272" containerName="kube-rbac-proxy-web"
Jul 07 16:29:53.914618 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.914599    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2916de3-ae2c-4839-8a1c-94866aabb272" containerName="kube-rbac-proxy-web"
Jul 07 16:29:53.914618 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.914616    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2916de3-ae2c-4839-8a1c-94866aabb272" containerName="prometheus"
Jul 07 16:29:53.915120 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.914623    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2916de3-ae2c-4839-8a1c-94866aabb272" containerName="prometheus"
Jul 07 16:29:53.915120 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.914637    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2916de3-ae2c-4839-8a1c-94866aabb272" containerName="kube-rbac-proxy-thanos"
Jul 07 16:29:53.915120 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.914645    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2916de3-ae2c-4839-8a1c-94866aabb272" containerName="kube-rbac-proxy-thanos"
Jul 07 16:29:53.915120 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.914718    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2916de3-ae2c-4839-8a1c-94866aabb272" containerName="thanos-sidecar"
Jul 07 16:29:53.915120 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.914730    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2916de3-ae2c-4839-8a1c-94866aabb272" containerName="kube-rbac-proxy-thanos"
Jul 07 16:29:53.915120 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.914743    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2916de3-ae2c-4839-8a1c-94866aabb272" containerName="config-reloader"
Jul 07 16:29:53.915120 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.914751    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="34272f85-199c-456f-a0ff-f7fad01b6d33" containerName="registry"
Jul 07 16:29:53.915120 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.914759    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2916de3-ae2c-4839-8a1c-94866aabb272" containerName="prometheus"
Jul 07 16:29:53.915120 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.914767    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2916de3-ae2c-4839-8a1c-94866aabb272" containerName="kube-rbac-proxy-web"
Jul 07 16:29:53.915120 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.914776    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2916de3-ae2c-4839-8a1c-94866aabb272" containerName="kube-rbac-proxy"
Jul 07 16:29:53.920158 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.920136    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:29:53.926501 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.926476    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 07 16:29:53.926501 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.926496    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 07 16:29:53.926682 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.926662    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 07 16:29:53.926877 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.926862    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 07 16:29:53.927253 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.927234    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 07 16:29:53.927383 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.927300    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 07 16:29:53.927383 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.927316    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 07 16:29:53.927383 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.927323    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-bnsshpukssp67\""
Jul 07 16:29:53.927610 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.927552    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 07 16:29:53.927610 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.927569    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 07 16:29:53.927610 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.927587    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 07 16:29:53.927781 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.927664    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-jm6rn\""
Jul 07 16:29:53.927919 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.927907    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 07 16:29:53.929696 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.929676    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 07 16:29:53.929980 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.929966    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 07 16:29:53.930570 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.930556    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 07 16:29:53.935211 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.935193    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 07 16:29:53.957778 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:53.957674    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 16:29:54.050457 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:54.050419    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48f92138-7c05-4122-88f1-9e7a536914e9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"48f92138-7c05-4122-88f1-9e7a536914e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:29:54.050457 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:54.050464    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/48f92138-7c05-4122-88f1-9e7a536914e9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"48f92138-7c05-4122-88f1-9e7a536914e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:29:54.050707 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:54.050484    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/48f92138-7c05-4122-88f1-9e7a536914e9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"48f92138-7c05-4122-88f1-9e7a536914e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:29:54.050707 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:54.050539    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/48f92138-7c05-4122-88f1-9e7a536914e9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"48f92138-7c05-4122-88f1-9e7a536914e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:29:54.050707 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:54.050573    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/48f92138-7c05-4122-88f1-9e7a536914e9-web-config\") pod \"prometheus-k8s-0\" (UID: \"48f92138-7c05-4122-88f1-9e7a536914e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:29:54.050707 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:54.050592    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlk5q\" (UniqueName: \"kubernetes.io/projected/48f92138-7c05-4122-88f1-9e7a536914e9-kube-api-access-jlk5q\") pod \"prometheus-k8s-0\" (UID: \"48f92138-7c05-4122-88f1-9e7a536914e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:29:54.050707 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:54.050631    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48f92138-7c05-4122-88f1-9e7a536914e9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"48f92138-7c05-4122-88f1-9e7a536914e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:29:54.050707 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:54.050682    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/48f92138-7c05-4122-88f1-9e7a536914e9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"48f92138-7c05-4122-88f1-9e7a536914e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:29:54.050951 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:54.050725    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/48f92138-7c05-4122-88f1-9e7a536914e9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"48f92138-7c05-4122-88f1-9e7a536914e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:29:54.050951 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:54.050753    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/48f92138-7c05-4122-88f1-9e7a536914e9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"48f92138-7c05-4122-88f1-9e7a536914e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:29:54.050951 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:54.050805    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/48f92138-7c05-4122-88f1-9e7a536914e9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"48f92138-7c05-4122-88f1-9e7a536914e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:29:54.050951 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:54.050832    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/48f92138-7c05-4122-88f1-9e7a536914e9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"48f92138-7c05-4122-88f1-9e7a536914e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:29:54.050951 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:54.050865    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/48f92138-7c05-4122-88f1-9e7a536914e9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"48f92138-7c05-4122-88f1-9e7a536914e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:29:54.050951 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:54.050880    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/48f92138-7c05-4122-88f1-9e7a536914e9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"48f92138-7c05-4122-88f1-9e7a536914e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:29:54.050951 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:54.050898    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/48f92138-7c05-4122-88f1-9e7a536914e9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"48f92138-7c05-4122-88f1-9e7a536914e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:29:54.050951 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:54.050928    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48f92138-7c05-4122-88f1-9e7a536914e9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"48f92138-7c05-4122-88f1-9e7a536914e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:29:54.050951 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:54.050943    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/48f92138-7c05-4122-88f1-9e7a536914e9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"48f92138-7c05-4122-88f1-9e7a536914e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:29:54.051290 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:54.050977    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/48f92138-7c05-4122-88f1-9e7a536914e9-config\") pod \"prometheus-k8s-0\" (UID: \"48f92138-7c05-4122-88f1-9e7a536914e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:29:54.051290 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:54.051036    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/48f92138-7c05-4122-88f1-9e7a536914e9-config-out\") pod \"prometheus-k8s-0\" (UID: \"48f92138-7c05-4122-88f1-9e7a536914e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:29:54.051290 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:54.051061    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/48f92138-7c05-4122-88f1-9e7a536914e9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"48f92138-7c05-4122-88f1-9e7a536914e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:29:54.151774 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:54.151729    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48f92138-7c05-4122-88f1-9e7a536914e9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"48f92138-7c05-4122-88f1-9e7a536914e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:29:54.151774 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:54.151779    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/48f92138-7c05-4122-88f1-9e7a536914e9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"48f92138-7c05-4122-88f1-9e7a536914e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:29:54.152038 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:54.151902    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/48f92138-7c05-4122-88f1-9e7a536914e9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"48f92138-7c05-4122-88f1-9e7a536914e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:29:54.152038 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:54.151947    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/48f92138-7c05-4122-88f1-9e7a536914e9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"48f92138-7c05-4122-88f1-9e7a536914e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:29:54.152038 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:54.151970    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/48f92138-7c05-4122-88f1-9e7a536914e9-web-config\") pod \"prometheus-k8s-0\" (UID: \"48f92138-7c05-4122-88f1-9e7a536914e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:29:54.152038 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:54.151993    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlk5q\" (UniqueName: \"kubernetes.io/projected/48f92138-7c05-4122-88f1-9e7a536914e9-kube-api-access-jlk5q\") pod \"prometheus-k8s-0\" (UID: \"48f92138-7c05-4122-88f1-9e7a536914e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:29:54.152038 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:54.152030    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48f92138-7c05-4122-88f1-9e7a536914e9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"48f92138-7c05-4122-88f1-9e7a536914e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:29:54.152308 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:54.152057    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/48f92138-7c05-4122-88f1-9e7a536914e9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"48f92138-7c05-4122-88f1-9e7a536914e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:29:54.152308 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:54.152085    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/48f92138-7c05-4122-88f1-9e7a536914e9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"48f92138-7c05-4122-88f1-9e7a536914e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:29:54.152308 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:54.152112    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/48f92138-7c05-4122-88f1-9e7a536914e9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"48f92138-7c05-4122-88f1-9e7a536914e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:29:54.152308 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:54.152157    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/48f92138-7c05-4122-88f1-9e7a536914e9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"48f92138-7c05-4122-88f1-9e7a536914e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:29:54.152308 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:54.152187    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/48f92138-7c05-4122-88f1-9e7a536914e9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"48f92138-7c05-4122-88f1-9e7a536914e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:29:54.152308 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:54.152232    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/48f92138-7c05-4122-88f1-9e7a536914e9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"48f92138-7c05-4122-88f1-9e7a536914e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:29:54.152308 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:54.152282    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/48f92138-7c05-4122-88f1-9e7a536914e9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"48f92138-7c05-4122-88f1-9e7a536914e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:29:54.152666 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:54.152316    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/48f92138-7c05-4122-88f1-9e7a536914e9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"48f92138-7c05-4122-88f1-9e7a536914e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:29:54.152666 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:54.152398    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48f92138-7c05-4122-88f1-9e7a536914e9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"48f92138-7c05-4122-88f1-9e7a536914e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:29:54.152666 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:54.152425    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/48f92138-7c05-4122-88f1-9e7a536914e9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"48f92138-7c05-4122-88f1-9e7a536914e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:29:54.152666 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:54.152450    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/48f92138-7c05-4122-88f1-9e7a536914e9-config\") pod \"prometheus-k8s-0\" (UID: \"48f92138-7c05-4122-88f1-9e7a536914e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:29:54.152666 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:54.152480    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/48f92138-7c05-4122-88f1-9e7a536914e9-config-out\") pod \"prometheus-k8s-0\" (UID: \"48f92138-7c05-4122-88f1-9e7a536914e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:29:54.152666 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:54.152505    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/48f92138-7c05-4122-88f1-9e7a536914e9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"48f92138-7c05-4122-88f1-9e7a536914e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:29:54.152963 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:54.152747    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/48f92138-7c05-4122-88f1-9e7a536914e9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"48f92138-7c05-4122-88f1-9e7a536914e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:29:54.152963 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:54.152810    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48f92138-7c05-4122-88f1-9e7a536914e9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"48f92138-7c05-4122-88f1-9e7a536914e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:29:54.153399 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:54.153371    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/48f92138-7c05-4122-88f1-9e7a536914e9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"48f92138-7c05-4122-88f1-9e7a536914e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:29:54.153962 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:54.153640    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48f92138-7c05-4122-88f1-9e7a536914e9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"48f92138-7c05-4122-88f1-9e7a536914e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:29:54.154974 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:54.154891    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/48f92138-7c05-4122-88f1-9e7a536914e9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"48f92138-7c05-4122-88f1-9e7a536914e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:29:54.155090 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:54.155065    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48f92138-7c05-4122-88f1-9e7a536914e9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"48f92138-7c05-4122-88f1-9e7a536914e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:29:54.155286 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:54.155264    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/48f92138-7c05-4122-88f1-9e7a536914e9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"48f92138-7c05-4122-88f1-9e7a536914e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:29:54.155390 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:54.155301    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/48f92138-7c05-4122-88f1-9e7a536914e9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"48f92138-7c05-4122-88f1-9e7a536914e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:29:54.155570 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:54.155521    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/48f92138-7c05-4122-88f1-9e7a536914e9-web-config\") pod \"prometheus-k8s-0\" (UID: \"48f92138-7c05-4122-88f1-9e7a536914e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:29:54.155570 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:54.155548    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/48f92138-7c05-4122-88f1-9e7a536914e9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"48f92138-7c05-4122-88f1-9e7a536914e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:29:54.155953 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:54.155930    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/48f92138-7c05-4122-88f1-9e7a536914e9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"48f92138-7c05-4122-88f1-9e7a536914e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:29:54.156037 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:54.156019    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/48f92138-7c05-4122-88f1-9e7a536914e9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"48f92138-7c05-4122-88f1-9e7a536914e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:29:54.156941 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:54.156910    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/48f92138-7c05-4122-88f1-9e7a536914e9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"48f92138-7c05-4122-88f1-9e7a536914e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:29:54.157045 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:54.156999    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/48f92138-7c05-4122-88f1-9e7a536914e9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"48f92138-7c05-4122-88f1-9e7a536914e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:29:54.157314 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:54.157291    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/48f92138-7c05-4122-88f1-9e7a536914e9-config-out\") pod \"prometheus-k8s-0\" (UID: \"48f92138-7c05-4122-88f1-9e7a536914e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:29:54.157631 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:54.157612    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/48f92138-7c05-4122-88f1-9e7a536914e9-config\") pod \"prometheus-k8s-0\" (UID: \"48f92138-7c05-4122-88f1-9e7a536914e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:29:54.157738 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:54.157718    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/48f92138-7c05-4122-88f1-9e7a536914e9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"48f92138-7c05-4122-88f1-9e7a536914e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:29:54.157793 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:54.157738    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/48f92138-7c05-4122-88f1-9e7a536914e9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"48f92138-7c05-4122-88f1-9e7a536914e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:29:54.158525 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:54.158503    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/48f92138-7c05-4122-88f1-9e7a536914e9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"48f92138-7c05-4122-88f1-9e7a536914e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:29:54.165600 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:54.165568    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlk5q\" (UniqueName: \"kubernetes.io/projected/48f92138-7c05-4122-88f1-9e7a536914e9-kube-api-access-jlk5q\") pod \"prometheus-k8s-0\" (UID: \"48f92138-7c05-4122-88f1-9e7a536914e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:29:54.229629 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:54.229590    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:29:54.386287 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:54.386252    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 16:29:54.390975 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:29:54.390946    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48f92138_7c05_4122_88f1_9e7a536914e9.slice/crio-f34ce41cf336c0afaad606379473b6925f3e8c9c5f8e7841d47d9434bf32aca7 WatchSource:0}: Error finding container f34ce41cf336c0afaad606379473b6925f3e8c9c5f8e7841d47d9434bf32aca7: Status 404 returned error can't find the container with id f34ce41cf336c0afaad606379473b6925f3e8c9c5f8e7841d47d9434bf32aca7
Jul 07 16:29:54.513562 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:54.513531    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2916de3-ae2c-4839-8a1c-94866aabb272" path="/var/lib/kubelet/pods/a2916de3-ae2c-4839-8a1c-94866aabb272/volumes"
Jul 07 16:29:54.829271 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:54.829174    2578 generic.go:356] "Generic (PLEG): container finished" podID="48f92138-7c05-4122-88f1-9e7a536914e9" containerID="88f6a3eae278d1ff40a00617a250dec301d94f287692f7cac5e851d71c75276a" exitCode=0
Jul 07 16:29:54.829463 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:54.829264    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"48f92138-7c05-4122-88f1-9e7a536914e9","Type":"ContainerDied","Data":"88f6a3eae278d1ff40a00617a250dec301d94f287692f7cac5e851d71c75276a"}
Jul 07 16:29:54.829463 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:54.829340    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"48f92138-7c05-4122-88f1-9e7a536914e9","Type":"ContainerStarted","Data":"f34ce41cf336c0afaad606379473b6925f3e8c9c5f8e7841d47d9434bf32aca7"}
Jul 07 16:29:55.837736 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:55.837700    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"48f92138-7c05-4122-88f1-9e7a536914e9","Type":"ContainerStarted","Data":"efbfd6eeac8232724ad2729fae93ea7c12d7beaad05e4beb02ea3c701b1a1af7"}
Jul 07 16:29:55.838181 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:55.837792    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"48f92138-7c05-4122-88f1-9e7a536914e9","Type":"ContainerStarted","Data":"b8b6a8f496aee696ff8e8d91c6e6c41ffdff70a3850ce45d5ee755f4c7e550a8"}
Jul 07 16:29:55.838181 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:55.837820    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"48f92138-7c05-4122-88f1-9e7a536914e9","Type":"ContainerStarted","Data":"b9c097dccd75371d1b7a0b8199f61e1de03bea03044e65fd08e10be15d227d3f"}
Jul 07 16:29:55.838181 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:55.837844    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"48f92138-7c05-4122-88f1-9e7a536914e9","Type":"ContainerStarted","Data":"f31f5dd2659c98dccc35bee6f0f1288a824a867ae65d8883844872702e50e4f7"}
Jul 07 16:29:55.838181 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:55.837870    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"48f92138-7c05-4122-88f1-9e7a536914e9","Type":"ContainerStarted","Data":"7c5d6a10f9c8f4979eee558096411698872f2c56ec5576d77cfd742d4addf4f2"}
Jul 07 16:29:55.838181 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:55.837900    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"48f92138-7c05-4122-88f1-9e7a536914e9","Type":"ContainerStarted","Data":"a0ba75b87b9dbb8552410de8fdc60d6c2b69ca52dde9d054aef3539849bdc33b"}
Jul 07 16:29:55.878083 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:55.878025    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.858465007 podStartE2EDuration="2.878009692s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.544685ms" isStatefulPod=false podCreationTimestamp="2026-07-07 16:29:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:29:55.876327372 +0000 UTC m=+397.963295830" watchObservedRunningTime="2026-07-07 16:29:55.878009692 +0000 UTC m=+397.964978150"
Jul 07 16:29:59.229799 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:29:59.229759    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:30:54.230619 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:30:54.230581    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:30:54.246654 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:30:54.246626    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:30:55.082808 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:30:55.082779    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:32:58.136602 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:32:58.136566    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-778798b69f-8b2t2"]
Jul 07 16:32:58.139835 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:32:58.139817    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-778798b69f-8b2t2"
Jul 07 16:32:58.142974 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:32:58.142943    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 07 16:32:58.144258 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:32:58.144229    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 07 16:32:58.144419 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:32:58.144340    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-9z65z\""
Jul 07 16:32:58.144669 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:32:58.144650    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 07 16:32:58.144726 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:32:58.144701    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 07 16:32:58.147704 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:32:58.145041    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 07 16:32:58.153847 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:32:58.153818    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-778798b69f-8b2t2"]
Jul 07 16:32:58.197337 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:32:58.197292    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ccd0ce2f-0119-4a44-978f-c212a7b9e71f-cert\") pod \"lws-controller-manager-778798b69f-8b2t2\" (UID: \"ccd0ce2f-0119-4a44-978f-c212a7b9e71f\") " pod="openshift-lws-operator/lws-controller-manager-778798b69f-8b2t2"
Jul 07 16:32:58.197546 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:32:58.197437    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ccd0ce2f-0119-4a44-978f-c212a7b9e71f-manager-config\") pod \"lws-controller-manager-778798b69f-8b2t2\" (UID: \"ccd0ce2f-0119-4a44-978f-c212a7b9e71f\") " pod="openshift-lws-operator/lws-controller-manager-778798b69f-8b2t2"
Jul 07 16:32:58.197546 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:32:58.197489    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfn76\" (UniqueName: \"kubernetes.io/projected/ccd0ce2f-0119-4a44-978f-c212a7b9e71f-kube-api-access-sfn76\") pod \"lws-controller-manager-778798b69f-8b2t2\" (UID: \"ccd0ce2f-0119-4a44-978f-c212a7b9e71f\") " pod="openshift-lws-operator/lws-controller-manager-778798b69f-8b2t2"
Jul 07 16:32:58.197546 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:32:58.197511    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ccd0ce2f-0119-4a44-978f-c212a7b9e71f-metrics-cert\") pod \"lws-controller-manager-778798b69f-8b2t2\" (UID: \"ccd0ce2f-0119-4a44-978f-c212a7b9e71f\") " pod="openshift-lws-operator/lws-controller-manager-778798b69f-8b2t2"
Jul 07 16:32:58.298189 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:32:58.298151    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ccd0ce2f-0119-4a44-978f-c212a7b9e71f-manager-config\") pod \"lws-controller-manager-778798b69f-8b2t2\" (UID: \"ccd0ce2f-0119-4a44-978f-c212a7b9e71f\") " pod="openshift-lws-operator/lws-controller-manager-778798b69f-8b2t2"
Jul 07 16:32:58.298189 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:32:58.298204    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfn76\" (UniqueName: \"kubernetes.io/projected/ccd0ce2f-0119-4a44-978f-c212a7b9e71f-kube-api-access-sfn76\") pod \"lws-controller-manager-778798b69f-8b2t2\" (UID: \"ccd0ce2f-0119-4a44-978f-c212a7b9e71f\") " pod="openshift-lws-operator/lws-controller-manager-778798b69f-8b2t2"
Jul 07 16:32:58.298464 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:32:58.298224    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ccd0ce2f-0119-4a44-978f-c212a7b9e71f-metrics-cert\") pod \"lws-controller-manager-778798b69f-8b2t2\" (UID: \"ccd0ce2f-0119-4a44-978f-c212a7b9e71f\") " pod="openshift-lws-operator/lws-controller-manager-778798b69f-8b2t2"
Jul 07 16:32:58.298464 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:32:58.298244    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ccd0ce2f-0119-4a44-978f-c212a7b9e71f-cert\") pod \"lws-controller-manager-778798b69f-8b2t2\" (UID: \"ccd0ce2f-0119-4a44-978f-c212a7b9e71f\") " pod="openshift-lws-operator/lws-controller-manager-778798b69f-8b2t2"
Jul 07 16:32:58.298972 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:32:58.298948    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ccd0ce2f-0119-4a44-978f-c212a7b9e71f-manager-config\") pod \"lws-controller-manager-778798b69f-8b2t2\" (UID: \"ccd0ce2f-0119-4a44-978f-c212a7b9e71f\") " pod="openshift-lws-operator/lws-controller-manager-778798b69f-8b2t2"
Jul 07 16:32:58.300936 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:32:58.300911    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ccd0ce2f-0119-4a44-978f-c212a7b9e71f-metrics-cert\") pod \"lws-controller-manager-778798b69f-8b2t2\" (UID: \"ccd0ce2f-0119-4a44-978f-c212a7b9e71f\") " pod="openshift-lws-operator/lws-controller-manager-778798b69f-8b2t2"
Jul 07 16:32:58.301043 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:32:58.300911    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ccd0ce2f-0119-4a44-978f-c212a7b9e71f-cert\") pod \"lws-controller-manager-778798b69f-8b2t2\" (UID: \"ccd0ce2f-0119-4a44-978f-c212a7b9e71f\") " pod="openshift-lws-operator/lws-controller-manager-778798b69f-8b2t2"
Jul 07 16:32:58.308153 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:32:58.308132    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfn76\" (UniqueName: \"kubernetes.io/projected/ccd0ce2f-0119-4a44-978f-c212a7b9e71f-kube-api-access-sfn76\") pod \"lws-controller-manager-778798b69f-8b2t2\" (UID: \"ccd0ce2f-0119-4a44-978f-c212a7b9e71f\") " pod="openshift-lws-operator/lws-controller-manager-778798b69f-8b2t2"
Jul 07 16:32:58.452246 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:32:58.452152    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-778798b69f-8b2t2"
Jul 07 16:32:58.609241 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:32:58.609207    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-778798b69f-8b2t2"]
Jul 07 16:32:58.612286 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:32:58.612259    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccd0ce2f_0119_4a44_978f_c212a7b9e71f.slice/crio-daa9ba8f0ee3c9af447c76fcd6033b28f19898a21c389a41a97648256237acec WatchSource:0}: Error finding container daa9ba8f0ee3c9af447c76fcd6033b28f19898a21c389a41a97648256237acec: Status 404 returned error can't find the container with id daa9ba8f0ee3c9af447c76fcd6033b28f19898a21c389a41a97648256237acec
Jul 07 16:32:59.526950 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:32:59.526914    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-778798b69f-8b2t2" event={"ID":"ccd0ce2f-0119-4a44-978f-c212a7b9e71f","Type":"ContainerStarted","Data":"daa9ba8f0ee3c9af447c76fcd6033b28f19898a21c389a41a97648256237acec"}
Jul 07 16:33:01.537002 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:33:01.536919    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-778798b69f-8b2t2" event={"ID":"ccd0ce2f-0119-4a44-978f-c212a7b9e71f","Type":"ContainerStarted","Data":"1c4c228c6d95d17aa79671d03e049b93133539772a4530632167722add3e918a"}
Jul 07 16:33:01.537393 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:33:01.537008    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-778798b69f-8b2t2"
Jul 07 16:33:01.557894 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:33:01.557843    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-778798b69f-8b2t2" podStartSLOduration=0.973540246 podStartE2EDuration="3.557826071s" totalImagesPullingTime="2.584285825s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:32:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:33:01.556329203 +0000 UTC m=+583.643297663" watchObservedRunningTime="2026-07-07 16:33:01.557826071 +0000 UTC m=+583.644794566"
Jul 07 16:33:10.438374 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:33:10.436186    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7fb6d99899-499sg"]
Jul 07 16:33:10.440697 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:33:10.440670    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7fb6d99899-499sg"
Jul 07 16:33:10.443209 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:33:10.443187    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 07 16:33:10.443677 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:33:10.443659    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 07 16:33:10.443805 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:33:10.443685    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-9fsmk\""
Jul 07 16:33:10.444021 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:33:10.444002    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 07 16:33:10.444084 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:33:10.444069    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 07 16:33:10.457852 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:33:10.457816    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7fb6d99899-499sg"]
Jul 07 16:33:10.510845 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:33:10.510804    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6e9ea2bd-5f43-40f4-a287-07ebc83fb243-webhook-cert\") pod \"opendatahub-operator-controller-manager-7fb6d99899-499sg\" (UID: \"6e9ea2bd-5f43-40f4-a287-07ebc83fb243\") " pod="opendatahub/opendatahub-operator-controller-manager-7fb6d99899-499sg"
Jul 07 16:33:10.510992 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:33:10.510848    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bs9zh\" (UniqueName: \"kubernetes.io/projected/6e9ea2bd-5f43-40f4-a287-07ebc83fb243-kube-api-access-bs9zh\") pod \"opendatahub-operator-controller-manager-7fb6d99899-499sg\" (UID: \"6e9ea2bd-5f43-40f4-a287-07ebc83fb243\") " pod="opendatahub/opendatahub-operator-controller-manager-7fb6d99899-499sg"
Jul 07 16:33:10.510992 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:33:10.510932    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6e9ea2bd-5f43-40f4-a287-07ebc83fb243-manifests\") pod \"opendatahub-operator-controller-manager-7fb6d99899-499sg\" (UID: \"6e9ea2bd-5f43-40f4-a287-07ebc83fb243\") " pod="opendatahub/opendatahub-operator-controller-manager-7fb6d99899-499sg"
Jul 07 16:33:10.511087 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:33:10.510992    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6e9ea2bd-5f43-40f4-a287-07ebc83fb243-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7fb6d99899-499sg\" (UID: \"6e9ea2bd-5f43-40f4-a287-07ebc83fb243\") " pod="opendatahub/opendatahub-operator-controller-manager-7fb6d99899-499sg"
Jul 07 16:33:10.511087 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:33:10.511028    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6e9ea2bd-5f43-40f4-a287-07ebc83fb243-tmp\") pod \"opendatahub-operator-controller-manager-7fb6d99899-499sg\" (UID: \"6e9ea2bd-5f43-40f4-a287-07ebc83fb243\") " pod="opendatahub/opendatahub-operator-controller-manager-7fb6d99899-499sg"
Jul 07 16:33:10.612516 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:33:10.612480    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6e9ea2bd-5f43-40f4-a287-07ebc83fb243-webhook-cert\") pod \"opendatahub-operator-controller-manager-7fb6d99899-499sg\" (UID: \"6e9ea2bd-5f43-40f4-a287-07ebc83fb243\") " pod="opendatahub/opendatahub-operator-controller-manager-7fb6d99899-499sg"
Jul 07 16:33:10.612516 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:33:10.612513    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bs9zh\" (UniqueName: \"kubernetes.io/projected/6e9ea2bd-5f43-40f4-a287-07ebc83fb243-kube-api-access-bs9zh\") pod \"opendatahub-operator-controller-manager-7fb6d99899-499sg\" (UID: \"6e9ea2bd-5f43-40f4-a287-07ebc83fb243\") " pod="opendatahub/opendatahub-operator-controller-manager-7fb6d99899-499sg"
Jul 07 16:33:10.612736 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:33:10.612543    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6e9ea2bd-5f43-40f4-a287-07ebc83fb243-manifests\") pod \"opendatahub-operator-controller-manager-7fb6d99899-499sg\" (UID: \"6e9ea2bd-5f43-40f4-a287-07ebc83fb243\") " pod="opendatahub/opendatahub-operator-controller-manager-7fb6d99899-499sg"
Jul 07 16:33:10.612736 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:33:10.612609    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6e9ea2bd-5f43-40f4-a287-07ebc83fb243-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7fb6d99899-499sg\" (UID: \"6e9ea2bd-5f43-40f4-a287-07ebc83fb243\") " pod="opendatahub/opendatahub-operator-controller-manager-7fb6d99899-499sg"
Jul 07 16:33:10.612844 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:33:10.612764    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6e9ea2bd-5f43-40f4-a287-07ebc83fb243-tmp\") pod \"opendatahub-operator-controller-manager-7fb6d99899-499sg\" (UID: \"6e9ea2bd-5f43-40f4-a287-07ebc83fb243\") " pod="opendatahub/opendatahub-operator-controller-manager-7fb6d99899-499sg"
Jul 07 16:33:10.612982 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:33:10.612959    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6e9ea2bd-5f43-40f4-a287-07ebc83fb243-manifests\") pod \"opendatahub-operator-controller-manager-7fb6d99899-499sg\" (UID: \"6e9ea2bd-5f43-40f4-a287-07ebc83fb243\") " pod="opendatahub/opendatahub-operator-controller-manager-7fb6d99899-499sg"
Jul 07 16:33:10.615106 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:33:10.615080    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6e9ea2bd-5f43-40f4-a287-07ebc83fb243-tmp\") pod \"opendatahub-operator-controller-manager-7fb6d99899-499sg\" (UID: \"6e9ea2bd-5f43-40f4-a287-07ebc83fb243\") " pod="opendatahub/opendatahub-operator-controller-manager-7fb6d99899-499sg"
Jul 07 16:33:10.615339 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:33:10.615315    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6e9ea2bd-5f43-40f4-a287-07ebc83fb243-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7fb6d99899-499sg\" (UID: \"6e9ea2bd-5f43-40f4-a287-07ebc83fb243\") " pod="opendatahub/opendatahub-operator-controller-manager-7fb6d99899-499sg"
Jul 07 16:33:10.615412 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:33:10.615397    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6e9ea2bd-5f43-40f4-a287-07ebc83fb243-webhook-cert\") pod \"opendatahub-operator-controller-manager-7fb6d99899-499sg\" (UID: \"6e9ea2bd-5f43-40f4-a287-07ebc83fb243\") " pod="opendatahub/opendatahub-operator-controller-manager-7fb6d99899-499sg"
Jul 07 16:33:10.624233 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:33:10.624207    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bs9zh\" (UniqueName: \"kubernetes.io/projected/6e9ea2bd-5f43-40f4-a287-07ebc83fb243-kube-api-access-bs9zh\") pod \"opendatahub-operator-controller-manager-7fb6d99899-499sg\" (UID: \"6e9ea2bd-5f43-40f4-a287-07ebc83fb243\") " pod="opendatahub/opendatahub-operator-controller-manager-7fb6d99899-499sg"
Jul 07 16:33:10.751714 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:33:10.751625    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7fb6d99899-499sg"
Jul 07 16:33:10.895608 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:33:10.895509    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7fb6d99899-499sg"]
Jul 07 16:33:10.899557 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:33:10.899527    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e9ea2bd_5f43_40f4_a287_07ebc83fb243.slice/crio-61030614ce6a01a339698a454596bf424b60a42328ca4e25c475793e860c93c0 WatchSource:0}: Error finding container 61030614ce6a01a339698a454596bf424b60a42328ca4e25c475793e860c93c0: Status 404 returned error can't find the container with id 61030614ce6a01a339698a454596bf424b60a42328ca4e25c475793e860c93c0
Jul 07 16:33:11.576506 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:33:11.576463    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7fb6d99899-499sg" event={"ID":"6e9ea2bd-5f43-40f4-a287-07ebc83fb243","Type":"ContainerStarted","Data":"61030614ce6a01a339698a454596bf424b60a42328ca4e25c475793e860c93c0"}
Jul 07 16:33:12.545919 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:33:12.545889    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-778798b69f-8b2t2"
Jul 07 16:33:14.593624 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:33:14.593588    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7fb6d99899-499sg" event={"ID":"6e9ea2bd-5f43-40f4-a287-07ebc83fb243","Type":"ContainerStarted","Data":"0a114f716e8162a542313b8cf790db77fd8e81e26284599e67a35ae41496e199"}
Jul 07 16:33:15.599208 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:33:15.599172    2578 generic.go:356] "Generic (PLEG): container finished" podID="6e9ea2bd-5f43-40f4-a287-07ebc83fb243" containerID="0a114f716e8162a542313b8cf790db77fd8e81e26284599e67a35ae41496e199" exitCode=0
Jul 07 16:33:15.599649 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:33:15.599209    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7fb6d99899-499sg" event={"ID":"6e9ea2bd-5f43-40f4-a287-07ebc83fb243","Type":"ContainerDied","Data":"0a114f716e8162a542313b8cf790db77fd8e81e26284599e67a35ae41496e199"}
Jul 07 16:33:16.605599 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:33:16.605564    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7fb6d99899-499sg" event={"ID":"6e9ea2bd-5f43-40f4-a287-07ebc83fb243","Type":"ContainerStarted","Data":"1654fcf9059d62f8961311defc57b88bf2d1bdd68f36747157766b0de9649734"}
Jul 07 16:33:16.605998 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:33:16.605801    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7fb6d99899-499sg"
Jul 07 16:33:16.632573 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:33:16.632520    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7fb6d99899-499sg" podStartSLOduration=2.072977132 podStartE2EDuration="6.632503528s" totalImagesPullingTime="3.422650796s" totalInitContainerRuntime="1.1368756s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:33:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:33:16.631012345 +0000 UTC m=+598.717980805" watchObservedRunningTime="2026-07-07 16:33:16.632503528 +0000 UTC m=+598.719471986"
Jul 07 16:33:27.612047 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:33:27.612014    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7fb6d99899-499sg"
Jul 07 16:33:38.342608 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:33:38.342564    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgb25"]
Jul 07 16:33:38.353724 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:33:38.353693    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgb25"
Jul 07 16:33:38.357909 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:33:38.357881    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 07 16:33:38.358093 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:33:38.358015    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 07 16:33:38.358093 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:33:38.358031    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 07 16:33:38.358214 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:33:38.358107    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-vmn9p\""
Jul 07 16:33:38.358303 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:33:38.358267    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 07 16:33:38.369752 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:33:38.369717    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgb25"]
Jul 07 16:33:38.451141 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:33:38.451099    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/481ab942-bed0-43b2-b9e4-f3dcc6d3d857-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-xgb25\" (UID: \"481ab942-bed0-43b2-b9e4-f3dcc6d3d857\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgb25"
Jul 07 16:33:38.451141 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:33:38.451150    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/481ab942-bed0-43b2-b9e4-f3dcc6d3d857-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-xgb25\" (UID: \"481ab942-bed0-43b2-b9e4-f3dcc6d3d857\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgb25"
Jul 07 16:33:38.451473 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:33:38.451171    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzngn\" (UniqueName: \"kubernetes.io/projected/481ab942-bed0-43b2-b9e4-f3dcc6d3d857-kube-api-access-wzngn\") pod \"istiod-openshift-gateway-94bb8fbfd-xgb25\" (UID: \"481ab942-bed0-43b2-b9e4-f3dcc6d3d857\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgb25"
Jul 07 16:33:38.451473 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:33:38.451189    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/481ab942-bed0-43b2-b9e4-f3dcc6d3d857-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-xgb25\" (UID: \"481ab942-bed0-43b2-b9e4-f3dcc6d3d857\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgb25"
Jul 07 16:33:38.451473 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:33:38.451272    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/481ab942-bed0-43b2-b9e4-f3dcc6d3d857-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-xgb25\" (UID: \"481ab942-bed0-43b2-b9e4-f3dcc6d3d857\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgb25"
Jul 07 16:33:38.451473 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:33:38.451312    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/481ab942-bed0-43b2-b9e4-f3dcc6d3d857-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-xgb25\" (UID: \"481ab942-bed0-43b2-b9e4-f3dcc6d3d857\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgb25"
Jul 07 16:33:38.451473 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:33:38.451335    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/481ab942-bed0-43b2-b9e4-f3dcc6d3d857-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-xgb25\" (UID: \"481ab942-bed0-43b2-b9e4-f3dcc6d3d857\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgb25"
Jul 07 16:33:38.552096 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:33:38.552059    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/481ab942-bed0-43b2-b9e4-f3dcc6d3d857-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-xgb25\" (UID: \"481ab942-bed0-43b2-b9e4-f3dcc6d3d857\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgb25"
Jul 07 16:33:38.552096 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:33:38.552093    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzngn\" (UniqueName: \"kubernetes.io/projected/481ab942-bed0-43b2-b9e4-f3dcc6d3d857-kube-api-access-wzngn\") pod \"istiod-openshift-gateway-94bb8fbfd-xgb25\" (UID: \"481ab942-bed0-43b2-b9e4-f3dcc6d3d857\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgb25"
Jul 07 16:33:38.552394 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:33:38.552115    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/481ab942-bed0-43b2-b9e4-f3dcc6d3d857-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-xgb25\" (UID: \"481ab942-bed0-43b2-b9e4-f3dcc6d3d857\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgb25"
Jul 07 16:33:38.552394 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:33:38.552144    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/481ab942-bed0-43b2-b9e4-f3dcc6d3d857-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-xgb25\" (UID: \"481ab942-bed0-43b2-b9e4-f3dcc6d3d857\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgb25"
Jul 07 16:33:38.552394 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:33:38.552163    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/481ab942-bed0-43b2-b9e4-f3dcc6d3d857-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-xgb25\" (UID: \"481ab942-bed0-43b2-b9e4-f3dcc6d3d857\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgb25"
Jul 07 16:33:38.552394 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:33:38.552178    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/481ab942-bed0-43b2-b9e4-f3dcc6d3d857-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-xgb25\" (UID: \"481ab942-bed0-43b2-b9e4-f3dcc6d3d857\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgb25"
Jul 07 16:33:38.552394 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:33:38.552226    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/481ab942-bed0-43b2-b9e4-f3dcc6d3d857-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-xgb25\" (UID: \"481ab942-bed0-43b2-b9e4-f3dcc6d3d857\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgb25"
Jul 07 16:33:38.552886 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:33:38.552863    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/481ab942-bed0-43b2-b9e4-f3dcc6d3d857-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-xgb25\" (UID: \"481ab942-bed0-43b2-b9e4-f3dcc6d3d857\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgb25"
Jul 07 16:33:38.554592 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:33:38.554560    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/481ab942-bed0-43b2-b9e4-f3dcc6d3d857-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-xgb25\" (UID: \"481ab942-bed0-43b2-b9e4-f3dcc6d3d857\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgb25"
Jul 07 16:33:38.554748 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:33:38.554730    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/481ab942-bed0-43b2-b9e4-f3dcc6d3d857-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-xgb25\" (UID: \"481ab942-bed0-43b2-b9e4-f3dcc6d3d857\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgb25"
Jul 07 16:33:38.554951 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:33:38.554934    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/481ab942-bed0-43b2-b9e4-f3dcc6d3d857-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-xgb25\" (UID: \"481ab942-bed0-43b2-b9e4-f3dcc6d3d857\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgb25"
Jul 07 16:33:38.554995 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:33:38.554972    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/481ab942-bed0-43b2-b9e4-f3dcc6d3d857-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-xgb25\" (UID: \"481ab942-bed0-43b2-b9e4-f3dcc6d3d857\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgb25"
Jul 07 16:33:38.562667 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:33:38.562634    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/481ab942-bed0-43b2-b9e4-f3dcc6d3d857-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-xgb25\" (UID: \"481ab942-bed0-43b2-b9e4-f3dcc6d3d857\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgb25"
Jul 07 16:33:38.562806 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:33:38.562750    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzngn\" (UniqueName: \"kubernetes.io/projected/481ab942-bed0-43b2-b9e4-f3dcc6d3d857-kube-api-access-wzngn\") pod \"istiod-openshift-gateway-94bb8fbfd-xgb25\" (UID: \"481ab942-bed0-43b2-b9e4-f3dcc6d3d857\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgb25"
Jul 07 16:33:38.664873 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:33:38.664783    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgb25"
Jul 07 16:33:38.881297 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:33:38.881263    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgb25"]
Jul 07 16:33:38.884483 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:33:38.884453    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod481ab942_bed0_43b2_b9e4_f3dcc6d3d857.slice/crio-2d6b113f3fa9bd7ba1caa280b62c02e46d4c514547889396eb13829971c58ab8 WatchSource:0}: Error finding container 2d6b113f3fa9bd7ba1caa280b62c02e46d4c514547889396eb13829971c58ab8: Status 404 returned error can't find the container with id 2d6b113f3fa9bd7ba1caa280b62c02e46d4c514547889396eb13829971c58ab8
Jul 07 16:33:38.886723 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:33:38.886704    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 16:33:39.704712 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:33:39.704571    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgb25" event={"ID":"481ab942-bed0-43b2-b9e4-f3dcc6d3d857","Type":"ContainerStarted","Data":"2d6b113f3fa9bd7ba1caa280b62c02e46d4c514547889396eb13829971c58ab8"}
Jul 07 16:33:41.090780 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:33:41.090741    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 16:33:41.091060 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:33:41.090819    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 16:33:41.718605 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:33:41.718572    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgb25" event={"ID":"481ab942-bed0-43b2-b9e4-f3dcc6d3d857","Type":"ContainerStarted","Data":"cfc42ba93e0ca555d3ed772a45f8213296e9dcf14ee36cdfaf0f9e3622f0ba72"}
Jul 07 16:33:41.718787 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:33:41.718685    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgb25"
Jul 07 16:33:41.905566 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:33:41.905511    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgb25" podStartSLOduration=1.70190821 podStartE2EDuration="3.905492568s" totalImagesPullingTime="2.203584358s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:33:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:33:41.904795996 +0000 UTC m=+623.991764457" watchObservedRunningTime="2026-07-07 16:33:41.905492568 +0000 UTC m=+623.992461025"
Jul 07 16:33:42.724492 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:33:42.724466    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgb25"
Jul 07 16:36:04.538168 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:36:04.538129    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:36:04.541574 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:36:04.541557    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"
Jul 07 16:36:04.545538 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:36:04.545512    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-7cb8t\""
Jul 07 16:36:04.545813 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:36:04.545795    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 07 16:36:04.546536 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:36:04.546518    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 07 16:36:04.546639 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:36:04.546614    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 07 16:36:04.559996 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:36:04.559967    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:36:04.609061 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:36:04.609024    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:36:04.612918 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:36:04.612892    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qtgn\" (UniqueName: \"kubernetes.io/projected/a12e4193-f796-4004-bfc8-39486dea1c7d-kube-api-access-5qtgn\") pod \"limitador-limitador-54d6d988d5-4jvmb\" (UID: \"a12e4193-f796-4004-bfc8-39486dea1c7d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"
Jul 07 16:36:04.613053 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:36:04.612964    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a12e4193-f796-4004-bfc8-39486dea1c7d-config-file\") pod \"limitador-limitador-54d6d988d5-4jvmb\" (UID: \"a12e4193-f796-4004-bfc8-39486dea1c7d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"
Jul 07 16:36:04.713850 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:36:04.713808    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a12e4193-f796-4004-bfc8-39486dea1c7d-config-file\") pod \"limitador-limitador-54d6d988d5-4jvmb\" (UID: \"a12e4193-f796-4004-bfc8-39486dea1c7d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"
Jul 07 16:36:04.714025 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:36:04.713910    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qtgn\" (UniqueName: \"kubernetes.io/projected/a12e4193-f796-4004-bfc8-39486dea1c7d-kube-api-access-5qtgn\") pod \"limitador-limitador-54d6d988d5-4jvmb\" (UID: \"a12e4193-f796-4004-bfc8-39486dea1c7d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"
Jul 07 16:36:04.714506 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:36:04.714485    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a12e4193-f796-4004-bfc8-39486dea1c7d-config-file\") pod \"limitador-limitador-54d6d988d5-4jvmb\" (UID: \"a12e4193-f796-4004-bfc8-39486dea1c7d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"
Jul 07 16:36:04.727437 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:36:04.727411    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qtgn\" (UniqueName: \"kubernetes.io/projected/a12e4193-f796-4004-bfc8-39486dea1c7d-kube-api-access-5qtgn\") pod \"limitador-limitador-54d6d988d5-4jvmb\" (UID: \"a12e4193-f796-4004-bfc8-39486dea1c7d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"
Jul 07 16:36:04.851612 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:36:04.851569    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"
Jul 07 16:36:05.009578 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:36:05.009544    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:36:05.013383 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:36:05.013330    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda12e4193_f796_4004_bfc8_39486dea1c7d.slice/crio-f07fa4386142bcac1740c427164f367adf9e0defaf6cc57688b5f9b79e74ebc3 WatchSource:0}: Error finding container f07fa4386142bcac1740c427164f367adf9e0defaf6cc57688b5f9b79e74ebc3: Status 404 returned error can't find the container with id f07fa4386142bcac1740c427164f367adf9e0defaf6cc57688b5f9b79e74ebc3
Jul 07 16:36:05.332570 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:36:05.332532    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-4jvmb" event={"ID":"a12e4193-f796-4004-bfc8-39486dea1c7d","Type":"ContainerStarted","Data":"f07fa4386142bcac1740c427164f367adf9e0defaf6cc57688b5f9b79e74ebc3"}
Jul 07 16:36:08.348381 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:36:08.348320    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-4jvmb" event={"ID":"a12e4193-f796-4004-bfc8-39486dea1c7d","Type":"ContainerStarted","Data":"2cac8d778a6add8b98294487ac6df4dfd57984143e06dd8eb5aedd0e532ae31d"}
Jul 07 16:36:08.348868 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:36:08.348510    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"
Jul 07 16:36:08.372636 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:36:08.372575    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-4jvmb" podStartSLOduration=1.871736459 podStartE2EDuration="4.372558725s" totalImagesPullingTime="2.500822266s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:36:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:36:08.37030875 +0000 UTC m=+770.457277209" watchObservedRunningTime="2026-07-07 16:36:08.372558725 +0000 UTC m=+770.459527238"
Jul 07 16:36:19.355187 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:36:19.355156    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"
Jul 07 16:37:20.485425 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:37:20.485383    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:37:39.604927 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:37:39.604891    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4djll"]
Jul 07 16:37:39.608382 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:37:39.608333    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4djll"
Jul 07 16:37:39.612259 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:37:39.612235    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 07 16:37:39.612259 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:37:39.612252    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 07 16:37:39.612472 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:37:39.612366    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-xlwbt\""
Jul 07 16:37:39.612472 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:37:39.612375    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 07 16:37:39.635521 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:37:39.635487    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4djll"]
Jul 07 16:37:39.765201 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:37:39.765151    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58c2fa5a-daf6-43b8-8c69-f1c4e031bb31-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4djll\" (UID: \"58c2fa5a-daf6-43b8-8c69-f1c4e031bb31\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4djll"
Jul 07 16:37:39.765201 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:37:39.765201    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58c2fa5a-daf6-43b8-8c69-f1c4e031bb31-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4djll\" (UID: \"58c2fa5a-daf6-43b8-8c69-f1c4e031bb31\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4djll"
Jul 07 16:37:39.765497 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:37:39.765229    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58c2fa5a-daf6-43b8-8c69-f1c4e031bb31-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4djll\" (UID: \"58c2fa5a-daf6-43b8-8c69-f1c4e031bb31\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4djll"
Jul 07 16:37:39.765497 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:37:39.765304    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58c2fa5a-daf6-43b8-8c69-f1c4e031bb31-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4djll\" (UID: \"58c2fa5a-daf6-43b8-8c69-f1c4e031bb31\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4djll"
Jul 07 16:37:39.765497 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:37:39.765398    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5cc4\" (UniqueName: \"kubernetes.io/projected/58c2fa5a-daf6-43b8-8c69-f1c4e031bb31-kube-api-access-n5cc4\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4djll\" (UID: \"58c2fa5a-daf6-43b8-8c69-f1c4e031bb31\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4djll"
Jul 07 16:37:39.765497 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:37:39.765427    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58c2fa5a-daf6-43b8-8c69-f1c4e031bb31-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4djll\" (UID: \"58c2fa5a-daf6-43b8-8c69-f1c4e031bb31\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4djll"
Jul 07 16:37:39.866848 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:37:39.866755    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58c2fa5a-daf6-43b8-8c69-f1c4e031bb31-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4djll\" (UID: \"58c2fa5a-daf6-43b8-8c69-f1c4e031bb31\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4djll"
Jul 07 16:37:39.866848 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:37:39.866797    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58c2fa5a-daf6-43b8-8c69-f1c4e031bb31-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4djll\" (UID: \"58c2fa5a-daf6-43b8-8c69-f1c4e031bb31\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4djll"
Jul 07 16:37:39.866848 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:37:39.866823    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58c2fa5a-daf6-43b8-8c69-f1c4e031bb31-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4djll\" (UID: \"58c2fa5a-daf6-43b8-8c69-f1c4e031bb31\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4djll"
Jul 07 16:37:39.866848 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:37:39.866844    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58c2fa5a-daf6-43b8-8c69-f1c4e031bb31-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4djll\" (UID: \"58c2fa5a-daf6-43b8-8c69-f1c4e031bb31\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4djll"
Jul 07 16:37:39.867155 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:37:39.866902    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5cc4\" (UniqueName: \"kubernetes.io/projected/58c2fa5a-daf6-43b8-8c69-f1c4e031bb31-kube-api-access-n5cc4\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4djll\" (UID: \"58c2fa5a-daf6-43b8-8c69-f1c4e031bb31\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4djll"
Jul 07 16:37:39.867155 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:37:39.866928    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58c2fa5a-daf6-43b8-8c69-f1c4e031bb31-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4djll\" (UID: \"58c2fa5a-daf6-43b8-8c69-f1c4e031bb31\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4djll"
Jul 07 16:37:39.867263 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:37:39.867239    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58c2fa5a-daf6-43b8-8c69-f1c4e031bb31-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4djll\" (UID: \"58c2fa5a-daf6-43b8-8c69-f1c4e031bb31\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4djll"
Jul 07 16:37:39.867321 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:37:39.867303    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58c2fa5a-daf6-43b8-8c69-f1c4e031bb31-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4djll\" (UID: \"58c2fa5a-daf6-43b8-8c69-f1c4e031bb31\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4djll"
Jul 07 16:37:39.867404 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:37:39.867300    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58c2fa5a-daf6-43b8-8c69-f1c4e031bb31-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4djll\" (UID: \"58c2fa5a-daf6-43b8-8c69-f1c4e031bb31\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4djll"
Jul 07 16:37:39.869265 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:37:39.869243    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58c2fa5a-daf6-43b8-8c69-f1c4e031bb31-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4djll\" (UID: \"58c2fa5a-daf6-43b8-8c69-f1c4e031bb31\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4djll"
Jul 07 16:37:39.869525 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:37:39.869507    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58c2fa5a-daf6-43b8-8c69-f1c4e031bb31-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4djll\" (UID: \"58c2fa5a-daf6-43b8-8c69-f1c4e031bb31\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4djll"
Jul 07 16:37:39.877915 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:37:39.877880    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5cc4\" (UniqueName: \"kubernetes.io/projected/58c2fa5a-daf6-43b8-8c69-f1c4e031bb31-kube-api-access-n5cc4\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4djll\" (UID: \"58c2fa5a-daf6-43b8-8c69-f1c4e031bb31\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4djll"
Jul 07 16:37:39.919061 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:37:39.919025    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4djll"
Jul 07 16:37:40.059733 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:37:40.059695    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4djll"]
Jul 07 16:37:40.062649 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:37:40.062608    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58c2fa5a_daf6_43b8_8c69_f1c4e031bb31.slice/crio-c3e10b00418754be37a78ad0ae97320f580b3ffb039f2a1b725ba231be2336f6 WatchSource:0}: Error finding container c3e10b00418754be37a78ad0ae97320f580b3ffb039f2a1b725ba231be2336f6: Status 404 returned error can't find the container with id c3e10b00418754be37a78ad0ae97320f580b3ffb039f2a1b725ba231be2336f6
Jul 07 16:37:40.178793 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:37:40.178704    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:37:40.745687 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:37:40.745652    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4djll" event={"ID":"58c2fa5a-daf6-43b8-8c69-f1c4e031bb31","Type":"ContainerStarted","Data":"c3e10b00418754be37a78ad0ae97320f580b3ffb039f2a1b725ba231be2336f6"}
Jul 07 16:37:41.752258 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:37:41.752224    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4djll" event={"ID":"58c2fa5a-daf6-43b8-8c69-f1c4e031bb31","Type":"ContainerStarted","Data":"73728895e4d1a4caaa60ff59cd3c6b7e80ca032ee00b6667e5e819f3765be0a7"}
Jul 07 16:37:41.775596 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:37:41.775533    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4djll" podStartSLOduration=1.572877272 podStartE2EDuration="2.775515017s" totalImagesPullingTime="1.202637745s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:37:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:37:41.774373933 +0000 UTC m=+863.861342395" watchObservedRunningTime="2026-07-07 16:37:41.775515017 +0000 UTC m=+863.862483503"
Jul 07 16:37:45.583404 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:37:45.583370    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:37:49.919811 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:37:49.919752    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4djll"
Jul 07 16:37:49.920283 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:37:49.919846    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4djll"
Jul 07 16:37:49.932657 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:37:49.932628    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4djll"
Jul 07 16:37:50.801550 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:37:50.801517    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4djll"
Jul 07 16:38:01.148999 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:38:01.148961    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:38:05.908193 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:38:05.908155    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:38:07.479215 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:38:07.479179    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-h6gz7"]
Jul 07 16:38:07.485331 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:38:07.485304    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h6gz7"
Jul 07 16:38:07.488570 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:38:07.488545    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 07 16:38:07.504606 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:38:07.504572    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-h6gz7"]
Jul 07 16:38:07.609596 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:38:07.609556    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9147a413-91ea-4b3f-a8a5-c394a0239882-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-h6gz7\" (UID: \"9147a413-91ea-4b3f-a8a5-c394a0239882\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h6gz7"
Jul 07 16:38:07.609778 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:38:07.609611    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9147a413-91ea-4b3f-a8a5-c394a0239882-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-h6gz7\" (UID: \"9147a413-91ea-4b3f-a8a5-c394a0239882\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h6gz7"
Jul 07 16:38:07.609778 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:38:07.609641    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9147a413-91ea-4b3f-a8a5-c394a0239882-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-h6gz7\" (UID: \"9147a413-91ea-4b3f-a8a5-c394a0239882\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h6gz7"
Jul 07 16:38:07.609778 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:38:07.609662    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9147a413-91ea-4b3f-a8a5-c394a0239882-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-h6gz7\" (UID: \"9147a413-91ea-4b3f-a8a5-c394a0239882\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h6gz7"
Jul 07 16:38:07.609778 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:38:07.609685    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwtl2\" (UniqueName: \"kubernetes.io/projected/9147a413-91ea-4b3f-a8a5-c394a0239882-kube-api-access-gwtl2\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-h6gz7\" (UID: \"9147a413-91ea-4b3f-a8a5-c394a0239882\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h6gz7"
Jul 07 16:38:07.609778 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:38:07.609757    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9147a413-91ea-4b3f-a8a5-c394a0239882-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-h6gz7\" (UID: \"9147a413-91ea-4b3f-a8a5-c394a0239882\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h6gz7"
Jul 07 16:38:07.710496 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:38:07.710458    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9147a413-91ea-4b3f-a8a5-c394a0239882-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-h6gz7\" (UID: \"9147a413-91ea-4b3f-a8a5-c394a0239882\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h6gz7"
Jul 07 16:38:07.710496 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:38:07.710496    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9147a413-91ea-4b3f-a8a5-c394a0239882-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-h6gz7\" (UID: \"9147a413-91ea-4b3f-a8a5-c394a0239882\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h6gz7"
Jul 07 16:38:07.710736 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:38:07.710527    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9147a413-91ea-4b3f-a8a5-c394a0239882-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-h6gz7\" (UID: \"9147a413-91ea-4b3f-a8a5-c394a0239882\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h6gz7"
Jul 07 16:38:07.710736 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:38:07.710560    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwtl2\" (UniqueName: \"kubernetes.io/projected/9147a413-91ea-4b3f-a8a5-c394a0239882-kube-api-access-gwtl2\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-h6gz7\" (UID: \"9147a413-91ea-4b3f-a8a5-c394a0239882\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h6gz7"
Jul 07 16:38:07.710736 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:38:07.710632    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9147a413-91ea-4b3f-a8a5-c394a0239882-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-h6gz7\" (UID: \"9147a413-91ea-4b3f-a8a5-c394a0239882\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h6gz7"
Jul 07 16:38:07.710736 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:38:07.710684    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9147a413-91ea-4b3f-a8a5-c394a0239882-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-h6gz7\" (UID: \"9147a413-91ea-4b3f-a8a5-c394a0239882\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h6gz7"
Jul 07 16:38:07.710948 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:38:07.710925    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9147a413-91ea-4b3f-a8a5-c394a0239882-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-h6gz7\" (UID: \"9147a413-91ea-4b3f-a8a5-c394a0239882\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h6gz7"
Jul 07 16:38:07.711010 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:38:07.710963    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9147a413-91ea-4b3f-a8a5-c394a0239882-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-h6gz7\" (UID: \"9147a413-91ea-4b3f-a8a5-c394a0239882\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h6gz7"
Jul 07 16:38:07.711082 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:38:07.711058    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9147a413-91ea-4b3f-a8a5-c394a0239882-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-h6gz7\" (UID: \"9147a413-91ea-4b3f-a8a5-c394a0239882\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h6gz7"
Jul 07 16:38:07.712887 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:38:07.712871    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9147a413-91ea-4b3f-a8a5-c394a0239882-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-h6gz7\" (UID: \"9147a413-91ea-4b3f-a8a5-c394a0239882\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h6gz7"
Jul 07 16:38:07.713062 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:38:07.713045    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9147a413-91ea-4b3f-a8a5-c394a0239882-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-h6gz7\" (UID: \"9147a413-91ea-4b3f-a8a5-c394a0239882\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h6gz7"
Jul 07 16:38:07.723957 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:38:07.723924    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwtl2\" (UniqueName: \"kubernetes.io/projected/9147a413-91ea-4b3f-a8a5-c394a0239882-kube-api-access-gwtl2\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-h6gz7\" (UID: \"9147a413-91ea-4b3f-a8a5-c394a0239882\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h6gz7"
Jul 07 16:38:07.826762 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:38:07.826667    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h6gz7"
Jul 07 16:38:07.977233 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:38:07.977146    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-h6gz7"]
Jul 07 16:38:07.981239 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:38:07.981209    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9147a413_91ea_4b3f_a8a5_c394a0239882.slice/crio-7c651d09cac36b72be9183eb21accb27bade8f6a9c52810071973ba85e1b5d97 WatchSource:0}: Error finding container 7c651d09cac36b72be9183eb21accb27bade8f6a9c52810071973ba85e1b5d97: Status 404 returned error can't find the container with id 7c651d09cac36b72be9183eb21accb27bade8f6a9c52810071973ba85e1b5d97
Jul 07 16:38:08.868318 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:38:08.868282    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h6gz7" event={"ID":"9147a413-91ea-4b3f-a8a5-c394a0239882","Type":"ContainerStarted","Data":"9c6c2cbba43dd2d7433d97b2020547b0fb5e8d678de497291d5c6927cf3f4909"}
Jul 07 16:38:08.868846 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:38:08.868369    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h6gz7" event={"ID":"9147a413-91ea-4b3f-a8a5-c394a0239882","Type":"ContainerStarted","Data":"7c651d09cac36b72be9183eb21accb27bade8f6a9c52810071973ba85e1b5d97"}
Jul 07 16:38:08.891743 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:38:08.891684    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h6gz7" podStartSLOduration=1.6743464829999999 podStartE2EDuration="1.891662161s" totalImagesPullingTime="217.315678ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:38:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:38:08.890234225 +0000 UTC m=+890.977202685" watchObservedRunningTime="2026-07-07 16:38:08.891662161 +0000 UTC m=+890.978630597"
Jul 07 16:38:13.482994 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:38:13.482949    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:38:17.827626 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:38:17.827585    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h6gz7"
Jul 07 16:38:17.828072 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:38:17.827649    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h6gz7"
Jul 07 16:38:17.843023 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:38:17.842993    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h6gz7"
Jul 07 16:38:17.918535 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:38:17.918503    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h6gz7"
Jul 07 16:38:18.678775 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:38:18.678727    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:39:41.577190 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:39:41.577105    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:39:53.700205 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:39:53.700167    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:40:01.993498 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:40:01.993462    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:40:11.986523 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:40:11.986477    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:40:22.075274 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:40:22.075235    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:40:50.197794 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:40:50.197751    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:41:01.803416 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:41:01.803379    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:41:16.531413 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:41:16.531291    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:41:25.198246 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:41:25.198206    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:41:46.179202 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:41:46.179159    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:41:55.967702 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:41:55.967645    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:42:03.381437 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:42:03.381395    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:42:13.676096 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:42:13.676049    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:42:23.375874 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:42:23.375835    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:42:32.071839 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:42:32.071803    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:42:43.272963 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:42:43.272879    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:42:50.081860 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:42:50.081814    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:42:56.865806 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:42:56.865769    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:43:06.570939 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:43:06.570900    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:43:18.615027 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:43:18.614990    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:43:27.970974 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:43:27.970929    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:43:53.679926 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:43:53.679889    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:44:03.570621 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:44:03.570581    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:44:23.978755 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:44:23.978670    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:44:32.195629 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:44:32.195587    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:44:42.569585 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:44:42.569551    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:44:51.067095 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:44:51.067050    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:45:01.104980 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:45:01.104935    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:46:53.471131 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:46:53.471095    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:47:01.980836 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:47:01.980798    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:47:15.785608 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:47:15.785574    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:47:27.380376 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:47:27.380312    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:47:38.371557 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:47:38.371521    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:47:48.673601 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:47:48.673557    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:47:57.486427 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:47:57.486379    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:48:09.074082 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:48:09.074042    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:48:18.970214 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:48:18.970180    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:48:29.389064 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:48:29.389012    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:48:38.971583 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:48:38.971540    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:49:02.414519 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:49:02.414479    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:49:11.482389 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:49:11.482331    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:49:22.877881 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:49:22.877848    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:49:32.989298 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:49:32.989249    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:49:47.682320 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:49:47.682281    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:49:58.179454 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:49:58.179419    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:50:06.574702 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:50:06.574663    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:50:15.729475 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:50:15.729392    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:50:24.980913 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:50:24.980867    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:50:35.569720 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:50:35.569682    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:51:04.078805 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:51:04.078764    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:51:13.089486 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:51:13.089450    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:51:23.894028 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:51:23.893990    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:51:32.687726 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:51:32.687682    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:51:43.787656 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:51:43.787567    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:51:51.778897 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:51:51.778857    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:52:00.989980 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:52:00.989945    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:52:09.476156 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:52:09.476120    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:52:18.281465 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:52:18.281428    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:52:31.423622 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:52:31.423588    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:52:43.274535 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:52:43.274495    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:52:51.485242 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:52:51.485201    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:53:00.474487 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:53:00.474455    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:53:08.665938 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:53:08.665901    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:53:17.481171 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:53:17.481128    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:53:27.000360 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:53:27.000313    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:53:39.285827 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:53:39.285780    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:54:01.480604 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:54:01.480568    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:54:08.678251 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:54:08.678211    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:55:33.179422 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:55:33.179380    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:55:39.879195 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:55:39.879158    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:55:46.977576 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:55:46.977528    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:55:56.176668 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:55:56.176625    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:56:09.408707 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:56:09.408625    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:56:42.311429 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:56:42.311375    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:56:51.720154 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:56:51.720115    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:57:06.353926 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:57:06.353889    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:57:19.881638 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:57:19.881598    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:57:59.579674 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:57:59.579627    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:58:14.552277 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:58:14.552239    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:58:24.469266 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:58:24.469221    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:59:12.301748 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:59:12.301651    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:59:22.794814 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:59:22.794772    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:59:36.286176 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:59:36.286138    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:59:43.782717 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:59:43.782676    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-4b5d6a/test-model-4b5d6a-kserve-9dd79ff9c-7mdj8"]
Jul 07 16:59:43.785891 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:59:43.785866    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-4b5d6a/test-model-4b5d6a-kserve-9dd79ff9c-7mdj8"
Jul 07 16:59:43.790063 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:59:43.790035    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-4b5d6a\"/\"kube-root-ca.crt\""
Jul 07 16:59:43.790224 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:59:43.790126    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-4b5d6a\"/\"test-model-4b5d6a-kserve-self-signed-certs\""
Jul 07 16:59:43.790224 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:59:43.790104    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-4b5d6a\"/\"default-dockercfg-vq2g2\""
Jul 07 16:59:43.790224 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:59:43.790100    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-4b5d6a\"/\"openshift-service-ca.crt\""
Jul 07 16:59:43.807599 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:59:43.807556    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-4b5d6a/test-model-4b5d6a-kserve-9dd79ff9c-7mdj8"]
Jul 07 16:59:43.914677 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:59:43.914629    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3b12749-fdda-4df9-a4fe-3b921b529576-home\") pod \"test-model-4b5d6a-kserve-9dd79ff9c-7mdj8\" (UID: \"f3b12749-fdda-4df9-a4fe-3b921b529576\") " pod="ai-tenant-e2e-inf-b-4b5d6a/test-model-4b5d6a-kserve-9dd79ff9c-7mdj8"
Jul 07 16:59:43.914677 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:59:43.914679    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3b12749-fdda-4df9-a4fe-3b921b529576-tmp-dir\") pod \"test-model-4b5d6a-kserve-9dd79ff9c-7mdj8\" (UID: \"f3b12749-fdda-4df9-a4fe-3b921b529576\") " pod="ai-tenant-e2e-inf-b-4b5d6a/test-model-4b5d6a-kserve-9dd79ff9c-7mdj8"
Jul 07 16:59:43.914890 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:59:43.914730    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3b12749-fdda-4df9-a4fe-3b921b529576-dshm\") pod \"test-model-4b5d6a-kserve-9dd79ff9c-7mdj8\" (UID: \"f3b12749-fdda-4df9-a4fe-3b921b529576\") " pod="ai-tenant-e2e-inf-b-4b5d6a/test-model-4b5d6a-kserve-9dd79ff9c-7mdj8"
Jul 07 16:59:43.914890 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:59:43.914745    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3b12749-fdda-4df9-a4fe-3b921b529576-tls-certs\") pod \"test-model-4b5d6a-kserve-9dd79ff9c-7mdj8\" (UID: \"f3b12749-fdda-4df9-a4fe-3b921b529576\") " pod="ai-tenant-e2e-inf-b-4b5d6a/test-model-4b5d6a-kserve-9dd79ff9c-7mdj8"
Jul 07 16:59:43.914890 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:59:43.914812    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3b12749-fdda-4df9-a4fe-3b921b529576-model-cache\") pod \"test-model-4b5d6a-kserve-9dd79ff9c-7mdj8\" (UID: \"f3b12749-fdda-4df9-a4fe-3b921b529576\") " pod="ai-tenant-e2e-inf-b-4b5d6a/test-model-4b5d6a-kserve-9dd79ff9c-7mdj8"
Jul 07 16:59:43.914890 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:59:43.914834    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8tzv\" (UniqueName: \"kubernetes.io/projected/f3b12749-fdda-4df9-a4fe-3b921b529576-kube-api-access-w8tzv\") pod \"test-model-4b5d6a-kserve-9dd79ff9c-7mdj8\" (UID: \"f3b12749-fdda-4df9-a4fe-3b921b529576\") " pod="ai-tenant-e2e-inf-b-4b5d6a/test-model-4b5d6a-kserve-9dd79ff9c-7mdj8"
Jul 07 16:59:44.016007 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:59:44.015970    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3b12749-fdda-4df9-a4fe-3b921b529576-model-cache\") pod \"test-model-4b5d6a-kserve-9dd79ff9c-7mdj8\" (UID: \"f3b12749-fdda-4df9-a4fe-3b921b529576\") " pod="ai-tenant-e2e-inf-b-4b5d6a/test-model-4b5d6a-kserve-9dd79ff9c-7mdj8"
Jul 07 16:59:44.016007 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:59:44.016012    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8tzv\" (UniqueName: \"kubernetes.io/projected/f3b12749-fdda-4df9-a4fe-3b921b529576-kube-api-access-w8tzv\") pod \"test-model-4b5d6a-kserve-9dd79ff9c-7mdj8\" (UID: \"f3b12749-fdda-4df9-a4fe-3b921b529576\") " pod="ai-tenant-e2e-inf-b-4b5d6a/test-model-4b5d6a-kserve-9dd79ff9c-7mdj8"
Jul 07 16:59:44.016238 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:59:44.016065    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3b12749-fdda-4df9-a4fe-3b921b529576-home\") pod \"test-model-4b5d6a-kserve-9dd79ff9c-7mdj8\" (UID: \"f3b12749-fdda-4df9-a4fe-3b921b529576\") " pod="ai-tenant-e2e-inf-b-4b5d6a/test-model-4b5d6a-kserve-9dd79ff9c-7mdj8"
Jul 07 16:59:44.016238 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:59:44.016089    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3b12749-fdda-4df9-a4fe-3b921b529576-tmp-dir\") pod \"test-model-4b5d6a-kserve-9dd79ff9c-7mdj8\" (UID: \"f3b12749-fdda-4df9-a4fe-3b921b529576\") " pod="ai-tenant-e2e-inf-b-4b5d6a/test-model-4b5d6a-kserve-9dd79ff9c-7mdj8"
Jul 07 16:59:44.016238 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:59:44.016112    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3b12749-fdda-4df9-a4fe-3b921b529576-dshm\") pod \"test-model-4b5d6a-kserve-9dd79ff9c-7mdj8\" (UID: \"f3b12749-fdda-4df9-a4fe-3b921b529576\") " pod="ai-tenant-e2e-inf-b-4b5d6a/test-model-4b5d6a-kserve-9dd79ff9c-7mdj8"
Jul 07 16:59:44.016238 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:59:44.016128    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3b12749-fdda-4df9-a4fe-3b921b529576-tls-certs\") pod \"test-model-4b5d6a-kserve-9dd79ff9c-7mdj8\" (UID: \"f3b12749-fdda-4df9-a4fe-3b921b529576\") " pod="ai-tenant-e2e-inf-b-4b5d6a/test-model-4b5d6a-kserve-9dd79ff9c-7mdj8"
Jul 07 16:59:44.016511 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:59:44.016489    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3b12749-fdda-4df9-a4fe-3b921b529576-model-cache\") pod \"test-model-4b5d6a-kserve-9dd79ff9c-7mdj8\" (UID: \"f3b12749-fdda-4df9-a4fe-3b921b529576\") " pod="ai-tenant-e2e-inf-b-4b5d6a/test-model-4b5d6a-kserve-9dd79ff9c-7mdj8"
Jul 07 16:59:44.016555 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:59:44.016529    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3b12749-fdda-4df9-a4fe-3b921b529576-tmp-dir\") pod \"test-model-4b5d6a-kserve-9dd79ff9c-7mdj8\" (UID: \"f3b12749-fdda-4df9-a4fe-3b921b529576\") " pod="ai-tenant-e2e-inf-b-4b5d6a/test-model-4b5d6a-kserve-9dd79ff9c-7mdj8"
Jul 07 16:59:44.016591 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:59:44.016542    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3b12749-fdda-4df9-a4fe-3b921b529576-home\") pod \"test-model-4b5d6a-kserve-9dd79ff9c-7mdj8\" (UID: \"f3b12749-fdda-4df9-a4fe-3b921b529576\") " pod="ai-tenant-e2e-inf-b-4b5d6a/test-model-4b5d6a-kserve-9dd79ff9c-7mdj8"
Jul 07 16:59:44.018514 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:59:44.018493    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3b12749-fdda-4df9-a4fe-3b921b529576-dshm\") pod \"test-model-4b5d6a-kserve-9dd79ff9c-7mdj8\" (UID: \"f3b12749-fdda-4df9-a4fe-3b921b529576\") " pod="ai-tenant-e2e-inf-b-4b5d6a/test-model-4b5d6a-kserve-9dd79ff9c-7mdj8"
Jul 07 16:59:44.018902 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:59:44.018881    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3b12749-fdda-4df9-a4fe-3b921b529576-tls-certs\") pod \"test-model-4b5d6a-kserve-9dd79ff9c-7mdj8\" (UID: \"f3b12749-fdda-4df9-a4fe-3b921b529576\") " pod="ai-tenant-e2e-inf-b-4b5d6a/test-model-4b5d6a-kserve-9dd79ff9c-7mdj8"
Jul 07 16:59:44.026752 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:59:44.026721    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8tzv\" (UniqueName: \"kubernetes.io/projected/f3b12749-fdda-4df9-a4fe-3b921b529576-kube-api-access-w8tzv\") pod \"test-model-4b5d6a-kserve-9dd79ff9c-7mdj8\" (UID: \"f3b12749-fdda-4df9-a4fe-3b921b529576\") " pod="ai-tenant-e2e-inf-b-4b5d6a/test-model-4b5d6a-kserve-9dd79ff9c-7mdj8"
Jul 07 16:59:44.095571 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:59:44.095541    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-4b5d6a/test-model-4b5d6a-kserve-9dd79ff9c-7mdj8"
Jul 07 16:59:44.242623 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:59:44.242595    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-4b5d6a/test-model-4b5d6a-kserve-9dd79ff9c-7mdj8"]
Jul 07 16:59:44.246084 ip-10-0-129-6 kubenswrapper[2578]: W0707 16:59:44.246035    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf3b12749_fdda_4df9_a4fe_3b921b529576.slice/crio-99d2b13181bfb522d7e474481e1e19f4106403139f0ea91c251cf76dc745a419 WatchSource:0}: Error finding container 99d2b13181bfb522d7e474481e1e19f4106403139f0ea91c251cf76dc745a419: Status 404 returned error can't find the container with id 99d2b13181bfb522d7e474481e1e19f4106403139f0ea91c251cf76dc745a419
Jul 07 16:59:44.580535 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:59:44.580503    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-4b5d6a/test-model-4b5d6a-kserve-9dd79ff9c-7mdj8" event={"ID":"f3b12749-fdda-4df9-a4fe-3b921b529576","Type":"ContainerStarted","Data":"47e1e295e795cd1616c8297d7da3920a9dbaf12aca5963b566bd5093caab1ea1"}
Jul 07 16:59:44.580699 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:59:44.580548    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-4b5d6a/test-model-4b5d6a-kserve-9dd79ff9c-7mdj8" event={"ID":"f3b12749-fdda-4df9-a4fe-3b921b529576","Type":"ContainerStarted","Data":"99d2b13181bfb522d7e474481e1e19f4106403139f0ea91c251cf76dc745a419"}
Jul 07 16:59:44.606381 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:59:44.606305    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-4b5d6a/test-model-4b5d6a-kserve-9dd79ff9c-7mdj8" podStartSLOduration=1.606288967 podStartE2EDuration="1.606288967s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:59:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:59:44.60448862 +0000 UTC m=+2186.691457109" watchObservedRunningTime="2026-07-07 16:59:44.606288967 +0000 UTC m=+2186.693257452"
Jul 07 16:59:49.877075 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:59:49.877039    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 16:59:54.095953 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:59:54.095916    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-4b5d6a/test-model-4b5d6a-kserve-9dd79ff9c-7mdj8"
Jul 07 16:59:54.095953 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:59:54.095968    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-4b5d6a/test-model-4b5d6a-kserve-9dd79ff9c-7mdj8"
Jul 07 16:59:54.108661 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:59:54.108629    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-4b5d6a/test-model-4b5d6a-kserve-9dd79ff9c-7mdj8"
Jul 07 16:59:54.638482 ip-10-0-129-6 kubenswrapper[2578]: I0707 16:59:54.638452    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-4b5d6a/test-model-4b5d6a-kserve-9dd79ff9c-7mdj8"
Jul 07 17:00:00.145624 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:00:00.145583    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-b-4b5d6a-29724060-ct2j8"]
Jul 07 17:00:00.148989 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:00:00.148970    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-4b5d6a-29724060-ct2j8"
Jul 07 17:00:00.151876 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:00:00.151850    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-lb77l\""
Jul 07 17:00:00.158777 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:00:00.158732    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-b-4b5d6a-29724060-ct2j8"]
Jul 07 17:00:00.259413 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:00:00.259373    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5jml\" (UniqueName: \"kubernetes.io/projected/4398221d-40e5-4a11-a3d3-f720315e41dc-kube-api-access-r5jml\") pod \"maas-api-key-cleanup-e2e-inf-b-4b5d6a-29724060-ct2j8\" (UID: \"4398221d-40e5-4a11-a3d3-f720315e41dc\") " pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-4b5d6a-29724060-ct2j8"
Jul 07 17:00:00.360365 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:00:00.360320    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5jml\" (UniqueName: \"kubernetes.io/projected/4398221d-40e5-4a11-a3d3-f720315e41dc-kube-api-access-r5jml\") pod \"maas-api-key-cleanup-e2e-inf-b-4b5d6a-29724060-ct2j8\" (UID: \"4398221d-40e5-4a11-a3d3-f720315e41dc\") " pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-4b5d6a-29724060-ct2j8"
Jul 07 17:00:00.369906 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:00:00.369867    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5jml\" (UniqueName: \"kubernetes.io/projected/4398221d-40e5-4a11-a3d3-f720315e41dc-kube-api-access-r5jml\") pod \"maas-api-key-cleanup-e2e-inf-b-4b5d6a-29724060-ct2j8\" (UID: \"4398221d-40e5-4a11-a3d3-f720315e41dc\") " pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-4b5d6a-29724060-ct2j8"
Jul 07 17:00:00.461607 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:00:00.461512    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-4b5d6a-29724060-ct2j8"
Jul 07 17:00:00.605247 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:00:00.605207    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-b-4b5d6a-29724060-ct2j8"]
Jul 07 17:00:00.608496 ip-10-0-129-6 kubenswrapper[2578]: W0707 17:00:00.608468    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4398221d_40e5_4a11_a3d3_f720315e41dc.slice/crio-fa54f2e42a464e95c2efcf4b6c193c6d0a232f01d1a44b45b560c37b4c5ba7db WatchSource:0}: Error finding container fa54f2e42a464e95c2efcf4b6c193c6d0a232f01d1a44b45b560c37b4c5ba7db: Status 404 returned error can't find the container with id fa54f2e42a464e95c2efcf4b6c193c6d0a232f01d1a44b45b560c37b4c5ba7db
Jul 07 17:00:00.610924 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:00:00.610903    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 17:00:00.652192 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:00:00.652160    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-4b5d6a-29724060-ct2j8" event={"ID":"4398221d-40e5-4a11-a3d3-f720315e41dc","Type":"ContainerStarted","Data":"fa54f2e42a464e95c2efcf4b6c193c6d0a232f01d1a44b45b560c37b4c5ba7db"}
Jul 07 17:00:06.962715 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:00:06.962682    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-reuse-37478f-9d4c5b796-j879z"]
Jul 07 17:00:06.967620 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:00:06.967593    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-reuse-37478f-9d4c5b796-j879z"
Jul 07 17:00:06.970448 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:00:06.970429    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-reuse-37478f-serving-cert\""
Jul 07 17:00:06.990186 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:00:06.990151    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-reuse-37478f-9d4c5b796-j879z"]
Jul 07 17:00:07.027244 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:00:07.027199    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7742c22b-163a-427a-a5d7-f2d61b9f053c-openshift-service-ca\") pod \"maas-api-e2e-reuse-37478f-9d4c5b796-j879z\" (UID: \"7742c22b-163a-427a-a5d7-f2d61b9f053c\") " pod="opendatahub/maas-api-e2e-reuse-37478f-9d4c5b796-j879z"
Jul 07 17:00:07.027473 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:00:07.027258    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7742c22b-163a-427a-a5d7-f2d61b9f053c-maas-api-tls\") pod \"maas-api-e2e-reuse-37478f-9d4c5b796-j879z\" (UID: \"7742c22b-163a-427a-a5d7-f2d61b9f053c\") " pod="opendatahub/maas-api-e2e-reuse-37478f-9d4c5b796-j879z"
Jul 07 17:00:07.027473 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:00:07.027304    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prpq5\" (UniqueName: \"kubernetes.io/projected/7742c22b-163a-427a-a5d7-f2d61b9f053c-kube-api-access-prpq5\") pod \"maas-api-e2e-reuse-37478f-9d4c5b796-j879z\" (UID: \"7742c22b-163a-427a-a5d7-f2d61b9f053c\") " pod="opendatahub/maas-api-e2e-reuse-37478f-9d4c5b796-j879z"
Jul 07 17:00:07.127897 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:00:07.127842    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7742c22b-163a-427a-a5d7-f2d61b9f053c-openshift-service-ca\") pod \"maas-api-e2e-reuse-37478f-9d4c5b796-j879z\" (UID: \"7742c22b-163a-427a-a5d7-f2d61b9f053c\") " pod="opendatahub/maas-api-e2e-reuse-37478f-9d4c5b796-j879z"
Jul 07 17:00:07.127897 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:00:07.127913    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7742c22b-163a-427a-a5d7-f2d61b9f053c-maas-api-tls\") pod \"maas-api-e2e-reuse-37478f-9d4c5b796-j879z\" (UID: \"7742c22b-163a-427a-a5d7-f2d61b9f053c\") " pod="opendatahub/maas-api-e2e-reuse-37478f-9d4c5b796-j879z"
Jul 07 17:00:07.128190 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:00:07.127935    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prpq5\" (UniqueName: \"kubernetes.io/projected/7742c22b-163a-427a-a5d7-f2d61b9f053c-kube-api-access-prpq5\") pod \"maas-api-e2e-reuse-37478f-9d4c5b796-j879z\" (UID: \"7742c22b-163a-427a-a5d7-f2d61b9f053c\") " pod="opendatahub/maas-api-e2e-reuse-37478f-9d4c5b796-j879z"
Jul 07 17:00:07.128190 ip-10-0-129-6 kubenswrapper[2578]: E0707 17:00:07.128065    2578 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-reuse-37478f-serving-cert: secret "maas-api-e2e-reuse-37478f-serving-cert" not found
Jul 07 17:00:07.128190 ip-10-0-129-6 kubenswrapper[2578]: E0707 17:00:07.128145    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7742c22b-163a-427a-a5d7-f2d61b9f053c-maas-api-tls podName:7742c22b-163a-427a-a5d7-f2d61b9f053c nodeName:}" failed. No retries permitted until 2026-07-07 17:00:07.628128452 +0000 UTC m=+2209.715096892 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7742c22b-163a-427a-a5d7-f2d61b9f053c-maas-api-tls") pod "maas-api-e2e-reuse-37478f-9d4c5b796-j879z" (UID: "7742c22b-163a-427a-a5d7-f2d61b9f053c") : secret "maas-api-e2e-reuse-37478f-serving-cert" not found
Jul 07 17:00:07.128709 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:00:07.128685    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7742c22b-163a-427a-a5d7-f2d61b9f053c-openshift-service-ca\") pod \"maas-api-e2e-reuse-37478f-9d4c5b796-j879z\" (UID: \"7742c22b-163a-427a-a5d7-f2d61b9f053c\") " pod="opendatahub/maas-api-e2e-reuse-37478f-9d4c5b796-j879z"
Jul 07 17:00:07.156225 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:00:07.156177    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-prpq5\" (UniqueName: \"kubernetes.io/projected/7742c22b-163a-427a-a5d7-f2d61b9f053c-kube-api-access-prpq5\") pod \"maas-api-e2e-reuse-37478f-9d4c5b796-j879z\" (UID: \"7742c22b-163a-427a-a5d7-f2d61b9f053c\") " pod="opendatahub/maas-api-e2e-reuse-37478f-9d4c5b796-j879z"
Jul 07 17:00:07.632071 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:00:07.632029    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7742c22b-163a-427a-a5d7-f2d61b9f053c-maas-api-tls\") pod \"maas-api-e2e-reuse-37478f-9d4c5b796-j879z\" (UID: \"7742c22b-163a-427a-a5d7-f2d61b9f053c\") " pod="opendatahub/maas-api-e2e-reuse-37478f-9d4c5b796-j879z"
Jul 07 17:00:07.634582 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:00:07.634555    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7742c22b-163a-427a-a5d7-f2d61b9f053c-maas-api-tls\") pod \"maas-api-e2e-reuse-37478f-9d4c5b796-j879z\" (UID: \"7742c22b-163a-427a-a5d7-f2d61b9f053c\") " pod="opendatahub/maas-api-e2e-reuse-37478f-9d4c5b796-j879z"
Jul 07 17:00:07.878670 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:00:07.878635    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-reuse-37478f-9d4c5b796-j879z"
Jul 07 17:00:08.032758 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:00:08.032732    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-reuse-37478f-9d4c5b796-j879z"]
Jul 07 17:00:08.035411 ip-10-0-129-6 kubenswrapper[2578]: W0707 17:00:08.035381    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7742c22b_163a_427a_a5d7_f2d61b9f053c.slice/crio-1d2a38db4453ebe0053bdada2042d3806d40c5220a8abfd85d6c5b73f22ca957 WatchSource:0}: Error finding container 1d2a38db4453ebe0053bdada2042d3806d40c5220a8abfd85d6c5b73f22ca957: Status 404 returned error can't find the container with id 1d2a38db4453ebe0053bdada2042d3806d40c5220a8abfd85d6c5b73f22ca957
Jul 07 17:00:08.689049 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:00:08.689008    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-reuse-37478f-9d4c5b796-j879z" event={"ID":"7742c22b-163a-427a-a5d7-f2d61b9f053c","Type":"ContainerStarted","Data":"1d2a38db4453ebe0053bdada2042d3806d40c5220a8abfd85d6c5b73f22ca957"}
Jul 07 17:00:11.707336 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:00:11.707285    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-reuse-37478f-9d4c5b796-j879z" event={"ID":"7742c22b-163a-427a-a5d7-f2d61b9f053c","Type":"ContainerStarted","Data":"37c04cd3be82acff13604f60fcc4bff74a53cecfeac25fee822b437520010f9e"}
Jul 07 17:00:11.707893 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:00:11.707485    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-reuse-37478f-9d4c5b796-j879z"
Jul 07 17:00:11.735955 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:00:11.735893    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-reuse-37478f-9d4c5b796-j879z" podStartSLOduration=2.8872064330000002 podStartE2EDuration="5.735874977s" totalImagesPullingTime="2.848668544s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:00:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:00:11.735179284 +0000 UTC m=+2213.822147743" watchObservedRunningTime="2026-07-07 17:00:11.735874977 +0000 UTC m=+2213.822843438"
Jul 07 17:00:12.185257 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:00:12.185223    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 17:00:17.718314 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:00:17.718278    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-reuse-37478f-9d4c5b796-j879z"
Jul 07 17:00:20.751107 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:00:20.751067    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-4b5d6a-29724060-ct2j8" event={"ID":"4398221d-40e5-4a11-a3d3-f720315e41dc","Type":"ContainerStarted","Data":"0e0d3d78fa5087ddd3c97e9873a8ddb9dcf028b58445fccd92681c304bf83710"}
Jul 07 17:00:20.773714 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:00:20.773655    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-4b5d6a-29724060-ct2j8" podStartSLOduration=1.157836597 podStartE2EDuration="20.773636992s" totalImagesPullingTime="19.615800395s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:00:20.771665194 +0000 UTC m=+2222.858633652" watchObservedRunningTime="2026-07-07 17:00:20.773636992 +0000 UTC m=+2222.860605461"
Jul 07 17:00:21.756955 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:00:21.756915    2578 generic.go:356] "Generic (PLEG): container finished" podID="4398221d-40e5-4a11-a3d3-f720315e41dc" containerID="0e0d3d78fa5087ddd3c97e9873a8ddb9dcf028b58445fccd92681c304bf83710" exitCode=0
Jul 07 17:00:21.757469 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:00:21.757001    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-4b5d6a-29724060-ct2j8" event={"ID":"4398221d-40e5-4a11-a3d3-f720315e41dc","Type":"ContainerDied","Data":"0e0d3d78fa5087ddd3c97e9873a8ddb9dcf028b58445fccd92681c304bf83710"}
Jul 07 17:00:22.900163 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:00:22.900132    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-4b5d6a-29724060-ct2j8"
Jul 07 17:00:22.973940 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:00:22.973906    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r5jml\" (UniqueName: \"kubernetes.io/projected/4398221d-40e5-4a11-a3d3-f720315e41dc-kube-api-access-r5jml\") pod \"4398221d-40e5-4a11-a3d3-f720315e41dc\" (UID: \"4398221d-40e5-4a11-a3d3-f720315e41dc\") "
Jul 07 17:00:22.976165 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:00:22.976142    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4398221d-40e5-4a11-a3d3-f720315e41dc-kube-api-access-r5jml" (OuterVolumeSpecName: "kube-api-access-r5jml") pod "4398221d-40e5-4a11-a3d3-f720315e41dc" (UID: "4398221d-40e5-4a11-a3d3-f720315e41dc"). InnerVolumeSpecName "kube-api-access-r5jml". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:00:23.074589 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:00:23.074488    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r5jml\" (UniqueName: \"kubernetes.io/projected/4398221d-40e5-4a11-a3d3-f720315e41dc-kube-api-access-r5jml\") on node \"ip-10-0-129-6.ec2.internal\" DevicePath \"\""
Jul 07 17:00:23.766430 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:00:23.766405    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-4b5d6a-29724060-ct2j8"
Jul 07 17:00:23.766430 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:00:23.766403    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-4b5d6a-29724060-ct2j8" event={"ID":"4398221d-40e5-4a11-a3d3-f720315e41dc","Type":"ContainerDied","Data":"fa54f2e42a464e95c2efcf4b6c193c6d0a232f01d1a44b45b560c37b4c5ba7db"}
Jul 07 17:00:23.766642 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:00:23.766457    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fa54f2e42a464e95c2efcf4b6c193c6d0a232f01d1a44b45b560c37b4c5ba7db"
Jul 07 17:00:30.996368 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:00:30.996297    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 17:00:49.122927 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:00:49.122892    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-reuse-37478f-9d4c5b796-j879z"]
Jul 07 17:00:49.123414 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:00:49.123109    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-reuse-37478f-9d4c5b796-j879z" podUID="7742c22b-163a-427a-a5d7-f2d61b9f053c" containerName="maas-api" containerID="cri-o://37c04cd3be82acff13604f60fcc4bff74a53cecfeac25fee822b437520010f9e" gracePeriod=30
Jul 07 17:00:49.381555 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:00:49.381470    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-reuse-37478f-9d4c5b796-j879z"
Jul 07 17:00:49.400843 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:00:49.400797    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-prpq5\" (UniqueName: \"kubernetes.io/projected/7742c22b-163a-427a-a5d7-f2d61b9f053c-kube-api-access-prpq5\") pod \"7742c22b-163a-427a-a5d7-f2d61b9f053c\" (UID: \"7742c22b-163a-427a-a5d7-f2d61b9f053c\") "
Jul 07 17:00:49.401048 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:00:49.400864    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7742c22b-163a-427a-a5d7-f2d61b9f053c-openshift-service-ca\") pod \"7742c22b-163a-427a-a5d7-f2d61b9f053c\" (UID: \"7742c22b-163a-427a-a5d7-f2d61b9f053c\") "
Jul 07 17:00:49.401048 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:00:49.401015    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7742c22b-163a-427a-a5d7-f2d61b9f053c-maas-api-tls\") pod \"7742c22b-163a-427a-a5d7-f2d61b9f053c\" (UID: \"7742c22b-163a-427a-a5d7-f2d61b9f053c\") "
Jul 07 17:00:49.401276 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:00:49.401250    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7742c22b-163a-427a-a5d7-f2d61b9f053c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7742c22b-163a-427a-a5d7-f2d61b9f053c" (UID: "7742c22b-163a-427a-a5d7-f2d61b9f053c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:00:49.401413 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:00:49.401400    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7742c22b-163a-427a-a5d7-f2d61b9f053c-openshift-service-ca\") on node \"ip-10-0-129-6.ec2.internal\" DevicePath \"\""
Jul 07 17:00:49.403128 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:00:49.403092    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7742c22b-163a-427a-a5d7-f2d61b9f053c-kube-api-access-prpq5" (OuterVolumeSpecName: "kube-api-access-prpq5") pod "7742c22b-163a-427a-a5d7-f2d61b9f053c" (UID: "7742c22b-163a-427a-a5d7-f2d61b9f053c"). InnerVolumeSpecName "kube-api-access-prpq5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:00:49.403267 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:00:49.403221    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7742c22b-163a-427a-a5d7-f2d61b9f053c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7742c22b-163a-427a-a5d7-f2d61b9f053c" (UID: "7742c22b-163a-427a-a5d7-f2d61b9f053c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:00:49.502663 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:00:49.502623    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-prpq5\" (UniqueName: \"kubernetes.io/projected/7742c22b-163a-427a-a5d7-f2d61b9f053c-kube-api-access-prpq5\") on node \"ip-10-0-129-6.ec2.internal\" DevicePath \"\""
Jul 07 17:00:49.502663 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:00:49.502656    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7742c22b-163a-427a-a5d7-f2d61b9f053c-maas-api-tls\") on node \"ip-10-0-129-6.ec2.internal\" DevicePath \"\""
Jul 07 17:00:49.882922 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:00:49.882885    2578 generic.go:356] "Generic (PLEG): container finished" podID="7742c22b-163a-427a-a5d7-f2d61b9f053c" containerID="37c04cd3be82acff13604f60fcc4bff74a53cecfeac25fee822b437520010f9e" exitCode=0
Jul 07 17:00:49.883148 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:00:49.882928    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-reuse-37478f-9d4c5b796-j879z"
Jul 07 17:00:49.883148 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:00:49.882946    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-reuse-37478f-9d4c5b796-j879z" event={"ID":"7742c22b-163a-427a-a5d7-f2d61b9f053c","Type":"ContainerDied","Data":"37c04cd3be82acff13604f60fcc4bff74a53cecfeac25fee822b437520010f9e"}
Jul 07 17:00:49.883148 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:00:49.882999    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-reuse-37478f-9d4c5b796-j879z" event={"ID":"7742c22b-163a-427a-a5d7-f2d61b9f053c","Type":"ContainerDied","Data":"1d2a38db4453ebe0053bdada2042d3806d40c5220a8abfd85d6c5b73f22ca957"}
Jul 07 17:00:49.883148 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:00:49.883027    2578 scope.go:117] "RemoveContainer" containerID="37c04cd3be82acff13604f60fcc4bff74a53cecfeac25fee822b437520010f9e"
Jul 07 17:00:49.892718 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:00:49.892701    2578 scope.go:117] "RemoveContainer" containerID="37c04cd3be82acff13604f60fcc4bff74a53cecfeac25fee822b437520010f9e"
Jul 07 17:00:49.893020 ip-10-0-129-6 kubenswrapper[2578]: E0707 17:00:49.892990    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37c04cd3be82acff13604f60fcc4bff74a53cecfeac25fee822b437520010f9e\": container with ID starting with 37c04cd3be82acff13604f60fcc4bff74a53cecfeac25fee822b437520010f9e not found: ID does not exist" containerID="37c04cd3be82acff13604f60fcc4bff74a53cecfeac25fee822b437520010f9e"
Jul 07 17:00:49.893124 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:00:49.893026    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37c04cd3be82acff13604f60fcc4bff74a53cecfeac25fee822b437520010f9e"} err="failed to get container status \"37c04cd3be82acff13604f60fcc4bff74a53cecfeac25fee822b437520010f9e\": rpc error: code = NotFound desc = could not find container \"37c04cd3be82acff13604f60fcc4bff74a53cecfeac25fee822b437520010f9e\": container with ID starting with 37c04cd3be82acff13604f60fcc4bff74a53cecfeac25fee822b437520010f9e not found: ID does not exist"
Jul 07 17:00:49.909557 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:00:49.909522    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-reuse-37478f-9d4c5b796-j879z"]
Jul 07 17:00:49.915743 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:00:49.915716    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-reuse-37478f-9d4c5b796-j879z"]
Jul 07 17:00:50.514975 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:00:50.514941    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7742c22b-163a-427a-a5d7-f2d61b9f053c" path="/var/lib/kubelet/pods/7742c22b-163a-427a-a5d7-f2d61b9f053c/volumes"
Jul 07 17:00:56.176285 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:00:56.176248    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 17:01:34.888094 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:01:34.888052    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 17:01:54.745118 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:01:54.745083    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-4b5d6a/test-model-4b5d6a-kserve-9dd79ff9c-7mdj8"]
Jul 07 17:01:58.979170 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:01:58.979136    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 17:02:09.765748 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:02:09.765662    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-4b5d6a/test-model-4b5d6a-kserve-9dd79ff9c-7mdj8" podUID="f3b12749-fdda-4df9-a4fe-3b921b529576" containerName="main" containerID="cri-o://47e1e295e795cd1616c8297d7da3920a9dbaf12aca5963b566bd5093caab1ea1" gracePeriod=45
Jul 07 17:02:10.022927 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:02:10.022858    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-4b5d6a/test-model-4b5d6a-kserve-9dd79ff9c-7mdj8"
Jul 07 17:02:10.045831 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:02:10.045790    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3b12749-fdda-4df9-a4fe-3b921b529576-tls-certs\") pod \"f3b12749-fdda-4df9-a4fe-3b921b529576\" (UID: \"f3b12749-fdda-4df9-a4fe-3b921b529576\") "
Jul 07 17:02:10.046073 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:02:10.045846    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3b12749-fdda-4df9-a4fe-3b921b529576-model-cache\") pod \"f3b12749-fdda-4df9-a4fe-3b921b529576\" (UID: \"f3b12749-fdda-4df9-a4fe-3b921b529576\") "
Jul 07 17:02:10.046073 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:02:10.045896    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w8tzv\" (UniqueName: \"kubernetes.io/projected/f3b12749-fdda-4df9-a4fe-3b921b529576-kube-api-access-w8tzv\") pod \"f3b12749-fdda-4df9-a4fe-3b921b529576\" (UID: \"f3b12749-fdda-4df9-a4fe-3b921b529576\") "
Jul 07 17:02:10.046198 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:02:10.046150    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3b12749-fdda-4df9-a4fe-3b921b529576-model-cache" (OuterVolumeSpecName: "model-cache") pod "f3b12749-fdda-4df9-a4fe-3b921b529576" (UID: "f3b12749-fdda-4df9-a4fe-3b921b529576"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:02:10.048294 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:02:10.048261    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3b12749-fdda-4df9-a4fe-3b921b529576-kube-api-access-w8tzv" (OuterVolumeSpecName: "kube-api-access-w8tzv") pod "f3b12749-fdda-4df9-a4fe-3b921b529576" (UID: "f3b12749-fdda-4df9-a4fe-3b921b529576"). InnerVolumeSpecName "kube-api-access-w8tzv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:02:10.048294 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:02:10.048266    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3b12749-fdda-4df9-a4fe-3b921b529576-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f3b12749-fdda-4df9-a4fe-3b921b529576" (UID: "f3b12749-fdda-4df9-a4fe-3b921b529576"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:02:10.147296 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:02:10.147263    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3b12749-fdda-4df9-a4fe-3b921b529576-tmp-dir\") pod \"f3b12749-fdda-4df9-a4fe-3b921b529576\" (UID: \"f3b12749-fdda-4df9-a4fe-3b921b529576\") "
Jul 07 17:02:10.147296 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:02:10.147297    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3b12749-fdda-4df9-a4fe-3b921b529576-dshm\") pod \"f3b12749-fdda-4df9-a4fe-3b921b529576\" (UID: \"f3b12749-fdda-4df9-a4fe-3b921b529576\") "
Jul 07 17:02:10.147584 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:02:10.147322    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3b12749-fdda-4df9-a4fe-3b921b529576-home\") pod \"f3b12749-fdda-4df9-a4fe-3b921b529576\" (UID: \"f3b12749-fdda-4df9-a4fe-3b921b529576\") "
Jul 07 17:02:10.147584 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:02:10.147485    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w8tzv\" (UniqueName: \"kubernetes.io/projected/f3b12749-fdda-4df9-a4fe-3b921b529576-kube-api-access-w8tzv\") on node \"ip-10-0-129-6.ec2.internal\" DevicePath \"\""
Jul 07 17:02:10.147584 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:02:10.147495    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3b12749-fdda-4df9-a4fe-3b921b529576-tls-certs\") on node \"ip-10-0-129-6.ec2.internal\" DevicePath \"\""
Jul 07 17:02:10.147584 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:02:10.147504    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3b12749-fdda-4df9-a4fe-3b921b529576-model-cache\") on node \"ip-10-0-129-6.ec2.internal\" DevicePath \"\""
Jul 07 17:02:10.147776 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:02:10.147602    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3b12749-fdda-4df9-a4fe-3b921b529576-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f3b12749-fdda-4df9-a4fe-3b921b529576" (UID: "f3b12749-fdda-4df9-a4fe-3b921b529576"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:02:10.147776 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:02:10.147618    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3b12749-fdda-4df9-a4fe-3b921b529576-home" (OuterVolumeSpecName: "home") pod "f3b12749-fdda-4df9-a4fe-3b921b529576" (UID: "f3b12749-fdda-4df9-a4fe-3b921b529576"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:02:10.149486 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:02:10.149459    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3b12749-fdda-4df9-a4fe-3b921b529576-dshm" (OuterVolumeSpecName: "dshm") pod "f3b12749-fdda-4df9-a4fe-3b921b529576" (UID: "f3b12749-fdda-4df9-a4fe-3b921b529576"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:02:10.241396 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:02:10.241358    2578 generic.go:356] "Generic (PLEG): container finished" podID="f3b12749-fdda-4df9-a4fe-3b921b529576" containerID="47e1e295e795cd1616c8297d7da3920a9dbaf12aca5963b566bd5093caab1ea1" exitCode=0
Jul 07 17:02:10.241598 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:02:10.241425    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-4b5d6a/test-model-4b5d6a-kserve-9dd79ff9c-7mdj8"
Jul 07 17:02:10.241598 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:02:10.241442    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-4b5d6a/test-model-4b5d6a-kserve-9dd79ff9c-7mdj8" event={"ID":"f3b12749-fdda-4df9-a4fe-3b921b529576","Type":"ContainerDied","Data":"47e1e295e795cd1616c8297d7da3920a9dbaf12aca5963b566bd5093caab1ea1"}
Jul 07 17:02:10.241598 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:02:10.241495    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-4b5d6a/test-model-4b5d6a-kserve-9dd79ff9c-7mdj8" event={"ID":"f3b12749-fdda-4df9-a4fe-3b921b529576","Type":"ContainerDied","Data":"99d2b13181bfb522d7e474481e1e19f4106403139f0ea91c251cf76dc745a419"}
Jul 07 17:02:10.241598 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:02:10.241527    2578 scope.go:117] "RemoveContainer" containerID="47e1e295e795cd1616c8297d7da3920a9dbaf12aca5963b566bd5093caab1ea1"
Jul 07 17:02:10.250290 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:02:10.249178    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3b12749-fdda-4df9-a4fe-3b921b529576-tmp-dir\") on node \"ip-10-0-129-6.ec2.internal\" DevicePath \"\""
Jul 07 17:02:10.250290 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:02:10.249217    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3b12749-fdda-4df9-a4fe-3b921b529576-dshm\") on node \"ip-10-0-129-6.ec2.internal\" DevicePath \"\""
Jul 07 17:02:10.250290 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:02:10.249230    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3b12749-fdda-4df9-a4fe-3b921b529576-home\") on node \"ip-10-0-129-6.ec2.internal\" DevicePath \"\""
Jul 07 17:02:10.254516 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:02:10.253740    2578 scope.go:117] "RemoveContainer" containerID="47e1e295e795cd1616c8297d7da3920a9dbaf12aca5963b566bd5093caab1ea1"
Jul 07 17:02:10.254972 ip-10-0-129-6 kubenswrapper[2578]: E0707 17:02:10.254944    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47e1e295e795cd1616c8297d7da3920a9dbaf12aca5963b566bd5093caab1ea1\": container with ID starting with 47e1e295e795cd1616c8297d7da3920a9dbaf12aca5963b566bd5093caab1ea1 not found: ID does not exist" containerID="47e1e295e795cd1616c8297d7da3920a9dbaf12aca5963b566bd5093caab1ea1"
Jul 07 17:02:10.255096 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:02:10.254978    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47e1e295e795cd1616c8297d7da3920a9dbaf12aca5963b566bd5093caab1ea1"} err="failed to get container status \"47e1e295e795cd1616c8297d7da3920a9dbaf12aca5963b566bd5093caab1ea1\": rpc error: code = NotFound desc = could not find container \"47e1e295e795cd1616c8297d7da3920a9dbaf12aca5963b566bd5093caab1ea1\": container with ID starting with 47e1e295e795cd1616c8297d7da3920a9dbaf12aca5963b566bd5093caab1ea1 not found: ID does not exist"
Jul 07 17:02:10.269728 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:02:10.269689    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-4b5d6a/test-model-4b5d6a-kserve-9dd79ff9c-7mdj8"]
Jul 07 17:02:10.273970 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:02:10.273899    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-4b5d6a/test-model-4b5d6a-kserve-9dd79ff9c-7mdj8"]
Jul 07 17:02:10.514320 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:02:10.514283    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3b12749-fdda-4df9-a4fe-3b921b529576" path="/var/lib/kubelet/pods/f3b12749-fdda-4df9-a4fe-3b921b529576/volumes"
Jul 07 17:02:39.235792 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:02:39.235755    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-b-4b5d6a-29724060-ct2j8"]
Jul 07 17:02:39.239266 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:02:39.239237    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-b-4b5d6a-29724060-ct2j8"]
Jul 07 17:02:40.513915 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:02:40.513871    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4398221d-40e5-4a11-a3d3-f720315e41dc" path="/var/lib/kubelet/pods/4398221d-40e5-4a11-a3d3-f720315e41dc/volumes"
Jul 07 17:02:41.574288 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:02:41.574246    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 17:02:48.885174 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:02:48.885140    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-a-966483-7474b75b8f-5q7xp"]
Jul 07 17:02:48.885589 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:02:48.885488    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4398221d-40e5-4a11-a3d3-f720315e41dc" containerName="cleanup"
Jul 07 17:02:48.885589 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:02:48.885501    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4398221d-40e5-4a11-a3d3-f720315e41dc" containerName="cleanup"
Jul 07 17:02:48.885589 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:02:48.885519    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7742c22b-163a-427a-a5d7-f2d61b9f053c" containerName="maas-api"
Jul 07 17:02:48.885589 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:02:48.885525    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7742c22b-163a-427a-a5d7-f2d61b9f053c" containerName="maas-api"
Jul 07 17:02:48.885589 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:02:48.885532    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3b12749-fdda-4df9-a4fe-3b921b529576" containerName="main"
Jul 07 17:02:48.885589 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:02:48.885537    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3b12749-fdda-4df9-a4fe-3b921b529576" containerName="main"
Jul 07 17:02:48.885589 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:02:48.885586    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3b12749-fdda-4df9-a4fe-3b921b529576" containerName="main"
Jul 07 17:02:48.885834 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:02:48.885596    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="7742c22b-163a-427a-a5d7-f2d61b9f053c" containerName="maas-api"
Jul 07 17:02:48.885834 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:02:48.885603    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4398221d-40e5-4a11-a3d3-f720315e41dc" containerName="cleanup"
Jul 07 17:02:48.888911 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:02:48.888889    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-966483-7474b75b8f-5q7xp"
Jul 07 17:02:48.894198 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:02:48.894173    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-lb77l\""
Jul 07 17:02:48.894379 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:02:48.894174    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-a-966483-serving-cert\""
Jul 07 17:02:48.931064 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:02:48.931022    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-966483-7474b75b8f-5q7xp"]
Jul 07 17:02:49.015273 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:02:49.015239    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58c5486b-49dc-4146-a695-bcb79b237227-openshift-service-ca\") pod \"maas-api-e2e-api-a-966483-7474b75b8f-5q7xp\" (UID: \"58c5486b-49dc-4146-a695-bcb79b237227\") " pod="opendatahub/maas-api-e2e-api-a-966483-7474b75b8f-5q7xp"
Jul 07 17:02:49.015497 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:02:49.015293    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58c5486b-49dc-4146-a695-bcb79b237227-maas-api-tls\") pod \"maas-api-e2e-api-a-966483-7474b75b8f-5q7xp\" (UID: \"58c5486b-49dc-4146-a695-bcb79b237227\") " pod="opendatahub/maas-api-e2e-api-a-966483-7474b75b8f-5q7xp"
Jul 07 17:02:49.015497 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:02:49.015393    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nt9d\" (UniqueName: \"kubernetes.io/projected/58c5486b-49dc-4146-a695-bcb79b237227-kube-api-access-5nt9d\") pod \"maas-api-e2e-api-a-966483-7474b75b8f-5q7xp\" (UID: \"58c5486b-49dc-4146-a695-bcb79b237227\") " pod="opendatahub/maas-api-e2e-api-a-966483-7474b75b8f-5q7xp"
Jul 07 17:02:49.116225 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:02:49.116186    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nt9d\" (UniqueName: \"kubernetes.io/projected/58c5486b-49dc-4146-a695-bcb79b237227-kube-api-access-5nt9d\") pod \"maas-api-e2e-api-a-966483-7474b75b8f-5q7xp\" (UID: \"58c5486b-49dc-4146-a695-bcb79b237227\") " pod="opendatahub/maas-api-e2e-api-a-966483-7474b75b8f-5q7xp"
Jul 07 17:02:49.116433 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:02:49.116249    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58c5486b-49dc-4146-a695-bcb79b237227-openshift-service-ca\") pod \"maas-api-e2e-api-a-966483-7474b75b8f-5q7xp\" (UID: \"58c5486b-49dc-4146-a695-bcb79b237227\") " pod="opendatahub/maas-api-e2e-api-a-966483-7474b75b8f-5q7xp"
Jul 07 17:02:49.116433 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:02:49.116291    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58c5486b-49dc-4146-a695-bcb79b237227-maas-api-tls\") pod \"maas-api-e2e-api-a-966483-7474b75b8f-5q7xp\" (UID: \"58c5486b-49dc-4146-a695-bcb79b237227\") " pod="opendatahub/maas-api-e2e-api-a-966483-7474b75b8f-5q7xp"
Jul 07 17:02:49.116916 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:02:49.116894    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58c5486b-49dc-4146-a695-bcb79b237227-openshift-service-ca\") pod \"maas-api-e2e-api-a-966483-7474b75b8f-5q7xp\" (UID: \"58c5486b-49dc-4146-a695-bcb79b237227\") " pod="opendatahub/maas-api-e2e-api-a-966483-7474b75b8f-5q7xp"
Jul 07 17:02:49.118848 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:02:49.118823    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58c5486b-49dc-4146-a695-bcb79b237227-maas-api-tls\") pod \"maas-api-e2e-api-a-966483-7474b75b8f-5q7xp\" (UID: \"58c5486b-49dc-4146-a695-bcb79b237227\") " pod="opendatahub/maas-api-e2e-api-a-966483-7474b75b8f-5q7xp"
Jul 07 17:02:49.140834 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:02:49.140760    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nt9d\" (UniqueName: \"kubernetes.io/projected/58c5486b-49dc-4146-a695-bcb79b237227-kube-api-access-5nt9d\") pod \"maas-api-e2e-api-a-966483-7474b75b8f-5q7xp\" (UID: \"58c5486b-49dc-4146-a695-bcb79b237227\") " pod="opendatahub/maas-api-e2e-api-a-966483-7474b75b8f-5q7xp"
Jul 07 17:02:49.199494 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:02:49.199450    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-966483-7474b75b8f-5q7xp"
Jul 07 17:02:49.354011 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:02:49.353984    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-966483-7474b75b8f-5q7xp"]
Jul 07 17:02:49.356676 ip-10-0-129-6 kubenswrapper[2578]: W0707 17:02:49.356647    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58c5486b_49dc_4146_a695_bcb79b237227.slice/crio-ba3f54146e3be10630a6b17ea1d22e1d19bb905389f43a1ae89326347f2a18ca WatchSource:0}: Error finding container ba3f54146e3be10630a6b17ea1d22e1d19bb905389f43a1ae89326347f2a18ca: Status 404 returned error can't find the container with id ba3f54146e3be10630a6b17ea1d22e1d19bb905389f43a1ae89326347f2a18ca
Jul 07 17:02:49.413282 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:02:49.413191    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-966483-7474b75b8f-5q7xp" event={"ID":"58c5486b-49dc-4146-a695-bcb79b237227","Type":"ContainerStarted","Data":"ba3f54146e3be10630a6b17ea1d22e1d19bb905389f43a1ae89326347f2a18ca"}
Jul 07 17:02:50.418725 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:02:50.418688    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-966483-7474b75b8f-5q7xp" event={"ID":"58c5486b-49dc-4146-a695-bcb79b237227","Type":"ContainerStarted","Data":"c51c04551bacef5e5788125f63bb24a323c9e9058d60ea552372c5c2f5599677"}
Jul 07 17:02:50.419131 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:02:50.418779    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-a-966483-7474b75b8f-5q7xp"
Jul 07 17:02:50.445121 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:02:50.445064    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-a-966483-7474b75b8f-5q7xp" podStartSLOduration=2.010909876 podStartE2EDuration="2.445043919s" totalImagesPullingTime="434.134043ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:02:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:02:50.443564012 +0000 UTC m=+2372.530532470" watchObservedRunningTime="2026-07-07 17:02:50.445043919 +0000 UTC m=+2372.532012377"
Jul 07 17:02:53.275138 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:02:53.275100    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 17:02:56.428692 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:02:56.428665    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-a-966483-7474b75b8f-5q7xp"
Jul 07 17:03:07.679824 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:03:07.679785    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 17:03:10.788284 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:03:10.788247    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-966483-7474b75b8f-5q7xp"]
Jul 07 17:03:10.788837 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:03:10.788531    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-a-966483-7474b75b8f-5q7xp" podUID="58c5486b-49dc-4146-a695-bcb79b237227" containerName="maas-api" containerID="cri-o://c51c04551bacef5e5788125f63bb24a323c9e9058d60ea552372c5c2f5599677" gracePeriod=30
Jul 07 17:03:11.034522 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:03:11.034494    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-966483-7474b75b8f-5q7xp"
Jul 07 17:03:11.115875 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:03:11.115834    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58c5486b-49dc-4146-a695-bcb79b237227-maas-api-tls\") pod \"58c5486b-49dc-4146-a695-bcb79b237227\" (UID: \"58c5486b-49dc-4146-a695-bcb79b237227\") "
Jul 07 17:03:11.116080 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:03:11.115973    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5nt9d\" (UniqueName: \"kubernetes.io/projected/58c5486b-49dc-4146-a695-bcb79b237227-kube-api-access-5nt9d\") pod \"58c5486b-49dc-4146-a695-bcb79b237227\" (UID: \"58c5486b-49dc-4146-a695-bcb79b237227\") "
Jul 07 17:03:11.116080 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:03:11.116013    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58c5486b-49dc-4146-a695-bcb79b237227-openshift-service-ca\") pod \"58c5486b-49dc-4146-a695-bcb79b237227\" (UID: \"58c5486b-49dc-4146-a695-bcb79b237227\") "
Jul 07 17:03:11.116446 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:03:11.116416    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58c5486b-49dc-4146-a695-bcb79b237227-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "58c5486b-49dc-4146-a695-bcb79b237227" (UID: "58c5486b-49dc-4146-a695-bcb79b237227"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:03:11.118014 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:03:11.117990    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58c5486b-49dc-4146-a695-bcb79b237227-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "58c5486b-49dc-4146-a695-bcb79b237227" (UID: "58c5486b-49dc-4146-a695-bcb79b237227"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:03:11.118109 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:03:11.118038    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58c5486b-49dc-4146-a695-bcb79b237227-kube-api-access-5nt9d" (OuterVolumeSpecName: "kube-api-access-5nt9d") pod "58c5486b-49dc-4146-a695-bcb79b237227" (UID: "58c5486b-49dc-4146-a695-bcb79b237227"). InnerVolumeSpecName "kube-api-access-5nt9d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:03:11.217708 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:03:11.217655    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58c5486b-49dc-4146-a695-bcb79b237227-maas-api-tls\") on node \"ip-10-0-129-6.ec2.internal\" DevicePath \"\""
Jul 07 17:03:11.217708 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:03:11.217701    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5nt9d\" (UniqueName: \"kubernetes.io/projected/58c5486b-49dc-4146-a695-bcb79b237227-kube-api-access-5nt9d\") on node \"ip-10-0-129-6.ec2.internal\" DevicePath \"\""
Jul 07 17:03:11.217708 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:03:11.217713    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58c5486b-49dc-4146-a695-bcb79b237227-openshift-service-ca\") on node \"ip-10-0-129-6.ec2.internal\" DevicePath \"\""
Jul 07 17:03:11.511291 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:03:11.511186    2578 generic.go:356] "Generic (PLEG): container finished" podID="58c5486b-49dc-4146-a695-bcb79b237227" containerID="c51c04551bacef5e5788125f63bb24a323c9e9058d60ea552372c5c2f5599677" exitCode=0
Jul 07 17:03:11.511291 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:03:11.511242    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-966483-7474b75b8f-5q7xp"
Jul 07 17:03:11.511291 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:03:11.511267    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-966483-7474b75b8f-5q7xp" event={"ID":"58c5486b-49dc-4146-a695-bcb79b237227","Type":"ContainerDied","Data":"c51c04551bacef5e5788125f63bb24a323c9e9058d60ea552372c5c2f5599677"}
Jul 07 17:03:11.511590 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:03:11.511312    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-966483-7474b75b8f-5q7xp" event={"ID":"58c5486b-49dc-4146-a695-bcb79b237227","Type":"ContainerDied","Data":"ba3f54146e3be10630a6b17ea1d22e1d19bb905389f43a1ae89326347f2a18ca"}
Jul 07 17:03:11.511590 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:03:11.511336    2578 scope.go:117] "RemoveContainer" containerID="c51c04551bacef5e5788125f63bb24a323c9e9058d60ea552372c5c2f5599677"
Jul 07 17:03:11.520924 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:03:11.520897    2578 scope.go:117] "RemoveContainer" containerID="c51c04551bacef5e5788125f63bb24a323c9e9058d60ea552372c5c2f5599677"
Jul 07 17:03:11.521258 ip-10-0-129-6 kubenswrapper[2578]: E0707 17:03:11.521240    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c51c04551bacef5e5788125f63bb24a323c9e9058d60ea552372c5c2f5599677\": container with ID starting with c51c04551bacef5e5788125f63bb24a323c9e9058d60ea552372c5c2f5599677 not found: ID does not exist" containerID="c51c04551bacef5e5788125f63bb24a323c9e9058d60ea552372c5c2f5599677"
Jul 07 17:03:11.521318 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:03:11.521269    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c51c04551bacef5e5788125f63bb24a323c9e9058d60ea552372c5c2f5599677"} err="failed to get container status \"c51c04551bacef5e5788125f63bb24a323c9e9058d60ea552372c5c2f5599677\": rpc error: code = NotFound desc = could not find container \"c51c04551bacef5e5788125f63bb24a323c9e9058d60ea552372c5c2f5599677\": container with ID starting with c51c04551bacef5e5788125f63bb24a323c9e9058d60ea552372c5c2f5599677 not found: ID does not exist"
Jul 07 17:03:11.533906 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:03:11.533871    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-966483-7474b75b8f-5q7xp"]
Jul 07 17:03:11.537844 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:03:11.537814    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-a-966483-7474b75b8f-5q7xp"]
Jul 07 17:03:12.515293 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:03:12.515253    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58c5486b-49dc-4146-a695-bcb79b237227" path="/var/lib/kubelet/pods/58c5486b-49dc-4146-a695-bcb79b237227/volumes"
Jul 07 17:03:20.673247 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:03:20.673210    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 17:03:29.089246 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:03:29.089215    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-a-58e7b2-7d49b9648c-htcqj"]
Jul 07 17:03:29.089660 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:03:29.089589    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58c5486b-49dc-4146-a695-bcb79b237227" containerName="maas-api"
Jul 07 17:03:29.089660 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:03:29.089603    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="58c5486b-49dc-4146-a695-bcb79b237227" containerName="maas-api"
Jul 07 17:03:29.089660 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:03:29.089657    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="58c5486b-49dc-4146-a695-bcb79b237227" containerName="maas-api"
Jul 07 17:03:29.092741 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:03:29.092722    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-58e7b2-7d49b9648c-htcqj"
Jul 07 17:03:29.100994 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:03:29.100970    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-lb77l\""
Jul 07 17:03:29.101098 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:03:29.100970    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-a-58e7b2-serving-cert\""
Jul 07 17:03:29.112869 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:03:29.112834    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-58e7b2-7d49b9648c-htcqj"]
Jul 07 17:03:29.182784 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:03:29.182746    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b2293e8-f28f-4324-955b-00a15eff5c5c-maas-api-tls\") pod \"maas-api-e2e-shared-a-58e7b2-7d49b9648c-htcqj\" (UID: \"5b2293e8-f28f-4324-955b-00a15eff5c5c\") " pod="opendatahub/maas-api-e2e-shared-a-58e7b2-7d49b9648c-htcqj"
Jul 07 17:03:29.182956 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:03:29.182800    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b2293e8-f28f-4324-955b-00a15eff5c5c-openshift-service-ca\") pod \"maas-api-e2e-shared-a-58e7b2-7d49b9648c-htcqj\" (UID: \"5b2293e8-f28f-4324-955b-00a15eff5c5c\") " pod="opendatahub/maas-api-e2e-shared-a-58e7b2-7d49b9648c-htcqj"
Jul 07 17:03:29.182956 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:03:29.182865    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsg5l\" (UniqueName: \"kubernetes.io/projected/5b2293e8-f28f-4324-955b-00a15eff5c5c-kube-api-access-hsg5l\") pod \"maas-api-e2e-shared-a-58e7b2-7d49b9648c-htcqj\" (UID: \"5b2293e8-f28f-4324-955b-00a15eff5c5c\") " pod="opendatahub/maas-api-e2e-shared-a-58e7b2-7d49b9648c-htcqj"
Jul 07 17:03:29.284317 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:03:29.284267    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b2293e8-f28f-4324-955b-00a15eff5c5c-openshift-service-ca\") pod \"maas-api-e2e-shared-a-58e7b2-7d49b9648c-htcqj\" (UID: \"5b2293e8-f28f-4324-955b-00a15eff5c5c\") " pod="opendatahub/maas-api-e2e-shared-a-58e7b2-7d49b9648c-htcqj"
Jul 07 17:03:29.284566 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:03:29.284336    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsg5l\" (UniqueName: \"kubernetes.io/projected/5b2293e8-f28f-4324-955b-00a15eff5c5c-kube-api-access-hsg5l\") pod \"maas-api-e2e-shared-a-58e7b2-7d49b9648c-htcqj\" (UID: \"5b2293e8-f28f-4324-955b-00a15eff5c5c\") " pod="opendatahub/maas-api-e2e-shared-a-58e7b2-7d49b9648c-htcqj"
Jul 07 17:03:29.284566 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:03:29.284420    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b2293e8-f28f-4324-955b-00a15eff5c5c-maas-api-tls\") pod \"maas-api-e2e-shared-a-58e7b2-7d49b9648c-htcqj\" (UID: \"5b2293e8-f28f-4324-955b-00a15eff5c5c\") " pod="opendatahub/maas-api-e2e-shared-a-58e7b2-7d49b9648c-htcqj"
Jul 07 17:03:29.285031 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:03:29.285004    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b2293e8-f28f-4324-955b-00a15eff5c5c-openshift-service-ca\") pod \"maas-api-e2e-shared-a-58e7b2-7d49b9648c-htcqj\" (UID: \"5b2293e8-f28f-4324-955b-00a15eff5c5c\") " pod="opendatahub/maas-api-e2e-shared-a-58e7b2-7d49b9648c-htcqj"
Jul 07 17:03:29.286803 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:03:29.286772    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b2293e8-f28f-4324-955b-00a15eff5c5c-maas-api-tls\") pod \"maas-api-e2e-shared-a-58e7b2-7d49b9648c-htcqj\" (UID: \"5b2293e8-f28f-4324-955b-00a15eff5c5c\") " pod="opendatahub/maas-api-e2e-shared-a-58e7b2-7d49b9648c-htcqj"
Jul 07 17:03:29.315117 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:03:29.315077    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsg5l\" (UniqueName: \"kubernetes.io/projected/5b2293e8-f28f-4324-955b-00a15eff5c5c-kube-api-access-hsg5l\") pod \"maas-api-e2e-shared-a-58e7b2-7d49b9648c-htcqj\" (UID: \"5b2293e8-f28f-4324-955b-00a15eff5c5c\") " pod="opendatahub/maas-api-e2e-shared-a-58e7b2-7d49b9648c-htcqj"
Jul 07 17:03:29.403655 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:03:29.403559    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-58e7b2-7d49b9648c-htcqj"
Jul 07 17:03:29.562187 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:03:29.562150    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-58e7b2-7d49b9648c-htcqj"]
Jul 07 17:03:29.565337 ip-10-0-129-6 kubenswrapper[2578]: W0707 17:03:29.565306    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b2293e8_f28f_4324_955b_00a15eff5c5c.slice/crio-aa09d51eb0c6a0be6930f5b57f1cc47105396c398d3bfc285601700fbba7e127 WatchSource:0}: Error finding container aa09d51eb0c6a0be6930f5b57f1cc47105396c398d3bfc285601700fbba7e127: Status 404 returned error can't find the container with id aa09d51eb0c6a0be6930f5b57f1cc47105396c398d3bfc285601700fbba7e127
Jul 07 17:03:29.595991 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:03:29.595955    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-58e7b2-7d49b9648c-htcqj" event={"ID":"5b2293e8-f28f-4324-955b-00a15eff5c5c","Type":"ContainerStarted","Data":"aa09d51eb0c6a0be6930f5b57f1cc47105396c398d3bfc285601700fbba7e127"}
Jul 07 17:03:30.602160 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:03:30.602121    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-58e7b2-7d49b9648c-htcqj" event={"ID":"5b2293e8-f28f-4324-955b-00a15eff5c5c","Type":"ContainerStarted","Data":"e3449244fc20db8fc8443d4763de23e15b7563f78d6b727a3cece274199044e2"}
Jul 07 17:03:30.602576 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:03:30.602302    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-a-58e7b2-7d49b9648c-htcqj"
Jul 07 17:03:30.627807 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:03:30.627755    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-a-58e7b2-7d49b9648c-htcqj" podStartSLOduration=1.302800282 podStartE2EDuration="1.627737768s" totalImagesPullingTime="324.937486ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:03:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:03:30.626048236 +0000 UTC m=+2412.713016706" watchObservedRunningTime="2026-07-07 17:03:30.627737768 +0000 UTC m=+2412.714706235"
Jul 07 17:03:32.883487 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:03:32.883445    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 17:03:36.612578 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:03:36.612544    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-a-58e7b2-7d49b9648c-htcqj"
Jul 07 17:03:37.067080 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:03:37.066996    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-b-fa4616-6cd6fd86fc-77xqw"]
Jul 07 17:03:37.070633 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:03:37.070610    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-fa4616-6cd6fd86fc-77xqw"
Jul 07 17:03:37.075732 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:03:37.075435    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-b-fa4616-serving-cert\""
Jul 07 17:03:37.087673 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:03:37.087643    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-fa4616-6cd6fd86fc-77xqw"]
Jul 07 17:03:37.257447 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:03:37.257409    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1700b685-1349-4c4f-8c21-0e09847a0ace-maas-api-tls\") pod \"maas-api-e2e-shared-b-fa4616-6cd6fd86fc-77xqw\" (UID: \"1700b685-1349-4c4f-8c21-0e09847a0ace\") " pod="opendatahub/maas-api-e2e-shared-b-fa4616-6cd6fd86fc-77xqw"
Jul 07 17:03:37.257629 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:03:37.257456    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfcck\" (UniqueName: \"kubernetes.io/projected/1700b685-1349-4c4f-8c21-0e09847a0ace-kube-api-access-mfcck\") pod \"maas-api-e2e-shared-b-fa4616-6cd6fd86fc-77xqw\" (UID: \"1700b685-1349-4c4f-8c21-0e09847a0ace\") " pod="opendatahub/maas-api-e2e-shared-b-fa4616-6cd6fd86fc-77xqw"
Jul 07 17:03:37.257629 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:03:37.257487    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1700b685-1349-4c4f-8c21-0e09847a0ace-openshift-service-ca\") pod \"maas-api-e2e-shared-b-fa4616-6cd6fd86fc-77xqw\" (UID: \"1700b685-1349-4c4f-8c21-0e09847a0ace\") " pod="opendatahub/maas-api-e2e-shared-b-fa4616-6cd6fd86fc-77xqw"
Jul 07 17:03:37.358874 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:03:37.358827    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1700b685-1349-4c4f-8c21-0e09847a0ace-maas-api-tls\") pod \"maas-api-e2e-shared-b-fa4616-6cd6fd86fc-77xqw\" (UID: \"1700b685-1349-4c4f-8c21-0e09847a0ace\") " pod="opendatahub/maas-api-e2e-shared-b-fa4616-6cd6fd86fc-77xqw"
Jul 07 17:03:37.358874 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:03:37.358882    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfcck\" (UniqueName: \"kubernetes.io/projected/1700b685-1349-4c4f-8c21-0e09847a0ace-kube-api-access-mfcck\") pod \"maas-api-e2e-shared-b-fa4616-6cd6fd86fc-77xqw\" (UID: \"1700b685-1349-4c4f-8c21-0e09847a0ace\") " pod="opendatahub/maas-api-e2e-shared-b-fa4616-6cd6fd86fc-77xqw"
Jul 07 17:03:37.359099 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:03:37.358915    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1700b685-1349-4c4f-8c21-0e09847a0ace-openshift-service-ca\") pod \"maas-api-e2e-shared-b-fa4616-6cd6fd86fc-77xqw\" (UID: \"1700b685-1349-4c4f-8c21-0e09847a0ace\") " pod="opendatahub/maas-api-e2e-shared-b-fa4616-6cd6fd86fc-77xqw"
Jul 07 17:03:37.359684 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:03:37.359650    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1700b685-1349-4c4f-8c21-0e09847a0ace-openshift-service-ca\") pod \"maas-api-e2e-shared-b-fa4616-6cd6fd86fc-77xqw\" (UID: \"1700b685-1349-4c4f-8c21-0e09847a0ace\") " pod="opendatahub/maas-api-e2e-shared-b-fa4616-6cd6fd86fc-77xqw"
Jul 07 17:03:37.361289 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:03:37.361265    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1700b685-1349-4c4f-8c21-0e09847a0ace-maas-api-tls\") pod \"maas-api-e2e-shared-b-fa4616-6cd6fd86fc-77xqw\" (UID: \"1700b685-1349-4c4f-8c21-0e09847a0ace\") " pod="opendatahub/maas-api-e2e-shared-b-fa4616-6cd6fd86fc-77xqw"
Jul 07 17:03:37.368217 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:03:37.368192    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfcck\" (UniqueName: \"kubernetes.io/projected/1700b685-1349-4c4f-8c21-0e09847a0ace-kube-api-access-mfcck\") pod \"maas-api-e2e-shared-b-fa4616-6cd6fd86fc-77xqw\" (UID: \"1700b685-1349-4c4f-8c21-0e09847a0ace\") " pod="opendatahub/maas-api-e2e-shared-b-fa4616-6cd6fd86fc-77xqw"
Jul 07 17:03:37.385196 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:03:37.385162    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-fa4616-6cd6fd86fc-77xqw"
Jul 07 17:03:37.535360 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:03:37.535303    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-fa4616-6cd6fd86fc-77xqw"]
Jul 07 17:03:37.538181 ip-10-0-129-6 kubenswrapper[2578]: W0707 17:03:37.538152    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1700b685_1349_4c4f_8c21_0e09847a0ace.slice/crio-f71fa3958a0b275f80981b9c2e0f08daf274d17bda1efb88edf51c0129416624 WatchSource:0}: Error finding container f71fa3958a0b275f80981b9c2e0f08daf274d17bda1efb88edf51c0129416624: Status 404 returned error can't find the container with id f71fa3958a0b275f80981b9c2e0f08daf274d17bda1efb88edf51c0129416624
Jul 07 17:03:37.635399 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:03:37.635298    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-fa4616-6cd6fd86fc-77xqw" event={"ID":"1700b685-1349-4c4f-8c21-0e09847a0ace","Type":"ContainerStarted","Data":"f71fa3958a0b275f80981b9c2e0f08daf274d17bda1efb88edf51c0129416624"}
Jul 07 17:03:38.641610 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:03:38.641574    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-fa4616-6cd6fd86fc-77xqw" event={"ID":"1700b685-1349-4c4f-8c21-0e09847a0ace","Type":"ContainerStarted","Data":"35bcb6e62d382ee14f3801940be06a8f4347f1e4168105018419930e123aaac7"}
Jul 07 17:03:38.642008 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:03:38.641684    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-b-fa4616-6cd6fd86fc-77xqw"
Jul 07 17:03:38.673718 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:03:38.673662    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-b-fa4616-6cd6fd86fc-77xqw" podStartSLOduration=1.203862152 podStartE2EDuration="1.673643435s" totalImagesPullingTime="469.781283ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:03:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:03:38.672368815 +0000 UTC m=+2420.759337275" watchObservedRunningTime="2026-07-07 17:03:38.673643435 +0000 UTC m=+2420.760611893"
Jul 07 17:03:44.653322 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:03:44.653290    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-b-fa4616-6cd6fd86fc-77xqw"
Jul 07 17:03:45.970248 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:03:45.970203    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 17:04:01.684445 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:04:01.684403    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 17:04:21.380272 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:04:21.380237    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-fa4616/auth-test-model-fa4616-kserve-6d96b5c7f9-k8rd9"]
Jul 07 17:04:21.383604 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:04:21.383584    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fa4616/auth-test-model-fa4616-kserve-6d96b5c7f9-k8rd9"
Jul 07 17:04:21.386426 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:04:21.386403    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-fa4616\"/\"kube-root-ca.crt\""
Jul 07 17:04:21.387590 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:04:21.387566    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-fa4616\"/\"openshift-service-ca.crt\""
Jul 07 17:04:21.387705 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:04:21.387612    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-fa4616\"/\"default-dockercfg-jvr5l\""
Jul 07 17:04:21.387705 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:04:21.387612    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-fa4616\"/\"auth-test-model-fa4616-kserve-self-signed-certs\""
Jul 07 17:04:21.393930 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:04:21.393905    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-fa4616/auth-test-model-fa4616-kserve-6d96b5c7f9-k8rd9"]
Jul 07 17:04:21.561174 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:04:21.561130    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/29161b54-a314-45df-8e3d-9485349f1438-tls-certs\") pod \"auth-test-model-fa4616-kserve-6d96b5c7f9-k8rd9\" (UID: \"29161b54-a314-45df-8e3d-9485349f1438\") " pod="ai-tenant-e2e-shared-b-fa4616/auth-test-model-fa4616-kserve-6d96b5c7f9-k8rd9"
Jul 07 17:04:21.561408 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:04:21.561213    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55hgf\" (UniqueName: \"kubernetes.io/projected/29161b54-a314-45df-8e3d-9485349f1438-kube-api-access-55hgf\") pod \"auth-test-model-fa4616-kserve-6d96b5c7f9-k8rd9\" (UID: \"29161b54-a314-45df-8e3d-9485349f1438\") " pod="ai-tenant-e2e-shared-b-fa4616/auth-test-model-fa4616-kserve-6d96b5c7f9-k8rd9"
Jul 07 17:04:21.561408 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:04:21.561236    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/29161b54-a314-45df-8e3d-9485349f1438-dshm\") pod \"auth-test-model-fa4616-kserve-6d96b5c7f9-k8rd9\" (UID: \"29161b54-a314-45df-8e3d-9485349f1438\") " pod="ai-tenant-e2e-shared-b-fa4616/auth-test-model-fa4616-kserve-6d96b5c7f9-k8rd9"
Jul 07 17:04:21.561408 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:04:21.561281    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/29161b54-a314-45df-8e3d-9485349f1438-home\") pod \"auth-test-model-fa4616-kserve-6d96b5c7f9-k8rd9\" (UID: \"29161b54-a314-45df-8e3d-9485349f1438\") " pod="ai-tenant-e2e-shared-b-fa4616/auth-test-model-fa4616-kserve-6d96b5c7f9-k8rd9"
Jul 07 17:04:21.561408 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:04:21.561375    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/29161b54-a314-45df-8e3d-9485349f1438-model-cache\") pod \"auth-test-model-fa4616-kserve-6d96b5c7f9-k8rd9\" (UID: \"29161b54-a314-45df-8e3d-9485349f1438\") " pod="ai-tenant-e2e-shared-b-fa4616/auth-test-model-fa4616-kserve-6d96b5c7f9-k8rd9"
Jul 07 17:04:21.561408 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:04:21.561395    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29161b54-a314-45df-8e3d-9485349f1438-tmp-dir\") pod \"auth-test-model-fa4616-kserve-6d96b5c7f9-k8rd9\" (UID: \"29161b54-a314-45df-8e3d-9485349f1438\") " pod="ai-tenant-e2e-shared-b-fa4616/auth-test-model-fa4616-kserve-6d96b5c7f9-k8rd9"
Jul 07 17:04:21.662093 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:04:21.662003    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/29161b54-a314-45df-8e3d-9485349f1438-tls-certs\") pod \"auth-test-model-fa4616-kserve-6d96b5c7f9-k8rd9\" (UID: \"29161b54-a314-45df-8e3d-9485349f1438\") " pod="ai-tenant-e2e-shared-b-fa4616/auth-test-model-fa4616-kserve-6d96b5c7f9-k8rd9"
Jul 07 17:04:21.662093 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:04:21.662065    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55hgf\" (UniqueName: \"kubernetes.io/projected/29161b54-a314-45df-8e3d-9485349f1438-kube-api-access-55hgf\") pod \"auth-test-model-fa4616-kserve-6d96b5c7f9-k8rd9\" (UID: \"29161b54-a314-45df-8e3d-9485349f1438\") " pod="ai-tenant-e2e-shared-b-fa4616/auth-test-model-fa4616-kserve-6d96b5c7f9-k8rd9"
Jul 07 17:04:21.662282 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:04:21.662254    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/29161b54-a314-45df-8e3d-9485349f1438-dshm\") pod \"auth-test-model-fa4616-kserve-6d96b5c7f9-k8rd9\" (UID: \"29161b54-a314-45df-8e3d-9485349f1438\") " pod="ai-tenant-e2e-shared-b-fa4616/auth-test-model-fa4616-kserve-6d96b5c7f9-k8rd9"
Jul 07 17:04:21.662322 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:04:21.662301    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/29161b54-a314-45df-8e3d-9485349f1438-home\") pod \"auth-test-model-fa4616-kserve-6d96b5c7f9-k8rd9\" (UID: \"29161b54-a314-45df-8e3d-9485349f1438\") " pod="ai-tenant-e2e-shared-b-fa4616/auth-test-model-fa4616-kserve-6d96b5c7f9-k8rd9"
Jul 07 17:04:21.662419 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:04:21.662337    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/29161b54-a314-45df-8e3d-9485349f1438-model-cache\") pod \"auth-test-model-fa4616-kserve-6d96b5c7f9-k8rd9\" (UID: \"29161b54-a314-45df-8e3d-9485349f1438\") " pod="ai-tenant-e2e-shared-b-fa4616/auth-test-model-fa4616-kserve-6d96b5c7f9-k8rd9"
Jul 07 17:04:21.662419 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:04:21.662399    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29161b54-a314-45df-8e3d-9485349f1438-tmp-dir\") pod \"auth-test-model-fa4616-kserve-6d96b5c7f9-k8rd9\" (UID: \"29161b54-a314-45df-8e3d-9485349f1438\") " pod="ai-tenant-e2e-shared-b-fa4616/auth-test-model-fa4616-kserve-6d96b5c7f9-k8rd9"
Jul 07 17:04:21.662800 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:04:21.662767    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/29161b54-a314-45df-8e3d-9485349f1438-home\") pod \"auth-test-model-fa4616-kserve-6d96b5c7f9-k8rd9\" (UID: \"29161b54-a314-45df-8e3d-9485349f1438\") " pod="ai-tenant-e2e-shared-b-fa4616/auth-test-model-fa4616-kserve-6d96b5c7f9-k8rd9"
Jul 07 17:04:21.662800 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:04:21.662793    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29161b54-a314-45df-8e3d-9485349f1438-tmp-dir\") pod \"auth-test-model-fa4616-kserve-6d96b5c7f9-k8rd9\" (UID: \"29161b54-a314-45df-8e3d-9485349f1438\") " pod="ai-tenant-e2e-shared-b-fa4616/auth-test-model-fa4616-kserve-6d96b5c7f9-k8rd9"
Jul 07 17:04:21.662966 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:04:21.662776    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/29161b54-a314-45df-8e3d-9485349f1438-model-cache\") pod \"auth-test-model-fa4616-kserve-6d96b5c7f9-k8rd9\" (UID: \"29161b54-a314-45df-8e3d-9485349f1438\") " pod="ai-tenant-e2e-shared-b-fa4616/auth-test-model-fa4616-kserve-6d96b5c7f9-k8rd9"
Jul 07 17:04:21.664650 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:04:21.664625    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/29161b54-a314-45df-8e3d-9485349f1438-dshm\") pod \"auth-test-model-fa4616-kserve-6d96b5c7f9-k8rd9\" (UID: \"29161b54-a314-45df-8e3d-9485349f1438\") " pod="ai-tenant-e2e-shared-b-fa4616/auth-test-model-fa4616-kserve-6d96b5c7f9-k8rd9"
Jul 07 17:04:21.664762 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:04:21.664748    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/29161b54-a314-45df-8e3d-9485349f1438-tls-certs\") pod \"auth-test-model-fa4616-kserve-6d96b5c7f9-k8rd9\" (UID: \"29161b54-a314-45df-8e3d-9485349f1438\") " pod="ai-tenant-e2e-shared-b-fa4616/auth-test-model-fa4616-kserve-6d96b5c7f9-k8rd9"
Jul 07 17:04:21.672559 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:04:21.672535    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55hgf\" (UniqueName: \"kubernetes.io/projected/29161b54-a314-45df-8e3d-9485349f1438-kube-api-access-55hgf\") pod \"auth-test-model-fa4616-kserve-6d96b5c7f9-k8rd9\" (UID: \"29161b54-a314-45df-8e3d-9485349f1438\") " pod="ai-tenant-e2e-shared-b-fa4616/auth-test-model-fa4616-kserve-6d96b5c7f9-k8rd9"
Jul 07 17:04:21.693636 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:04:21.693586    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fa4616/auth-test-model-fa4616-kserve-6d96b5c7f9-k8rd9"
Jul 07 17:04:21.839837 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:04:21.839803    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-fa4616/auth-test-model-fa4616-kserve-6d96b5c7f9-k8rd9"]
Jul 07 17:04:21.844690 ip-10-0-129-6 kubenswrapper[2578]: W0707 17:04:21.844654    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod29161b54_a314_45df_8e3d_9485349f1438.slice/crio-481f17816367e0e25853ea40d940304dacfbaea4f0197a9bc9249b42137c31b0 WatchSource:0}: Error finding container 481f17816367e0e25853ea40d940304dacfbaea4f0197a9bc9249b42137c31b0: Status 404 returned error can't find the container with id 481f17816367e0e25853ea40d940304dacfbaea4f0197a9bc9249b42137c31b0
Jul 07 17:04:22.840472 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:04:22.840438    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fa4616/auth-test-model-fa4616-kserve-6d96b5c7f9-k8rd9" event={"ID":"29161b54-a314-45df-8e3d-9485349f1438","Type":"ContainerStarted","Data":"b24e3dca92b71217f7587a8733a7e6daf9b966d5cadc7999e7ff839410b7ee46"}
Jul 07 17:04:22.840896 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:04:22.840479    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fa4616/auth-test-model-fa4616-kserve-6d96b5c7f9-k8rd9" event={"ID":"29161b54-a314-45df-8e3d-9485349f1438","Type":"ContainerStarted","Data":"481f17816367e0e25853ea40d940304dacfbaea4f0197a9bc9249b42137c31b0"}
Jul 07 17:04:22.865539 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:04:22.865459    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-fa4616/auth-test-model-fa4616-kserve-6d96b5c7f9-k8rd9" podStartSLOduration=1.865440484 podStartE2EDuration="1.865440484s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:04:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:04:22.864512176 +0000 UTC m=+2464.951480634" watchObservedRunningTime="2026-07-07 17:04:22.865440484 +0000 UTC m=+2464.952408968"
Jul 07 17:04:24.780576 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:04:24.780533    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 17:04:31.694291 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:04:31.694240    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-fa4616/auth-test-model-fa4616-kserve-6d96b5c7f9-k8rd9"
Jul 07 17:04:31.694739 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:04:31.694313    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-fa4616/auth-test-model-fa4616-kserve-6d96b5c7f9-k8rd9"
Jul 07 17:04:31.707129 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:04:31.707100    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-fa4616/auth-test-model-fa4616-kserve-6d96b5c7f9-k8rd9"
Jul 07 17:04:31.893812 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:04:31.893782    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-fa4616/auth-test-model-fa4616-kserve-6d96b5c7f9-k8rd9"
Jul 07 17:04:39.975237 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:04:39.975197    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 17:04:55.578526 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:04:55.578484    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 17:05:12.372076 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:05:12.371987    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 17:05:26.290214 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:05:26.290178    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 17:05:42.885653 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:05:42.885611    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 17:05:59.496952 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:05:59.496916    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 17:06:14.674396 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:06:14.674339    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 17:06:20.084020 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:06:20.083976    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-fa4616/auth-test-model-fa4616-kserve-6d96b5c7f9-k8rd9"]
Jul 07 17:06:33.196122 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:06:33.196083    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 17:06:35.104074 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:06:35.104006    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-fa4616/auth-test-model-fa4616-kserve-6d96b5c7f9-k8rd9" podUID="29161b54-a314-45df-8e3d-9485349f1438" containerName="main" containerID="cri-o://b24e3dca92b71217f7587a8733a7e6daf9b966d5cadc7999e7ff839410b7ee46" gracePeriod=45
Jul 07 17:06:35.356243 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:06:35.356174    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fa4616/auth-test-model-fa4616-kserve-6d96b5c7f9-k8rd9"
Jul 07 17:06:35.452758 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:06:35.452721    2578 generic.go:356] "Generic (PLEG): container finished" podID="29161b54-a314-45df-8e3d-9485349f1438" containerID="b24e3dca92b71217f7587a8733a7e6daf9b966d5cadc7999e7ff839410b7ee46" exitCode=0
Jul 07 17:06:35.452758 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:06:35.452763    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fa4616/auth-test-model-fa4616-kserve-6d96b5c7f9-k8rd9"
Jul 07 17:06:35.453010 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:06:35.452796    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fa4616/auth-test-model-fa4616-kserve-6d96b5c7f9-k8rd9" event={"ID":"29161b54-a314-45df-8e3d-9485349f1438","Type":"ContainerDied","Data":"b24e3dca92b71217f7587a8733a7e6daf9b966d5cadc7999e7ff839410b7ee46"}
Jul 07 17:06:35.453010 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:06:35.452838    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fa4616/auth-test-model-fa4616-kserve-6d96b5c7f9-k8rd9" event={"ID":"29161b54-a314-45df-8e3d-9485349f1438","Type":"ContainerDied","Data":"481f17816367e0e25853ea40d940304dacfbaea4f0197a9bc9249b42137c31b0"}
Jul 07 17:06:35.453010 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:06:35.452857    2578 scope.go:117] "RemoveContainer" containerID="b24e3dca92b71217f7587a8733a7e6daf9b966d5cadc7999e7ff839410b7ee46"
Jul 07 17:06:35.461173 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:06:35.461150    2578 scope.go:117] "RemoveContainer" containerID="b24e3dca92b71217f7587a8733a7e6daf9b966d5cadc7999e7ff839410b7ee46"
Jul 07 17:06:35.461466 ip-10-0-129-6 kubenswrapper[2578]: E0707 17:06:35.461446    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b24e3dca92b71217f7587a8733a7e6daf9b966d5cadc7999e7ff839410b7ee46\": container with ID starting with b24e3dca92b71217f7587a8733a7e6daf9b966d5cadc7999e7ff839410b7ee46 not found: ID does not exist" containerID="b24e3dca92b71217f7587a8733a7e6daf9b966d5cadc7999e7ff839410b7ee46"
Jul 07 17:06:35.461542 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:06:35.461482    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b24e3dca92b71217f7587a8733a7e6daf9b966d5cadc7999e7ff839410b7ee46"} err="failed to get container status \"b24e3dca92b71217f7587a8733a7e6daf9b966d5cadc7999e7ff839410b7ee46\": rpc error: code = NotFound desc = could not find container \"b24e3dca92b71217f7587a8733a7e6daf9b966d5cadc7999e7ff839410b7ee46\": container with ID starting with b24e3dca92b71217f7587a8733a7e6daf9b966d5cadc7999e7ff839410b7ee46 not found: ID does not exist"
Jul 07 17:06:35.486566 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:06:35.486529    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/29161b54-a314-45df-8e3d-9485349f1438-home\") pod \"29161b54-a314-45df-8e3d-9485349f1438\" (UID: \"29161b54-a314-45df-8e3d-9485349f1438\") "
Jul 07 17:06:35.486718 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:06:35.486625    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/29161b54-a314-45df-8e3d-9485349f1438-tls-certs\") pod \"29161b54-a314-45df-8e3d-9485349f1438\" (UID: \"29161b54-a314-45df-8e3d-9485349f1438\") "
Jul 07 17:06:35.486718 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:06:35.486655    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-55hgf\" (UniqueName: \"kubernetes.io/projected/29161b54-a314-45df-8e3d-9485349f1438-kube-api-access-55hgf\") pod \"29161b54-a314-45df-8e3d-9485349f1438\" (UID: \"29161b54-a314-45df-8e3d-9485349f1438\") "
Jul 07 17:06:35.486832 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:06:35.486720    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/29161b54-a314-45df-8e3d-9485349f1438-model-cache\") pod \"29161b54-a314-45df-8e3d-9485349f1438\" (UID: \"29161b54-a314-45df-8e3d-9485349f1438\") "
Jul 07 17:06:35.486832 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:06:35.486750    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/29161b54-a314-45df-8e3d-9485349f1438-dshm\") pod \"29161b54-a314-45df-8e3d-9485349f1438\" (UID: \"29161b54-a314-45df-8e3d-9485349f1438\") "
Jul 07 17:06:35.486832 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:06:35.486781    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29161b54-a314-45df-8e3d-9485349f1438-tmp-dir\") pod \"29161b54-a314-45df-8e3d-9485349f1438\" (UID: \"29161b54-a314-45df-8e3d-9485349f1438\") "
Jul 07 17:06:35.486832 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:06:35.486809    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29161b54-a314-45df-8e3d-9485349f1438-home" (OuterVolumeSpecName: "home") pod "29161b54-a314-45df-8e3d-9485349f1438" (UID: "29161b54-a314-45df-8e3d-9485349f1438"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:06:35.487064 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:06:35.487015    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29161b54-a314-45df-8e3d-9485349f1438-model-cache" (OuterVolumeSpecName: "model-cache") pod "29161b54-a314-45df-8e3d-9485349f1438" (UID: "29161b54-a314-45df-8e3d-9485349f1438"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:06:35.487064 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:06:35.487039    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/29161b54-a314-45df-8e3d-9485349f1438-home\") on node \"ip-10-0-129-6.ec2.internal\" DevicePath \"\""
Jul 07 17:06:35.487242 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:06:35.487081    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29161b54-a314-45df-8e3d-9485349f1438-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "29161b54-a314-45df-8e3d-9485349f1438" (UID: "29161b54-a314-45df-8e3d-9485349f1438"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:06:35.489025 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:06:35.489001    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29161b54-a314-45df-8e3d-9485349f1438-kube-api-access-55hgf" (OuterVolumeSpecName: "kube-api-access-55hgf") pod "29161b54-a314-45df-8e3d-9485349f1438" (UID: "29161b54-a314-45df-8e3d-9485349f1438"). InnerVolumeSpecName "kube-api-access-55hgf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:06:35.489160 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:06:35.489000    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29161b54-a314-45df-8e3d-9485349f1438-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "29161b54-a314-45df-8e3d-9485349f1438" (UID: "29161b54-a314-45df-8e3d-9485349f1438"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:06:35.489160 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:06:35.489001    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29161b54-a314-45df-8e3d-9485349f1438-dshm" (OuterVolumeSpecName: "dshm") pod "29161b54-a314-45df-8e3d-9485349f1438" (UID: "29161b54-a314-45df-8e3d-9485349f1438"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:06:35.588521 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:06:35.588476    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/29161b54-a314-45df-8e3d-9485349f1438-tls-certs\") on node \"ip-10-0-129-6.ec2.internal\" DevicePath \"\""
Jul 07 17:06:35.588521 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:06:35.588512    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-55hgf\" (UniqueName: \"kubernetes.io/projected/29161b54-a314-45df-8e3d-9485349f1438-kube-api-access-55hgf\") on node \"ip-10-0-129-6.ec2.internal\" DevicePath \"\""
Jul 07 17:06:35.588521 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:06:35.588523    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/29161b54-a314-45df-8e3d-9485349f1438-model-cache\") on node \"ip-10-0-129-6.ec2.internal\" DevicePath \"\""
Jul 07 17:06:35.588760 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:06:35.588534    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/29161b54-a314-45df-8e3d-9485349f1438-dshm\") on node \"ip-10-0-129-6.ec2.internal\" DevicePath \"\""
Jul 07 17:06:35.588760 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:06:35.588543    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29161b54-a314-45df-8e3d-9485349f1438-tmp-dir\") on node \"ip-10-0-129-6.ec2.internal\" DevicePath \"\""
Jul 07 17:06:35.785005 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:06:35.784969    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-fa4616/auth-test-model-fa4616-kserve-6d96b5c7f9-k8rd9"]
Jul 07 17:06:35.793523 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:06:35.793488    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-fa4616/auth-test-model-fa4616-kserve-6d96b5c7f9-k8rd9"]
Jul 07 17:06:36.514121 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:06:36.514086    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29161b54-a314-45df-8e3d-9485349f1438" path="/var/lib/kubelet/pods/29161b54-a314-45df-8e3d-9485349f1438/volumes"
Jul 07 17:07:04.595577 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:07:04.595538    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 17:07:18.480522 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:07:18.480490    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 17:07:18.611183 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:07:18.611144    2578 scope.go:117] "RemoveContainer" containerID="0e0d3d78fa5087ddd3c97e9873a8ddb9dcf028b58445fccd92681c304bf83710"
Jul 07 17:07:35.816947 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:07:35.816907    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 17:07:53.896510 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:07:53.896464    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 17:08:18.295454 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:08:18.295371    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 17:08:39.879263 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:08:39.879223    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-fa4616/rate-test-model-fa4616-kserve-55db8f9955-lbg4z"]
Jul 07 17:08:39.879663 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:08:39.879629    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29161b54-a314-45df-8e3d-9485349f1438" containerName="main"
Jul 07 17:08:39.879663 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:08:39.879642    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="29161b54-a314-45df-8e3d-9485349f1438" containerName="main"
Jul 07 17:08:39.879747 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:08:39.879717    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="29161b54-a314-45df-8e3d-9485349f1438" containerName="main"
Jul 07 17:08:39.882854 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:08:39.882836    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fa4616/rate-test-model-fa4616-kserve-55db8f9955-lbg4z"
Jul 07 17:08:39.886176 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:08:39.886150    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-fa4616\"/\"kube-root-ca.crt\""
Jul 07 17:08:39.886320 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:08:39.886150    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-fa4616\"/\"default-dockercfg-jvr5l\""
Jul 07 17:08:39.887328 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:08:39.887314    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-fa4616\"/\"openshift-service-ca.crt\""
Jul 07 17:08:39.887424 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:08:39.887407    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-fa4616\"/\"rate-test-model-fa4616-kserve-self-signed-certs\""
Jul 07 17:08:39.899924 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:08:39.899892    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-fa4616/rate-test-model-fa4616-kserve-55db8f9955-lbg4z"]
Jul 07 17:08:39.931516 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:08:39.931479    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/41179ffa-bb5b-4127-8bdc-9b77011608c6-tls-certs\") pod \"rate-test-model-fa4616-kserve-55db8f9955-lbg4z\" (UID: \"41179ffa-bb5b-4127-8bdc-9b77011608c6\") " pod="ai-tenant-e2e-shared-b-fa4616/rate-test-model-fa4616-kserve-55db8f9955-lbg4z"
Jul 07 17:08:39.931516 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:08:39.931516    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/41179ffa-bb5b-4127-8bdc-9b77011608c6-dshm\") pod \"rate-test-model-fa4616-kserve-55db8f9955-lbg4z\" (UID: \"41179ffa-bb5b-4127-8bdc-9b77011608c6\") " pod="ai-tenant-e2e-shared-b-fa4616/rate-test-model-fa4616-kserve-55db8f9955-lbg4z"
Jul 07 17:08:39.931758 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:08:39.931589    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/41179ffa-bb5b-4127-8bdc-9b77011608c6-model-cache\") pod \"rate-test-model-fa4616-kserve-55db8f9955-lbg4z\" (UID: \"41179ffa-bb5b-4127-8bdc-9b77011608c6\") " pod="ai-tenant-e2e-shared-b-fa4616/rate-test-model-fa4616-kserve-55db8f9955-lbg4z"
Jul 07 17:08:39.931758 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:08:39.931670    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41179ffa-bb5b-4127-8bdc-9b77011608c6-tmp-dir\") pod \"rate-test-model-fa4616-kserve-55db8f9955-lbg4z\" (UID: \"41179ffa-bb5b-4127-8bdc-9b77011608c6\") " pod="ai-tenant-e2e-shared-b-fa4616/rate-test-model-fa4616-kserve-55db8f9955-lbg4z"
Jul 07 17:08:39.931758 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:08:39.931709    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6t9bj\" (UniqueName: \"kubernetes.io/projected/41179ffa-bb5b-4127-8bdc-9b77011608c6-kube-api-access-6t9bj\") pod \"rate-test-model-fa4616-kserve-55db8f9955-lbg4z\" (UID: \"41179ffa-bb5b-4127-8bdc-9b77011608c6\") " pod="ai-tenant-e2e-shared-b-fa4616/rate-test-model-fa4616-kserve-55db8f9955-lbg4z"
Jul 07 17:08:39.931758 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:08:39.931736    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/41179ffa-bb5b-4127-8bdc-9b77011608c6-home\") pod \"rate-test-model-fa4616-kserve-55db8f9955-lbg4z\" (UID: \"41179ffa-bb5b-4127-8bdc-9b77011608c6\") " pod="ai-tenant-e2e-shared-b-fa4616/rate-test-model-fa4616-kserve-55db8f9955-lbg4z"
Jul 07 17:08:40.033003 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:08:40.032965    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41179ffa-bb5b-4127-8bdc-9b77011608c6-tmp-dir\") pod \"rate-test-model-fa4616-kserve-55db8f9955-lbg4z\" (UID: \"41179ffa-bb5b-4127-8bdc-9b77011608c6\") " pod="ai-tenant-e2e-shared-b-fa4616/rate-test-model-fa4616-kserve-55db8f9955-lbg4z"
Jul 07 17:08:40.033188 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:08:40.033009    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6t9bj\" (UniqueName: \"kubernetes.io/projected/41179ffa-bb5b-4127-8bdc-9b77011608c6-kube-api-access-6t9bj\") pod \"rate-test-model-fa4616-kserve-55db8f9955-lbg4z\" (UID: \"41179ffa-bb5b-4127-8bdc-9b77011608c6\") " pod="ai-tenant-e2e-shared-b-fa4616/rate-test-model-fa4616-kserve-55db8f9955-lbg4z"
Jul 07 17:08:40.033188 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:08:40.033040    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/41179ffa-bb5b-4127-8bdc-9b77011608c6-home\") pod \"rate-test-model-fa4616-kserve-55db8f9955-lbg4z\" (UID: \"41179ffa-bb5b-4127-8bdc-9b77011608c6\") " pod="ai-tenant-e2e-shared-b-fa4616/rate-test-model-fa4616-kserve-55db8f9955-lbg4z"
Jul 07 17:08:40.033188 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:08:40.033096    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/41179ffa-bb5b-4127-8bdc-9b77011608c6-tls-certs\") pod \"rate-test-model-fa4616-kserve-55db8f9955-lbg4z\" (UID: \"41179ffa-bb5b-4127-8bdc-9b77011608c6\") " pod="ai-tenant-e2e-shared-b-fa4616/rate-test-model-fa4616-kserve-55db8f9955-lbg4z"
Jul 07 17:08:40.033188 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:08:40.033123    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/41179ffa-bb5b-4127-8bdc-9b77011608c6-dshm\") pod \"rate-test-model-fa4616-kserve-55db8f9955-lbg4z\" (UID: \"41179ffa-bb5b-4127-8bdc-9b77011608c6\") " pod="ai-tenant-e2e-shared-b-fa4616/rate-test-model-fa4616-kserve-55db8f9955-lbg4z"
Jul 07 17:08:40.033188 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:08:40.033184    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/41179ffa-bb5b-4127-8bdc-9b77011608c6-model-cache\") pod \"rate-test-model-fa4616-kserve-55db8f9955-lbg4z\" (UID: \"41179ffa-bb5b-4127-8bdc-9b77011608c6\") " pod="ai-tenant-e2e-shared-b-fa4616/rate-test-model-fa4616-kserve-55db8f9955-lbg4z"
Jul 07 17:08:40.033510 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:08:40.033485    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/41179ffa-bb5b-4127-8bdc-9b77011608c6-home\") pod \"rate-test-model-fa4616-kserve-55db8f9955-lbg4z\" (UID: \"41179ffa-bb5b-4127-8bdc-9b77011608c6\") " pod="ai-tenant-e2e-shared-b-fa4616/rate-test-model-fa4616-kserve-55db8f9955-lbg4z"
Jul 07 17:08:40.033576 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:08:40.033510    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41179ffa-bb5b-4127-8bdc-9b77011608c6-tmp-dir\") pod \"rate-test-model-fa4616-kserve-55db8f9955-lbg4z\" (UID: \"41179ffa-bb5b-4127-8bdc-9b77011608c6\") " pod="ai-tenant-e2e-shared-b-fa4616/rate-test-model-fa4616-kserve-55db8f9955-lbg4z"
Jul 07 17:08:40.033576 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:08:40.033539    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/41179ffa-bb5b-4127-8bdc-9b77011608c6-model-cache\") pod \"rate-test-model-fa4616-kserve-55db8f9955-lbg4z\" (UID: \"41179ffa-bb5b-4127-8bdc-9b77011608c6\") " pod="ai-tenant-e2e-shared-b-fa4616/rate-test-model-fa4616-kserve-55db8f9955-lbg4z"
Jul 07 17:08:40.035509 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:08:40.035485    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/41179ffa-bb5b-4127-8bdc-9b77011608c6-dshm\") pod \"rate-test-model-fa4616-kserve-55db8f9955-lbg4z\" (UID: \"41179ffa-bb5b-4127-8bdc-9b77011608c6\") " pod="ai-tenant-e2e-shared-b-fa4616/rate-test-model-fa4616-kserve-55db8f9955-lbg4z"
Jul 07 17:08:40.035667 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:08:40.035651    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/41179ffa-bb5b-4127-8bdc-9b77011608c6-tls-certs\") pod \"rate-test-model-fa4616-kserve-55db8f9955-lbg4z\" (UID: \"41179ffa-bb5b-4127-8bdc-9b77011608c6\") " pod="ai-tenant-e2e-shared-b-fa4616/rate-test-model-fa4616-kserve-55db8f9955-lbg4z"
Jul 07 17:08:40.042810 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:08:40.042777    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6t9bj\" (UniqueName: \"kubernetes.io/projected/41179ffa-bb5b-4127-8bdc-9b77011608c6-kube-api-access-6t9bj\") pod \"rate-test-model-fa4616-kserve-55db8f9955-lbg4z\" (UID: \"41179ffa-bb5b-4127-8bdc-9b77011608c6\") " pod="ai-tenant-e2e-shared-b-fa4616/rate-test-model-fa4616-kserve-55db8f9955-lbg4z"
Jul 07 17:08:40.192254 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:08:40.192168    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fa4616/rate-test-model-fa4616-kserve-55db8f9955-lbg4z"
Jul 07 17:08:40.343506 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:08:40.343472    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-fa4616/rate-test-model-fa4616-kserve-55db8f9955-lbg4z"]
Jul 07 17:08:40.346699 ip-10-0-129-6 kubenswrapper[2578]: W0707 17:08:40.346668    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod41179ffa_bb5b_4127_8bdc_9b77011608c6.slice/crio-0cbae083504fa24577baeec8fbcf9d3bab953b25c0d4d5bb1bdde2b77d388e59 WatchSource:0}: Error finding container 0cbae083504fa24577baeec8fbcf9d3bab953b25c0d4d5bb1bdde2b77d388e59: Status 404 returned error can't find the container with id 0cbae083504fa24577baeec8fbcf9d3bab953b25c0d4d5bb1bdde2b77d388e59
Jul 07 17:08:41.028425 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:08:41.028390    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fa4616/rate-test-model-fa4616-kserve-55db8f9955-lbg4z" event={"ID":"41179ffa-bb5b-4127-8bdc-9b77011608c6","Type":"ContainerStarted","Data":"5f61e7d93132121bbf17f626aa4e54e7a67c3f26ef5d1d7b07ec27df1c22598f"}
Jul 07 17:08:41.028425 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:08:41.028430    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fa4616/rate-test-model-fa4616-kserve-55db8f9955-lbg4z" event={"ID":"41179ffa-bb5b-4127-8bdc-9b77011608c6","Type":"ContainerStarted","Data":"0cbae083504fa24577baeec8fbcf9d3bab953b25c0d4d5bb1bdde2b77d388e59"}
Jul 07 17:08:41.064013 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:08:41.063957    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-fa4616/rate-test-model-fa4616-kserve-55db8f9955-lbg4z" podStartSLOduration=2.063941141 podStartE2EDuration="2.063941141s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:08:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:08:41.062758937 +0000 UTC m=+2723.149727396" watchObservedRunningTime="2026-07-07 17:08:41.063941141 +0000 UTC m=+2723.150909599"
Jul 07 17:08:44.197702 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:08:44.197664    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 17:08:50.193214 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:08:50.193171    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-fa4616/rate-test-model-fa4616-kserve-55db8f9955-lbg4z"
Jul 07 17:08:50.193774 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:08:50.193479    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-fa4616/rate-test-model-fa4616-kserve-55db8f9955-lbg4z"
Jul 07 17:08:50.206184 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:08:50.206154    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-fa4616/rate-test-model-fa4616-kserve-55db8f9955-lbg4z"
Jul 07 17:08:51.091508 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:08:51.091478    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-fa4616/rate-test-model-fa4616-kserve-55db8f9955-lbg4z"
Jul 07 17:08:57.600640 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:08:57.600600    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 17:09:14.585018 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:14.584976    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 17:09:22.213668 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:22.213618    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-fa4616/rate-test-model-fa4616-kserve-55db8f9955-lbg4z"]
Jul 07 17:09:27.880972 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:27.880927    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 17:09:28.620836 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:28.620796    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-58e7b2-7d49b9648c-htcqj"]
Jul 07 17:09:28.621077 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:28.621045    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-a-58e7b2-7d49b9648c-htcqj" podUID="5b2293e8-f28f-4324-955b-00a15eff5c5c" containerName="maas-api" containerID="cri-o://e3449244fc20db8fc8443d4763de23e15b7563f78d6b727a3cece274199044e2" gracePeriod=30
Jul 07 17:09:28.872566 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:28.872504    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-58e7b2-7d49b9648c-htcqj"
Jul 07 17:09:28.986863 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:28.986824    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b2293e8-f28f-4324-955b-00a15eff5c5c-maas-api-tls\") pod \"5b2293e8-f28f-4324-955b-00a15eff5c5c\" (UID: \"5b2293e8-f28f-4324-955b-00a15eff5c5c\") "
Jul 07 17:09:28.986863 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:28.986871    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hsg5l\" (UniqueName: \"kubernetes.io/projected/5b2293e8-f28f-4324-955b-00a15eff5c5c-kube-api-access-hsg5l\") pod \"5b2293e8-f28f-4324-955b-00a15eff5c5c\" (UID: \"5b2293e8-f28f-4324-955b-00a15eff5c5c\") "
Jul 07 17:09:28.987449 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:28.986900    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b2293e8-f28f-4324-955b-00a15eff5c5c-openshift-service-ca\") pod \"5b2293e8-f28f-4324-955b-00a15eff5c5c\" (UID: \"5b2293e8-f28f-4324-955b-00a15eff5c5c\") "
Jul 07 17:09:28.987449 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:28.987328    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b2293e8-f28f-4324-955b-00a15eff5c5c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5b2293e8-f28f-4324-955b-00a15eff5c5c" (UID: "5b2293e8-f28f-4324-955b-00a15eff5c5c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:09:28.988980 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:28.988957    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b2293e8-f28f-4324-955b-00a15eff5c5c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5b2293e8-f28f-4324-955b-00a15eff5c5c" (UID: "5b2293e8-f28f-4324-955b-00a15eff5c5c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:09:28.989036 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:28.988976    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b2293e8-f28f-4324-955b-00a15eff5c5c-kube-api-access-hsg5l" (OuterVolumeSpecName: "kube-api-access-hsg5l") pod "5b2293e8-f28f-4324-955b-00a15eff5c5c" (UID: "5b2293e8-f28f-4324-955b-00a15eff5c5c"). InnerVolumeSpecName "kube-api-access-hsg5l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:09:29.088012 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:29.087983    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b2293e8-f28f-4324-955b-00a15eff5c5c-maas-api-tls\") on node \"ip-10-0-129-6.ec2.internal\" DevicePath \"\""
Jul 07 17:09:29.088012 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:29.088014    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hsg5l\" (UniqueName: \"kubernetes.io/projected/5b2293e8-f28f-4324-955b-00a15eff5c5c-kube-api-access-hsg5l\") on node \"ip-10-0-129-6.ec2.internal\" DevicePath \"\""
Jul 07 17:09:29.088163 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:29.088025    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b2293e8-f28f-4324-955b-00a15eff5c5c-openshift-service-ca\") on node \"ip-10-0-129-6.ec2.internal\" DevicePath \"\""
Jul 07 17:09:29.249269 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:29.249181    2578 generic.go:356] "Generic (PLEG): container finished" podID="5b2293e8-f28f-4324-955b-00a15eff5c5c" containerID="e3449244fc20db8fc8443d4763de23e15b7563f78d6b727a3cece274199044e2" exitCode=0
Jul 07 17:09:29.249269 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:29.249229    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-58e7b2-7d49b9648c-htcqj"
Jul 07 17:09:29.249269 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:29.249249    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-58e7b2-7d49b9648c-htcqj" event={"ID":"5b2293e8-f28f-4324-955b-00a15eff5c5c","Type":"ContainerDied","Data":"e3449244fc20db8fc8443d4763de23e15b7563f78d6b727a3cece274199044e2"}
Jul 07 17:09:29.249565 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:29.249315    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-58e7b2-7d49b9648c-htcqj" event={"ID":"5b2293e8-f28f-4324-955b-00a15eff5c5c","Type":"ContainerDied","Data":"aa09d51eb0c6a0be6930f5b57f1cc47105396c398d3bfc285601700fbba7e127"}
Jul 07 17:09:29.249565 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:29.249367    2578 scope.go:117] "RemoveContainer" containerID="e3449244fc20db8fc8443d4763de23e15b7563f78d6b727a3cece274199044e2"
Jul 07 17:09:29.257972 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:29.257953    2578 scope.go:117] "RemoveContainer" containerID="e3449244fc20db8fc8443d4763de23e15b7563f78d6b727a3cece274199044e2"
Jul 07 17:09:29.258248 ip-10-0-129-6 kubenswrapper[2578]: E0707 17:09:29.258229    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3449244fc20db8fc8443d4763de23e15b7563f78d6b727a3cece274199044e2\": container with ID starting with e3449244fc20db8fc8443d4763de23e15b7563f78d6b727a3cece274199044e2 not found: ID does not exist" containerID="e3449244fc20db8fc8443d4763de23e15b7563f78d6b727a3cece274199044e2"
Jul 07 17:09:29.258313 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:29.258259    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3449244fc20db8fc8443d4763de23e15b7563f78d6b727a3cece274199044e2"} err="failed to get container status \"e3449244fc20db8fc8443d4763de23e15b7563f78d6b727a3cece274199044e2\": rpc error: code = NotFound desc = could not find container \"e3449244fc20db8fc8443d4763de23e15b7563f78d6b727a3cece274199044e2\": container with ID starting with e3449244fc20db8fc8443d4763de23e15b7563f78d6b727a3cece274199044e2 not found: ID does not exist"
Jul 07 17:09:29.272049 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:29.272017    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-58e7b2-7d49b9648c-htcqj"]
Jul 07 17:09:29.278199 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:29.278174    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-58e7b2-7d49b9648c-htcqj"]
Jul 07 17:09:30.520135 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:30.520098    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b2293e8-f28f-4324-955b-00a15eff5c5c" path="/var/lib/kubelet/pods/5b2293e8-f28f-4324-955b-00a15eff5c5c/volumes"
Jul 07 17:09:37.234539 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:37.234482    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-fa4616/rate-test-model-fa4616-kserve-55db8f9955-lbg4z" podUID="41179ffa-bb5b-4127-8bdc-9b77011608c6" containerName="main" containerID="cri-o://5f61e7d93132121bbf17f626aa4e54e7a67c3f26ef5d1d7b07ec27df1c22598f" gracePeriod=45
Jul 07 17:09:37.487506 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:37.487434    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fa4616/rate-test-model-fa4616-kserve-55db8f9955-lbg4z"
Jul 07 17:09:37.568375 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:37.568302    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6t9bj\" (UniqueName: \"kubernetes.io/projected/41179ffa-bb5b-4127-8bdc-9b77011608c6-kube-api-access-6t9bj\") pod \"41179ffa-bb5b-4127-8bdc-9b77011608c6\" (UID: \"41179ffa-bb5b-4127-8bdc-9b77011608c6\") "
Jul 07 17:09:37.568375 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:37.568383    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/41179ffa-bb5b-4127-8bdc-9b77011608c6-home\") pod \"41179ffa-bb5b-4127-8bdc-9b77011608c6\" (UID: \"41179ffa-bb5b-4127-8bdc-9b77011608c6\") "
Jul 07 17:09:37.568615 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:37.568407    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41179ffa-bb5b-4127-8bdc-9b77011608c6-tmp-dir\") pod \"41179ffa-bb5b-4127-8bdc-9b77011608c6\" (UID: \"41179ffa-bb5b-4127-8bdc-9b77011608c6\") "
Jul 07 17:09:37.568615 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:37.568555    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/41179ffa-bb5b-4127-8bdc-9b77011608c6-dshm\") pod \"41179ffa-bb5b-4127-8bdc-9b77011608c6\" (UID: \"41179ffa-bb5b-4127-8bdc-9b77011608c6\") "
Jul 07 17:09:37.568725 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:37.568617    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/41179ffa-bb5b-4127-8bdc-9b77011608c6-tls-certs\") pod \"41179ffa-bb5b-4127-8bdc-9b77011608c6\" (UID: \"41179ffa-bb5b-4127-8bdc-9b77011608c6\") "
Jul 07 17:09:37.568725 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:37.568640    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/41179ffa-bb5b-4127-8bdc-9b77011608c6-model-cache\") pod \"41179ffa-bb5b-4127-8bdc-9b77011608c6\" (UID: \"41179ffa-bb5b-4127-8bdc-9b77011608c6\") "
Jul 07 17:09:37.568725 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:37.568669    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41179ffa-bb5b-4127-8bdc-9b77011608c6-home" (OuterVolumeSpecName: "home") pod "41179ffa-bb5b-4127-8bdc-9b77011608c6" (UID: "41179ffa-bb5b-4127-8bdc-9b77011608c6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:09:37.568725 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:37.568692    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41179ffa-bb5b-4127-8bdc-9b77011608c6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "41179ffa-bb5b-4127-8bdc-9b77011608c6" (UID: "41179ffa-bb5b-4127-8bdc-9b77011608c6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:09:37.568936 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:37.568913    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/41179ffa-bb5b-4127-8bdc-9b77011608c6-home\") on node \"ip-10-0-129-6.ec2.internal\" DevicePath \"\""
Jul 07 17:09:37.568977 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:37.568918    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41179ffa-bb5b-4127-8bdc-9b77011608c6-model-cache" (OuterVolumeSpecName: "model-cache") pod "41179ffa-bb5b-4127-8bdc-9b77011608c6" (UID: "41179ffa-bb5b-4127-8bdc-9b77011608c6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:09:37.568977 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:37.568935    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41179ffa-bb5b-4127-8bdc-9b77011608c6-tmp-dir\") on node \"ip-10-0-129-6.ec2.internal\" DevicePath \"\""
Jul 07 17:09:37.570666 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:37.570640    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41179ffa-bb5b-4127-8bdc-9b77011608c6-dshm" (OuterVolumeSpecName: "dshm") pod "41179ffa-bb5b-4127-8bdc-9b77011608c6" (UID: "41179ffa-bb5b-4127-8bdc-9b77011608c6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:09:37.570767 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:37.570662    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41179ffa-bb5b-4127-8bdc-9b77011608c6-kube-api-access-6t9bj" (OuterVolumeSpecName: "kube-api-access-6t9bj") pod "41179ffa-bb5b-4127-8bdc-9b77011608c6" (UID: "41179ffa-bb5b-4127-8bdc-9b77011608c6"). InnerVolumeSpecName "kube-api-access-6t9bj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:09:37.570767 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:37.570681    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41179ffa-bb5b-4127-8bdc-9b77011608c6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "41179ffa-bb5b-4127-8bdc-9b77011608c6" (UID: "41179ffa-bb5b-4127-8bdc-9b77011608c6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:09:37.669525 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:37.669475    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6t9bj\" (UniqueName: \"kubernetes.io/projected/41179ffa-bb5b-4127-8bdc-9b77011608c6-kube-api-access-6t9bj\") on node \"ip-10-0-129-6.ec2.internal\" DevicePath \"\""
Jul 07 17:09:37.669525 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:37.669521    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/41179ffa-bb5b-4127-8bdc-9b77011608c6-dshm\") on node \"ip-10-0-129-6.ec2.internal\" DevicePath \"\""
Jul 07 17:09:37.669525 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:37.669531    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/41179ffa-bb5b-4127-8bdc-9b77011608c6-tls-certs\") on node \"ip-10-0-129-6.ec2.internal\" DevicePath \"\""
Jul 07 17:09:37.669525 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:37.669539    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/41179ffa-bb5b-4127-8bdc-9b77011608c6-model-cache\") on node \"ip-10-0-129-6.ec2.internal\" DevicePath \"\""
Jul 07 17:09:37.673433 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:37.673400    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 17:09:38.295183 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:38.295147    2578 generic.go:356] "Generic (PLEG): container finished" podID="41179ffa-bb5b-4127-8bdc-9b77011608c6" containerID="5f61e7d93132121bbf17f626aa4e54e7a67c3f26ef5d1d7b07ec27df1c22598f" exitCode=0
Jul 07 17:09:38.295703 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:38.295191    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fa4616/rate-test-model-fa4616-kserve-55db8f9955-lbg4z"
Jul 07 17:09:38.295703 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:38.295223    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fa4616/rate-test-model-fa4616-kserve-55db8f9955-lbg4z" event={"ID":"41179ffa-bb5b-4127-8bdc-9b77011608c6","Type":"ContainerDied","Data":"5f61e7d93132121bbf17f626aa4e54e7a67c3f26ef5d1d7b07ec27df1c22598f"}
Jul 07 17:09:38.295703 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:38.295263    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fa4616/rate-test-model-fa4616-kserve-55db8f9955-lbg4z" event={"ID":"41179ffa-bb5b-4127-8bdc-9b77011608c6","Type":"ContainerDied","Data":"0cbae083504fa24577baeec8fbcf9d3bab953b25c0d4d5bb1bdde2b77d388e59"}
Jul 07 17:09:38.295703 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:38.295286    2578 scope.go:117] "RemoveContainer" containerID="5f61e7d93132121bbf17f626aa4e54e7a67c3f26ef5d1d7b07ec27df1c22598f"
Jul 07 17:09:38.304947 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:38.304922    2578 scope.go:117] "RemoveContainer" containerID="5f61e7d93132121bbf17f626aa4e54e7a67c3f26ef5d1d7b07ec27df1c22598f"
Jul 07 17:09:38.305277 ip-10-0-129-6 kubenswrapper[2578]: E0707 17:09:38.305257    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f61e7d93132121bbf17f626aa4e54e7a67c3f26ef5d1d7b07ec27df1c22598f\": container with ID starting with 5f61e7d93132121bbf17f626aa4e54e7a67c3f26ef5d1d7b07ec27df1c22598f not found: ID does not exist" containerID="5f61e7d93132121bbf17f626aa4e54e7a67c3f26ef5d1d7b07ec27df1c22598f"
Jul 07 17:09:38.305326 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:38.305289    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f61e7d93132121bbf17f626aa4e54e7a67c3f26ef5d1d7b07ec27df1c22598f"} err="failed to get container status \"5f61e7d93132121bbf17f626aa4e54e7a67c3f26ef5d1d7b07ec27df1c22598f\": rpc error: code = NotFound desc = could not find container \"5f61e7d93132121bbf17f626aa4e54e7a67c3f26ef5d1d7b07ec27df1c22598f\": container with ID starting with 5f61e7d93132121bbf17f626aa4e54e7a67c3f26ef5d1d7b07ec27df1c22598f not found: ID does not exist"
Jul 07 17:09:38.319721 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:38.319682    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-fa4616/rate-test-model-fa4616-kserve-55db8f9955-lbg4z"]
Jul 07 17:09:38.322749 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:38.322716    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-fa4616/rate-test-model-fa4616-kserve-55db8f9955-lbg4z"]
Jul 07 17:09:38.514032 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:38.513997    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41179ffa-bb5b-4127-8bdc-9b77011608c6" path="/var/lib/kubelet/pods/41179ffa-bb5b-4127-8bdc-9b77011608c6/volumes"
Jul 07 17:09:41.135425 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:41.135312    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-fa4616-6cd6fd86fc-77xqw"]
Jul 07 17:09:41.135912 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:41.135616    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-b-fa4616-6cd6fd86fc-77xqw" podUID="1700b685-1349-4c4f-8c21-0e09847a0ace" containerName="maas-api" containerID="cri-o://35bcb6e62d382ee14f3801940be06a8f4347f1e4168105018419930e123aaac7" gracePeriod=30
Jul 07 17:09:41.589550 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:41.589523    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-fa4616-6cd6fd86fc-77xqw"
Jul 07 17:09:41.707524 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:41.707433    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1700b685-1349-4c4f-8c21-0e09847a0ace-openshift-service-ca\") pod \"1700b685-1349-4c4f-8c21-0e09847a0ace\" (UID: \"1700b685-1349-4c4f-8c21-0e09847a0ace\") "
Jul 07 17:09:41.707524 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:41.707505    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mfcck\" (UniqueName: \"kubernetes.io/projected/1700b685-1349-4c4f-8c21-0e09847a0ace-kube-api-access-mfcck\") pod \"1700b685-1349-4c4f-8c21-0e09847a0ace\" (UID: \"1700b685-1349-4c4f-8c21-0e09847a0ace\") "
Jul 07 17:09:41.707719 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:41.707587    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1700b685-1349-4c4f-8c21-0e09847a0ace-maas-api-tls\") pod \"1700b685-1349-4c4f-8c21-0e09847a0ace\" (UID: \"1700b685-1349-4c4f-8c21-0e09847a0ace\") "
Jul 07 17:09:41.707899 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:41.707865    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1700b685-1349-4c4f-8c21-0e09847a0ace-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1700b685-1349-4c4f-8c21-0e09847a0ace" (UID: "1700b685-1349-4c4f-8c21-0e09847a0ace"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:09:41.709685 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:41.709657    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1700b685-1349-4c4f-8c21-0e09847a0ace-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1700b685-1349-4c4f-8c21-0e09847a0ace" (UID: "1700b685-1349-4c4f-8c21-0e09847a0ace"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:09:41.709685 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:41.709668    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1700b685-1349-4c4f-8c21-0e09847a0ace-kube-api-access-mfcck" (OuterVolumeSpecName: "kube-api-access-mfcck") pod "1700b685-1349-4c4f-8c21-0e09847a0ace" (UID: "1700b685-1349-4c4f-8c21-0e09847a0ace"). InnerVolumeSpecName "kube-api-access-mfcck". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:09:41.808201 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:41.808160    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1700b685-1349-4c4f-8c21-0e09847a0ace-openshift-service-ca\") on node \"ip-10-0-129-6.ec2.internal\" DevicePath \"\""
Jul 07 17:09:41.808201 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:41.808196    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mfcck\" (UniqueName: \"kubernetes.io/projected/1700b685-1349-4c4f-8c21-0e09847a0ace-kube-api-access-mfcck\") on node \"ip-10-0-129-6.ec2.internal\" DevicePath \"\""
Jul 07 17:09:41.808201 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:41.808206    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1700b685-1349-4c4f-8c21-0e09847a0ace-maas-api-tls\") on node \"ip-10-0-129-6.ec2.internal\" DevicePath \"\""
Jul 07 17:09:42.314637 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:42.314603    2578 generic.go:356] "Generic (PLEG): container finished" podID="1700b685-1349-4c4f-8c21-0e09847a0ace" containerID="35bcb6e62d382ee14f3801940be06a8f4347f1e4168105018419930e123aaac7" exitCode=0
Jul 07 17:09:42.314637 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:42.314644    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-fa4616-6cd6fd86fc-77xqw" event={"ID":"1700b685-1349-4c4f-8c21-0e09847a0ace","Type":"ContainerDied","Data":"35bcb6e62d382ee14f3801940be06a8f4347f1e4168105018419930e123aaac7"}
Jul 07 17:09:42.315229 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:42.314657    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-fa4616-6cd6fd86fc-77xqw"
Jul 07 17:09:42.315229 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:42.314687    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-fa4616-6cd6fd86fc-77xqw" event={"ID":"1700b685-1349-4c4f-8c21-0e09847a0ace","Type":"ContainerDied","Data":"f71fa3958a0b275f80981b9c2e0f08daf274d17bda1efb88edf51c0129416624"}
Jul 07 17:09:42.315229 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:42.314709    2578 scope.go:117] "RemoveContainer" containerID="35bcb6e62d382ee14f3801940be06a8f4347f1e4168105018419930e123aaac7"
Jul 07 17:09:42.323288 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:42.323270    2578 scope.go:117] "RemoveContainer" containerID="35bcb6e62d382ee14f3801940be06a8f4347f1e4168105018419930e123aaac7"
Jul 07 17:09:42.323628 ip-10-0-129-6 kubenswrapper[2578]: E0707 17:09:42.323605    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35bcb6e62d382ee14f3801940be06a8f4347f1e4168105018419930e123aaac7\": container with ID starting with 35bcb6e62d382ee14f3801940be06a8f4347f1e4168105018419930e123aaac7 not found: ID does not exist" containerID="35bcb6e62d382ee14f3801940be06a8f4347f1e4168105018419930e123aaac7"
Jul 07 17:09:42.323702 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:42.323636    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35bcb6e62d382ee14f3801940be06a8f4347f1e4168105018419930e123aaac7"} err="failed to get container status \"35bcb6e62d382ee14f3801940be06a8f4347f1e4168105018419930e123aaac7\": rpc error: code = NotFound desc = could not find container \"35bcb6e62d382ee14f3801940be06a8f4347f1e4168105018419930e123aaac7\": container with ID starting with 35bcb6e62d382ee14f3801940be06a8f4347f1e4168105018419930e123aaac7 not found: ID does not exist"
Jul 07 17:09:42.336934 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:42.336895    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-fa4616-6cd6fd86fc-77xqw"]
Jul 07 17:09:42.346843 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:42.342554    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-fa4616-6cd6fd86fc-77xqw"]
Jul 07 17:09:42.514572 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:42.514537    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1700b685-1349-4c4f-8c21-0e09847a0ace" path="/var/lib/kubelet/pods/1700b685-1349-4c4f-8c21-0e09847a0ace/volumes"
Jul 07 17:09:48.480372 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:48.478295    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4jvmb"]
Jul 07 17:09:54.581070 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:54.581038    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7fb6d99899-499sg_6e9ea2bd-5f43-40f4-a287-07ebc83fb243/copy-manifests/0.log"
Jul 07 17:09:54.602309 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:54.602273    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7fb6d99899-499sg_6e9ea2bd-5f43-40f4-a287-07ebc83fb243/manager/0.log"
Jul 07 17:09:57.137923 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:57.137891    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-4jvmb_a12e4193-f796-4004-bfc8-39486dea1c7d/limitador/0.log"
Jul 07 17:09:57.791314 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:57.791280    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-xgb25_481ab942-bed0-43b2-b9e4-f3dcc6d3d857/discovery/0.log"
Jul 07 17:09:58.566312 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:58.566282    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-76b5464cf7-q8skn_83acc011-1498-4b7f-ba25-6aba7588b38e/router/0.log"
Jul 07 17:09:58.967536 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:58.967501    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-4djll_58c2fa5a-daf6-43b8-8c69-f1c4e031bb31/main/0.log"
Jul 07 17:09:59.496986 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:09:59.496952    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-h6gz7_9147a413-91ea-4b3f-a8a5-c394a0239882/main/0.log"
Jul 07 17:10:07.004731 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:10:07.004695    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-qhrbs_01b7d29e-fb29-4aae-9f8c-eb6403a682cb/global-pull-secret-syncer/0.log"
Jul 07 17:10:07.159331 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:10:07.159299    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-zcqml_dbe86d02-ec4b-4424-a88f-098ee332c985/konnectivity-agent/0.log"
Jul 07 17:10:07.186061 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:10:07.186027    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-6.ec2.internal_22e77dea25ac0ea044c4bb8f6b7df505/haproxy/0.log"
Jul 07 17:10:12.755840 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:10:12.755745    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-4jvmb_a12e4193-f796-4004-bfc8-39486dea1c7d/limitador/0.log"
Jul 07 17:10:14.710036 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:10:14.709999    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-xr746_740adb53-e810-41c9-856a-0954705c32c0/cluster-monitoring-operator/0.log"
Jul 07 17:10:14.862718 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:10:14.862692    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-84cct_f7defa20-fc0d-4ff6-bf3f-5553b40961f0/monitoring-plugin/0.log"
Jul 07 17:10:15.018890 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:10:15.018808    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s8bvv_349e522c-90e5-4667-a3f0-14208cdcb868/node-exporter/0.log"
Jul 07 17:10:15.043744 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:10:15.043707    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s8bvv_349e522c-90e5-4667-a3f0-14208cdcb868/kube-rbac-proxy/0.log"
Jul 07 17:10:15.066101 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:10:15.066069    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s8bvv_349e522c-90e5-4667-a3f0-14208cdcb868/init-textfile/0.log"
Jul 07 17:10:15.285455 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:10:15.285373    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_48f92138-7c05-4122-88f1-9e7a536914e9/prometheus/0.log"
Jul 07 17:10:15.313402 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:10:15.313372    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_48f92138-7c05-4122-88f1-9e7a536914e9/config-reloader/0.log"
Jul 07 17:10:15.342410 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:10:15.342377    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_48f92138-7c05-4122-88f1-9e7a536914e9/thanos-sidecar/0.log"
Jul 07 17:10:15.370568 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:10:15.370510    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_48f92138-7c05-4122-88f1-9e7a536914e9/kube-rbac-proxy-web/0.log"
Jul 07 17:10:15.400902 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:10:15.400855    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_48f92138-7c05-4122-88f1-9e7a536914e9/kube-rbac-proxy/0.log"
Jul 07 17:10:15.431068 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:10:15.431028    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_48f92138-7c05-4122-88f1-9e7a536914e9/kube-rbac-proxy-thanos/0.log"
Jul 07 17:10:15.461410 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:10:15.461365    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_48f92138-7c05-4122-88f1-9e7a536914e9/init-config-reloader/0.log"
Jul 07 17:10:15.502934 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:10:15.502895    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-zczcb_cca6e33b-7e40-456e-8f80-c5c8d81c98d8/prometheus-operator/0.log"
Jul 07 17:10:15.538887 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:10:15.538781    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-zczcb_cca6e33b-7e40-456e-8f80-c5c8d81c98d8/kube-rbac-proxy/0.log"
Jul 07 17:10:15.575576 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:10:15.575548    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-wvkw2_8f7c0bc0-b716-4bff-92b9-5333825b6734/prometheus-operator-admission-webhook/0.log"
Jul 07 17:10:16.643554 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:10:16.641376    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-nkp5f/perf-node-gather-daemonset-mvmnq"]
Jul 07 17:10:16.643554 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:10:16.642063    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41179ffa-bb5b-4127-8bdc-9b77011608c6" containerName="main"
Jul 07 17:10:16.643554 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:10:16.642082    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="41179ffa-bb5b-4127-8bdc-9b77011608c6" containerName="main"
Jul 07 17:10:16.643554 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:10:16.642122    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b2293e8-f28f-4324-955b-00a15eff5c5c" containerName="maas-api"
Jul 07 17:10:16.643554 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:10:16.642133    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b2293e8-f28f-4324-955b-00a15eff5c5c" containerName="maas-api"
Jul 07 17:10:16.643554 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:10:16.642155    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1700b685-1349-4c4f-8c21-0e09847a0ace" containerName="maas-api"
Jul 07 17:10:16.643554 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:10:16.642164    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1700b685-1349-4c4f-8c21-0e09847a0ace" containerName="maas-api"
Jul 07 17:10:16.643554 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:10:16.642300    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="1700b685-1349-4c4f-8c21-0e09847a0ace" containerName="maas-api"
Jul 07 17:10:16.643554 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:10:16.642310    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="41179ffa-bb5b-4127-8bdc-9b77011608c6" containerName="main"
Jul 07 17:10:16.643554 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:10:16.642331    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b2293e8-f28f-4324-955b-00a15eff5c5c" containerName="maas-api"
Jul 07 17:10:16.646150 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:10:16.646130    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nkp5f/perf-node-gather-daemonset-mvmnq"
Jul 07 17:10:16.649135 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:10:16.649109    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nkp5f\"/\"kube-root-ca.crt\""
Jul 07 17:10:16.649279 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:10:16.649145    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nkp5f\"/\"openshift-service-ca.crt\""
Jul 07 17:10:16.650219 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:10:16.650197    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-nkp5f\"/\"default-dockercfg-4vg9d\""
Jul 07 17:10:16.655077 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:10:16.655052    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nkp5f/perf-node-gather-daemonset-mvmnq"]
Jul 07 17:10:16.716484 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:10:16.716438    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vvq8\" (UniqueName: \"kubernetes.io/projected/7227587b-c968-420d-951c-9efb1edeb9d4-kube-api-access-6vvq8\") pod \"perf-node-gather-daemonset-mvmnq\" (UID: \"7227587b-c968-420d-951c-9efb1edeb9d4\") " pod="openshift-must-gather-nkp5f/perf-node-gather-daemonset-mvmnq"
Jul 07 17:10:16.716484 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:10:16.716485    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7227587b-c968-420d-951c-9efb1edeb9d4-podres\") pod \"perf-node-gather-daemonset-mvmnq\" (UID: \"7227587b-c968-420d-951c-9efb1edeb9d4\") " pod="openshift-must-gather-nkp5f/perf-node-gather-daemonset-mvmnq"
Jul 07 17:10:16.716725 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:10:16.716528    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7227587b-c968-420d-951c-9efb1edeb9d4-sys\") pod \"perf-node-gather-daemonset-mvmnq\" (UID: \"7227587b-c968-420d-951c-9efb1edeb9d4\") " pod="openshift-must-gather-nkp5f/perf-node-gather-daemonset-mvmnq"
Jul 07 17:10:16.716725 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:10:16.716564    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7227587b-c968-420d-951c-9efb1edeb9d4-proc\") pod \"perf-node-gather-daemonset-mvmnq\" (UID: \"7227587b-c968-420d-951c-9efb1edeb9d4\") " pod="openshift-must-gather-nkp5f/perf-node-gather-daemonset-mvmnq"
Jul 07 17:10:16.716725 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:10:16.716634    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7227587b-c968-420d-951c-9efb1edeb9d4-lib-modules\") pod \"perf-node-gather-daemonset-mvmnq\" (UID: \"7227587b-c968-420d-951c-9efb1edeb9d4\") " pod="openshift-must-gather-nkp5f/perf-node-gather-daemonset-mvmnq"
Jul 07 17:10:16.817894 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:10:16.817844    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vvq8\" (UniqueName: \"kubernetes.io/projected/7227587b-c968-420d-951c-9efb1edeb9d4-kube-api-access-6vvq8\") pod \"perf-node-gather-daemonset-mvmnq\" (UID: \"7227587b-c968-420d-951c-9efb1edeb9d4\") " pod="openshift-must-gather-nkp5f/perf-node-gather-daemonset-mvmnq"
Jul 07 17:10:16.817894 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:10:16.817894    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7227587b-c968-420d-951c-9efb1edeb9d4-podres\") pod \"perf-node-gather-daemonset-mvmnq\" (UID: \"7227587b-c968-420d-951c-9efb1edeb9d4\") " pod="openshift-must-gather-nkp5f/perf-node-gather-daemonset-mvmnq"
Jul 07 17:10:16.818156 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:10:16.817987    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7227587b-c968-420d-951c-9efb1edeb9d4-sys\") pod \"perf-node-gather-daemonset-mvmnq\" (UID: \"7227587b-c968-420d-951c-9efb1edeb9d4\") " pod="openshift-must-gather-nkp5f/perf-node-gather-daemonset-mvmnq"
Jul 07 17:10:16.818156 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:10:16.818048    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7227587b-c968-420d-951c-9efb1edeb9d4-sys\") pod \"perf-node-gather-daemonset-mvmnq\" (UID: \"7227587b-c968-420d-951c-9efb1edeb9d4\") " pod="openshift-must-gather-nkp5f/perf-node-gather-daemonset-mvmnq"
Jul 07 17:10:16.818156 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:10:16.818095    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7227587b-c968-420d-951c-9efb1edeb9d4-proc\") pod \"perf-node-gather-daemonset-mvmnq\" (UID: \"7227587b-c968-420d-951c-9efb1edeb9d4\") " pod="openshift-must-gather-nkp5f/perf-node-gather-daemonset-mvmnq"
Jul 07 17:10:16.818156 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:10:16.818116    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7227587b-c968-420d-951c-9efb1edeb9d4-podres\") pod \"perf-node-gather-daemonset-mvmnq\" (UID: \"7227587b-c968-420d-951c-9efb1edeb9d4\") " pod="openshift-must-gather-nkp5f/perf-node-gather-daemonset-mvmnq"
Jul 07 17:10:16.818377 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:10:16.818172    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7227587b-c968-420d-951c-9efb1edeb9d4-proc\") pod \"perf-node-gather-daemonset-mvmnq\" (UID: \"7227587b-c968-420d-951c-9efb1edeb9d4\") " pod="openshift-must-gather-nkp5f/perf-node-gather-daemonset-mvmnq"
Jul 07 17:10:16.818377 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:10:16.818198    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7227587b-c968-420d-951c-9efb1edeb9d4-lib-modules\") pod \"perf-node-gather-daemonset-mvmnq\" (UID: \"7227587b-c968-420d-951c-9efb1edeb9d4\") " pod="openshift-must-gather-nkp5f/perf-node-gather-daemonset-mvmnq"
Jul 07 17:10:16.818377 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:10:16.818338    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7227587b-c968-420d-951c-9efb1edeb9d4-lib-modules\") pod \"perf-node-gather-daemonset-mvmnq\" (UID: \"7227587b-c968-420d-951c-9efb1edeb9d4\") " pod="openshift-must-gather-nkp5f/perf-node-gather-daemonset-mvmnq"
Jul 07 17:10:16.827247 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:10:16.827219    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vvq8\" (UniqueName: \"kubernetes.io/projected/7227587b-c968-420d-951c-9efb1edeb9d4-kube-api-access-6vvq8\") pod \"perf-node-gather-daemonset-mvmnq\" (UID: \"7227587b-c968-420d-951c-9efb1edeb9d4\") " pod="openshift-must-gather-nkp5f/perf-node-gather-daemonset-mvmnq"
Jul 07 17:10:16.957536 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:10:16.957437    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nkp5f/perf-node-gather-daemonset-mvmnq"
Jul 07 17:10:17.097503 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:10:17.097472    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nkp5f/perf-node-gather-daemonset-mvmnq"]
Jul 07 17:10:17.100193 ip-10-0-129-6 kubenswrapper[2578]: W0707 17:10:17.100156    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7227587b_c968_420d_951c_9efb1edeb9d4.slice/crio-3f8636467626ce718eaf64095708fb8c97bdd82531f904661a66d03a16a00c95 WatchSource:0}: Error finding container 3f8636467626ce718eaf64095708fb8c97bdd82531f904661a66d03a16a00c95: Status 404 returned error can't find the container with id 3f8636467626ce718eaf64095708fb8c97bdd82531f904661a66d03a16a00c95
Jul 07 17:10:17.469024 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:10:17.468991    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nkp5f/perf-node-gather-daemonset-mvmnq" event={"ID":"7227587b-c968-420d-951c-9efb1edeb9d4","Type":"ContainerStarted","Data":"eb72963cd4412c8de985cfff8ab46fb32d89ef5beb9bedd9b307c271e2143964"}
Jul 07 17:10:17.469215 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:10:17.469041    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nkp5f/perf-node-gather-daemonset-mvmnq" event={"ID":"7227587b-c968-420d-951c-9efb1edeb9d4","Type":"ContainerStarted","Data":"3f8636467626ce718eaf64095708fb8c97bdd82531f904661a66d03a16a00c95"}
Jul 07 17:10:17.469215 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:10:17.469132    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-nkp5f/perf-node-gather-daemonset-mvmnq"
Jul 07 17:10:17.488329 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:10:17.488221    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-nkp5f/perf-node-gather-daemonset-mvmnq" podStartSLOduration=1.488200704 podStartE2EDuration="1.488200704s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:10:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:10:17.486459564 +0000 UTC m=+2819.573428036" watchObservedRunningTime="2026-07-07 17:10:17.488200704 +0000 UTC m=+2819.575169162"
Jul 07 17:10:20.028884 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:10:20.028852    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-m7n9j_97c7d1d5-ed8a-4785-b56e-e76a83166958/dns/0.log"
Jul 07 17:10:20.055291 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:10:20.055264    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-m7n9j_97c7d1d5-ed8a-4785-b56e-e76a83166958/kube-rbac-proxy/0.log"
Jul 07 17:10:20.142312 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:10:20.142279    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xpjlg_92a59c06-08c5-471c-943f-7f378028262c/dns-node-resolver/0.log"
Jul 07 17:10:20.716940 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:10:20.716906    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6cc646db48-pv5v6_bcc5fcc5-aec1-49d7-abc9-4e23b61c1dcf/registry/0.log"
Jul 07 17:10:20.773605 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:10:20.773544    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nk4br_2d6c0087-96b8-4c36-bc5b-e6f2ab2d179f/node-ca/0.log"
Jul 07 17:10:22.046519 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:10:22.046483    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-xgb25_481ab942-bed0-43b2-b9e4-f3dcc6d3d857/discovery/0.log"
Jul 07 17:10:22.310075 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:10:22.309972    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-76b5464cf7-q8skn_83acc011-1498-4b7f-ba25-6aba7588b38e/router/0.log"
Jul 07 17:10:23.018741 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:10:23.018712    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kxns9_f70a870c-9842-41b6-a874-b06704c78994/serve-healthcheck-canary/0.log"
Jul 07 17:10:23.483520 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:10:23.483489    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-nkp5f/perf-node-gather-daemonset-mvmnq"
Jul 07 17:10:23.655980 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:10:23.655950    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ks8pq_9ad40b4c-1d31-421e-a343-4162c9575748/kube-rbac-proxy/0.log"
Jul 07 17:10:23.682490 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:10:23.682460    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ks8pq_9ad40b4c-1d31-421e-a343-4162c9575748/exporter/0.log"
Jul 07 17:10:23.709307 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:10:23.709275    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ks8pq_9ad40b4c-1d31-421e-a343-4162c9575748/extractor/0.log"
Jul 07 17:10:27.086397 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:10:27.086338    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7fb6d99899-499sg_6e9ea2bd-5f43-40f4-a287-07ebc83fb243/manager/0.log"
Jul 07 17:10:27.124604 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:10:27.124567    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7fb6d99899-499sg_6e9ea2bd-5f43-40f4-a287-07ebc83fb243/copy-manifests/0.log"
Jul 07 17:10:27.334578 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:10:27.334545    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-xgb25_481ab942-bed0-43b2-b9e4-f3dcc6d3d857/discovery/0.log"
Jul 07 17:10:27.525406 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:10:27.525375    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-76b5464cf7-q8skn_83acc011-1498-4b7f-ba25-6aba7588b38e/router/0.log"
Jul 07 17:10:28.801991 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:10:28.801905    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-778798b69f-8b2t2_ccd0ce2f-0119-4a44-978f-c212a7b9e71f/manager/0.log"
Jul 07 17:10:28.922955 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:10:28.922914    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-xgb25_481ab942-bed0-43b2-b9e4-f3dcc6d3d857/discovery/0.log"
Jul 07 17:10:29.135306 ip-10-0-129-6 kubenswrapper[2578]: I0707 17:10:29.135272    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-76b5464cf7-q8skn_83acc011-1498-4b7f-ba25-6aba7588b38e/router/0.log"