Sep 18 04:06:04.276315 ip-10-0-129-207 systemd[1]: Starting Kubernetes Kubelet...
Sep 18 04:06:04.701390 ip-10-0-129-207 kubenswrapper[2585]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 18 04:06:04.701390 ip-10-0-129-207 kubenswrapper[2585]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 18 04:06:04.701390 ip-10-0-129-207 kubenswrapper[2585]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 18 04:06:04.701390 ip-10-0-129-207 kubenswrapper[2585]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 18 04:06:04.701390 ip-10-0-129-207 kubenswrapper[2585]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 18 04:06:04.702526 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.702433    2585 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 18 04:06:04.710689 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710650    2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 04:06:04.710689 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710678    2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 04:06:04.710689 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710681    2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 04:06:04.710689 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710685    2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 04:06:04.710689 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710687    2585 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 04:06:04.710689 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710691    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 04:06:04.710689 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710694    2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 04:06:04.710689 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710696    2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 04:06:04.710689 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710699    2585 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 04:06:04.710689 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710702    2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 04:06:04.711106 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710705    2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 04:06:04.711106 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710708    2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 04:06:04.711106 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710713    2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 04:06:04.711106 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710717    2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 04:06:04.711106 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710720    2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 04:06:04.711106 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710723    2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 04:06:04.711106 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710726    2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 04:06:04.711106 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710729    2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 04:06:04.711106 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710732    2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 04:06:04.711106 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710735    2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 04:06:04.711106 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710738    2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 04:06:04.711106 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710741    2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 04:06:04.711106 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710743    2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 04:06:04.711106 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710746    2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 04:06:04.711106 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710748    2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 04:06:04.711106 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710751    2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 04:06:04.711106 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710754    2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 04:06:04.711106 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710762    2585 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 04:06:04.711106 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710767    2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 04:06:04.711558 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710771    2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 04:06:04.711558 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710773    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 04:06:04.711558 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710776    2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 04:06:04.711558 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710779    2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 04:06:04.711558 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710782    2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 04:06:04.711558 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710784    2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 04:06:04.711558 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710787    2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 04:06:04.711558 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710790    2585 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 04:06:04.711558 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710793    2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 04:06:04.711558 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710795    2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 04:06:04.711558 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710798    2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 04:06:04.711558 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710801    2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 04:06:04.711558 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710803    2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 04:06:04.711558 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710806    2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 04:06:04.711558 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710809    2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 04:06:04.711558 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710812    2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 04:06:04.711558 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710815    2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 04:06:04.711558 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710817    2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 04:06:04.711558 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710820    2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 04:06:04.711558 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710822    2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 04:06:04.712074 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710825    2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 04:06:04.712074 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710828    2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 04:06:04.712074 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710830    2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 04:06:04.712074 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710833    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 04:06:04.712074 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710835    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 04:06:04.712074 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710838    2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 04:06:04.712074 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710841    2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 04:06:04.712074 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710844    2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 04:06:04.712074 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710846    2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 04:06:04.712074 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710849    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 04:06:04.712074 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710852    2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 04:06:04.712074 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710854    2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 04:06:04.712074 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710857    2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 04:06:04.712074 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710861    2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 04:06:04.712074 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710863    2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 04:06:04.712074 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710866    2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 04:06:04.712074 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710868    2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 04:06:04.712074 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710871    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 04:06:04.712074 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710874    2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 04:06:04.712579 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710876    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 04:06:04.712579 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710879    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 04:06:04.712579 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710881    2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 04:06:04.712579 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710884    2585 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 04:06:04.712579 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710887    2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 04:06:04.712579 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710889    2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 04:06:04.712579 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710894    2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 04:06:04.712579 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710897    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 04:06:04.712579 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710900    2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 04:06:04.712579 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710902    2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 04:06:04.712579 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710905    2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 04:06:04.712579 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710908    2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 04:06:04.712579 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710911    2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 04:06:04.712579 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710913    2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 04:06:04.712579 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710916    2585 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 04:06:04.712579 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710920    2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 04:06:04.712579 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710922    2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 04:06:04.712579 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710927    2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 04:06:04.712579 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710930    2585 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 04:06:04.713175 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710933    2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 04:06:04.713175 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710937    2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 04:06:04.713175 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710940    2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 04:06:04.713175 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710943    2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 04:06:04.713175 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710946    2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 04:06:04.713175 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710948    2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 04:06:04.713175 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710951    2585 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 04:06:04.713175 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710954    2585 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 04:06:04.713175 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710956    2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 04:06:04.713175 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710959    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 04:06:04.713175 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710962    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 04:06:04.713175 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.710964    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 04:06:04.713175 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711691    2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 04:06:04.713175 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711697    2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 04:06:04.713175 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711701    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 04:06:04.713175 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711704    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 04:06:04.713175 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711707    2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 04:06:04.713175 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711710    2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 04:06:04.713175 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711713    2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 04:06:04.713175 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711717    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 04:06:04.713658 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711720    2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 04:06:04.713658 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711723    2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 04:06:04.713658 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711726    2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 04:06:04.713658 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711729    2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 04:06:04.713658 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711732    2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 04:06:04.713658 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711735    2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 04:06:04.713658 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711738    2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 04:06:04.713658 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711740    2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 04:06:04.713658 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711743    2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 04:06:04.713658 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711746    2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 04:06:04.713658 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711749    2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 04:06:04.713658 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711752    2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 04:06:04.713658 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711754    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 04:06:04.713658 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711757    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 04:06:04.713658 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711759    2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 04:06:04.713658 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711762    2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 04:06:04.713658 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711764    2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 04:06:04.713658 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711767    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 04:06:04.713658 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711769    2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 04:06:04.714161 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711772    2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 04:06:04.714161 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711774    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 04:06:04.714161 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711777    2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 04:06:04.714161 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711779    2585 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 04:06:04.714161 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711782    2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 04:06:04.714161 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711784    2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 04:06:04.714161 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711787    2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 04:06:04.714161 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711790    2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 04:06:04.714161 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711793    2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 04:06:04.714161 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711795    2585 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 04:06:04.714161 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711798    2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 04:06:04.714161 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711801    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 04:06:04.714161 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711804    2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 04:06:04.714161 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711806    2585 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 04:06:04.714161 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711809    2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 04:06:04.714161 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711812    2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 04:06:04.714161 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711815    2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 04:06:04.714161 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711817    2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 04:06:04.714161 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711820    2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 04:06:04.714161 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711822    2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 04:06:04.714648 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711825    2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 04:06:04.714648 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711827    2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 04:06:04.714648 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711830    2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 04:06:04.714648 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711834    2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 04:06:04.714648 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711836    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 04:06:04.714648 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711839    2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 04:06:04.714648 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711844    2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 04:06:04.714648 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711847    2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 04:06:04.714648 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711851    2585 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 04:06:04.714648 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711854    2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 04:06:04.714648 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711856    2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 04:06:04.714648 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711859    2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 04:06:04.714648 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711863    2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 04:06:04.714648 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711867    2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 04:06:04.714648 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711870    2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 04:06:04.714648 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711874    2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 04:06:04.714648 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711877    2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 04:06:04.714648 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711880    2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 04:06:04.714648 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711883    2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 04:06:04.715145 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711886    2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 04:06:04.715145 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711889    2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 04:06:04.715145 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711891    2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 04:06:04.715145 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711894    2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 04:06:04.715145 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711897    2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 04:06:04.715145 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711899    2585 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 04:06:04.715145 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711902    2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 04:06:04.715145 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711904    2585 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 04:06:04.715145 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711907    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 04:06:04.715145 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711909    2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 04:06:04.715145 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711912    2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 04:06:04.715145 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711915    2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 04:06:04.715145 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711917    2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 04:06:04.715145 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711920    2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 04:06:04.715145 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711922    2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 04:06:04.715145 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711925    2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 04:06:04.715145 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711927    2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 04:06:04.715145 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711931    2585 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 04:06:04.715145 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711934    2585 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 04:06:04.715145 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711937    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 04:06:04.715628 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711940    2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 04:06:04.715628 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711945    2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 04:06:04.715628 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711947    2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 04:06:04.715628 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711950    2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 04:06:04.715628 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711953    2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 04:06:04.715628 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711955    2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 04:06:04.715628 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711958    2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 04:06:04.715628 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711961    2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 04:06:04.715628 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711963    2585 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 04:06:04.715628 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711966    2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 04:06:04.715628 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711968    2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 04:06:04.715628 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711971    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 04:06:04.715628 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.711973    2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 04:06:04.715628 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712420    2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 04:06:04.715628 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712426    2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 04:06:04.715628 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712430    2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 04:06:04.715628 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712433    2585 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 04:06:04.715628 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712436    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 04:06:04.715628 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712439    2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 04:06:04.715628 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712442    2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 04:06:04.716156 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712445    2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 04:06:04.716156 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712448    2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 04:06:04.716156 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712451    2585 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 04:06:04.716156 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712453    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 04:06:04.716156 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712457    2585 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 04:06:04.716156 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712461    2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 04:06:04.716156 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712464    2585 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 04:06:04.716156 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712467    2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 04:06:04.716156 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712469    2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 04:06:04.716156 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712472    2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 04:06:04.716156 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712475    2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 04:06:04.716156 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712478    2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 04:06:04.716156 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712481    2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 04:06:04.716156 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712493    2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 04:06:04.716156 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712496    2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 04:06:04.716156 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712499    2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 04:06:04.716156 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712502    2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 04:06:04.716156 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712504    2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 04:06:04.716156 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712507    2585 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 04:06:04.716156 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712509    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 04:06:04.716686 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712512    2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 04:06:04.716686 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712515    2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 04:06:04.716686 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712518    2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 04:06:04.716686 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712520    2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 04:06:04.716686 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712523    2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 04:06:04.716686 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712528    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 04:06:04.716686 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712531    2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 04:06:04.716686 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712534    2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 04:06:04.716686 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712536    2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 04:06:04.716686 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712539    2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 04:06:04.716686 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712541    2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 04:06:04.716686 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712545    2585 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 04:06:04.716686 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712548    2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 04:06:04.716686 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712551    2585 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 04:06:04.716686 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712555    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 04:06:04.716686 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712558    2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 04:06:04.716686 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712561    2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 04:06:04.716686 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712563    2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 04:06:04.716686 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712566    2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 04:06:04.716686 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712569    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 04:06:04.717202 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712571    2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 04:06:04.717202 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712574    2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 04:06:04.717202 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712577    2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 04:06:04.717202 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712580    2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 04:06:04.717202 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712583    2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 04:06:04.717202 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712586    2585 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 04:06:04.717202 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712589    2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 04:06:04.717202 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712591    2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 04:06:04.717202 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712594    2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 04:06:04.717202 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712596    2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 04:06:04.717202 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712599    2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 04:06:04.717202 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712601    2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 04:06:04.717202 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712604    2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 04:06:04.717202 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712607    2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 04:06:04.717202 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712609    2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 04:06:04.717202 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712611    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 04:06:04.717202 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712614    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 04:06:04.717202 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712617    2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 04:06:04.717202 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712620    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 04:06:04.717202 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712622    2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 04:06:04.717705 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712625    2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 04:06:04.717705 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712628    2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 04:06:04.717705 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712630    2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 04:06:04.717705 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712636    2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 04:06:04.717705 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712639    2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 04:06:04.717705 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712642    2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 04:06:04.717705 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712645    2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 04:06:04.717705 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712649    2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 04:06:04.717705 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712652    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 04:06:04.717705 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712655    2585 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 04:06:04.717705 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712659    2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 04:06:04.717705 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712663    2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 04:06:04.717705 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712666    2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 04:06:04.717705 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712669    2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 04:06:04.717705 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712671    2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 04:06:04.717705 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712674    2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 04:06:04.717705 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712677    2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 04:06:04.717705 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712680    2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 04:06:04.718145 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712683    2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 04:06:04.718145 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712685    2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 04:06:04.718145 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712688    2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 04:06:04.718145 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712690    2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 04:06:04.718145 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712693    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 04:06:04.718145 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712696    2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 04:06:04.718145 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712699    2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 04:06:04.718145 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712702    2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 04:06:04.718145 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712704    2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 04:06:04.718145 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712707    2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 04:06:04.718145 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712709    2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 04:06:04.718145 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712712    2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 04:06:04.718145 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712715    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 04:06:04.718145 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.712717    2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 04:06:04.718145 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.712790    2585 flags.go:64] FLAG: --address="0.0.0.0"
Sep 18 04:06:04.718145 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.712828    2585 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 18 04:06:04.718145 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.712836    2585 flags.go:64] FLAG: --anonymous-auth="true"
Sep 18 04:06:04.718145 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.712840    2585 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 18 04:06:04.718145 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.712845    2585 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 18 04:06:04.718145 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.712848    2585 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 18 04:06:04.718145 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.712853    2585 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 18 04:06:04.719505 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.712858    2585 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 18 04:06:04.719505 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.712861    2585 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 18 04:06:04.719505 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.712864    2585 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 18 04:06:04.719505 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.712868    2585 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 18 04:06:04.719505 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.712871    2585 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 18 04:06:04.719505 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.712874    2585 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 18 04:06:04.719505 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.712877    2585 flags.go:64] FLAG: --cgroup-root=""
Sep 18 04:06:04.719505 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.712880    2585 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 18 04:06:04.719505 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.712883    2585 flags.go:64] FLAG: --client-ca-file=""
Sep 18 04:06:04.719505 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.712887    2585 flags.go:64] FLAG: --cloud-provider="external"
Sep 18 04:06:04.719505 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.712890    2585 flags.go:64] FLAG: --cluster-dns="[]"
Sep 18 04:06:04.719505 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.712894    2585 flags.go:64] FLAG: --cluster-domain=""
Sep 18 04:06:04.719505 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.712897    2585 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 18 04:06:04.719505 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.712900    2585 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 18 04:06:04.719505 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.712903    2585 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 18 04:06:04.719505 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.712906    2585 flags.go:64] FLAG: --container-log-max-files="5"
Sep 18 04:06:04.719505 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.712910    2585 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 18 04:06:04.719505 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.712913    2585 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 18 04:06:04.719505 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.712916    2585 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 18 04:06:04.719505 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.712920    2585 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 18 04:06:04.719505 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.712923    2585 flags.go:64] FLAG: --contention-profiling="false"
Sep 18 04:06:04.719505 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.712927    2585 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 18 04:06:04.719505 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.712930    2585 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 18 04:06:04.719505 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.712934    2585 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 18 04:06:04.720123 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.712937    2585 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 18 04:06:04.720123 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.712941    2585 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 18 04:06:04.720123 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.712944    2585 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 18 04:06:04.720123 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.712947    2585 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 18 04:06:04.720123 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.712950    2585 flags.go:64] FLAG: --enable-load-reader="false"
Sep 18 04:06:04.720123 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.712953    2585 flags.go:64] FLAG: --enable-server="true"
Sep 18 04:06:04.720123 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.712956    2585 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 18 04:06:04.720123 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.712961    2585 flags.go:64] FLAG: --event-burst="100"
Sep 18 04:06:04.720123 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.712964    2585 flags.go:64] FLAG: --event-qps="50"
Sep 18 04:06:04.720123 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.712967    2585 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 18 04:06:04.720123 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.712970    2585 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 18 04:06:04.720123 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.712973    2585 flags.go:64] FLAG: --eviction-hard=""
Sep 18 04:06:04.720123 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.712978    2585 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 18 04:06:04.720123 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.712981    2585 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 18 04:06:04.720123 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.712984    2585 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 18 04:06:04.720123 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.712987    2585 flags.go:64] FLAG: --eviction-soft=""
Sep 18 04:06:04.720123 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.712990    2585 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 18 04:06:04.720123 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.712993    2585 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 18 04:06:04.720123 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.712996    2585 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 18 04:06:04.720123 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713000    2585 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 18 04:06:04.720123 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713002    2585 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 18 04:06:04.720123 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713005    2585 flags.go:64] FLAG: --fail-swap-on="true"
Sep 18 04:06:04.720123 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713008    2585 flags.go:64] FLAG: --feature-gates=""
Sep 18 04:06:04.720123 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713012    2585 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 18 04:06:04.720123 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713015    2585 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 18 04:06:04.720751 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713018    2585 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 18 04:06:04.720751 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713021    2585 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 18 04:06:04.720751 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713024    2585 flags.go:64] FLAG: --healthz-port="10248"
Sep 18 04:06:04.720751 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713027    2585 flags.go:64] FLAG: --help="false"
Sep 18 04:06:04.720751 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713030    2585 flags.go:64] FLAG: --hostname-override="ip-10-0-129-207.ec2.internal"
Sep 18 04:06:04.720751 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713033    2585 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 18 04:06:04.720751 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713036    2585 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 18 04:06:04.720751 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713039    2585 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 18 04:06:04.720751 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713042    2585 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 18 04:06:04.720751 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713045    2585 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 18 04:06:04.720751 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713064    2585 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 18 04:06:04.720751 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713068    2585 flags.go:64] FLAG: --image-service-endpoint=""
Sep 18 04:06:04.720751 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713070    2585 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 18 04:06:04.720751 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713073    2585 flags.go:64] FLAG: --kube-api-burst="100"
Sep 18 04:06:04.720751 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713076    2585 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 18 04:06:04.720751 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713080    2585 flags.go:64] FLAG: --kube-api-qps="50"
Sep 18 04:06:04.720751 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713083    2585 flags.go:64] FLAG: --kube-reserved=""
Sep 18 04:06:04.720751 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713086    2585 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 18 04:06:04.720751 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713088    2585 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 18 04:06:04.720751 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713091    2585 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 18 04:06:04.720751 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713094    2585 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 18 04:06:04.720751 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713097    2585 flags.go:64] FLAG: --lock-file=""
Sep 18 04:06:04.720751 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713100    2585 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 18 04:06:04.720751 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713102    2585 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 18 04:06:04.721417 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713105    2585 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 18 04:06:04.721417 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713110    2585 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 18 04:06:04.721417 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713115    2585 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 18 04:06:04.721417 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713117    2585 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 18 04:06:04.721417 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713120    2585 flags.go:64] FLAG: --logging-format="text"
Sep 18 04:06:04.721417 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713123    2585 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 18 04:06:04.721417 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713126    2585 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 18 04:06:04.721417 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713129    2585 flags.go:64] FLAG: --manifest-url=""
Sep 18 04:06:04.721417 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713132    2585 flags.go:64] FLAG: --manifest-url-header=""
Sep 18 04:06:04.721417 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713136    2585 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 18 04:06:04.721417 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713139    2585 flags.go:64] FLAG: --max-open-files="1000000"
Sep 18 04:06:04.721417 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713143    2585 flags.go:64] FLAG: --max-pods="110"
Sep 18 04:06:04.721417 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713149    2585 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 18 04:06:04.721417 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713152    2585 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 18 04:06:04.721417 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713155    2585 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 18 04:06:04.721417 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713158    2585 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 18 04:06:04.721417 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713161    2585 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 18 04:06:04.721417 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713164    2585 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 18 04:06:04.721417 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713167    2585 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 18 04:06:04.721417 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713175    2585 flags.go:64] FLAG: --node-status-max-images="50"
Sep 18 04:06:04.721417 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713178    2585 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 18 04:06:04.721417 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713181    2585 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 18 04:06:04.721417 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713186    2585 flags.go:64] FLAG: --pod-cidr=""
Sep 18 04:06:04.721982 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713189    2585 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc"
Sep 18 04:06:04.721982 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713195    2585 flags.go:64] FLAG: --pod-manifest-path=""
Sep 18 04:06:04.721982 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713197    2585 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 18 04:06:04.721982 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713200    2585 flags.go:64] FLAG: --pods-per-core="0"
Sep 18 04:06:04.721982 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713203    2585 flags.go:64] FLAG: --port="10250"
Sep 18 04:06:04.721982 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713206    2585 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 18 04:06:04.721982 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713210    2585 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02ad99a01e9830d42"
Sep 18 04:06:04.721982 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713213    2585 flags.go:64] FLAG: --qos-reserved=""
Sep 18 04:06:04.721982 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713216    2585 flags.go:64] FLAG: --read-only-port="10255"
Sep 18 04:06:04.721982 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713219    2585 flags.go:64] FLAG: --register-node="true"
Sep 18 04:06:04.721982 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713222    2585 flags.go:64] FLAG: --register-with-taints=""
Sep 18 04:06:04.721982 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713226    2585 flags.go:64] FLAG: --registry-burst="10"
Sep 18 04:06:04.721982 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713232    2585 flags.go:64] FLAG: --registry-qps="5"
Sep 18 04:06:04.721982 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713235    2585 flags.go:64] FLAG: --reserved-cpus=""
Sep 18 04:06:04.721982 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713237    2585 flags.go:64] FLAG: --reserved-memory=""
Sep 18 04:06:04.721982 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713246    2585 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 18 04:06:04.721982 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713249    2585 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 18 04:06:04.721982 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713252    2585 flags.go:64] FLAG: --rotate-certificates="false"
Sep 18 04:06:04.721982 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713255    2585 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 18 04:06:04.721982 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713258    2585 flags.go:64] FLAG: --runonce="false"
Sep 18 04:06:04.721982 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713260    2585 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 18 04:06:04.721982 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713263    2585 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 18 04:06:04.721982 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713270    2585 flags.go:64] FLAG: --seccomp-default="false"
Sep 18 04:06:04.721982 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713273    2585 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 18 04:06:04.721982 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713276    2585 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 18 04:06:04.722637 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713279    2585 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 18 04:06:04.722637 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713282    2585 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 18 04:06:04.722637 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713285    2585 flags.go:64] FLAG: --storage-driver-password="root"
Sep 18 04:06:04.722637 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713288    2585 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 18 04:06:04.722637 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713291    2585 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 18 04:06:04.722637 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713294    2585 flags.go:64] FLAG: --storage-driver-user="root"
Sep 18 04:06:04.722637 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713298    2585 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 18 04:06:04.722637 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713302    2585 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 18 04:06:04.722637 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713305    2585 flags.go:64] FLAG: --system-cgroups=""
Sep 18 04:06:04.722637 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713307    2585 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 18 04:06:04.722637 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713313    2585 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 18 04:06:04.722637 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713316    2585 flags.go:64] FLAG: --tls-cert-file=""
Sep 18 04:06:04.722637 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713318    2585 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 18 04:06:04.722637 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713322    2585 flags.go:64] FLAG: --tls-min-version=""
Sep 18 04:06:04.722637 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713325    2585 flags.go:64] FLAG: --tls-private-key-file=""
Sep 18 04:06:04.722637 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713328    2585 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 18 04:06:04.722637 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713331    2585 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 18 04:06:04.722637 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713334    2585 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 18 04:06:04.722637 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713337    2585 flags.go:64] FLAG: --v="2"
Sep 18 04:06:04.722637 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713341    2585 flags.go:64] FLAG: --version="false"
Sep 18 04:06:04.722637 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713345    2585 flags.go:64] FLAG: --vmodule=""
Sep 18 04:06:04.722637 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713349    2585 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 18 04:06:04.722637 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.713353    2585 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 18 04:06:04.722637 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713468    2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 04:06:04.722637 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713472    2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 04:06:04.723239 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713475    2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 04:06:04.723239 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713478    2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 04:06:04.723239 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713481    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 04:06:04.723239 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713484    2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 04:06:04.723239 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713488    2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 04:06:04.723239 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713491    2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 04:06:04.723239 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713493    2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 04:06:04.723239 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713496    2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 04:06:04.723239 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713499    2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 04:06:04.723239 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713502    2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 04:06:04.723239 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713504    2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 04:06:04.723239 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713507    2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 04:06:04.723239 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713510    2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 04:06:04.723239 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713515    2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 04:06:04.723239 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713518    2585 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 04:06:04.723239 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713521    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 04:06:04.723239 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713523    2585 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 04:06:04.723239 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713526    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 04:06:04.723239 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713529    2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 04:06:04.723239 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713531    2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 04:06:04.723751 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713534    2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 04:06:04.723751 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713536    2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 04:06:04.723751 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713539    2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 04:06:04.723751 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713541    2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 04:06:04.723751 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713544    2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 04:06:04.723751 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713546    2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 04:06:04.723751 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713549    2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 04:06:04.723751 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713551    2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 04:06:04.723751 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713554    2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 04:06:04.723751 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713557    2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 04:06:04.723751 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713560    2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 04:06:04.723751 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713562    2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 04:06:04.723751 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713565    2585 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 04:06:04.723751 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713568    2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 04:06:04.723751 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713570    2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 04:06:04.723751 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713573    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 04:06:04.723751 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713577    2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 04:06:04.723751 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713580    2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 04:06:04.723751 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713583    2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 04:06:04.723751 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713585    2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 04:06:04.724258 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713588    2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 04:06:04.724258 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713591    2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 04:06:04.724258 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713593    2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 04:06:04.724258 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713596    2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 04:06:04.724258 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713599    2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 04:06:04.724258 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713604    2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 04:06:04.724258 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713609    2585 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 04:06:04.724258 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713612    2585 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 04:06:04.724258 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713614    2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 04:06:04.724258 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713617    2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 04:06:04.724258 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713620    2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 04:06:04.724258 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713622    2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 04:06:04.724258 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713625    2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 04:06:04.724258 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713629    2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 04:06:04.724258 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713633    2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 04:06:04.724258 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713636    2585 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 04:06:04.724258 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713640    2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 04:06:04.724258 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713643    2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 04:06:04.724258 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713647    2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 04:06:04.724741 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713650    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 04:06:04.724741 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713653    2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 04:06:04.724741 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713656    2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 04:06:04.724741 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713659    2585 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 04:06:04.724741 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713662    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 04:06:04.724741 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713665    2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 04:06:04.724741 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713669    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 04:06:04.724741 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713672    2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 04:06:04.724741 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713674    2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 04:06:04.724741 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713679    2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 04:06:04.724741 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713682    2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 04:06:04.724741 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713684    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 04:06:04.724741 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713687    2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 04:06:04.724741 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713690    2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 04:06:04.724741 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713693    2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 04:06:04.724741 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713695    2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 04:06:04.724741 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713698    2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 04:06:04.724741 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713700    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 04:06:04.724741 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713704    2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 04:06:04.724741 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713707    2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 04:06:04.725320 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713710    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 04:06:04.725320 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713712    2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 04:06:04.725320 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713715    2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 04:06:04.725320 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713718    2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 04:06:04.725320 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713720    2585 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 04:06:04.725320 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713723    2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 04:06:04.725320 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713726    2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 04:06:04.725320 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713728    2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 04:06:04.725320 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713731    2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 04:06:04.725320 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713733    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 04:06:04.725320 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713737    2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 04:06:04.725320 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713739    2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 04:06:04.725320 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713742    2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 04:06:04.725320 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713745    2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 04:06:04.725320 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713747    2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 04:06:04.725320 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713750    2585 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 04:06:04.725320 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713753    2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 04:06:04.725320 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.713756    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 04:06:04.725787 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.714490    2585 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 18 04:06:04.725787 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.722715    2585 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 18 04:06:04.725787 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.722733    2585 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 18 04:06:04.725787 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.723659    2585 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 18 04:06:04.725787 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.723666    2585 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 18 04:06:04.725787 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723727    2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 04:06:04.725787 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723732    2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 04:06:04.725787 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723736    2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 04:06:04.725787 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723739    2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 04:06:04.725787 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723744    2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 04:06:04.725787 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723748    2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 04:06:04.725787 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723751    2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 04:06:04.725787 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723754    2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 04:06:04.725787 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723757    2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 04:06:04.726148 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723760    2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 04:06:04.726148 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723763    2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 04:06:04.726148 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723765    2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 04:06:04.726148 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723768    2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 04:06:04.726148 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723771    2585 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 04:06:04.726148 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723774    2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 04:06:04.726148 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723776    2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 04:06:04.726148 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723781    2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 04:06:04.726148 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723784    2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 04:06:04.726148 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723788    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 04:06:04.726148 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723791    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 04:06:04.726148 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723794    2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 04:06:04.726148 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723796    2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 04:06:04.726148 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723799    2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 04:06:04.726148 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723802    2585 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 04:06:04.726148 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723805    2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 04:06:04.726148 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723808    2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 04:06:04.726148 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723811    2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 04:06:04.726148 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723814    2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 04:06:04.726148 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723816    2585 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 04:06:04.726641 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723820    2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 04:06:04.726641 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723823    2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 04:06:04.726641 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723825    2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 04:06:04.726641 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723828    2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 04:06:04.726641 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723830    2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 04:06:04.726641 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723834    2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 04:06:04.726641 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723838    2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 04:06:04.726641 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723841    2585 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 04:06:04.726641 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723844    2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 04:06:04.726641 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723847    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 04:06:04.726641 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723850    2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 04:06:04.726641 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723853    2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 04:06:04.726641 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723856    2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 04:06:04.726641 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723859    2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 04:06:04.726641 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723862    2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 04:06:04.726641 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723864    2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 04:06:04.726641 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723867    2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 04:06:04.726641 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723869    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 04:06:04.726641 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723872    2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 04:06:04.727176 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723875    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 04:06:04.727176 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723877    2585 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 04:06:04.727176 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723880    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 04:06:04.727176 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723883    2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 04:06:04.727176 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723885    2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 04:06:04.727176 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723888    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 04:06:04.727176 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723890    2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 04:06:04.727176 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723893    2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 04:06:04.727176 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723896    2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 04:06:04.727176 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723899    2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 04:06:04.727176 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723902    2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 04:06:04.727176 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723905    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 04:06:04.727176 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723908    2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 04:06:04.727176 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723911    2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 04:06:04.727176 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723913    2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 04:06:04.727176 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723916    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 04:06:04.727176 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723919    2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 04:06:04.727176 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723921    2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 04:06:04.727176 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723923    2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 04:06:04.727176 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723926    2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 04:06:04.727661 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723928    2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 04:06:04.727661 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723931    2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 04:06:04.727661 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723933    2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 04:06:04.727661 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723936    2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 04:06:04.727661 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723939    2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 04:06:04.727661 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723941    2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 04:06:04.727661 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723944    2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 04:06:04.727661 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723946    2585 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 04:06:04.727661 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723949    2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 04:06:04.727661 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723952    2585 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 04:06:04.727661 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723954    2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 04:06:04.727661 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723957    2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 04:06:04.727661 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723959    2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 04:06:04.727661 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723962    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 04:06:04.727661 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723964    2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 04:06:04.727661 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723967    2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 04:06:04.727661 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723969    2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 04:06:04.727661 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723972    2585 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 04:06:04.727661 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723974    2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 04:06:04.727661 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723977    2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 04:06:04.728188 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723979    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 04:06:04.728188 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723982    2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 04:06:04.728188 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723985    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 04:06:04.728188 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723987    2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 04:06:04.728188 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723991    2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 04:06:04.728188 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723994    2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 04:06:04.728188 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723996    2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 04:06:04.728188 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.723999    2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 04:06:04.728188 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724001    2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 04:06:04.728188 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724004    2585 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 04:06:04.728188 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724006    2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 04:06:04.728188 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.724011    2585 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 18 04:06:04.728188 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724157    2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 04:06:04.728188 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724163    2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 04:06:04.728188 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724166    2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 04:06:04.728562 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724170    2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 04:06:04.728562 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724174    2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 04:06:04.728562 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724177    2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 04:06:04.728562 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724181    2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 04:06:04.728562 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724184    2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 04:06:04.728562 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724186    2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 04:06:04.728562 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724189    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 04:06:04.728562 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724192    2585 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 04:06:04.728562 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724194    2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 04:06:04.728562 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724197    2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 04:06:04.728562 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724200    2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 04:06:04.728562 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724202    2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 04:06:04.728562 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724205    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 04:06:04.728562 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724207    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 04:06:04.728562 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724210    2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 04:06:04.728562 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724213    2585 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 04:06:04.728562 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724215    2585 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 04:06:04.728562 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724218    2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 04:06:04.728562 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724221    2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 04:06:04.729033 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724224    2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 04:06:04.729033 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724227    2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 04:06:04.729033 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724230    2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 04:06:04.729033 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724233    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 04:06:04.729033 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724235    2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 04:06:04.729033 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724238    2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 04:06:04.729033 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724240    2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 04:06:04.729033 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724243    2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 04:06:04.729033 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724246    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 04:06:04.729033 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724249    2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 04:06:04.729033 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724252    2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 04:06:04.729033 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724254    2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 04:06:04.729033 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724257    2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 04:06:04.729033 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724260    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 04:06:04.729033 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724262    2585 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 04:06:04.729033 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724265    2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 04:06:04.729033 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724268    2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 04:06:04.729033 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724271    2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 04:06:04.729033 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724274    2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 04:06:04.729033 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724276    2585 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 04:06:04.729033 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724279    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 04:06:04.729592 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724281    2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 04:06:04.729592 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724284    2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 04:06:04.729592 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724287    2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 04:06:04.729592 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724289    2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 04:06:04.729592 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724292    2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 04:06:04.729592 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724294    2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 04:06:04.729592 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724297    2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 04:06:04.729592 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724299    2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 04:06:04.729592 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724302    2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 04:06:04.729592 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724305    2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 04:06:04.729592 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724308    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 04:06:04.729592 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724310    2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 04:06:04.729592 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724313    2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 04:06:04.729592 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724316    2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 04:06:04.729592 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724319    2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 04:06:04.729592 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724321    2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 04:06:04.729592 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724324    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 04:06:04.729592 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724326    2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 04:06:04.729592 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724329    2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 04:06:04.729592 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724332    2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 04:06:04.730095 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724334    2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 04:06:04.730095 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724337    2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 04:06:04.730095 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724339    2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 04:06:04.730095 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724342    2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 04:06:04.730095 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724345    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 04:06:04.730095 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724347    2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 04:06:04.730095 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724350    2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 04:06:04.730095 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724352    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 04:06:04.730095 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724355    2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 04:06:04.730095 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724358    2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 04:06:04.730095 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724360    2585 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 04:06:04.730095 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724363    2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 04:06:04.730095 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724366    2585 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 04:06:04.730095 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724368    2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 04:06:04.730095 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724371    2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 04:06:04.730095 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724374    2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 04:06:04.730095 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724376    2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 04:06:04.730095 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724379    2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 04:06:04.730095 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724381    2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 04:06:04.730560 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724384    2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 04:06:04.730560 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724388    2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 04:06:04.730560 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724392    2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 04:06:04.730560 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724396    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 04:06:04.730560 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724399    2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 04:06:04.730560 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724401    2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 04:06:04.730560 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724404    2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 04:06:04.730560 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724407    2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 04:06:04.730560 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724410    2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 04:06:04.730560 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724412    2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 04:06:04.730560 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724415    2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 04:06:04.730560 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724418    2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 04:06:04.730560 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724421    2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 04:06:04.730560 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724424    2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 04:06:04.730560 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724426    2585 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 04:06:04.730560 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724429    2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 04:06:04.730560 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:04.724431    2585 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 04:06:04.730979 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.724436    2585 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 18 04:06:04.730979 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.724553    2585 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 18 04:06:04.730979 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.726933    2585 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 18 04:06:04.730979 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.728022    2585 server.go:1019] "Starting client certificate rotation"
Sep 18 04:06:04.730979 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.728126    2585 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 18 04:06:04.730979 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.728162    2585 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 18 04:06:04.730979 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.730830    2585 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 18 04:06:04.736171 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.735220    2585 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 18 04:06:04.750167 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.750147    2585 log.go:25] "Validated CRI v1 runtime API"
Sep 18 04:06:04.751956 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.751940    2585 log.go:25] "Validated CRI v1 image API"
Sep 18 04:06:04.753747 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.753731    2585 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 18 04:06:04.757215 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.757193    2585 fs.go:135] Filesystem UUIDs: map[3f915483-1cb7-487c-b32b-0b1bb50aa421:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 946e4475-f255-474a-a8d6-caef7c31cc0b:/dev/nvme0n1p4]
Sep 18 04:06:04.757284 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.757217    2585 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 18 04:06:04.762306 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.762200    2585 manager.go:216] Machine: {Timestamp:2026-09-18 04:06:04.760793633 +0000 UTC m=+0.372082164 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3096396 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec295520d598aeb9d5d8a62d50852c94 SystemUUID:ec295520-d598-aeb9-d5d8-a62d50852c94 BootID:6ffbe874-5ff4-49d3-a3c9-2960f6101f17 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:c3:d8:ff:e1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:c3:d8:ff:e1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b2:02:2f:c4:37:dc Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 18 04:06:04.762306 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.762300    2585 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 18 04:06:04.762423 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.762373    2585 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 18 04:06:04.762619 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.762600    2585 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 18 04:06:04.766131 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.766107    2585 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 18 04:06:04.766272 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.766133    2585 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-207.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 18 04:06:04.767027 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.767017    2585 topology_manager.go:138] "Creating topology manager with none policy"
Sep 18 04:06:04.767072 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.767028    2585 container_manager_linux.go:309] "Creating device plugin manager"
Sep 18 04:06:04.767072 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.767037    2585 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 18 04:06:04.767072 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.767065    2585 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 18 04:06:04.767154 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.767137    2585 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 18 04:06:04.771816 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.771805    2585 state_mem.go:36] "Initialized new in-memory state store"
Sep 18 04:06:04.771921 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.771911    2585 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 18 04:06:04.771953 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.771940    2585 kubelet.go:486] "Attempting to sync node with API server"
Sep 18 04:06:04.771953 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.771949    2585 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 18 04:06:04.772003 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.771970    2585 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 18 04:06:04.772003 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.771979    2585 kubelet.go:398] "Adding apiserver pod source"
Sep 18 04:06:04.772003 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.771987    2585 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 18 04:06:04.772378 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.772355    2585 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 18 04:06:04.772378 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.772375    2585 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 18 04:06:04.774719 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.774700    2585 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1"
Sep 18 04:06:04.777604 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.777591    2585 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 18 04:06:04.777665 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.777642    2585 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 18 04:06:04.779647 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.779635    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 18 04:06:04.779688 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.779654    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 18 04:06:04.779688 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.779661    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 18 04:06:04.779688 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.779667    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 18 04:06:04.779688 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.779674    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 18 04:06:04.779688 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.779680    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 18 04:06:04.779811 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.779692    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 18 04:06:04.779811 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.779698    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 18 04:06:04.779811 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.779705    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 18 04:06:04.779811 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.779710    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 18 04:06:04.779811 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.779723    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 18 04:06:04.779811 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.779728    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 18 04:06:04.781521 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.781501    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 18 04:06:04.781521 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.781521    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 18 04:06:04.782767 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:04.782744    2585 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-207.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 18 04:06:04.782849 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:04.782747    2585 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 18 04:06:04.784228 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.784207    2585 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-207.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 18 04:06:04.785949 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.785931    2585 server.go:1268] "Started kubelet"
Sep 18 04:06:04.786046 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.785994    2585 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 18 04:06:04.786217 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.786165    2585 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 18 04:06:04.786339 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.786319    2585 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 18 04:06:04.786885 ip-10-0-129-207 systemd[1]: Started Kubernetes Kubelet.
Sep 18 04:06:04.788277 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.788264    2585 server.go:310] "Adding debug handlers to kubelet server"
Sep 18 04:06:04.790425 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.790404    2585 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 18 04:06:04.793395 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:04.793377    2585 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 18 04:06:04.798275 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.798260    2585 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 18 04:06:04.798340 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.798316    2585 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 18 04:06:04.798389 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:04.798366    2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-207.ec2.internal\" not found"
Sep 18 04:06:04.799090 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.799070    2585 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 18 04:06:04.799090 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.799093    2585 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 18 04:06:04.799221 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.799080    2585 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 18 04:06:04.799221 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.799165    2585 reconstruct.go:97] "Volume reconstruction finished"
Sep 18 04:06:04.799221 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.799173    2585 reconciler.go:29] "Reconciler: start to sync state"
Sep 18 04:06:04.799535 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.799520    2585 factory.go:153] Registering CRI-O factory
Sep 18 04:06:04.799584 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.799539    2585 factory.go:223] Registration of the crio container factory successfully
Sep 18 04:06:04.799631 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.799589    2585 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 18 04:06:04.799631 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.799597    2585 factory.go:55] Registering systemd factory
Sep 18 04:06:04.799631 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.799604    2585 factory.go:223] Registration of the systemd container factory successfully
Sep 18 04:06:04.799631 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.799619    2585 factory.go:103] Registering Raw factory
Sep 18 04:06:04.799631 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.799631    2585 manager.go:1196] Started watching for new ooms in manager
Sep 18 04:06:04.800008 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.799993    2585 manager.go:349] Starting recovery of all containers
Sep 18 04:06:04.801264 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:04.800068    2585 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-207.ec2.internal.18d64ea33407a384  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-207.ec2.internal,UID:ip-10-0-129-207.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-207.ec2.internal,},FirstTimestamp:2026-09-18 04:06:04.785902468 +0000 UTC m=+0.397191050,LastTimestamp:2026-09-18 04:06:04.785902468 +0000 UTC m=+0.397191050,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-207.ec2.internal,}"
Sep 18 04:06:04.801414 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:04.801391    2585 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-207.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 18 04:06:04.811378 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:04.811351    2585 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 18 04:06:04.811900 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.811879    2585 manager.go:354] Recovery completed
Sep 18 04:06:04.812776 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.812757    2585 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-smgtd"
Sep 18 04:06:04.819091 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.819078    2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 04:06:04.821150 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.821131    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-207.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 04:06:04.821219 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.821169    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-207.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 04:06:04.821219 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.821186    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-207.ec2.internal" event="NodeHasSufficientPID"
Sep 18 04:06:04.821440 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.821421    2585 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-smgtd"
Sep 18 04:06:04.821869 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.821854    2585 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 18 04:06:04.821869 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.821867    2585 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 18 04:06:04.821983 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.821881    2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 04:06:04.821983 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.821885    2585 state_mem.go:36] "Initialized new in-memory state store"
Sep 18 04:06:04.822659 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.822645    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-207.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 04:06:04.822741 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.822672    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-207.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 04:06:04.822741 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.822687    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-207.ec2.internal" event="NodeHasSufficientPID"
Sep 18 04:06:04.825687 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.825673    2585 policy_none.go:49] "None policy: Start"
Sep 18 04:06:04.825750 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.825692    2585 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 18 04:06:04.825750 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.825705    2585 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 18 04:06:04.828325 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.828313    2585 policy_none.go:47] "Start"
Sep 18 04:06:04.829907 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:04.829831    2585 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-207.ec2.internal.18d64ea336217ef0  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-207.ec2.internal,UID:ip-10-0-129-207.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-207.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-207.ec2.internal,},FirstTimestamp:2026-09-18 04:06:04.821151472 +0000 UTC m=+0.432440002,LastTimestamp:2026-09-18 04:06:04.821151472 +0000 UTC m=+0.432440002,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-207.ec2.internal,}"
Sep 18 04:06:04.883831 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.883811    2585 manager.go:337] "Starting Device Plugin manager"
Sep 18 04:06:04.886024 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:04.883864    2585 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 18 04:06:04.886024 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.883878    2585 server.go:87] "Starting device plugin registration server"
Sep 18 04:06:04.886024 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.884256    2585 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 18 04:06:04.886024 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.884274    2585 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 18 04:06:04.886024 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.884368    2585 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 18 04:06:04.886024 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.884459    2585 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 18 04:06:04.886024 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.884470    2585 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 18 04:06:04.886024 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:04.885614    2585 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 18 04:06:04.886024 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:04.885661    2585 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-207.ec2.internal\" not found"
Sep 18 04:06:04.900660 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.900626    2585 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 18 04:06:04.901909 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.901895    2585 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 18 04:06:04.902010 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.901945    2585 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 18 04:06:04.902010 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.901973    2585 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 18 04:06:04.902126 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:04.902019    2585 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 18 04:06:04.904435 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.904410    2585 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 04:06:04.984743 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.984614    2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 04:06:04.985682 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.985664    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-207.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 04:06:04.985760 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.985703    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-207.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 04:06:04.985760 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.985714    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-207.ec2.internal" event="NodeHasSufficientPID"
Sep 18 04:06:04.985760 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.985742    2585 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-207.ec2.internal"
Sep 18 04:06:04.994620 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:04.994598    2585 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-207.ec2.internal"
Sep 18 04:06:04.994620 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:04.994622    2585 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-207.ec2.internal\": node \"ip-10-0-129-207.ec2.internal\" not found"
Sep 18 04:06:05.002865 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:05.002840    2585 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-207.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-207.ec2.internal"]
Sep 18 04:06:05.002945 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:05.002907    2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 04:06:05.004041 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:05.004021    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-207.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 04:06:05.004148 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:05.004068    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-207.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 04:06:05.004148 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:05.004079    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-207.ec2.internal" event="NodeHasSufficientPID"
Sep 18 04:06:05.006345 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:05.006334    2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 04:06:05.006476 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:05.006462    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-207.ec2.internal"
Sep 18 04:06:05.006539 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:05.006493    2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 04:06:05.007005 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:05.006989    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-207.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 04:06:05.007082 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:05.007017    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-207.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 04:06:05.007082 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:05.006989    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-207.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 04:06:05.007082 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:05.007027    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-207.ec2.internal" event="NodeHasSufficientPID"
Sep 18 04:06:05.007082 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:05.007066    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-207.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 04:06:05.007082 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:05.007083    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-207.ec2.internal" event="NodeHasSufficientPID"
Sep 18 04:06:05.009242 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:05.009230    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-207.ec2.internal"
Sep 18 04:06:05.009290 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:05.009254    2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 04:06:05.009876 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:05.009862    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-207.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 04:06:05.009937 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:05.009887    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-207.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 04:06:05.009937 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:05.009899    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-207.ec2.internal" event="NodeHasSufficientPID"
Sep 18 04:06:05.020263 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:05.020245    2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-207.ec2.internal\" not found"
Sep 18 04:06:05.034715 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:05.034696    2585 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-207.ec2.internal\" not found" node="ip-10-0-129-207.ec2.internal"
Sep 18 04:06:05.038901 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:05.038887    2585 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-207.ec2.internal\" not found" node="ip-10-0-129-207.ec2.internal"
Sep 18 04:06:05.120591 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:05.120559    2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-207.ec2.internal\" not found"
Sep 18 04:06:05.200108 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:05.200076    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6e36e2886117ea7684cd038c4a64e729-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-207.ec2.internal\" (UID: \"6e36e2886117ea7684cd038c4a64e729\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-207.ec2.internal"
Sep 18 04:06:05.200108 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:05.200109    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e36e2886117ea7684cd038c4a64e729-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-207.ec2.internal\" (UID: \"6e36e2886117ea7684cd038c4a64e729\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-207.ec2.internal"
Sep 18 04:06:05.200265 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:05.200129    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/208db4364c1c40920f745701e77898f0-config\") pod \"kube-apiserver-proxy-ip-10-0-129-207.ec2.internal\" (UID: \"208db4364c1c40920f745701e77898f0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-207.ec2.internal"
Sep 18 04:06:05.221166 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:05.221146    2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-207.ec2.internal\" not found"
Sep 18 04:06:05.300867 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:05.300793    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6e36e2886117ea7684cd038c4a64e729-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-207.ec2.internal\" (UID: \"6e36e2886117ea7684cd038c4a64e729\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-207.ec2.internal"
Sep 18 04:06:05.300867 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:05.300834    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e36e2886117ea7684cd038c4a64e729-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-207.ec2.internal\" (UID: \"6e36e2886117ea7684cd038c4a64e729\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-207.ec2.internal"
Sep 18 04:06:05.300867 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:05.300865    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/208db4364c1c40920f745701e77898f0-config\") pod \"kube-apiserver-proxy-ip-10-0-129-207.ec2.internal\" (UID: \"208db4364c1c40920f745701e77898f0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-207.ec2.internal"
Sep 18 04:06:05.301008 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:05.300918    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e36e2886117ea7684cd038c4a64e729-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-207.ec2.internal\" (UID: \"6e36e2886117ea7684cd038c4a64e729\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-207.ec2.internal"
Sep 18 04:06:05.301008 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:05.300934    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/208db4364c1c40920f745701e77898f0-config\") pod \"kube-apiserver-proxy-ip-10-0-129-207.ec2.internal\" (UID: \"208db4364c1c40920f745701e77898f0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-207.ec2.internal"
Sep 18 04:06:05.301008 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:05.300935    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6e36e2886117ea7684cd038c4a64e729-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-207.ec2.internal\" (UID: \"6e36e2886117ea7684cd038c4a64e729\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-207.ec2.internal"
Sep 18 04:06:05.321950 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:05.321918    2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-207.ec2.internal\" not found"
Sep 18 04:06:05.337032 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:05.337000    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-207.ec2.internal"
Sep 18 04:06:05.342397 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:05.342149    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-207.ec2.internal"
Sep 18 04:06:06.576130 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:06.576093    2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-207.ec2.internal\" not found"
Sep 18 04:06:06.676596 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:06.676565    2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-207.ec2.internal\" not found"
Sep 18 04:06:06.777191 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:06.777113    2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-207.ec2.internal\" not found"
Sep 18 04:06:06.877664 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:06.877629    2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-207.ec2.internal\" not found"
Sep 18 04:06:06.881795 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:06.881776    2585 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 18 04:06:06.881954 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:06.881929    2585 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 18 04:06:06.978489 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:06.978454    2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-207.ec2.internal\" not found"
Sep 18 04:06:06.982612 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:06.982584    2585 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-17 04:01:05 +0000 UTC" deadline="2028-05-05 17:29:50.442145147 +0000 UTC"
Sep 18 04:06:06.982668 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:06.982613    2585 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14293h23m43.459535298s"
Sep 18 04:06:07.079515 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:07.079446    2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-207.ec2.internal\" not found"
Sep 18 04:06:07.088065 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.088035    2585 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 04:06:07.150178 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:07.150137    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod208db4364c1c40920f745701e77898f0.slice/crio-f2204d884a81559efdc2fbe7ba4633bee42d52af37dbd66df7a150557d4925dd WatchSource:0}: Error finding container f2204d884a81559efdc2fbe7ba4633bee42d52af37dbd66df7a150557d4925dd: Status 404 returned error can't find the container with id f2204d884a81559efdc2fbe7ba4633bee42d52af37dbd66df7a150557d4925dd
Sep 18 04:06:07.155111 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.155095    2585 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 04:06:07.164926 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.164912    2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 04:06:07.165843 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.165823    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-207.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 04:06:07.165952 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.165861    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-207.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 04:06:07.165952 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.165877    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-207.ec2.internal" event="NodeHasSufficientPID"
Sep 18 04:06:07.180392 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:07.180370    2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-207.ec2.internal\" not found"
Sep 18 04:06:07.215771 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:07.215747    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e36e2886117ea7684cd038c4a64e729.slice/crio-c9b6d59eb8b7c479168415fe01ccc9310c03ad5497f694438bcaac97206a4850 WatchSource:0}: Error finding container c9b6d59eb8b7c479168415fe01ccc9310c03ad5497f694438bcaac97206a4850: Status 404 returned error can't find the container with id c9b6d59eb8b7c479168415fe01ccc9310c03ad5497f694438bcaac97206a4850
Sep 18 04:06:07.280815 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:07.280778    2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-207.ec2.internal\" not found"
Sep 18 04:06:07.381401 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:07.381314    2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-207.ec2.internal\" not found"
Sep 18 04:06:07.423748 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.423724    2585 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 04:06:07.452948 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.452918    2585 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-207.ec2.internal"
Sep 18 04:06:07.466509 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.466478    2585 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 18 04:06:07.468469 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.468455    2585 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-207.ec2.internal"
Sep 18 04:06:07.478041 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.478026    2585 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 18 04:06:07.504572 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.504544    2585 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 04:06:07.926104 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.926069    2585 apiserver.go:52] "Watching apiserver"
Sep 18 04:06:07.933107 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.932824    2585 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 18 04:06:07.933365 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.933341    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-zg942","openshift-network-diagnostics/network-check-target-z59z5","openshift-network-operator/iptables-alerter-p9hks","openshift-ovn-kubernetes/ovnkube-node-g5hqb","kube-system/global-pull-secret-syncer-j59zp","kube-system/konnectivity-agent-prm5t","kube-system/kube-apiserver-proxy-ip-10-0-129-207.ec2.internal","openshift-cluster-node-tuning-operator/tuned-fsb94","openshift-dns/node-resolver-r47v5","openshift-multus/multus-sbmt7","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vlxg","openshift-image-registry/node-ca-pqmcs","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-207.ec2.internal","openshift-multus/multus-additional-cni-plugins-snwbg"]
Sep 18 04:06:07.935840 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.935814    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sbmt7"
Sep 18 04:06:07.938478 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.938455    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 18 04:06:07.938757 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.938741    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-z6k7z\""
Sep 18 04:06:07.939046 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.939031    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 18 04:06:07.939188 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.939169    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 18 04:06:07.939326 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.939313    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 18 04:06:07.941037 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.941017    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vlxg"
Sep 18 04:06:07.942071 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.942049    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-p9hks"
Sep 18 04:06:07.943079 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.943060    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 18 04:06:07.943453 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.943435    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 18 04:06:07.943794 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.943778    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 18 04:06:07.944052 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.944036    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-kvqbv\""
Sep 18 04:06:07.944541 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.944522    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 18 04:06:07.944864 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.944844    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 18 04:06:07.945111 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.945094    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 18 04:06:07.945383 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.945362    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb"
Sep 18 04:06:07.946907 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.946869    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-cccqv\""
Sep 18 04:06:07.947602 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.947275    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 18 04:06:07.947781 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.947759    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-smw2s\""
Sep 18 04:06:07.948019 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.948000    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 18 04:06:07.948268 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.948254    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 18 04:06:07.948440 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.948428    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j59zp"
Sep 18 04:06:07.948517 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:07.948477    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j59zp" podUID="6dc80677-6f9c-44fd-8d5f-e3c9f4846191"
Sep 18 04:06:07.949110 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.948944    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 18 04:06:07.949248 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.949199    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 18 04:06:07.949351 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.949202    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 18 04:06:07.950434 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.950411    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-prm5t"
Sep 18 04:06:07.952522 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.952360    2585 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 18 04:06:07.953172 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.953152    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 18 04:06:07.953460 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.953441    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-kgvcx\""
Sep 18 04:06:07.953621 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.953608    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 18 04:06:07.954372 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.954356    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-r47v5"
Sep 18 04:06:07.954868 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.954844    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-snwbg"
Sep 18 04:06:07.956488 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.956467    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-gwklr\""
Sep 18 04:06:07.956743 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.956722    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 18 04:06:07.956743 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.956733    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 18 04:06:07.957267 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.956942    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 18 04:06:07.957267 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.957169    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-qwkgc\""
Sep 18 04:06:07.957419 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.957401    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 18 04:06:07.958970 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.958881    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z59z5"
Sep 18 04:06:07.960802 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:07.960762    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z59z5" podUID="395617a1-d084-4753-82d1-8dabf26dc416"
Sep 18 04:06:07.961025 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.961005    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zg942"
Sep 18 04:06:07.961099 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:07.961075    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zg942" podUID="2d169a38-932c-4d14-8a19-3ce5341fc190"
Sep 18 04:06:07.963373 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.963347    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6dc80677-6f9c-44fd-8d5f-e3c9f4846191-dbus\") pod \"global-pull-secret-syncer-j59zp\" (UID: \"6dc80677-6f9c-44fd-8d5f-e3c9f4846191\") " pod="kube-system/global-pull-secret-syncer-j59zp"
Sep 18 04:06:07.963471 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.963394    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/54309f7d-04d4-42f8-8ef3-de8d52091386-hosts-file\") pod \"node-resolver-r47v5\" (UID: \"54309f7d-04d4-42f8-8ef3-de8d52091386\") " pod="openshift-dns/node-resolver-r47v5"
Sep 18 04:06:07.963471 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.963426    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29z6d\" (UniqueName: \"kubernetes.io/projected/54309f7d-04d4-42f8-8ef3-de8d52091386-kube-api-access-29z6d\") pod \"node-resolver-r47v5\" (UID: \"54309f7d-04d4-42f8-8ef3-de8d52091386\") " pod="openshift-dns/node-resolver-r47v5"
Sep 18 04:06:07.963471 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.963454    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c8cda828-9b0c-412e-8e40-d80abb0074f4-socket-dir\") pod \"aws-ebs-csi-driver-node-4vlxg\" (UID: \"c8cda828-9b0c-412e-8e40-d80abb0074f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vlxg"
Sep 18 04:06:07.963621 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.963490    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skdwn\" (UniqueName: \"kubernetes.io/projected/c8cda828-9b0c-412e-8e40-d80abb0074f4-kube-api-access-skdwn\") pod \"aws-ebs-csi-driver-node-4vlxg\" (UID: \"c8cda828-9b0c-412e-8e40-d80abb0074f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vlxg"
Sep 18 04:06:07.963621 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.963521    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6dc80677-6f9c-44fd-8d5f-e3c9f4846191-kubelet-config\") pod \"global-pull-secret-syncer-j59zp\" (UID: \"6dc80677-6f9c-44fd-8d5f-e3c9f4846191\") " pod="kube-system/global-pull-secret-syncer-j59zp"
Sep 18 04:06:07.963621 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.963552    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pw7r6\" (UniqueName: \"kubernetes.io/projected/dd11bf2c-ca30-45e3-811b-e7f912087184-kube-api-access-pw7r6\") pod \"multus-additional-cni-plugins-snwbg\" (UID: \"dd11bf2c-ca30-45e3-811b-e7f912087184\") " pod="openshift-multus/multus-additional-cni-plugins-snwbg"
Sep 18 04:06:07.963621 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.963581    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/443bf4cf-26a5-47aa-beae-59373c9a9d89-system-cni-dir\") pod \"multus-sbmt7\" (UID: \"443bf4cf-26a5-47aa-beae-59373c9a9d89\") " pod="openshift-multus/multus-sbmt7"
Sep 18 04:06:07.963621 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.963611    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/443bf4cf-26a5-47aa-beae-59373c9a9d89-host-run-netns\") pod \"multus-sbmt7\" (UID: \"443bf4cf-26a5-47aa-beae-59373c9a9d89\") " pod="openshift-multus/multus-sbmt7"
Sep 18 04:06:07.963825 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.963636    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cc11c9df-c3ad-4145-a5b0-a27f7225e599-systemd-units\") pod \"ovnkube-node-g5hqb\" (UID: \"cc11c9df-c3ad-4145-a5b0-a27f7225e599\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb"
Sep 18 04:06:07.963825 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.963665    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c8cda828-9b0c-412e-8e40-d80abb0074f4-registration-dir\") pod \"aws-ebs-csi-driver-node-4vlxg\" (UID: \"c8cda828-9b0c-412e-8e40-d80abb0074f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vlxg"
Sep 18 04:06:07.963825 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.963695    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cc11c9df-c3ad-4145-a5b0-a27f7225e599-ovn-node-metrics-cert\") pod \"ovnkube-node-g5hqb\" (UID: \"cc11c9df-c3ad-4145-a5b0-a27f7225e599\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb"
Sep 18 04:06:07.963825 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.963724    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c4d1f628-59bf-4e95-92d5-84171d5e04e3-agent-certs\") pod \"konnectivity-agent-prm5t\" (UID: \"c4d1f628-59bf-4e95-92d5-84171d5e04e3\") " pod="kube-system/konnectivity-agent-prm5t"
Sep 18 04:06:07.963825 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.963749    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dd11bf2c-ca30-45e3-811b-e7f912087184-cnibin\") pod \"multus-additional-cni-plugins-snwbg\" (UID: \"dd11bf2c-ca30-45e3-811b-e7f912087184\") " pod="openshift-multus/multus-additional-cni-plugins-snwbg"
Sep 18 04:06:07.963825 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.963778    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/443bf4cf-26a5-47aa-beae-59373c9a9d89-etc-kubernetes\") pod \"multus-sbmt7\" (UID: \"443bf4cf-26a5-47aa-beae-59373c9a9d89\") " pod="openshift-multus/multus-sbmt7"
Sep 18 04:06:07.963825 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.963806    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c8cda828-9b0c-412e-8e40-d80abb0074f4-device-dir\") pod \"aws-ebs-csi-driver-node-4vlxg\" (UID: \"c8cda828-9b0c-412e-8e40-d80abb0074f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vlxg"
Sep 18 04:06:07.964135 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.963836    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cc11c9df-c3ad-4145-a5b0-a27f7225e599-var-lib-openvswitch\") pod \"ovnkube-node-g5hqb\" (UID: \"cc11c9df-c3ad-4145-a5b0-a27f7225e599\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb"
Sep 18 04:06:07.964135 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.963870    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cc11c9df-c3ad-4145-a5b0-a27f7225e599-host-run-ovn-kubernetes\") pod \"ovnkube-node-g5hqb\" (UID: \"cc11c9df-c3ad-4145-a5b0-a27f7225e599\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb"
Sep 18 04:06:07.964135 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.963916    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dd11bf2c-ca30-45e3-811b-e7f912087184-tuning-conf-dir\") pod \"multus-additional-cni-plugins-snwbg\" (UID: \"dd11bf2c-ca30-45e3-811b-e7f912087184\") " pod="openshift-multus/multus-additional-cni-plugins-snwbg"
Sep 18 04:06:07.964135 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.963943    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/443bf4cf-26a5-47aa-beae-59373c9a9d89-multus-socket-dir-parent\") pod \"multus-sbmt7\" (UID: \"443bf4cf-26a5-47aa-beae-59373c9a9d89\") " pod="openshift-multus/multus-sbmt7"
Sep 18 04:06:07.964135 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.963972    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cc11c9df-c3ad-4145-a5b0-a27f7225e599-host-run-netns\") pod \"ovnkube-node-g5hqb\" (UID: \"cc11c9df-c3ad-4145-a5b0-a27f7225e599\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb"
Sep 18 04:06:07.964135 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.964010    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ebf95ef1-a64f-4c13-ad80-225816c94137-host-slash\") pod \"iptables-alerter-p9hks\" (UID: \"ebf95ef1-a64f-4c13-ad80-225816c94137\") " pod="openshift-network-operator/iptables-alerter-p9hks"
Sep 18 04:06:07.964135 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.964043    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cc11c9df-c3ad-4145-a5b0-a27f7225e599-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g5hqb\" (UID: \"cc11c9df-c3ad-4145-a5b0-a27f7225e599\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb"
Sep 18 04:06:07.964135 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.964077    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzp7p\" (UniqueName: \"kubernetes.io/projected/ebf95ef1-a64f-4c13-ad80-225816c94137-kube-api-access-jzp7p\") pod \"iptables-alerter-p9hks\" (UID: \"ebf95ef1-a64f-4c13-ad80-225816c94137\") " pod="openshift-network-operator/iptables-alerter-p9hks"
Sep 18 04:06:07.964135 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.964106    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cc11c9df-c3ad-4145-a5b0-a27f7225e599-log-socket\") pod \"ovnkube-node-g5hqb\" (UID: \"cc11c9df-c3ad-4145-a5b0-a27f7225e599\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb"
Sep 18 04:06:07.964520 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.964137    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cc11c9df-c3ad-4145-a5b0-a27f7225e599-ovnkube-script-lib\") pod \"ovnkube-node-g5hqb\" (UID: \"cc11c9df-c3ad-4145-a5b0-a27f7225e599\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb"
Sep 18 04:06:07.964520 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.964167    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dtn5\" (UniqueName: \"kubernetes.io/projected/443bf4cf-26a5-47aa-beae-59373c9a9d89-kube-api-access-9dtn5\") pod \"multus-sbmt7\" (UID: \"443bf4cf-26a5-47aa-beae-59373c9a9d89\") " pod="openshift-multus/multus-sbmt7"
Sep 18 04:06:07.964520 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.964197    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc11c9df-c3ad-4145-a5b0-a27f7225e599-host-kubelet\") pod \"ovnkube-node-g5hqb\" (UID: \"cc11c9df-c3ad-4145-a5b0-a27f7225e599\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb"
Sep 18 04:06:07.964520 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.964222    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c4d1f628-59bf-4e95-92d5-84171d5e04e3-konnectivity-ca\") pod \"konnectivity-agent-prm5t\" (UID: \"c4d1f628-59bf-4e95-92d5-84171d5e04e3\") " pod="kube-system/konnectivity-agent-prm5t"
Sep 18 04:06:07.964520 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.964257    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/443bf4cf-26a5-47aa-beae-59373c9a9d89-host-run-k8s-cni-cncf-io\") pod \"multus-sbmt7\" (UID: \"443bf4cf-26a5-47aa-beae-59373c9a9d89\") " pod="openshift-multus/multus-sbmt7"
Sep 18 04:06:07.964520 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.964288    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c8cda828-9b0c-412e-8e40-d80abb0074f4-etc-selinux\") pod \"aws-ebs-csi-driver-node-4vlxg\" (UID: \"c8cda828-9b0c-412e-8e40-d80abb0074f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vlxg"
Sep 18 04:06:07.964520 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.964321    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cc11c9df-c3ad-4145-a5b0-a27f7225e599-etc-openvswitch\") pod \"ovnkube-node-g5hqb\" (UID: \"cc11c9df-c3ad-4145-a5b0-a27f7225e599\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb"
Sep 18 04:06:07.964520 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.964361    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cc11c9df-c3ad-4145-a5b0-a27f7225e599-host-cni-netd\") pod \"ovnkube-node-g5hqb\" (UID: \"cc11c9df-c3ad-4145-a5b0-a27f7225e599\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb"
Sep 18 04:06:07.964520 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.964392    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/443bf4cf-26a5-47aa-beae-59373c9a9d89-host-var-lib-kubelet\") pod \"multus-sbmt7\" (UID: \"443bf4cf-26a5-47aa-beae-59373c9a9d89\") " pod="openshift-multus/multus-sbmt7"
Sep 18 04:06:07.964520 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.964436    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/443bf4cf-26a5-47aa-beae-59373c9a9d89-multus-daemon-config\") pod \"multus-sbmt7\" (UID: \"443bf4cf-26a5-47aa-beae-59373c9a9d89\") " pod="openshift-multus/multus-sbmt7"
Sep 18 04:06:07.964520 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.964469    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dd11bf2c-ca30-45e3-811b-e7f912087184-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-snwbg\" (UID: \"dd11bf2c-ca30-45e3-811b-e7f912087184\") " pod="openshift-multus/multus-additional-cni-plugins-snwbg"
Sep 18 04:06:07.964520 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.964502    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c8cda828-9b0c-412e-8e40-d80abb0074f4-sys-fs\") pod \"aws-ebs-csi-driver-node-4vlxg\" (UID: \"c8cda828-9b0c-412e-8e40-d80abb0074f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vlxg"
Sep 18 04:06:07.965088 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.964534    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cc11c9df-c3ad-4145-a5b0-a27f7225e599-run-systemd\") pod \"ovnkube-node-g5hqb\" (UID: \"cc11c9df-c3ad-4145-a5b0-a27f7225e599\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb"
Sep 18 04:06:07.965088 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.964567    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54309f7d-04d4-42f8-8ef3-de8d52091386-tmp-dir\") pod \"node-resolver-r47v5\" (UID: \"54309f7d-04d4-42f8-8ef3-de8d52091386\") " pod="openshift-dns/node-resolver-r47v5"
Sep 18 04:06:07.965088 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.964600    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ebf95ef1-a64f-4c13-ad80-225816c94137-iptables-alerter-script\") pod \"iptables-alerter-p9hks\" (UID: \"ebf95ef1-a64f-4c13-ad80-225816c94137\") " pod="openshift-network-operator/iptables-alerter-p9hks"
Sep 18 04:06:07.965088 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.964627    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dd11bf2c-ca30-45e3-811b-e7f912087184-cni-binary-copy\") pod \"multus-additional-cni-plugins-snwbg\" (UID: \"dd11bf2c-ca30-45e3-811b-e7f912087184\") " pod="openshift-multus/multus-additional-cni-plugins-snwbg"
Sep 18 04:06:07.965088 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.964665    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/443bf4cf-26a5-47aa-beae-59373c9a9d89-host-var-lib-cni-multus\") pod \"multus-sbmt7\" (UID: \"443bf4cf-26a5-47aa-beae-59373c9a9d89\") " pod="openshift-multus/multus-sbmt7"
Sep 18 04:06:07.965088 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.964697    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/443bf4cf-26a5-47aa-beae-59373c9a9d89-hostroot\") pod \"multus-sbmt7\" (UID: \"443bf4cf-26a5-47aa-beae-59373c9a9d89\") " pod="openshift-multus/multus-sbmt7"
Sep 18 04:06:07.965088 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.964732    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/443bf4cf-26a5-47aa-beae-59373c9a9d89-multus-conf-dir\") pod \"multus-sbmt7\" (UID: \"443bf4cf-26a5-47aa-beae-59373c9a9d89\") " pod="openshift-multus/multus-sbmt7"
Sep 18 04:06:07.965088 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.964758    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dd11bf2c-ca30-45e3-811b-e7f912087184-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-snwbg\" (UID: \"dd11bf2c-ca30-45e3-811b-e7f912087184\") " pod="openshift-multus/multus-additional-cni-plugins-snwbg"
Sep 18 04:06:07.965088 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.964789    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/443bf4cf-26a5-47aa-beae-59373c9a9d89-host-var-lib-cni-bin\") pod \"multus-sbmt7\" (UID: \"443bf4cf-26a5-47aa-beae-59373c9a9d89\") " pod="openshift-multus/multus-sbmt7"
Sep 18 04:06:07.965088 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.964821    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c8cda828-9b0c-412e-8e40-d80abb0074f4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4vlxg\" (UID: \"c8cda828-9b0c-412e-8e40-d80abb0074f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vlxg"
Sep 18 04:06:07.965088 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.964853    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6dc80677-6f9c-44fd-8d5f-e3c9f4846191-original-pull-secret\") pod \"global-pull-secret-syncer-j59zp\" (UID: \"6dc80677-6f9c-44fd-8d5f-e3c9f4846191\") " pod="kube-system/global-pull-secret-syncer-j59zp"
Sep 18 04:06:07.965088 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.964888    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/443bf4cf-26a5-47aa-beae-59373c9a9d89-multus-cni-dir\") pod \"multus-sbmt7\" (UID: \"443bf4cf-26a5-47aa-beae-59373c9a9d89\") " pod="openshift-multus/multus-sbmt7"
Sep 18 04:06:07.965088 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.964933    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cc11c9df-c3ad-4145-a5b0-a27f7225e599-run-openvswitch\") pod \"ovnkube-node-g5hqb\" (UID: \"cc11c9df-c3ad-4145-a5b0-a27f7225e599\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb"
Sep 18 04:06:07.965088 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.964962    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cc11c9df-c3ad-4145-a5b0-a27f7225e599-run-ovn\") pod \"ovnkube-node-g5hqb\" (UID: \"cc11c9df-c3ad-4145-a5b0-a27f7225e599\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb"
Sep 18 04:06:07.965088 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.964992    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cc11c9df-c3ad-4145-a5b0-a27f7225e599-host-cni-bin\") pod \"ovnkube-node-g5hqb\" (UID: \"cc11c9df-c3ad-4145-a5b0-a27f7225e599\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb"
Sep 18 04:06:07.965088 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.965023    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztmlr\" (UniqueName: \"kubernetes.io/projected/cc11c9df-c3ad-4145-a5b0-a27f7225e599-kube-api-access-ztmlr\") pod \"ovnkube-node-g5hqb\" (UID: \"cc11c9df-c3ad-4145-a5b0-a27f7225e599\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb"
Sep 18 04:06:07.965746 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.965059    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dd11bf2c-ca30-45e3-811b-e7f912087184-system-cni-dir\") pod \"multus-additional-cni-plugins-snwbg\" (UID: \"dd11bf2c-ca30-45e3-811b-e7f912087184\") " pod="openshift-multus/multus-additional-cni-plugins-snwbg"
Sep 18 04:06:07.965746 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.965083    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/443bf4cf-26a5-47aa-beae-59373c9a9d89-cnibin\") pod \"multus-sbmt7\" (UID: \"443bf4cf-26a5-47aa-beae-59373c9a9d89\") " pod="openshift-multus/multus-sbmt7"
Sep 18 04:06:07.965746 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.965114    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/443bf4cf-26a5-47aa-beae-59373c9a9d89-cni-binary-copy\") pod \"multus-sbmt7\" (UID: \"443bf4cf-26a5-47aa-beae-59373c9a9d89\") " pod="openshift-multus/multus-sbmt7"
Sep 18 04:06:07.965746 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.965145    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cc11c9df-c3ad-4145-a5b0-a27f7225e599-host-slash\") pod \"ovnkube-node-g5hqb\" (UID: \"cc11c9df-c3ad-4145-a5b0-a27f7225e599\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb"
Sep 18 04:06:07.965746 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.965174    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cc11c9df-c3ad-4145-a5b0-a27f7225e599-node-log\") pod \"ovnkube-node-g5hqb\" (UID: \"cc11c9df-c3ad-4145-a5b0-a27f7225e599\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb"
Sep 18 04:06:07.965746 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.965192    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fsb94"
Sep 18 04:06:07.965746 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.965204    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cc11c9df-c3ad-4145-a5b0-a27f7225e599-ovnkube-config\") pod \"ovnkube-node-g5hqb\" (UID: \"cc11c9df-c3ad-4145-a5b0-a27f7225e599\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb"
Sep 18 04:06:07.965746 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.965234    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cc11c9df-c3ad-4145-a5b0-a27f7225e599-env-overrides\") pod \"ovnkube-node-g5hqb\" (UID: \"cc11c9df-c3ad-4145-a5b0-a27f7225e599\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb"
Sep 18 04:06:07.965746 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.965270    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/443bf4cf-26a5-47aa-beae-59373c9a9d89-host-run-multus-certs\") pod \"multus-sbmt7\" (UID: \"443bf4cf-26a5-47aa-beae-59373c9a9d89\") " pod="openshift-multus/multus-sbmt7"
Sep 18 04:06:07.966166 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.966098    2585 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 18 04:06:07.967429 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.967211    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pqmcs"
Sep 18 04:06:07.968848 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.968730    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 18 04:06:07.968955 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.968918    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-wgv9j\""
Sep 18 04:06:07.969347 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.969316    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 18 04:06:07.969473 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.969452    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 18 04:06:07.970628 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.970606    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 18 04:06:07.970730 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.970609    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 18 04:06:07.971089 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.971007    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-c6ghh\""
Sep 18 04:06:07.989746 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.989728    2585 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-jk92w"
Sep 18 04:06:07.995754 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:07.995715    2585 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-jk92w"
Sep 18 04:06:08.054528 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.054507    2585 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 18 04:06:08.062748 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.062690    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-207.ec2.internal" event={"ID":"6e36e2886117ea7684cd038c4a64e729","Type":"ContainerStarted","Data":"c9b6d59eb8b7c479168415fe01ccc9310c03ad5497f694438bcaac97206a4850"}
Sep 18 04:06:08.064014 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.063989    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-207.ec2.internal" event={"ID":"208db4364c1c40920f745701e77898f0","Type":"ContainerStarted","Data":"f2204d884a81559efdc2fbe7ba4633bee42d52af37dbd66df7a150557d4925dd"}
Sep 18 04:06:08.065166 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.064977    2585 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 04:06:08.065921 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.065878    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c8cda828-9b0c-412e-8e40-d80abb0074f4-registration-dir\") pod \"aws-ebs-csi-driver-node-4vlxg\" (UID: \"c8cda828-9b0c-412e-8e40-d80abb0074f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vlxg"
Sep 18 04:06:08.065921 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.065926    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cc11c9df-c3ad-4145-a5b0-a27f7225e599-ovn-node-metrics-cert\") pod \"ovnkube-node-g5hqb\" (UID: \"cc11c9df-c3ad-4145-a5b0-a27f7225e599\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb"
Sep 18 04:06:08.066080 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.065948    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c4d1f628-59bf-4e95-92d5-84171d5e04e3-agent-certs\") pod \"konnectivity-agent-prm5t\" (UID: \"c4d1f628-59bf-4e95-92d5-84171d5e04e3\") " pod="kube-system/konnectivity-agent-prm5t"
Sep 18 04:06:08.066080 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.065981    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7z5kp\" (UniqueName: \"kubernetes.io/projected/1c08324d-73f3-4f3b-909e-78d4c450e24b-kube-api-access-7z5kp\") pod \"node-ca-pqmcs\" (UID: \"1c08324d-73f3-4f3b-909e-78d4c450e24b\") " pod="openshift-image-registry/node-ca-pqmcs"
Sep 18 04:06:08.066080 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.065988    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c8cda828-9b0c-412e-8e40-d80abb0074f4-registration-dir\") pod \"aws-ebs-csi-driver-node-4vlxg\" (UID: \"c8cda828-9b0c-412e-8e40-d80abb0074f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vlxg"
Sep 18 04:06:08.066080 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.066006    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dd11bf2c-ca30-45e3-811b-e7f912087184-cnibin\") pod \"multus-additional-cni-plugins-snwbg\" (UID: \"dd11bf2c-ca30-45e3-811b-e7f912087184\") " pod="openshift-multus/multus-additional-cni-plugins-snwbg"
Sep 18 04:06:08.066080 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.066042    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/443bf4cf-26a5-47aa-beae-59373c9a9d89-etc-kubernetes\") pod \"multus-sbmt7\" (UID: \"443bf4cf-26a5-47aa-beae-59373c9a9d89\") " pod="openshift-multus/multus-sbmt7"
Sep 18 04:06:08.066080 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.066067    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c8cda828-9b0c-412e-8e40-d80abb0074f4-device-dir\") pod \"aws-ebs-csi-driver-node-4vlxg\" (UID: \"c8cda828-9b0c-412e-8e40-d80abb0074f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vlxg"
Sep 18 04:06:08.066384 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.066088    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cc11c9df-c3ad-4145-a5b0-a27f7225e599-var-lib-openvswitch\") pod \"ovnkube-node-g5hqb\" (UID: \"cc11c9df-c3ad-4145-a5b0-a27f7225e599\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb"
Sep 18 04:06:08.066384 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.066111    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cc11c9df-c3ad-4145-a5b0-a27f7225e599-host-run-ovn-kubernetes\") pod \"ovnkube-node-g5hqb\" (UID: \"cc11c9df-c3ad-4145-a5b0-a27f7225e599\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb"
Sep 18 04:06:08.066384 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.066136    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dd11bf2c-ca30-45e3-811b-e7f912087184-tuning-conf-dir\") pod \"multus-additional-cni-plugins-snwbg\" (UID: \"dd11bf2c-ca30-45e3-811b-e7f912087184\") " pod="openshift-multus/multus-additional-cni-plugins-snwbg"
Sep 18 04:06:08.066384 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.066159    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/443bf4cf-26a5-47aa-beae-59373c9a9d89-multus-socket-dir-parent\") pod \"multus-sbmt7\" (UID: \"443bf4cf-26a5-47aa-beae-59373c9a9d89\") " pod="openshift-multus/multus-sbmt7"
Sep 18 04:06:08.066384 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.066182    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cc11c9df-c3ad-4145-a5b0-a27f7225e599-host-run-netns\") pod \"ovnkube-node-g5hqb\" (UID: \"cc11c9df-c3ad-4145-a5b0-a27f7225e599\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb"
Sep 18 04:06:08.066384 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.066204    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ebf95ef1-a64f-4c13-ad80-225816c94137-host-slash\") pod \"iptables-alerter-p9hks\" (UID: \"ebf95ef1-a64f-4c13-ad80-225816c94137\") " pod="openshift-network-operator/iptables-alerter-p9hks"
Sep 18 04:06:08.066384 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.066229    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eddb729c-9c21-4b4f-8306-5e475b718d65-lib-modules\") pod \"tuned-fsb94\" (UID: \"eddb729c-9c21-4b4f-8306-5e475b718d65\") " pod="openshift-cluster-node-tuning-operator/tuned-fsb94"
Sep 18 04:06:08.066384 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.066253    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eddb729c-9c21-4b4f-8306-5e475b718d65-var-lib-kubelet\") pod \"tuned-fsb94\" (UID: \"eddb729c-9c21-4b4f-8306-5e475b718d65\") " pod="openshift-cluster-node-tuning-operator/tuned-fsb94"
Sep 18 04:06:08.066384 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.066281    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cc11c9df-c3ad-4145-a5b0-a27f7225e599-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g5hqb\" (UID: \"cc11c9df-c3ad-4145-a5b0-a27f7225e599\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb"
Sep 18 04:06:08.066384 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.066306    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzp7p\" (UniqueName: \"kubernetes.io/projected/ebf95ef1-a64f-4c13-ad80-225816c94137-kube-api-access-jzp7p\") pod \"iptables-alerter-p9hks\" (UID: \"ebf95ef1-a64f-4c13-ad80-225816c94137\") " pod="openshift-network-operator/iptables-alerter-p9hks"
Sep 18 04:06:08.066384 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.066336    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/eddb729c-9c21-4b4f-8306-5e475b718d65-etc-modprobe-d\") pod \"tuned-fsb94\" (UID: \"eddb729c-9c21-4b4f-8306-5e475b718d65\") " pod="openshift-cluster-node-tuning-operator/tuned-fsb94"
Sep 18 04:06:08.066384 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.066361    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgsg5\" (UniqueName: \"kubernetes.io/projected/eddb729c-9c21-4b4f-8306-5e475b718d65-kube-api-access-qgsg5\") pod \"tuned-fsb94\" (UID: \"eddb729c-9c21-4b4f-8306-5e475b718d65\") " pod="openshift-cluster-node-tuning-operator/tuned-fsb94"
Sep 18 04:06:08.067144 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.066389    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cc11c9df-c3ad-4145-a5b0-a27f7225e599-log-socket\") pod \"ovnkube-node-g5hqb\" (UID: \"cc11c9df-c3ad-4145-a5b0-a27f7225e599\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb"
Sep 18 04:06:08.067144 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.066427    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cc11c9df-c3ad-4145-a5b0-a27f7225e599-ovnkube-script-lib\") pod \"ovnkube-node-g5hqb\" (UID: \"cc11c9df-c3ad-4145-a5b0-a27f7225e599\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb"
Sep 18 04:06:08.067144 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.066452    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dtn5\" (UniqueName: \"kubernetes.io/projected/443bf4cf-26a5-47aa-beae-59373c9a9d89-kube-api-access-9dtn5\") pod \"multus-sbmt7\" (UID: \"443bf4cf-26a5-47aa-beae-59373c9a9d89\") " pod="openshift-multus/multus-sbmt7"
Sep 18 04:06:08.067144 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.066475    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc11c9df-c3ad-4145-a5b0-a27f7225e599-host-kubelet\") pod \"ovnkube-node-g5hqb\" (UID: \"cc11c9df-c3ad-4145-a5b0-a27f7225e599\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb"
Sep 18 04:06:08.067144 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.066500    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c4d1f628-59bf-4e95-92d5-84171d5e04e3-konnectivity-ca\") pod \"konnectivity-agent-prm5t\" (UID: \"c4d1f628-59bf-4e95-92d5-84171d5e04e3\") " pod="kube-system/konnectivity-agent-prm5t"
Sep 18 04:06:08.067144 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.066517    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eddb729c-9c21-4b4f-8306-5e475b718d65-etc-kubernetes\") pod \"tuned-fsb94\" (UID: \"eddb729c-9c21-4b4f-8306-5e475b718d65\") " pod="openshift-cluster-node-tuning-operator/tuned-fsb94"
Sep 18 04:06:08.067144 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.066535    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/eddb729c-9c21-4b4f-8306-5e475b718d65-etc-systemd\") pod \"tuned-fsb94\" (UID: \"eddb729c-9c21-4b4f-8306-5e475b718d65\") " pod="openshift-cluster-node-tuning-operator/tuned-fsb94"
Sep 18 04:06:08.067144 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.066549    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/eddb729c-9c21-4b4f-8306-5e475b718d65-etc-tuned\") pod \"tuned-fsb94\" (UID: \"eddb729c-9c21-4b4f-8306-5e475b718d65\") " pod="openshift-cluster-node-tuning-operator/tuned-fsb94"
Sep 18 04:06:08.067144 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.066564    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1c08324d-73f3-4f3b-909e-78d4c450e24b-serviceca\") pod \"node-ca-pqmcs\" (UID: \"1c08324d-73f3-4f3b-909e-78d4c450e24b\") " pod="openshift-image-registry/node-ca-pqmcs"
Sep 18 04:06:08.067144 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.066579    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/443bf4cf-26a5-47aa-beae-59373c9a9d89-host-run-k8s-cni-cncf-io\") pod \"multus-sbmt7\" (UID: \"443bf4cf-26a5-47aa-beae-59373c9a9d89\") " pod="openshift-multus/multus-sbmt7"
Sep 18 04:06:08.067144 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.066596    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c8cda828-9b0c-412e-8e40-d80abb0074f4-etc-selinux\") pod \"aws-ebs-csi-driver-node-4vlxg\" (UID: \"c8cda828-9b0c-412e-8e40-d80abb0074f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vlxg"
Sep 18 04:06:08.067144 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.066613    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cc11c9df-c3ad-4145-a5b0-a27f7225e599-etc-openvswitch\") pod \"ovnkube-node-g5hqb\" (UID: \"cc11c9df-c3ad-4145-a5b0-a27f7225e599\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb"
Sep 18 04:06:08.067144 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.066655    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cc11c9df-c3ad-4145-a5b0-a27f7225e599-etc-openvswitch\") pod \"ovnkube-node-g5hqb\" (UID: \"cc11c9df-c3ad-4145-a5b0-a27f7225e599\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb"
Sep 18 04:06:08.067144 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.066725    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cc11c9df-c3ad-4145-a5b0-a27f7225e599-log-socket\") pod \"ovnkube-node-g5hqb\" (UID: \"cc11c9df-c3ad-4145-a5b0-a27f7225e599\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb"
Sep 18 04:06:08.067144 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.066746    2585 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 18 04:06:08.067144 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.066789    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc11c9df-c3ad-4145-a5b0-a27f7225e599-host-kubelet\") pod \"ovnkube-node-g5hqb\" (UID: \"cc11c9df-c3ad-4145-a5b0-a27f7225e599\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb"
Sep 18 04:06:08.067144 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.066908    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/443bf4cf-26a5-47aa-beae-59373c9a9d89-host-run-k8s-cni-cncf-io\") pod \"multus-sbmt7\" (UID: \"443bf4cf-26a5-47aa-beae-59373c9a9d89\") " pod="openshift-multus/multus-sbmt7"
Sep 18 04:06:08.067144 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.066892    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cc11c9df-c3ad-4145-a5b0-a27f7225e599-host-cni-netd\") pod \"ovnkube-node-g5hqb\" (UID: \"cc11c9df-c3ad-4145-a5b0-a27f7225e599\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb"
Sep 18 04:06:08.068007 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.066959    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tl9sp\" (UniqueName: \"kubernetes.io/projected/395617a1-d084-4753-82d1-8dabf26dc416-kube-api-access-tl9sp\") pod \"network-check-target-z59z5\" (UID: \"395617a1-d084-4753-82d1-8dabf26dc416\") " pod="openshift-network-diagnostics/network-check-target-z59z5"
Sep 18 04:06:08.068007 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.066963    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cc11c9df-c3ad-4145-a5b0-a27f7225e599-host-run-netns\") pod \"ovnkube-node-g5hqb\" (UID: \"cc11c9df-c3ad-4145-a5b0-a27f7225e599\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb"
Sep 18 04:06:08.068007 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.066993    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/443bf4cf-26a5-47aa-beae-59373c9a9d89-host-var-lib-kubelet\") pod \"multus-sbmt7\" (UID: \"443bf4cf-26a5-47aa-beae-59373c9a9d89\") " pod="openshift-multus/multus-sbmt7"
Sep 18 04:06:08.068007 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.066965    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c8cda828-9b0c-412e-8e40-d80abb0074f4-etc-selinux\") pod \"aws-ebs-csi-driver-node-4vlxg\" (UID: \"c8cda828-9b0c-412e-8e40-d80abb0074f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vlxg"
Sep 18 04:06:08.068007 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.067022    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/443bf4cf-26a5-47aa-beae-59373c9a9d89-multus-daemon-config\") pod \"multus-sbmt7\" (UID: \"443bf4cf-26a5-47aa-beae-59373c9a9d89\") " pod="openshift-multus/multus-sbmt7"
Sep 18 04:06:08.068007 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.067015    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c8cda828-9b0c-412e-8e40-d80abb0074f4-device-dir\") pod \"aws-ebs-csi-driver-node-4vlxg\" (UID: \"c8cda828-9b0c-412e-8e40-d80abb0074f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vlxg"
Sep 18 04:06:08.068007 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.067051    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d169a38-932c-4d14-8a19-3ce5341fc190-metrics-certs\") pod \"network-metrics-daemon-zg942\" (UID: \"2d169a38-932c-4d14-8a19-3ce5341fc190\") " pod="openshift-multus/network-metrics-daemon-zg942"
Sep 18 04:06:08.068007 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.067058    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cc11c9df-c3ad-4145-a5b0-a27f7225e599-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g5hqb\" (UID: \"cc11c9df-c3ad-4145-a5b0-a27f7225e599\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb"
Sep 18 04:06:08.068007 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.067075    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eddb729c-9c21-4b4f-8306-5e475b718d65-tmp\") pod \"tuned-fsb94\" (UID: \"eddb729c-9c21-4b4f-8306-5e475b718d65\") " pod="openshift-cluster-node-tuning-operator/tuned-fsb94"
Sep 18 04:06:08.068007 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.067082    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/443bf4cf-26a5-47aa-beae-59373c9a9d89-etc-kubernetes\") pod \"multus-sbmt7\" (UID: \"443bf4cf-26a5-47aa-beae-59373c9a9d89\") " pod="openshift-multus/multus-sbmt7"
Sep 18 04:06:08.068007 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.067102    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dd11bf2c-ca30-45e3-811b-e7f912087184-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-snwbg\" (UID: \"dd11bf2c-ca30-45e3-811b-e7f912087184\") " pod="openshift-multus/multus-additional-cni-plugins-snwbg"
Sep 18 04:06:08.068007 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.067107    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/443bf4cf-26a5-47aa-beae-59373c9a9d89-multus-socket-dir-parent\") pod \"multus-sbmt7\" (UID: \"443bf4cf-26a5-47aa-beae-59373c9a9d89\") " pod="openshift-multus/multus-sbmt7"
Sep 18 04:06:08.068007 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.067106    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cc11c9df-c3ad-4145-a5b0-a27f7225e599-host-run-ovn-kubernetes\") pod \"ovnkube-node-g5hqb\" (UID: \"cc11c9df-c3ad-4145-a5b0-a27f7225e599\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb"
Sep 18 04:06:08.068007 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.067139    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cc11c9df-c3ad-4145-a5b0-a27f7225e599-var-lib-openvswitch\") pod \"ovnkube-node-g5hqb\" (UID: \"cc11c9df-c3ad-4145-a5b0-a27f7225e599\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb"
Sep 18 04:06:08.068007 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.067166    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c8cda828-9b0c-412e-8e40-d80abb0074f4-sys-fs\") pod \"aws-ebs-csi-driver-node-4vlxg\" (UID: \"c8cda828-9b0c-412e-8e40-d80abb0074f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vlxg"
Sep 18 04:06:08.068007 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.067192    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cc11c9df-c3ad-4145-a5b0-a27f7225e599-run-systemd\") pod \"ovnkube-node-g5hqb\" (UID: \"cc11c9df-c3ad-4145-a5b0-a27f7225e599\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb"
Sep 18 04:06:08.068007 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.067174    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ebf95ef1-a64f-4c13-ad80-225816c94137-host-slash\") pod \"iptables-alerter-p9hks\" (UID: \"ebf95ef1-a64f-4c13-ad80-225816c94137\") " pod="openshift-network-operator/iptables-alerter-p9hks"
Sep 18 04:06:08.068848 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.067231    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cc11c9df-c3ad-4145-a5b0-a27f7225e599-host-cni-netd\") pod \"ovnkube-node-g5hqb\" (UID: \"cc11c9df-c3ad-4145-a5b0-a27f7225e599\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb"
Sep 18 04:06:08.068848 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.067232    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dd11bf2c-ca30-45e3-811b-e7f912087184-cnibin\") pod \"multus-additional-cni-plugins-snwbg\" (UID: \"dd11bf2c-ca30-45e3-811b-e7f912087184\") " pod="openshift-multus/multus-additional-cni-plugins-snwbg"
Sep 18 04:06:08.068848 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.067260    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/443bf4cf-26a5-47aa-beae-59373c9a9d89-host-var-lib-kubelet\") pod \"multus-sbmt7\" (UID: \"443bf4cf-26a5-47aa-beae-59373c9a9d89\") " pod="openshift-multus/multus-sbmt7"
Sep 18 04:06:08.068848 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.067280    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cc11c9df-c3ad-4145-a5b0-a27f7225e599-run-systemd\") pod \"ovnkube-node-g5hqb\" (UID: \"cc11c9df-c3ad-4145-a5b0-a27f7225e599\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb"
Sep 18 04:06:08.068848 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.067303    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54309f7d-04d4-42f8-8ef3-de8d52091386-tmp-dir\") pod \"node-resolver-r47v5\" (UID: \"54309f7d-04d4-42f8-8ef3-de8d52091386\") " pod="openshift-dns/node-resolver-r47v5"
Sep 18 04:06:08.068848 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.067333    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c8cda828-9b0c-412e-8e40-d80abb0074f4-sys-fs\") pod \"aws-ebs-csi-driver-node-4vlxg\" (UID: \"c8cda828-9b0c-412e-8e40-d80abb0074f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vlxg"
Sep 18 04:06:08.068848 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.067342    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c4d1f628-59bf-4e95-92d5-84171d5e04e3-konnectivity-ca\") pod \"konnectivity-agent-prm5t\" (UID: \"c4d1f628-59bf-4e95-92d5-84171d5e04e3\") " pod="kube-system/konnectivity-agent-prm5t"
Sep 18 04:06:08.068848 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.067348    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cc11c9df-c3ad-4145-a5b0-a27f7225e599-ovnkube-script-lib\") pod \"ovnkube-node-g5hqb\" (UID: \"cc11c9df-c3ad-4145-a5b0-a27f7225e599\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb"
Sep 18 04:06:08.068848 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.067365    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ebf95ef1-a64f-4c13-ad80-225816c94137-iptables-alerter-script\") pod \"iptables-alerter-p9hks\" (UID: \"ebf95ef1-a64f-4c13-ad80-225816c94137\") " pod="openshift-network-operator/iptables-alerter-p9hks"
Sep 18 04:06:08.068848 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.067418    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/eddb729c-9c21-4b4f-8306-5e475b718d65-etc-sysconfig\") pod \"tuned-fsb94\" (UID: \"eddb729c-9c21-4b4f-8306-5e475b718d65\") " pod="openshift-cluster-node-tuning-operator/tuned-fsb94"
Sep 18 04:06:08.068848 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.067445    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/eddb729c-9c21-4b4f-8306-5e475b718d65-etc-sysctl-d\") pod \"tuned-fsb94\" (UID: \"eddb729c-9c21-4b4f-8306-5e475b718d65\") " pod="openshift-cluster-node-tuning-operator/tuned-fsb94"
Sep 18 04:06:08.068848 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.067456    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dd11bf2c-ca30-45e3-811b-e7f912087184-tuning-conf-dir\") pod \"multus-additional-cni-plugins-snwbg\" (UID: \"dd11bf2c-ca30-45e3-811b-e7f912087184\") " pod="openshift-multus/multus-additional-cni-plugins-snwbg"
Sep 18 04:06:08.068848 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.067517    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dd11bf2c-ca30-45e3-811b-e7f912087184-cni-binary-copy\") pod \"multus-additional-cni-plugins-snwbg\" (UID: \"dd11bf2c-ca30-45e3-811b-e7f912087184\") " pod="openshift-multus/multus-additional-cni-plugins-snwbg"
Sep 18 04:06:08.068848 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.067591    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/443bf4cf-26a5-47aa-beae-59373c9a9d89-host-var-lib-cni-multus\") pod \"multus-sbmt7\" (UID: \"443bf4cf-26a5-47aa-beae-59373c9a9d89\") " pod="openshift-multus/multus-sbmt7"
Sep 18 04:06:08.068848 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.067626    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/443bf4cf-26a5-47aa-beae-59373c9a9d89-hostroot\") pod \"multus-sbmt7\" (UID: \"443bf4cf-26a5-47aa-beae-59373c9a9d89\") " pod="openshift-multus/multus-sbmt7"
Sep 18 04:06:08.068848 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.067661    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/443bf4cf-26a5-47aa-beae-59373c9a9d89-multus-conf-dir\") pod \"multus-sbmt7\" (UID: \"443bf4cf-26a5-47aa-beae-59373c9a9d89\") " pod="openshift-multus/multus-sbmt7"
Sep 18 04:06:08.068848 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.067669    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/443bf4cf-26a5-47aa-beae-59373c9a9d89-multus-daemon-config\") pod \"multus-sbmt7\" (UID: \"443bf4cf-26a5-47aa-beae-59373c9a9d89\") " pod="openshift-multus/multus-sbmt7"
Sep 18 04:06:08.069633 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.067682    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dd11bf2c-ca30-45e3-811b-e7f912087184-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-snwbg\" (UID: \"dd11bf2c-ca30-45e3-811b-e7f912087184\") " pod="openshift-multus/multus-additional-cni-plugins-snwbg"
Sep 18 04:06:08.069633 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.067686    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/eddb729c-9c21-4b4f-8306-5e475b718d65-run\") pod \"tuned-fsb94\" (UID: \"eddb729c-9c21-4b4f-8306-5e475b718d65\") " pod="openshift-cluster-node-tuning-operator/tuned-fsb94"
Sep 18 04:06:08.069633 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.067726    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/443bf4cf-26a5-47aa-beae-59373c9a9d89-hostroot\") pod \"multus-sbmt7\" (UID: \"443bf4cf-26a5-47aa-beae-59373c9a9d89\") " pod="openshift-multus/multus-sbmt7"
Sep 18 04:06:08.069633 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.067725    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eddb729c-9c21-4b4f-8306-5e475b718d65-sys\") pod \"tuned-fsb94\" (UID: \"eddb729c-9c21-4b4f-8306-5e475b718d65\") " pod="openshift-cluster-node-tuning-operator/tuned-fsb94"
Sep 18 04:06:08.069633 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.067764    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dd11bf2c-ca30-45e3-811b-e7f912087184-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-snwbg\" (UID: \"dd11bf2c-ca30-45e3-811b-e7f912087184\") " pod="openshift-multus/multus-additional-cni-plugins-snwbg"
Sep 18 04:06:08.069633 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.067773    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/443bf4cf-26a5-47aa-beae-59373c9a9d89-multus-conf-dir\") pod \"multus-sbmt7\" (UID: \"443bf4cf-26a5-47aa-beae-59373c9a9d89\") " pod="openshift-multus/multus-sbmt7"
Sep 18 04:06:08.069633 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.067791    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/443bf4cf-26a5-47aa-beae-59373c9a9d89-host-var-lib-cni-bin\") pod \"multus-sbmt7\" (UID: \"443bf4cf-26a5-47aa-beae-59373c9a9d89\") " pod="openshift-multus/multus-sbmt7"
Sep 18 04:06:08.069633 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.067796    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54309f7d-04d4-42f8-8ef3-de8d52091386-tmp-dir\") pod \"node-resolver-r47v5\" (UID: \"54309f7d-04d4-42f8-8ef3-de8d52091386\") " pod="openshift-dns/node-resolver-r47v5"
Sep 18 04:06:08.069633 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.067818    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c8cda828-9b0c-412e-8e40-d80abb0074f4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4vlxg\" (UID: \"c8cda828-9b0c-412e-8e40-d80abb0074f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vlxg"
Sep 18 04:06:08.069633 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.067862    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6dc80677-6f9c-44fd-8d5f-e3c9f4846191-original-pull-secret\") pod \"global-pull-secret-syncer-j59zp\" (UID: \"6dc80677-6f9c-44fd-8d5f-e3c9f4846191\") " pod="kube-system/global-pull-secret-syncer-j59zp"
Sep 18 04:06:08.069633 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.067883    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/443bf4cf-26a5-47aa-beae-59373c9a9d89-multus-cni-dir\") pod \"multus-sbmt7\" (UID: \"443bf4cf-26a5-47aa-beae-59373c9a9d89\") " pod="openshift-multus/multus-sbmt7"
Sep 18 04:06:08.069633 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.067885    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ebf95ef1-a64f-4c13-ad80-225816c94137-iptables-alerter-script\") pod \"iptables-alerter-p9hks\" (UID: \"ebf95ef1-a64f-4c13-ad80-225816c94137\") " pod="openshift-network-operator/iptables-alerter-p9hks"
Sep 18 04:06:08.069633 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.067889    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/443bf4cf-26a5-47aa-beae-59373c9a9d89-host-var-lib-cni-bin\") pod \"multus-sbmt7\" (UID: \"443bf4cf-26a5-47aa-beae-59373c9a9d89\") " pod="openshift-multus/multus-sbmt7"
Sep 18 04:06:08.069633 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.067911    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/443bf4cf-26a5-47aa-beae-59373c9a9d89-host-var-lib-cni-multus\") pod \"multus-sbmt7\" (UID: \"443bf4cf-26a5-47aa-beae-59373c9a9d89\") " pod="openshift-multus/multus-sbmt7"
Sep 18 04:06:08.069633 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.067923    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cc11c9df-c3ad-4145-a5b0-a27f7225e599-run-openvswitch\") pod \"ovnkube-node-g5hqb\" (UID: \"cc11c9df-c3ad-4145-a5b0-a27f7225e599\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb"
Sep 18 04:06:08.069633 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:08.068038    2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 04:06:08.069633 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.068075    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dd11bf2c-ca30-45e3-811b-e7f912087184-cni-binary-copy\") pod \"multus-additional-cni-plugins-snwbg\" (UID: \"dd11bf2c-ca30-45e3-811b-e7f912087184\") " pod="openshift-multus/multus-additional-cni-plugins-snwbg"
Sep 18 04:06:08.069633 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.068096    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c8cda828-9b0c-412e-8e40-d80abb0074f4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4vlxg\" (UID: \"c8cda828-9b0c-412e-8e40-d80abb0074f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vlxg"
Sep 18 04:06:08.070437 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.068122    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cc11c9df-c3ad-4145-a5b0-a27f7225e599-run-ovn\") pod \"ovnkube-node-g5hqb\" (UID: \"cc11c9df-c3ad-4145-a5b0-a27f7225e599\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb"
Sep 18 04:06:08.070437 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.068202    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/443bf4cf-26a5-47aa-beae-59373c9a9d89-multus-cni-dir\") pod \"multus-sbmt7\" (UID: \"443bf4cf-26a5-47aa-beae-59373c9a9d89\") " pod="openshift-multus/multus-sbmt7"
Sep 18 04:06:08.070437 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.068245    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cc11c9df-c3ad-4145-a5b0-a27f7225e599-host-cni-bin\") pod \"ovnkube-node-g5hqb\" (UID: \"cc11c9df-c3ad-4145-a5b0-a27f7225e599\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb"
Sep 18 04:06:08.070437 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:08.068265    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dc80677-6f9c-44fd-8d5f-e3c9f4846191-original-pull-secret podName:6dc80677-6f9c-44fd-8d5f-e3c9f4846191 nodeName:}" failed. No retries permitted until 2026-09-18 04:06:08.568251762 +0000 UTC m=+3.025694732 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6dc80677-6f9c-44fd-8d5f-e3c9f4846191-original-pull-secret") pod "global-pull-secret-syncer-j59zp" (UID: "6dc80677-6f9c-44fd-8d5f-e3c9f4846191") : object "kube-system"/"original-pull-secret" not registered
Sep 18 04:06:08.070437 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.068287    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cc11c9df-c3ad-4145-a5b0-a27f7225e599-run-openvswitch\") pod \"ovnkube-node-g5hqb\" (UID: \"cc11c9df-c3ad-4145-a5b0-a27f7225e599\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb"
Sep 18 04:06:08.070437 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.068298    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cc11c9df-c3ad-4145-a5b0-a27f7225e599-host-cni-bin\") pod \"ovnkube-node-g5hqb\" (UID: \"cc11c9df-c3ad-4145-a5b0-a27f7225e599\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb"
Sep 18 04:06:08.070437 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.068333    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztmlr\" (UniqueName: \"kubernetes.io/projected/cc11c9df-c3ad-4145-a5b0-a27f7225e599-kube-api-access-ztmlr\") pod \"ovnkube-node-g5hqb\" (UID: \"cc11c9df-c3ad-4145-a5b0-a27f7225e599\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb"
Sep 18 04:06:08.070437 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.068340    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cc11c9df-c3ad-4145-a5b0-a27f7225e599-run-ovn\") pod \"ovnkube-node-g5hqb\" (UID: \"cc11c9df-c3ad-4145-a5b0-a27f7225e599\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb"
Sep 18 04:06:08.070437 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.068374    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eddb729c-9c21-4b4f-8306-5e475b718d65-host\") pod \"tuned-fsb94\" (UID: \"eddb729c-9c21-4b4f-8306-5e475b718d65\") " pod="openshift-cluster-node-tuning-operator/tuned-fsb94"
Sep 18 04:06:08.070437 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.068402    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dd11bf2c-ca30-45e3-811b-e7f912087184-system-cni-dir\") pod \"multus-additional-cni-plugins-snwbg\" (UID: \"dd11bf2c-ca30-45e3-811b-e7f912087184\") " pod="openshift-multus/multus-additional-cni-plugins-snwbg"
Sep 18 04:06:08.070437 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.068443    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/443bf4cf-26a5-47aa-beae-59373c9a9d89-cnibin\") pod \"multus-sbmt7\" (UID: \"443bf4cf-26a5-47aa-beae-59373c9a9d89\") " pod="openshift-multus/multus-sbmt7"
Sep 18 04:06:08.070437 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.068476    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/443bf4cf-26a5-47aa-beae-59373c9a9d89-cni-binary-copy\") pod \"multus-sbmt7\" (UID: \"443bf4cf-26a5-47aa-beae-59373c9a9d89\") " pod="openshift-multus/multus-sbmt7"
Sep 18 04:06:08.070437 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.068497    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cc11c9df-c3ad-4145-a5b0-a27f7225e599-host-slash\") pod \"ovnkube-node-g5hqb\" (UID: \"cc11c9df-c3ad-4145-a5b0-a27f7225e599\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb"
Sep 18 04:06:08.070437 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.068519    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cc11c9df-c3ad-4145-a5b0-a27f7225e599-node-log\") pod \"ovnkube-node-g5hqb\" (UID: \"cc11c9df-c3ad-4145-a5b0-a27f7225e599\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb"
Sep 18 04:06:08.070437 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.068530    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/443bf4cf-26a5-47aa-beae-59373c9a9d89-cnibin\") pod \"multus-sbmt7\" (UID: \"443bf4cf-26a5-47aa-beae-59373c9a9d89\") " pod="openshift-multus/multus-sbmt7"
Sep 18 04:06:08.070437 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.068560    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cc11c9df-c3ad-4145-a5b0-a27f7225e599-ovnkube-config\") pod \"ovnkube-node-g5hqb\" (UID: \"cc11c9df-c3ad-4145-a5b0-a27f7225e599\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb"
Sep 18 04:06:08.070437 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.068579    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cc11c9df-c3ad-4145-a5b0-a27f7225e599-host-slash\") pod \"ovnkube-node-g5hqb\" (UID: \"cc11c9df-c3ad-4145-a5b0-a27f7225e599\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb"
Sep 18 04:06:08.071521 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.068572    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dd11bf2c-ca30-45e3-811b-e7f912087184-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-snwbg\" (UID: \"dd11bf2c-ca30-45e3-811b-e7f912087184\") " pod="openshift-multus/multus-additional-cni-plugins-snwbg"
Sep 18 04:06:08.071521 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.068582    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cc11c9df-c3ad-4145-a5b0-a27f7225e599-env-overrides\") pod \"ovnkube-node-g5hqb\" (UID: \"cc11c9df-c3ad-4145-a5b0-a27f7225e599\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb"
Sep 18 04:06:08.071521 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.068615    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dd11bf2c-ca30-45e3-811b-e7f912087184-system-cni-dir\") pod \"multus-additional-cni-plugins-snwbg\" (UID: \"dd11bf2c-ca30-45e3-811b-e7f912087184\") " pod="openshift-multus/multus-additional-cni-plugins-snwbg"
Sep 18 04:06:08.071521 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.068580    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cc11c9df-c3ad-4145-a5b0-a27f7225e599-node-log\") pod \"ovnkube-node-g5hqb\" (UID: \"cc11c9df-c3ad-4145-a5b0-a27f7225e599\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb"
Sep 18 04:06:08.071521 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.068650    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/443bf4cf-26a5-47aa-beae-59373c9a9d89-host-run-multus-certs\") pod \"multus-sbmt7\" (UID: \"443bf4cf-26a5-47aa-beae-59373c9a9d89\") " pod="openshift-multus/multus-sbmt7"
Sep 18 04:06:08.071521 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.068677    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6dc80677-6f9c-44fd-8d5f-e3c9f4846191-dbus\") pod \"global-pull-secret-syncer-j59zp\" (UID: \"6dc80677-6f9c-44fd-8d5f-e3c9f4846191\") " pod="kube-system/global-pull-secret-syncer-j59zp"
Sep 18 04:06:08.071521 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.068700    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/54309f7d-04d4-42f8-8ef3-de8d52091386-hosts-file\") pod \"node-resolver-r47v5\" (UID: \"54309f7d-04d4-42f8-8ef3-de8d52091386\") " pod="openshift-dns/node-resolver-r47v5"
Sep 18 04:06:08.071521 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.068724    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29z6d\" (UniqueName: \"kubernetes.io/projected/54309f7d-04d4-42f8-8ef3-de8d52091386-kube-api-access-29z6d\") pod \"node-resolver-r47v5\" (UID: \"54309f7d-04d4-42f8-8ef3-de8d52091386\") " pod="openshift-dns/node-resolver-r47v5"
Sep 18 04:06:08.071521 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.068749    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c8cda828-9b0c-412e-8e40-d80abb0074f4-socket-dir\") pod \"aws-ebs-csi-driver-node-4vlxg\" (UID: \"c8cda828-9b0c-412e-8e40-d80abb0074f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vlxg"
Sep 18 04:06:08.071521 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.068786    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skdwn\" (UniqueName: \"kubernetes.io/projected/c8cda828-9b0c-412e-8e40-d80abb0074f4-kube-api-access-skdwn\") pod \"aws-ebs-csi-driver-node-4vlxg\" (UID: \"c8cda828-9b0c-412e-8e40-d80abb0074f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vlxg"
Sep 18 04:06:08.071521 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.068809    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6dc80677-6f9c-44fd-8d5f-e3c9f4846191-kubelet-config\") pod \"global-pull-secret-syncer-j59zp\" (UID: \"6dc80677-6f9c-44fd-8d5f-e3c9f4846191\") " pod="kube-system/global-pull-secret-syncer-j59zp"
Sep 18 04:06:08.071521 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.068834    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pw7r6\" (UniqueName: \"kubernetes.io/projected/dd11bf2c-ca30-45e3-811b-e7f912087184-kube-api-access-pw7r6\") pod \"multus-additional-cni-plugins-snwbg\" (UID: \"dd11bf2c-ca30-45e3-811b-e7f912087184\") " pod="openshift-multus/multus-additional-cni-plugins-snwbg"
Sep 18 04:06:08.071521 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.068856    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/443bf4cf-26a5-47aa-beae-59373c9a9d89-system-cni-dir\") pod \"multus-sbmt7\" (UID: \"443bf4cf-26a5-47aa-beae-59373c9a9d89\") " pod="openshift-multus/multus-sbmt7"
Sep 18 04:06:08.071521 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.068925    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/443bf4cf-26a5-47aa-beae-59373c9a9d89-host-run-netns\") pod \"multus-sbmt7\" (UID: \"443bf4cf-26a5-47aa-beae-59373c9a9d89\") " pod="openshift-multus/multus-sbmt7"
Sep 18 04:06:08.071521 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.068947    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cc11c9df-c3ad-4145-a5b0-a27f7225e599-systemd-units\") pod \"ovnkube-node-g5hqb\" (UID: \"cc11c9df-c3ad-4145-a5b0-a27f7225e599\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb"
Sep 18 04:06:08.071521 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.068974    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9bq2\" (UniqueName: \"kubernetes.io/projected/2d169a38-932c-4d14-8a19-3ce5341fc190-kube-api-access-c9bq2\") pod \"network-metrics-daemon-zg942\" (UID: \"2d169a38-932c-4d14-8a19-3ce5341fc190\") " pod="openshift-multus/network-metrics-daemon-zg942"
Sep 18 04:06:08.071521 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.068997    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/eddb729c-9c21-4b4f-8306-5e475b718d65-etc-sysctl-conf\") pod \"tuned-fsb94\" (UID: \"eddb729c-9c21-4b4f-8306-5e475b718d65\") " pod="openshift-cluster-node-tuning-operator/tuned-fsb94"
Sep 18 04:06:08.072435 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.069040    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1c08324d-73f3-4f3b-909e-78d4c450e24b-host\") pod \"node-ca-pqmcs\" (UID: \"1c08324d-73f3-4f3b-909e-78d4c450e24b\") " pod="openshift-image-registry/node-ca-pqmcs"
Sep 18 04:06:08.072435 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.069049    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cc11c9df-c3ad-4145-a5b0-a27f7225e599-env-overrides\") pod \"ovnkube-node-g5hqb\" (UID: \"cc11c9df-c3ad-4145-a5b0-a27f7225e599\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb"
Sep 18 04:06:08.072435 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.069069    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/443bf4cf-26a5-47aa-beae-59373c9a9d89-cni-binary-copy\") pod \"multus-sbmt7\" (UID: \"443bf4cf-26a5-47aa-beae-59373c9a9d89\") " pod="openshift-multus/multus-sbmt7"
Sep 18 04:06:08.072435 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.069097    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cc11c9df-c3ad-4145-a5b0-a27f7225e599-ovnkube-config\") pod \"ovnkube-node-g5hqb\" (UID: \"cc11c9df-c3ad-4145-a5b0-a27f7225e599\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb"
Sep 18 04:06:08.072435 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.069166    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6dc80677-6f9c-44fd-8d5f-e3c9f4846191-dbus\") pod \"global-pull-secret-syncer-j59zp\" (UID: \"6dc80677-6f9c-44fd-8d5f-e3c9f4846191\") " pod="kube-system/global-pull-secret-syncer-j59zp"
Sep 18 04:06:08.072435 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.069172    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/443bf4cf-26a5-47aa-beae-59373c9a9d89-host-run-multus-certs\") pod \"multus-sbmt7\" (UID: \"443bf4cf-26a5-47aa-beae-59373c9a9d89\") " pod="openshift-multus/multus-sbmt7"
Sep 18 04:06:08.072435 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.069208    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/443bf4cf-26a5-47aa-beae-59373c9a9d89-system-cni-dir\") pod \"multus-sbmt7\" (UID: \"443bf4cf-26a5-47aa-beae-59373c9a9d89\") " pod="openshift-multus/multus-sbmt7"
Sep 18 04:06:08.072435 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.069212    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6dc80677-6f9c-44fd-8d5f-e3c9f4846191-kubelet-config\") pod \"global-pull-secret-syncer-j59zp\" (UID: \"6dc80677-6f9c-44fd-8d5f-e3c9f4846191\") " pod="kube-system/global-pull-secret-syncer-j59zp"
Sep 18 04:06:08.072435 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.069252    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/443bf4cf-26a5-47aa-beae-59373c9a9d89-host-run-netns\") pod \"multus-sbmt7\" (UID: \"443bf4cf-26a5-47aa-beae-59373c9a9d89\") " pod="openshift-multus/multus-sbmt7"
Sep 18 04:06:08.072435 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.069290    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/54309f7d-04d4-42f8-8ef3-de8d52091386-hosts-file\") pod \"node-resolver-r47v5\" (UID: \"54309f7d-04d4-42f8-8ef3-de8d52091386\") " pod="openshift-dns/node-resolver-r47v5"
Sep 18 04:06:08.072435 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.069326    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cc11c9df-c3ad-4145-a5b0-a27f7225e599-systemd-units\") pod \"ovnkube-node-g5hqb\" (UID: \"cc11c9df-c3ad-4145-a5b0-a27f7225e599\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb"
Sep 18 04:06:08.072435 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.069345    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c8cda828-9b0c-412e-8e40-d80abb0074f4-socket-dir\") pod \"aws-ebs-csi-driver-node-4vlxg\" (UID: \"c8cda828-9b0c-412e-8e40-d80abb0074f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vlxg"
Sep 18 04:06:08.072435 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.071555    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c4d1f628-59bf-4e95-92d5-84171d5e04e3-agent-certs\") pod \"konnectivity-agent-prm5t\" (UID: \"c4d1f628-59bf-4e95-92d5-84171d5e04e3\") " pod="kube-system/konnectivity-agent-prm5t"
Sep 18 04:06:08.075197 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.075124    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cc11c9df-c3ad-4145-a5b0-a27f7225e599-ovn-node-metrics-cert\") pod \"ovnkube-node-g5hqb\" (UID: \"cc11c9df-c3ad-4145-a5b0-a27f7225e599\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb"
Sep 18 04:06:08.078129 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.078106    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-29z6d\" (UniqueName: \"kubernetes.io/projected/54309f7d-04d4-42f8-8ef3-de8d52091386-kube-api-access-29z6d\") pod \"node-resolver-r47v5\" (UID: \"54309f7d-04d4-42f8-8ef3-de8d52091386\") " pod="openshift-dns/node-resolver-r47v5"
Sep 18 04:06:08.078723 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.078608    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dtn5\" (UniqueName: \"kubernetes.io/projected/443bf4cf-26a5-47aa-beae-59373c9a9d89-kube-api-access-9dtn5\") pod \"multus-sbmt7\" (UID: \"443bf4cf-26a5-47aa-beae-59373c9a9d89\") " pod="openshift-multus/multus-sbmt7"
Sep 18 04:06:08.078942 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.078866    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztmlr\" (UniqueName: \"kubernetes.io/projected/cc11c9df-c3ad-4145-a5b0-a27f7225e599-kube-api-access-ztmlr\") pod \"ovnkube-node-g5hqb\" (UID: \"cc11c9df-c3ad-4145-a5b0-a27f7225e599\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb"
Sep 18 04:06:08.079981 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.079958    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-skdwn\" (UniqueName: \"kubernetes.io/projected/c8cda828-9b0c-412e-8e40-d80abb0074f4-kube-api-access-skdwn\") pod \"aws-ebs-csi-driver-node-4vlxg\" (UID: \"c8cda828-9b0c-412e-8e40-d80abb0074f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vlxg"
Sep 18 04:06:08.080295 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.080276    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzp7p\" (UniqueName: \"kubernetes.io/projected/ebf95ef1-a64f-4c13-ad80-225816c94137-kube-api-access-jzp7p\") pod \"iptables-alerter-p9hks\" (UID: \"ebf95ef1-a64f-4c13-ad80-225816c94137\") " pod="openshift-network-operator/iptables-alerter-p9hks"
Sep 18 04:06:08.081806 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.081782    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pw7r6\" (UniqueName: \"kubernetes.io/projected/dd11bf2c-ca30-45e3-811b-e7f912087184-kube-api-access-pw7r6\") pod \"multus-additional-cni-plugins-snwbg\" (UID: \"dd11bf2c-ca30-45e3-811b-e7f912087184\") " pod="openshift-multus/multus-additional-cni-plugins-snwbg"
Sep 18 04:06:08.169331 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.169295    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9bq2\" (UniqueName: \"kubernetes.io/projected/2d169a38-932c-4d14-8a19-3ce5341fc190-kube-api-access-c9bq2\") pod \"network-metrics-daemon-zg942\" (UID: \"2d169a38-932c-4d14-8a19-3ce5341fc190\") " pod="openshift-multus/network-metrics-daemon-zg942"
Sep 18 04:06:08.169331 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.169333    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/eddb729c-9c21-4b4f-8306-5e475b718d65-etc-sysctl-conf\") pod \"tuned-fsb94\" (UID: \"eddb729c-9c21-4b4f-8306-5e475b718d65\") " pod="openshift-cluster-node-tuning-operator/tuned-fsb94"
Sep 18 04:06:08.169537 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.169348    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1c08324d-73f3-4f3b-909e-78d4c450e24b-host\") pod \"node-ca-pqmcs\" (UID: \"1c08324d-73f3-4f3b-909e-78d4c450e24b\") " pod="openshift-image-registry/node-ca-pqmcs"
Sep 18 04:06:08.169537 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.169365    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7z5kp\" (UniqueName: \"kubernetes.io/projected/1c08324d-73f3-4f3b-909e-78d4c450e24b-kube-api-access-7z5kp\") pod \"node-ca-pqmcs\" (UID: \"1c08324d-73f3-4f3b-909e-78d4c450e24b\") " pod="openshift-image-registry/node-ca-pqmcs"
Sep 18 04:06:08.169537 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.169423    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1c08324d-73f3-4f3b-909e-78d4c450e24b-host\") pod \"node-ca-pqmcs\" (UID: \"1c08324d-73f3-4f3b-909e-78d4c450e24b\") " pod="openshift-image-registry/node-ca-pqmcs"
Sep 18 04:06:08.169537 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.169477    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eddb729c-9c21-4b4f-8306-5e475b718d65-lib-modules\") pod \"tuned-fsb94\" (UID: \"eddb729c-9c21-4b4f-8306-5e475b718d65\") " pod="openshift-cluster-node-tuning-operator/tuned-fsb94"
Sep 18 04:06:08.169537 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.169508    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eddb729c-9c21-4b4f-8306-5e475b718d65-var-lib-kubelet\") pod \"tuned-fsb94\" (UID: \"eddb729c-9c21-4b4f-8306-5e475b718d65\") " pod="openshift-cluster-node-tuning-operator/tuned-fsb94"
Sep 18 04:06:08.169537 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.169525    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/eddb729c-9c21-4b4f-8306-5e475b718d65-etc-modprobe-d\") pod \"tuned-fsb94\" (UID: \"eddb729c-9c21-4b4f-8306-5e475b718d65\") " pod="openshift-cluster-node-tuning-operator/tuned-fsb94"
Sep 18 04:06:08.169537 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.169480    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/eddb729c-9c21-4b4f-8306-5e475b718d65-etc-sysctl-conf\") pod \"tuned-fsb94\" (UID: \"eddb729c-9c21-4b4f-8306-5e475b718d65\") " pod="openshift-cluster-node-tuning-operator/tuned-fsb94"
Sep 18 04:06:08.169537 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.169539    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgsg5\" (UniqueName: \"kubernetes.io/projected/eddb729c-9c21-4b4f-8306-5e475b718d65-kube-api-access-qgsg5\") pod \"tuned-fsb94\" (UID: \"eddb729c-9c21-4b4f-8306-5e475b718d65\") " pod="openshift-cluster-node-tuning-operator/tuned-fsb94"
Sep 18 04:06:08.169886 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.169563    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eddb729c-9c21-4b4f-8306-5e475b718d65-lib-modules\") pod \"tuned-fsb94\" (UID: \"eddb729c-9c21-4b4f-8306-5e475b718d65\") " pod="openshift-cluster-node-tuning-operator/tuned-fsb94"
Sep 18 04:06:08.169886 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.169590    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eddb729c-9c21-4b4f-8306-5e475b718d65-var-lib-kubelet\") pod \"tuned-fsb94\" (UID: \"eddb729c-9c21-4b4f-8306-5e475b718d65\") " pod="openshift-cluster-node-tuning-operator/tuned-fsb94"
Sep 18 04:06:08.169886 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.169576    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eddb729c-9c21-4b4f-8306-5e475b718d65-etc-kubernetes\") pod \"tuned-fsb94\" (UID: \"eddb729c-9c21-4b4f-8306-5e475b718d65\") " pod="openshift-cluster-node-tuning-operator/tuned-fsb94"
Sep 18 04:06:08.169886 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.169629    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/eddb729c-9c21-4b4f-8306-5e475b718d65-etc-systemd\") pod \"tuned-fsb94\" (UID: \"eddb729c-9c21-4b4f-8306-5e475b718d65\") " pod="openshift-cluster-node-tuning-operator/tuned-fsb94"
Sep 18 04:06:08.169886 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.169633    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/eddb729c-9c21-4b4f-8306-5e475b718d65-etc-modprobe-d\") pod \"tuned-fsb94\" (UID: \"eddb729c-9c21-4b4f-8306-5e475b718d65\") " pod="openshift-cluster-node-tuning-operator/tuned-fsb94"
Sep 18 04:06:08.169886 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.169652    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/eddb729c-9c21-4b4f-8306-5e475b718d65-etc-tuned\") pod \"tuned-fsb94\" (UID: \"eddb729c-9c21-4b4f-8306-5e475b718d65\") " pod="openshift-cluster-node-tuning-operator/tuned-fsb94"
Sep 18 04:06:08.169886 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.169674    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1c08324d-73f3-4f3b-909e-78d4c450e24b-serviceca\") pod \"node-ca-pqmcs\" (UID: \"1c08324d-73f3-4f3b-909e-78d4c450e24b\") " pod="openshift-image-registry/node-ca-pqmcs"
Sep 18 04:06:08.169886 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.169677    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eddb729c-9c21-4b4f-8306-5e475b718d65-etc-kubernetes\") pod \"tuned-fsb94\" (UID: \"eddb729c-9c21-4b4f-8306-5e475b718d65\") " pod="openshift-cluster-node-tuning-operator/tuned-fsb94"
Sep 18 04:06:08.169886 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.169679    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/eddb729c-9c21-4b4f-8306-5e475b718d65-etc-systemd\") pod \"tuned-fsb94\" (UID: \"eddb729c-9c21-4b4f-8306-5e475b718d65\") " pod="openshift-cluster-node-tuning-operator/tuned-fsb94"
Sep 18 04:06:08.169886 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.169702    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tl9sp\" (UniqueName: \"kubernetes.io/projected/395617a1-d084-4753-82d1-8dabf26dc416-kube-api-access-tl9sp\") pod \"network-check-target-z59z5\" (UID: \"395617a1-d084-4753-82d1-8dabf26dc416\") " pod="openshift-network-diagnostics/network-check-target-z59z5"
Sep 18 04:06:08.169886 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.169730    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d169a38-932c-4d14-8a19-3ce5341fc190-metrics-certs\") pod \"network-metrics-daemon-zg942\" (UID: \"2d169a38-932c-4d14-8a19-3ce5341fc190\") " pod="openshift-multus/network-metrics-daemon-zg942"
Sep 18 04:06:08.169886 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.169746    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eddb729c-9c21-4b4f-8306-5e475b718d65-tmp\") pod \"tuned-fsb94\" (UID: \"eddb729c-9c21-4b4f-8306-5e475b718d65\") " pod="openshift-cluster-node-tuning-operator/tuned-fsb94"
Sep 18 04:06:08.169886 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.169762    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/eddb729c-9c21-4b4f-8306-5e475b718d65-etc-sysconfig\") pod \"tuned-fsb94\" (UID: \"eddb729c-9c21-4b4f-8306-5e475b718d65\") " pod="openshift-cluster-node-tuning-operator/tuned-fsb94"
Sep 18 04:06:08.169886 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.169778    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/eddb729c-9c21-4b4f-8306-5e475b718d65-etc-sysctl-d\") pod \"tuned-fsb94\" (UID: \"eddb729c-9c21-4b4f-8306-5e475b718d65\") " pod="openshift-cluster-node-tuning-operator/tuned-fsb94"
Sep 18 04:06:08.169886 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.169834    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/eddb729c-9c21-4b4f-8306-5e475b718d65-etc-sysconfig\") pod \"tuned-fsb94\" (UID: \"eddb729c-9c21-4b4f-8306-5e475b718d65\") " pod="openshift-cluster-node-tuning-operator/tuned-fsb94"
Sep 18 04:06:08.169886 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.169804    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/eddb729c-9c21-4b4f-8306-5e475b718d65-run\") pod \"tuned-fsb94\" (UID: \"eddb729c-9c21-4b4f-8306-5e475b718d65\") " pod="openshift-cluster-node-tuning-operator/tuned-fsb94"
Sep 18 04:06:08.169886 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.169887    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eddb729c-9c21-4b4f-8306-5e475b718d65-sys\") pod \"tuned-fsb94\" (UID: \"eddb729c-9c21-4b4f-8306-5e475b718d65\") " pod="openshift-cluster-node-tuning-operator/tuned-fsb94"
Sep 18 04:06:08.169886 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:08.169912    2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 04:06:08.170555 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.169942    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eddb729c-9c21-4b4f-8306-5e475b718d65-host\") pod \"tuned-fsb94\" (UID: \"eddb729c-9c21-4b4f-8306-5e475b718d65\") " pod="openshift-cluster-node-tuning-operator/tuned-fsb94"
Sep 18 04:06:08.170555 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.169966    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/eddb729c-9c21-4b4f-8306-5e475b718d65-etc-sysctl-d\") pod \"tuned-fsb94\" (UID: \"eddb729c-9c21-4b4f-8306-5e475b718d65\") " pod="openshift-cluster-node-tuning-operator/tuned-fsb94"
Sep 18 04:06:08.170555 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.169978    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/eddb729c-9c21-4b4f-8306-5e475b718d65-run\") pod \"tuned-fsb94\" (UID: \"eddb729c-9c21-4b4f-8306-5e475b718d65\") " pod="openshift-cluster-node-tuning-operator/tuned-fsb94"
Sep 18 04:06:08.170555 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:08.169989    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d169a38-932c-4d14-8a19-3ce5341fc190-metrics-certs podName:2d169a38-932c-4d14-8a19-3ce5341fc190 nodeName:}" failed. No retries permitted until 2026-09-18 04:06:08.669968239 +0000 UTC m=+3.127411199 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2d169a38-932c-4d14-8a19-3ce5341fc190-metrics-certs") pod "network-metrics-daemon-zg942" (UID: "2d169a38-932c-4d14-8a19-3ce5341fc190") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 04:06:08.170555 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.170004    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eddb729c-9c21-4b4f-8306-5e475b718d65-host\") pod \"tuned-fsb94\" (UID: \"eddb729c-9c21-4b4f-8306-5e475b718d65\") " pod="openshift-cluster-node-tuning-operator/tuned-fsb94"
Sep 18 04:06:08.170555 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.170027    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eddb729c-9c21-4b4f-8306-5e475b718d65-sys\") pod \"tuned-fsb94\" (UID: \"eddb729c-9c21-4b4f-8306-5e475b718d65\") " pod="openshift-cluster-node-tuning-operator/tuned-fsb94"
Sep 18 04:06:08.170555 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.170186    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1c08324d-73f3-4f3b-909e-78d4c450e24b-serviceca\") pod \"node-ca-pqmcs\" (UID: \"1c08324d-73f3-4f3b-909e-78d4c450e24b\") " pod="openshift-image-registry/node-ca-pqmcs"
Sep 18 04:06:08.171770 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.171754    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eddb729c-9c21-4b4f-8306-5e475b718d65-tmp\") pod \"tuned-fsb94\" (UID: \"eddb729c-9c21-4b4f-8306-5e475b718d65\") " pod="openshift-cluster-node-tuning-operator/tuned-fsb94"
Sep 18 04:06:08.171853 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.171838    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/eddb729c-9c21-4b4f-8306-5e475b718d65-etc-tuned\") pod \"tuned-fsb94\" (UID: \"eddb729c-9c21-4b4f-8306-5e475b718d65\") " pod="openshift-cluster-node-tuning-operator/tuned-fsb94"
Sep 18 04:06:08.175710 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:08.175691    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 04:06:08.175710 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:08.175712    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 04:06:08.175839 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:08.175724    2585 projected.go:196] Error preparing data for projected volume kube-api-access-tl9sp for pod openshift-network-diagnostics/network-check-target-z59z5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 04:06:08.175839 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:08.175785    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/395617a1-d084-4753-82d1-8dabf26dc416-kube-api-access-tl9sp podName:395617a1-d084-4753-82d1-8dabf26dc416 nodeName:}" failed. No retries permitted until 2026-09-18 04:06:08.675770604 +0000 UTC m=+3.133213568 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-tl9sp" (UniqueName: "kubernetes.io/projected/395617a1-d084-4753-82d1-8dabf26dc416-kube-api-access-tl9sp") pod "network-check-target-z59z5" (UID: "395617a1-d084-4753-82d1-8dabf26dc416") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 04:06:08.177591 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.177539    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgsg5\" (UniqueName: \"kubernetes.io/projected/eddb729c-9c21-4b4f-8306-5e475b718d65-kube-api-access-qgsg5\") pod \"tuned-fsb94\" (UID: \"eddb729c-9c21-4b4f-8306-5e475b718d65\") " pod="openshift-cluster-node-tuning-operator/tuned-fsb94"
Sep 18 04:06:08.177892 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.177871    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7z5kp\" (UniqueName: \"kubernetes.io/projected/1c08324d-73f3-4f3b-909e-78d4c450e24b-kube-api-access-7z5kp\") pod \"node-ca-pqmcs\" (UID: \"1c08324d-73f3-4f3b-909e-78d4c450e24b\") " pod="openshift-image-registry/node-ca-pqmcs"
Sep 18 04:06:08.177987 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.177963    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9bq2\" (UniqueName: \"kubernetes.io/projected/2d169a38-932c-4d14-8a19-3ce5341fc190-kube-api-access-c9bq2\") pod \"network-metrics-daemon-zg942\" (UID: \"2d169a38-932c-4d14-8a19-3ce5341fc190\") " pod="openshift-multus/network-metrics-daemon-zg942"
Sep 18 04:06:08.252313 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.252282    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sbmt7"
Sep 18 04:06:08.270269 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.270086    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vlxg"
Sep 18 04:06:08.282964 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.282943    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-p9hks"
Sep 18 04:06:08.295654 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.295632    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb"
Sep 18 04:06:08.303315 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.303291    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-prm5t"
Sep 18 04:06:08.311916 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.311883    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-r47v5"
Sep 18 04:06:08.321518 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.321501    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-snwbg"
Sep 18 04:06:08.329144 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.329127    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fsb94"
Sep 18 04:06:08.335653 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.335635    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pqmcs"
Sep 18 04:06:08.571676 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.571583    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6dc80677-6f9c-44fd-8d5f-e3c9f4846191-original-pull-secret\") pod \"global-pull-secret-syncer-j59zp\" (UID: \"6dc80677-6f9c-44fd-8d5f-e3c9f4846191\") " pod="kube-system/global-pull-secret-syncer-j59zp"
Sep 18 04:06:08.571841 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:08.571742    2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 04:06:08.571841 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:08.571812    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dc80677-6f9c-44fd-8d5f-e3c9f4846191-original-pull-secret podName:6dc80677-6f9c-44fd-8d5f-e3c9f4846191 nodeName:}" failed. No retries permitted until 2026-09-18 04:06:09.571793146 +0000 UTC m=+4.029236095 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6dc80677-6f9c-44fd-8d5f-e3c9f4846191-original-pull-secret") pod "global-pull-secret-syncer-j59zp" (UID: "6dc80677-6f9c-44fd-8d5f-e3c9f4846191") : object "kube-system"/"original-pull-secret" not registered
Sep 18 04:06:08.672235 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.672206    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d169a38-932c-4d14-8a19-3ce5341fc190-metrics-certs\") pod \"network-metrics-daemon-zg942\" (UID: \"2d169a38-932c-4d14-8a19-3ce5341fc190\") " pod="openshift-multus/network-metrics-daemon-zg942"
Sep 18 04:06:08.672366 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:08.672320    2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 04:06:08.672414 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:08.672372    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d169a38-932c-4d14-8a19-3ce5341fc190-metrics-certs podName:2d169a38-932c-4d14-8a19-3ce5341fc190 nodeName:}" failed. No retries permitted until 2026-09-18 04:06:09.672358759 +0000 UTC m=+4.129801705 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2d169a38-932c-4d14-8a19-3ce5341fc190-metrics-certs") pod "network-metrics-daemon-zg942" (UID: "2d169a38-932c-4d14-8a19-3ce5341fc190") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 04:06:08.773041 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.773004    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tl9sp\" (UniqueName: \"kubernetes.io/projected/395617a1-d084-4753-82d1-8dabf26dc416-kube-api-access-tl9sp\") pod \"network-check-target-z59z5\" (UID: \"395617a1-d084-4753-82d1-8dabf26dc416\") " pod="openshift-network-diagnostics/network-check-target-z59z5"
Sep 18 04:06:08.773211 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:08.773151    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 04:06:08.773211 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:08.773172    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 04:06:08.773211 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:08.773181    2585 projected.go:196] Error preparing data for projected volume kube-api-access-tl9sp for pod openshift-network-diagnostics/network-check-target-z59z5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 04:06:08.773346 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:08.773229    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/395617a1-d084-4753-82d1-8dabf26dc416-kube-api-access-tl9sp podName:395617a1-d084-4753-82d1-8dabf26dc416 nodeName:}" failed. No retries permitted until 2026-09-18 04:06:09.773216996 +0000 UTC m=+4.230659946 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-tl9sp" (UniqueName: "kubernetes.io/projected/395617a1-d084-4753-82d1-8dabf26dc416-kube-api-access-tl9sp") pod "network-check-target-z59z5" (UID: "395617a1-d084-4753-82d1-8dabf26dc416") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 04:06:08.998728 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.998651    2585 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 04:01:07 +0000 UTC" deadline="2028-03-20 16:55:04.205441786 +0000 UTC"
Sep 18 04:06:08.998728 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:08.998680    2585 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13188h48m55.206765264s"
Sep 18 04:06:09.209355 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:09.209316    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd11bf2c_ca30_45e3_811b_e7f912087184.slice/crio-f401e537d1ca8465afbe55c10f07306a38e201e13cc7d249fce788610a7ab9fb WatchSource:0}: Error finding container f401e537d1ca8465afbe55c10f07306a38e201e13cc7d249fce788610a7ab9fb: Status 404 returned error can't find the container with id f401e537d1ca8465afbe55c10f07306a38e201e13cc7d249fce788610a7ab9fb
Sep 18 04:06:09.210455 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:09.210345    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54309f7d_04d4_42f8_8ef3_de8d52091386.slice/crio-f515a868b9d3587c0e2ff50a699715d84c5a5d9530b72ec0a59538722eb1ac48 WatchSource:0}: Error finding container f515a868b9d3587c0e2ff50a699715d84c5a5d9530b72ec0a59538722eb1ac48: Status 404 returned error can't find the container with id f515a868b9d3587c0e2ff50a699715d84c5a5d9530b72ec0a59538722eb1ac48
Sep 18 04:06:09.211107 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:09.211086    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8cda828_9b0c_412e_8e40_d80abb0074f4.slice/crio-f9932260c32a5a84108e1a3b4bda628ea38d2943f656dac06ee1b9abda0a96b7 WatchSource:0}: Error finding container f9932260c32a5a84108e1a3b4bda628ea38d2943f656dac06ee1b9abda0a96b7: Status 404 returned error can't find the container with id f9932260c32a5a84108e1a3b4bda628ea38d2943f656dac06ee1b9abda0a96b7
Sep 18 04:06:09.212163 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:09.212077    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod443bf4cf_26a5_47aa_beae_59373c9a9d89.slice/crio-b5575d7b532b389900eb3f25bc51f6957269f412e3217f0cafe008f68f78d3ab WatchSource:0}: Error finding container b5575d7b532b389900eb3f25bc51f6957269f412e3217f0cafe008f68f78d3ab: Status 404 returned error can't find the container with id b5575d7b532b389900eb3f25bc51f6957269f412e3217f0cafe008f68f78d3ab
Sep 18 04:06:09.213130 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:09.213067    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4d1f628_59bf_4e95_92d5_84171d5e04e3.slice/crio-8d347296392bac5a5c7d6cf742015469983aa07ed2cd42fcefe0743bc125d9d2 WatchSource:0}: Error finding container 8d347296392bac5a5c7d6cf742015469983aa07ed2cd42fcefe0743bc125d9d2: Status 404 returned error can't find the container with id 8d347296392bac5a5c7d6cf742015469983aa07ed2cd42fcefe0743bc125d9d2
Sep 18 04:06:09.214359 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:09.214113    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebf95ef1_a64f_4c13_ad80_225816c94137.slice/crio-1ff279ac4214eab414ac606ce43772f082fc1e03999a476c66134d387acac2dd WatchSource:0}: Error finding container 1ff279ac4214eab414ac606ce43772f082fc1e03999a476c66134d387acac2dd: Status 404 returned error can't find the container with id 1ff279ac4214eab414ac606ce43772f082fc1e03999a476c66134d387acac2dd
Sep 18 04:06:09.216059 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:09.216040    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c08324d_73f3_4f3b_909e_78d4c450e24b.slice/crio-f9dec2fc2d2e68bf400e6b03f9bb544d17c570cdb3e129fa36647a01b462f308 WatchSource:0}: Error finding container f9dec2fc2d2e68bf400e6b03f9bb544d17c570cdb3e129fa36647a01b462f308: Status 404 returned error can't find the container with id f9dec2fc2d2e68bf400e6b03f9bb544d17c570cdb3e129fa36647a01b462f308
Sep 18 04:06:09.217618 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:09.217283    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeddb729c_9c21_4b4f_8306_5e475b718d65.slice/crio-96ddc93ddbc1d4a96e5e78122f4b5fe9d2bac97c664557e794bf36c36650fe18 WatchSource:0}: Error finding container 96ddc93ddbc1d4a96e5e78122f4b5fe9d2bac97c664557e794bf36c36650fe18: Status 404 returned error can't find the container with id 96ddc93ddbc1d4a96e5e78122f4b5fe9d2bac97c664557e794bf36c36650fe18
Sep 18 04:06:09.219068 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:09.219034    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc11c9df_c3ad_4145_a5b0_a27f7225e599.slice/crio-510ef55db0a2d5450f3af11e0a1d1b629a0b362552dbaf6ebf9c91f01bb2875d WatchSource:0}: Error finding container 510ef55db0a2d5450f3af11e0a1d1b629a0b362552dbaf6ebf9c91f01bb2875d: Status 404 returned error can't find the container with id 510ef55db0a2d5450f3af11e0a1d1b629a0b362552dbaf6ebf9c91f01bb2875d
Sep 18 04:06:09.579125 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:09.579044    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6dc80677-6f9c-44fd-8d5f-e3c9f4846191-original-pull-secret\") pod \"global-pull-secret-syncer-j59zp\" (UID: \"6dc80677-6f9c-44fd-8d5f-e3c9f4846191\") " pod="kube-system/global-pull-secret-syncer-j59zp"
Sep 18 04:06:09.579241 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:09.579212    2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 04:06:09.579289 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:09.579282    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dc80677-6f9c-44fd-8d5f-e3c9f4846191-original-pull-secret podName:6dc80677-6f9c-44fd-8d5f-e3c9f4846191 nodeName:}" failed. No retries permitted until 2026-09-18 04:06:11.579263029 +0000 UTC m=+6.036705978 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6dc80677-6f9c-44fd-8d5f-e3c9f4846191-original-pull-secret") pod "global-pull-secret-syncer-j59zp" (UID: "6dc80677-6f9c-44fd-8d5f-e3c9f4846191") : object "kube-system"/"original-pull-secret" not registered
Sep 18 04:06:09.679535 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:09.679505    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d169a38-932c-4d14-8a19-3ce5341fc190-metrics-certs\") pod \"network-metrics-daemon-zg942\" (UID: \"2d169a38-932c-4d14-8a19-3ce5341fc190\") " pod="openshift-multus/network-metrics-daemon-zg942"
Sep 18 04:06:09.679688 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:09.679625    2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 04:06:09.679688 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:09.679682    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d169a38-932c-4d14-8a19-3ce5341fc190-metrics-certs podName:2d169a38-932c-4d14-8a19-3ce5341fc190 nodeName:}" failed. No retries permitted until 2026-09-18 04:06:11.67966889 +0000 UTC m=+6.137111837 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2d169a38-932c-4d14-8a19-3ce5341fc190-metrics-certs") pod "network-metrics-daemon-zg942" (UID: "2d169a38-932c-4d14-8a19-3ce5341fc190") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 04:06:09.780959 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:09.780886    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tl9sp\" (UniqueName: \"kubernetes.io/projected/395617a1-d084-4753-82d1-8dabf26dc416-kube-api-access-tl9sp\") pod \"network-check-target-z59z5\" (UID: \"395617a1-d084-4753-82d1-8dabf26dc416\") " pod="openshift-network-diagnostics/network-check-target-z59z5"
Sep 18 04:06:09.781130 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:09.781106    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 04:06:09.781130 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:09.781129    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 04:06:09.781235 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:09.781141    2585 projected.go:196] Error preparing data for projected volume kube-api-access-tl9sp for pod openshift-network-diagnostics/network-check-target-z59z5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 04:06:09.781235 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:09.781195    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/395617a1-d084-4753-82d1-8dabf26dc416-kube-api-access-tl9sp podName:395617a1-d084-4753-82d1-8dabf26dc416 nodeName:}" failed. No retries permitted until 2026-09-18 04:06:11.781178505 +0000 UTC m=+6.238621467 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-tl9sp" (UniqueName: "kubernetes.io/projected/395617a1-d084-4753-82d1-8dabf26dc416-kube-api-access-tl9sp") pod "network-check-target-z59z5" (UID: "395617a1-d084-4753-82d1-8dabf26dc416") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 04:06:09.999147 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:09.999037    2585 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 04:01:07 +0000 UTC" deadline="2028-07-03 14:34:47.09169203 +0000 UTC"
Sep 18 04:06:09.999147 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:09.999104    2585 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15706h28m37.092591992s"
Sep 18 04:06:10.059687 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:10.059656    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j59zp"
Sep 18 04:06:10.059844 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:10.059792    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j59zp" podUID="6dc80677-6f9c-44fd-8d5f-e3c9f4846191"
Sep 18 04:06:10.060215 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:10.060194    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z59z5"
Sep 18 04:06:10.060334 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:10.060290    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z59z5" podUID="395617a1-d084-4753-82d1-8dabf26dc416"
Sep 18 04:06:10.060393 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:10.060384    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zg942"
Sep 18 04:06:10.060481 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:10.060465    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zg942" podUID="2d169a38-932c-4d14-8a19-3ce5341fc190"
Sep 18 04:06:10.071551 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:10.071440    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb" event={"ID":"cc11c9df-c3ad-4145-a5b0-a27f7225e599","Type":"ContainerStarted","Data":"510ef55db0a2d5450f3af11e0a1d1b629a0b362552dbaf6ebf9c91f01bb2875d"}
Sep 18 04:06:10.084205 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:10.084169    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fsb94" event={"ID":"eddb729c-9c21-4b4f-8306-5e475b718d65","Type":"ContainerStarted","Data":"96ddc93ddbc1d4a96e5e78122f4b5fe9d2bac97c664557e794bf36c36650fe18"}
Sep 18 04:06:10.092763 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:10.092733    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-p9hks" event={"ID":"ebf95ef1-a64f-4c13-ad80-225816c94137","Type":"ContainerStarted","Data":"1ff279ac4214eab414ac606ce43772f082fc1e03999a476c66134d387acac2dd"}
Sep 18 04:06:10.101598 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:10.099344    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-prm5t" event={"ID":"c4d1f628-59bf-4e95-92d5-84171d5e04e3","Type":"ContainerStarted","Data":"8d347296392bac5a5c7d6cf742015469983aa07ed2cd42fcefe0743bc125d9d2"}
Sep 18 04:06:10.101598 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:10.101034    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vlxg" event={"ID":"c8cda828-9b0c-412e-8e40-d80abb0074f4","Type":"ContainerStarted","Data":"f9932260c32a5a84108e1a3b4bda628ea38d2943f656dac06ee1b9abda0a96b7"}
Sep 18 04:06:10.104177 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:10.104151    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sbmt7" event={"ID":"443bf4cf-26a5-47aa-beae-59373c9a9d89","Type":"ContainerStarted","Data":"b5575d7b532b389900eb3f25bc51f6957269f412e3217f0cafe008f68f78d3ab"}
Sep 18 04:06:10.109021 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:10.108994    2585 generic.go:356] "Generic (PLEG): container finished" podID="6e36e2886117ea7684cd038c4a64e729" containerID="ec36d84b02a1284b47e433ec936cce97e823476de6b8eba8c9329d3dfac246b7" exitCode=0
Sep 18 04:06:10.109115 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:10.109072    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-207.ec2.internal" event={"ID":"6e36e2886117ea7684cd038c4a64e729","Type":"ContainerDied","Data":"ec36d84b02a1284b47e433ec936cce97e823476de6b8eba8c9329d3dfac246b7"}
Sep 18 04:06:10.115580 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:10.115532    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-207.ec2.internal" event={"ID":"208db4364c1c40920f745701e77898f0","Type":"ContainerStarted","Data":"b8d625b801304dbaaeaa86c57ab709384bec6b9af75b9abe9965cb69a4536ff0"}
Sep 18 04:06:10.131912 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:10.128752    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pqmcs" event={"ID":"1c08324d-73f3-4f3b-909e-78d4c450e24b","Type":"ContainerStarted","Data":"f9dec2fc2d2e68bf400e6b03f9bb544d17c570cdb3e129fa36647a01b462f308"}
Sep 18 04:06:10.132773 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:10.132736    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-r47v5" event={"ID":"54309f7d-04d4-42f8-8ef3-de8d52091386","Type":"ContainerStarted","Data":"f515a868b9d3587c0e2ff50a699715d84c5a5d9530b72ec0a59538722eb1ac48"}
Sep 18 04:06:10.149850 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:10.149821    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-snwbg" event={"ID":"dd11bf2c-ca30-45e3-811b-e7f912087184","Type":"ContainerStarted","Data":"f401e537d1ca8465afbe55c10f07306a38e201e13cc7d249fce788610a7ab9fb"}
Sep 18 04:06:11.165051 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:11.164496    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-207.ec2.internal" event={"ID":"6e36e2886117ea7684cd038c4a64e729","Type":"ContainerStarted","Data":"00714021b52b52baf1a2f32783fbdd1c7e51306ec22cfab8108348292ceaa382"}
Sep 18 04:06:11.181368 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:11.181301    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-207.ec2.internal" podStartSLOduration=4.181277746 podStartE2EDuration="4.181277746s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 04:06:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:06:10.140162886 +0000 UTC m=+4.597605859" watchObservedRunningTime="2026-09-18 04:06:11.181277746 +0000 UTC m=+5.638720717"
Sep 18 04:06:11.599758 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:11.599608    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6dc80677-6f9c-44fd-8d5f-e3c9f4846191-original-pull-secret\") pod \"global-pull-secret-syncer-j59zp\" (UID: \"6dc80677-6f9c-44fd-8d5f-e3c9f4846191\") " pod="kube-system/global-pull-secret-syncer-j59zp"
Sep 18 04:06:11.599940 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:11.599768    2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 04:06:11.599940 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:11.599834    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dc80677-6f9c-44fd-8d5f-e3c9f4846191-original-pull-secret podName:6dc80677-6f9c-44fd-8d5f-e3c9f4846191 nodeName:}" failed. No retries permitted until 2026-09-18 04:06:15.599814128 +0000 UTC m=+10.057257079 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6dc80677-6f9c-44fd-8d5f-e3c9f4846191-original-pull-secret") pod "global-pull-secret-syncer-j59zp" (UID: "6dc80677-6f9c-44fd-8d5f-e3c9f4846191") : object "kube-system"/"original-pull-secret" not registered
Sep 18 04:06:11.701051 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:11.700395    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d169a38-932c-4d14-8a19-3ce5341fc190-metrics-certs\") pod \"network-metrics-daemon-zg942\" (UID: \"2d169a38-932c-4d14-8a19-3ce5341fc190\") " pod="openshift-multus/network-metrics-daemon-zg942"
Sep 18 04:06:11.701051 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:11.700562    2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 04:06:11.701051 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:11.700628    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d169a38-932c-4d14-8a19-3ce5341fc190-metrics-certs podName:2d169a38-932c-4d14-8a19-3ce5341fc190 nodeName:}" failed. No retries permitted until 2026-09-18 04:06:15.700609282 +0000 UTC m=+10.158052235 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2d169a38-932c-4d14-8a19-3ce5341fc190-metrics-certs") pod "network-metrics-daemon-zg942" (UID: "2d169a38-932c-4d14-8a19-3ce5341fc190") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 04:06:11.801079 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:11.801042    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tl9sp\" (UniqueName: \"kubernetes.io/projected/395617a1-d084-4753-82d1-8dabf26dc416-kube-api-access-tl9sp\") pod \"network-check-target-z59z5\" (UID: \"395617a1-d084-4753-82d1-8dabf26dc416\") " pod="openshift-network-diagnostics/network-check-target-z59z5"
Sep 18 04:06:11.801245 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:11.801215    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 04:06:11.801245 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:11.801236    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 04:06:11.801245 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:11.801249    2585 projected.go:196] Error preparing data for projected volume kube-api-access-tl9sp for pod openshift-network-diagnostics/network-check-target-z59z5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 04:06:11.801470 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:11.801317    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/395617a1-d084-4753-82d1-8dabf26dc416-kube-api-access-tl9sp podName:395617a1-d084-4753-82d1-8dabf26dc416 nodeName:}" failed. No retries permitted until 2026-09-18 04:06:15.801298027 +0000 UTC m=+10.258740999 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-tl9sp" (UniqueName: "kubernetes.io/projected/395617a1-d084-4753-82d1-8dabf26dc416-kube-api-access-tl9sp") pod "network-check-target-z59z5" (UID: "395617a1-d084-4753-82d1-8dabf26dc416") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 04:06:12.058085 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:12.057841    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z59z5"
Sep 18 04:06:12.058085 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:12.057841    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zg942"
Sep 18 04:06:12.058085 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:12.057986    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z59z5" podUID="395617a1-d084-4753-82d1-8dabf26dc416"
Sep 18 04:06:12.058085 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:12.058044    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zg942" podUID="2d169a38-932c-4d14-8a19-3ce5341fc190"
Sep 18 04:06:12.058085 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:12.057841    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j59zp"
Sep 18 04:06:12.058465 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:12.058124    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j59zp" podUID="6dc80677-6f9c-44fd-8d5f-e3c9f4846191"
Sep 18 04:06:14.058922 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:14.058005    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j59zp"
Sep 18 04:06:14.058922 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:14.058352    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j59zp" podUID="6dc80677-6f9c-44fd-8d5f-e3c9f4846191"
Sep 18 04:06:14.058922 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:14.058732    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z59z5"
Sep 18 04:06:14.058922 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:14.058813    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z59z5" podUID="395617a1-d084-4753-82d1-8dabf26dc416"
Sep 18 04:06:14.059529 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:14.059055    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zg942"
Sep 18 04:06:14.059529 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:14.059170    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zg942" podUID="2d169a38-932c-4d14-8a19-3ce5341fc190"
Sep 18 04:06:15.631914 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:15.631867    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6dc80677-6f9c-44fd-8d5f-e3c9f4846191-original-pull-secret\") pod \"global-pull-secret-syncer-j59zp\" (UID: \"6dc80677-6f9c-44fd-8d5f-e3c9f4846191\") " pod="kube-system/global-pull-secret-syncer-j59zp"
Sep 18 04:06:15.632368 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:15.632044    2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 04:06:15.632368 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:15.632106    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dc80677-6f9c-44fd-8d5f-e3c9f4846191-original-pull-secret podName:6dc80677-6f9c-44fd-8d5f-e3c9f4846191 nodeName:}" failed. No retries permitted until 2026-09-18 04:06:23.632087871 +0000 UTC m=+18.089530824 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6dc80677-6f9c-44fd-8d5f-e3c9f4846191-original-pull-secret") pod "global-pull-secret-syncer-j59zp" (UID: "6dc80677-6f9c-44fd-8d5f-e3c9f4846191") : object "kube-system"/"original-pull-secret" not registered
Sep 18 04:06:15.733227 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:15.733194    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d169a38-932c-4d14-8a19-3ce5341fc190-metrics-certs\") pod \"network-metrics-daemon-zg942\" (UID: \"2d169a38-932c-4d14-8a19-3ce5341fc190\") " pod="openshift-multus/network-metrics-daemon-zg942"
Sep 18 04:06:15.733418 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:15.733318    2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 04:06:15.733418 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:15.733385    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d169a38-932c-4d14-8a19-3ce5341fc190-metrics-certs podName:2d169a38-932c-4d14-8a19-3ce5341fc190 nodeName:}" failed. No retries permitted until 2026-09-18 04:06:23.733366766 +0000 UTC m=+18.190809727 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2d169a38-932c-4d14-8a19-3ce5341fc190-metrics-certs") pod "network-metrics-daemon-zg942" (UID: "2d169a38-932c-4d14-8a19-3ce5341fc190") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 04:06:15.834404 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:15.834315    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tl9sp\" (UniqueName: \"kubernetes.io/projected/395617a1-d084-4753-82d1-8dabf26dc416-kube-api-access-tl9sp\") pod \"network-check-target-z59z5\" (UID: \"395617a1-d084-4753-82d1-8dabf26dc416\") " pod="openshift-network-diagnostics/network-check-target-z59z5"
Sep 18 04:06:15.834560 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:15.834501    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 04:06:15.834560 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:15.834524    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 04:06:15.834560 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:15.834537    2585 projected.go:196] Error preparing data for projected volume kube-api-access-tl9sp for pod openshift-network-diagnostics/network-check-target-z59z5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 04:06:15.834710 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:15.834600    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/395617a1-d084-4753-82d1-8dabf26dc416-kube-api-access-tl9sp podName:395617a1-d084-4753-82d1-8dabf26dc416 nodeName:}" failed. No retries permitted until 2026-09-18 04:06:23.834581998 +0000 UTC m=+18.292024947 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-tl9sp" (UniqueName: "kubernetes.io/projected/395617a1-d084-4753-82d1-8dabf26dc416-kube-api-access-tl9sp") pod "network-check-target-z59z5" (UID: "395617a1-d084-4753-82d1-8dabf26dc416") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 04:06:16.056268 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:16.056188    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zg942"
Sep 18 04:06:16.056419 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:16.056325    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zg942" podUID="2d169a38-932c-4d14-8a19-3ce5341fc190"
Sep 18 04:06:16.056419 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:16.056384    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j59zp"
Sep 18 04:06:16.056535 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:16.056459    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j59zp" podUID="6dc80677-6f9c-44fd-8d5f-e3c9f4846191"
Sep 18 04:06:16.056535 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:16.056498    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z59z5"
Sep 18 04:06:16.056638 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:16.056567    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z59z5" podUID="395617a1-d084-4753-82d1-8dabf26dc416"
Sep 18 04:06:18.057593 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:18.056630    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j59zp"
Sep 18 04:06:18.057593 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:18.056654    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zg942"
Sep 18 04:06:18.057593 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:18.056630    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z59z5"
Sep 18 04:06:18.057593 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:18.056825    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j59zp" podUID="6dc80677-6f9c-44fd-8d5f-e3c9f4846191"
Sep 18 04:06:18.057593 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:18.057431    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zg942" podUID="2d169a38-932c-4d14-8a19-3ce5341fc190"
Sep 18 04:06:18.057593 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:18.057558    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z59z5" podUID="395617a1-d084-4753-82d1-8dabf26dc416"
Sep 18 04:06:20.056960 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:20.056927    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z59z5"
Sep 18 04:06:20.056960 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:20.056948    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zg942"
Sep 18 04:06:20.057475 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:20.057077    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zg942" podUID="2d169a38-932c-4d14-8a19-3ce5341fc190"
Sep 18 04:06:20.057475 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:20.057102    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j59zp"
Sep 18 04:06:20.057475 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:20.057203    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z59z5" podUID="395617a1-d084-4753-82d1-8dabf26dc416"
Sep 18 04:06:20.057475 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:20.057308    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j59zp" podUID="6dc80677-6f9c-44fd-8d5f-e3c9f4846191"
Sep 18 04:06:22.056998 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:22.056969    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j59zp"
Sep 18 04:06:22.057453 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:22.056968    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z59z5"
Sep 18 04:06:22.057453 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:22.057091    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j59zp" podUID="6dc80677-6f9c-44fd-8d5f-e3c9f4846191"
Sep 18 04:06:22.057453 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:22.056976    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zg942"
Sep 18 04:06:22.057453 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:22.057165    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z59z5" podUID="395617a1-d084-4753-82d1-8dabf26dc416"
Sep 18 04:06:22.057453 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:22.057251    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zg942" podUID="2d169a38-932c-4d14-8a19-3ce5341fc190"
Sep 18 04:06:23.690884 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:23.690842    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6dc80677-6f9c-44fd-8d5f-e3c9f4846191-original-pull-secret\") pod \"global-pull-secret-syncer-j59zp\" (UID: \"6dc80677-6f9c-44fd-8d5f-e3c9f4846191\") " pod="kube-system/global-pull-secret-syncer-j59zp"
Sep 18 04:06:23.691383 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:23.691018    2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 04:06:23.691383 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:23.691100    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dc80677-6f9c-44fd-8d5f-e3c9f4846191-original-pull-secret podName:6dc80677-6f9c-44fd-8d5f-e3c9f4846191 nodeName:}" failed. No retries permitted until 2026-09-18 04:06:39.69107867 +0000 UTC m=+34.148521619 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6dc80677-6f9c-44fd-8d5f-e3c9f4846191-original-pull-secret") pod "global-pull-secret-syncer-j59zp" (UID: "6dc80677-6f9c-44fd-8d5f-e3c9f4846191") : object "kube-system"/"original-pull-secret" not registered
Sep 18 04:06:23.792067 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:23.792033    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d169a38-932c-4d14-8a19-3ce5341fc190-metrics-certs\") pod \"network-metrics-daemon-zg942\" (UID: \"2d169a38-932c-4d14-8a19-3ce5341fc190\") " pod="openshift-multus/network-metrics-daemon-zg942"
Sep 18 04:06:23.792233 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:23.792195    2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 04:06:23.792293 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:23.792270    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d169a38-932c-4d14-8a19-3ce5341fc190-metrics-certs podName:2d169a38-932c-4d14-8a19-3ce5341fc190 nodeName:}" failed. No retries permitted until 2026-09-18 04:06:39.792248867 +0000 UTC m=+34.249691822 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2d169a38-932c-4d14-8a19-3ce5341fc190-metrics-certs") pod "network-metrics-daemon-zg942" (UID: "2d169a38-932c-4d14-8a19-3ce5341fc190") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 04:06:23.893225 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:23.893187    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tl9sp\" (UniqueName: \"kubernetes.io/projected/395617a1-d084-4753-82d1-8dabf26dc416-kube-api-access-tl9sp\") pod \"network-check-target-z59z5\" (UID: \"395617a1-d084-4753-82d1-8dabf26dc416\") " pod="openshift-network-diagnostics/network-check-target-z59z5"
Sep 18 04:06:23.893368 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:23.893321    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 04:06:23.893368 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:23.893336    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 04:06:23.893368 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:23.893346    2585 projected.go:196] Error preparing data for projected volume kube-api-access-tl9sp for pod openshift-network-diagnostics/network-check-target-z59z5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 04:06:23.893491 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:23.893393    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/395617a1-d084-4753-82d1-8dabf26dc416-kube-api-access-tl9sp podName:395617a1-d084-4753-82d1-8dabf26dc416 nodeName:}" failed. No retries permitted until 2026-09-18 04:06:39.893379548 +0000 UTC m=+34.350822494 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-tl9sp" (UniqueName: "kubernetes.io/projected/395617a1-d084-4753-82d1-8dabf26dc416-kube-api-access-tl9sp") pod "network-check-target-z59z5" (UID: "395617a1-d084-4753-82d1-8dabf26dc416") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 04:06:24.056332 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:24.056250    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z59z5"
Sep 18 04:06:24.056491 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:24.056250    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zg942"
Sep 18 04:06:24.056491 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:24.056377    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z59z5" podUID="395617a1-d084-4753-82d1-8dabf26dc416"
Sep 18 04:06:24.056491 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:24.056483    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zg942" podUID="2d169a38-932c-4d14-8a19-3ce5341fc190"
Sep 18 04:06:24.056640 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:24.056516    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j59zp"
Sep 18 04:06:24.056640 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:24.056591    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j59zp" podUID="6dc80677-6f9c-44fd-8d5f-e3c9f4846191"
Sep 18 04:06:26.057274 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:26.057243    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j59zp"
Sep 18 04:06:26.057675 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:26.057339    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zg942"
Sep 18 04:06:26.057675 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:26.057341    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j59zp" podUID="6dc80677-6f9c-44fd-8d5f-e3c9f4846191"
Sep 18 04:06:26.057675 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:26.057423    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zg942" podUID="2d169a38-932c-4d14-8a19-3ce5341fc190"
Sep 18 04:06:26.057675 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:26.057468    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z59z5"
Sep 18 04:06:26.057675 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:26.057526    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z59z5" podUID="395617a1-d084-4753-82d1-8dabf26dc416"
Sep 18 04:06:27.198768 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:27.198551    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-prm5t" event={"ID":"c4d1f628-59bf-4e95-92d5-84171d5e04e3","Type":"ContainerStarted","Data":"8b94878251df68efcd58f6eb1459a16292e3299a1c67999f17ea715345ea78e2"}
Sep 18 04:06:27.200283 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:27.200252    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vlxg" event={"ID":"c8cda828-9b0c-412e-8e40-d80abb0074f4","Type":"ContainerStarted","Data":"2c9bf37e9e9c700c9c6a058af5e2a6c4b721aabd8865ccc4f20c2caeb7d9908d"}
Sep 18 04:06:27.201821 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:27.201791    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sbmt7" event={"ID":"443bf4cf-26a5-47aa-beae-59373c9a9d89","Type":"ContainerStarted","Data":"a9665dc73413da5652710dc3bd90fd573b098a400b5fe7e7d2ecadb03f5eca1c"}
Sep 18 04:06:27.203281 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:27.203255    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pqmcs" event={"ID":"1c08324d-73f3-4f3b-909e-78d4c450e24b","Type":"ContainerStarted","Data":"875ddba5fc4f748f07acbd578a488648f1fb8aa93d1a9d1072483d6738c57b49"}
Sep 18 04:06:27.204911 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:27.204872    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-r47v5" event={"ID":"54309f7d-04d4-42f8-8ef3-de8d52091386","Type":"ContainerStarted","Data":"0a2e4879a3a9f6a0dc91571ba3d17f3c123a1606c6cff9fe693a9750b25ecc71"}
Sep 18 04:06:27.206661 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:27.206640    2585 generic.go:356] "Generic (PLEG): container finished" podID="dd11bf2c-ca30-45e3-811b-e7f912087184" containerID="bc9ee3cd29549da012b742cf401cb58ddc357de7e80404f69f19286df2795784" exitCode=0
Sep 18 04:06:27.206743 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:27.206702    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-snwbg" event={"ID":"dd11bf2c-ca30-45e3-811b-e7f912087184","Type":"ContainerDied","Data":"bc9ee3cd29549da012b742cf401cb58ddc357de7e80404f69f19286df2795784"}
Sep 18 04:06:27.208930 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:27.208892    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb" event={"ID":"cc11c9df-c3ad-4145-a5b0-a27f7225e599","Type":"ContainerStarted","Data":"ac3eb46ae0c020f528de5c957909580730eb8701251cff89e9ab63348220d918"}
Sep 18 04:06:27.209025 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:27.208971    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb" event={"ID":"cc11c9df-c3ad-4145-a5b0-a27f7225e599","Type":"ContainerStarted","Data":"85174f9797115b34c77ca3b08b1df7e4524b30175b7da122d387ddc9e2c6d33c"}
Sep 18 04:06:27.210497 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:27.210478    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fsb94" event={"ID":"eddb729c-9c21-4b4f-8306-5e475b718d65","Type":"ContainerStarted","Data":"c52a39be34aaa9b31c09643f94de48fb98508d2273cac65bc3d143a4ef021f1c"}
Sep 18 04:06:27.213329 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:27.213291    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-207.ec2.internal" podStartSLOduration=20.213280504 podStartE2EDuration="20.213280504s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 04:06:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:06:11.181780318 +0000 UTC m=+5.639223289" watchObservedRunningTime="2026-09-18 04:06:27.213280504 +0000 UTC m=+21.670723473"
Sep 18 04:06:27.213696 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:27.213670    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-prm5t" podStartSLOduration=11.019717623 podStartE2EDuration="21.213665098s" totalImagesPullingTime="10.193947475s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:06:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:06:27.213059348 +0000 UTC m=+21.670502320" watchObservedRunningTime="2026-09-18 04:06:27.213665098 +0000 UTC m=+21.671108081"
Sep 18 04:06:27.230440 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:27.230392    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-sbmt7" podStartSLOduration=3.466702143 podStartE2EDuration="21.23037248s" totalImagesPullingTime="17.763670337s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 04:06:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:06:27.229823296 +0000 UTC m=+21.687266265" watchObservedRunningTime="2026-09-18 04:06:27.23037248 +0000 UTC m=+21.687815450"
Sep 18 04:06:27.244554 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:27.244517    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-r47v5" podStartSLOduration=3.813493143 podStartE2EDuration="21.244505443s" totalImagesPullingTime="17.4310123s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 04:06:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:06:27.244156855 +0000 UTC m=+21.701599823" watchObservedRunningTime="2026-09-18 04:06:27.244505443 +0000 UTC m=+21.701948413"
Sep 18 04:06:27.286986 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:27.286947    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-fsb94" podStartSLOduration=3.623175541 podStartE2EDuration="21.286932734s" totalImagesPullingTime="17.663757193s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 04:06:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:06:27.286544097 +0000 UTC m=+21.743987066" watchObservedRunningTime="2026-09-18 04:06:27.286932734 +0000 UTC m=+21.744375743"
Sep 18 04:06:28.056907 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:28.056656    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j59zp"
Sep 18 04:06:28.057115 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:28.056656    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z59z5"
Sep 18 04:06:28.057115 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:28.057024    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j59zp" podUID="6dc80677-6f9c-44fd-8d5f-e3c9f4846191"
Sep 18 04:06:28.057115 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:28.056735    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zg942"
Sep 18 04:06:28.057115 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:28.057102    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z59z5" podUID="395617a1-d084-4753-82d1-8dabf26dc416"
Sep 18 04:06:28.057328 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:28.057201    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zg942" podUID="2d169a38-932c-4d14-8a19-3ce5341fc190"
Sep 18 04:06:28.204543 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:28.204511    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-prm5t"
Sep 18 04:06:28.205313 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:28.205295    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-prm5t"
Sep 18 04:06:28.216538 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:28.216513    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb" event={"ID":"cc11c9df-c3ad-4145-a5b0-a27f7225e599","Type":"ContainerStarted","Data":"3bbfe20b19127259d064dc61dfa76e78a7b3905a5dce40dda2c7605895630d18"}
Sep 18 04:06:28.216633 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:28.216574    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb" event={"ID":"cc11c9df-c3ad-4145-a5b0-a27f7225e599","Type":"ContainerStarted","Data":"0860b114d81644c1924de678a3d52ca6edfccb22fd93740ef879d124b61658f0"}
Sep 18 04:06:28.216633 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:28.216610    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb" event={"ID":"cc11c9df-c3ad-4145-a5b0-a27f7225e599","Type":"ContainerStarted","Data":"a3335bbd3b06c6084173219d4fa4584cbcc9eae581cc35569c8207713d70d043"}
Sep 18 04:06:28.216697 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:28.216637    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb" event={"ID":"cc11c9df-c3ad-4145-a5b0-a27f7225e599","Type":"ContainerStarted","Data":"92a2bbeddf418a65713b8bc3037d1cc505793ebffdbe159ea32fb2a199f867a6"}
Sep 18 04:06:28.220598 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:28.220562    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-pqmcs" podStartSLOduration=4.577024013 podStartE2EDuration="22.220550304s" totalImagesPullingTime="17.643526291s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 04:06:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:06:27.300554912 +0000 UTC m=+21.757997883" watchObservedRunningTime="2026-09-18 04:06:28.220550304 +0000 UTC m=+22.677993272"
Sep 18 04:06:28.540215 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:28.540175    2585 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 18 04:06:29.051448 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:29.051328    2585 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-18T04:06:28.540195229Z","UUID":"9bf0c5cf-c93f-49f8-9f96-a5285d30b4ee","Handler":null,"Name":"","Endpoint":""}
Sep 18 04:06:29.052687 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:29.052663    2585 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 18 04:06:29.052687 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:29.052691    2585 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 18 04:06:29.220559 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:29.220527    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-p9hks" event={"ID":"ebf95ef1-a64f-4c13-ad80-225816c94137","Type":"ContainerStarted","Data":"a3c44d4f50a93f8156c5d22d86b76b7695b01b560ea8ff4f5cea07f99e7986e5"}
Sep 18 04:06:29.222748 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:29.222728    2585 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 18 04:06:29.222748 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:29.222741    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vlxg" event={"ID":"c8cda828-9b0c-412e-8e40-d80abb0074f4","Type":"ContainerStarted","Data":"68ee47379727f87dddb2a37bc41b5737a217db0e63b82324bf69ea4ff0ba8c07"}
Sep 18 04:06:30.056587 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:30.056556    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j59zp"
Sep 18 04:06:30.056754 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:30.056560    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z59z5"
Sep 18 04:06:30.056754 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:30.056705    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zg942"
Sep 18 04:06:30.056838 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:30.056763    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z59z5" podUID="395617a1-d084-4753-82d1-8dabf26dc416"
Sep 18 04:06:30.056838 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:30.056680    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j59zp" podUID="6dc80677-6f9c-44fd-8d5f-e3c9f4846191"
Sep 18 04:06:30.056838 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:30.056830    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zg942" podUID="2d169a38-932c-4d14-8a19-3ce5341fc190"
Sep 18 04:06:30.230015 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:30.229939    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb" event={"ID":"cc11c9df-c3ad-4145-a5b0-a27f7225e599","Type":"ContainerStarted","Data":"f5493b2d7f6f8bf2a94ca5271cc0bab13326aec7c24ace67785baffc3f62e6d0"}
Sep 18 04:06:30.232483 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:30.232444    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vlxg" event={"ID":"c8cda828-9b0c-412e-8e40-d80abb0074f4","Type":"ContainerStarted","Data":"e9ef6daefbb0e56b41b9994c1ffa2c5d19c4e92ef888e7694f22c027bbdb7b40"}
Sep 18 04:06:30.250691 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:30.250646    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vlxg" podStartSLOduration=4.097654158 podStartE2EDuration="24.250632865s" totalImagesPullingTime="20.152978707s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 04:06:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:06:30.250377675 +0000 UTC m=+24.707820643" watchObservedRunningTime="2026-09-18 04:06:30.250632865 +0000 UTC m=+24.708075835"
Sep 18 04:06:30.250934 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:30.250915    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-p9hks" podStartSLOduration=6.823753064 podStartE2EDuration="24.250891968s" totalImagesPullingTime="17.427138904s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 04:06:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:06:29.235163613 +0000 UTC m=+23.692606584" watchObservedRunningTime="2026-09-18 04:06:30.250891968 +0000 UTC m=+24.708334937"
Sep 18 04:06:31.927078 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:31.927043    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-prm5t"
Sep 18 04:06:31.927519 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:31.927179    2585 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 18 04:06:31.927637 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:31.927616    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-prm5t"
Sep 18 04:06:32.057335 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:32.057061    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z59z5"
Sep 18 04:06:32.057502 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:32.057399    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z59z5" podUID="395617a1-d084-4753-82d1-8dabf26dc416"
Sep 18 04:06:32.057502 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:32.057167    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zg942"
Sep 18 04:06:32.057616 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:32.057509    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zg942" podUID="2d169a38-932c-4d14-8a19-3ce5341fc190"
Sep 18 04:06:32.057616 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:32.057063    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j59zp"
Sep 18 04:06:32.057616 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:32.057586    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j59zp" podUID="6dc80677-6f9c-44fd-8d5f-e3c9f4846191"
Sep 18 04:06:33.243336 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:33.243252    2585 generic.go:356] "Generic (PLEG): container finished" podID="dd11bf2c-ca30-45e3-811b-e7f912087184" containerID="8ee0d125a912be61523278d82942210a369b33774e9e09a0396aa09e68e90d12" exitCode=0
Sep 18 04:06:33.243336 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:33.243329    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-snwbg" event={"ID":"dd11bf2c-ca30-45e3-811b-e7f912087184","Type":"ContainerDied","Data":"8ee0d125a912be61523278d82942210a369b33774e9e09a0396aa09e68e90d12"}
Sep 18 04:06:33.247333 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:33.247293    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb" event={"ID":"cc11c9df-c3ad-4145-a5b0-a27f7225e599","Type":"ContainerStarted","Data":"1ec3265f22668f2ae0963cf3881b28311e2c26f8022c9799f2a5ae6f38cec76b"}
Sep 18 04:06:33.247541 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:33.247524    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb"
Sep 18 04:06:33.262674 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:33.262652    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb"
Sep 18 04:06:33.287891 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:33.287847    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb" podStartSLOduration=9.605892922 podStartE2EDuration="27.287833911s" totalImagesPullingTime="17.681940989s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 04:06:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:06:33.286706932 +0000 UTC m=+27.744149892" watchObservedRunningTime="2026-09-18 04:06:33.287833911 +0000 UTC m=+27.745276879"
Sep 18 04:06:34.059120 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:34.058955    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zg942"
Sep 18 04:06:34.059260 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:34.058995    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j59zp"
Sep 18 04:06:34.059260 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:34.059200    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zg942" podUID="2d169a38-932c-4d14-8a19-3ce5341fc190"
Sep 18 04:06:34.059260 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:34.059001    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z59z5"
Sep 18 04:06:34.059420 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:34.059259    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j59zp" podUID="6dc80677-6f9c-44fd-8d5f-e3c9f4846191"
Sep 18 04:06:34.059420 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:34.059364    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z59z5" podUID="395617a1-d084-4753-82d1-8dabf26dc416"
Sep 18 04:06:34.249525 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:34.249501    2585 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 18 04:06:34.249953 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:34.249929    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb"
Sep 18 04:06:34.264733 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:34.264709    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb"
Sep 18 04:06:34.473208 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:34.473089    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zg942"]
Sep 18 04:06:34.473366 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:34.473216    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zg942"
Sep 18 04:06:34.473366 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:34.473330    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zg942" podUID="2d169a38-932c-4d14-8a19-3ce5341fc190"
Sep 18 04:06:34.475636 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:34.475596    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-j59zp"]
Sep 18 04:06:34.475780 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:34.475698    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j59zp"
Sep 18 04:06:34.475842 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:34.475776    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j59zp" podUID="6dc80677-6f9c-44fd-8d5f-e3c9f4846191"
Sep 18 04:06:34.476307 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:34.476284    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-z59z5"]
Sep 18 04:06:34.476417 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:34.476362    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z59z5"
Sep 18 04:06:34.476473 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:34.476448    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z59z5" podUID="395617a1-d084-4753-82d1-8dabf26dc416"
Sep 18 04:06:35.253138 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:35.253057    2585 generic.go:356] "Generic (PLEG): container finished" podID="dd11bf2c-ca30-45e3-811b-e7f912087184" containerID="e431373de947ae975a494b22db3a5f9a236dcdfebd1834fd01ac74a24358d414" exitCode=0
Sep 18 04:06:35.253480 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:35.253147    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-snwbg" event={"ID":"dd11bf2c-ca30-45e3-811b-e7f912087184","Type":"ContainerDied","Data":"e431373de947ae975a494b22db3a5f9a236dcdfebd1834fd01ac74a24358d414"}
Sep 18 04:06:35.253480 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:35.253212    2585 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 18 04:06:35.434473 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:35.434446    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb"
Sep 18 04:06:36.058430 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:36.057956    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j59zp"
Sep 18 04:06:36.058430 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:36.057998    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z59z5"
Sep 18 04:06:36.058430 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:36.058074    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zg942"
Sep 18 04:06:36.058430 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:36.058173    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zg942" podUID="2d169a38-932c-4d14-8a19-3ce5341fc190"
Sep 18 04:06:36.058430 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:36.058067    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j59zp" podUID="6dc80677-6f9c-44fd-8d5f-e3c9f4846191"
Sep 18 04:06:36.058430 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:36.058279    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z59z5" podUID="395617a1-d084-4753-82d1-8dabf26dc416"
Sep 18 04:06:37.259818 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:37.259786    2585 generic.go:356] "Generic (PLEG): container finished" podID="dd11bf2c-ca30-45e3-811b-e7f912087184" containerID="3bbb52586b5abdd18e3598c2a98893923468707984b8c2189274355e6e3f8688" exitCode=0
Sep 18 04:06:37.260275 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:37.259870    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-snwbg" event={"ID":"dd11bf2c-ca30-45e3-811b-e7f912087184","Type":"ContainerDied","Data":"3bbb52586b5abdd18e3598c2a98893923468707984b8c2189274355e6e3f8688"}
Sep 18 04:06:37.270204 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:37.270171    2585 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb" podUID="cc11c9df-c3ad-4145-a5b0-a27f7225e599" containerName="ovnkube-controller" probeResult="failure" output=""
Sep 18 04:06:38.056370 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:38.056333    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j59zp"
Sep 18 04:06:38.056558 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:38.056333    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zg942"
Sep 18 04:06:38.056558 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:38.056333    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z59z5"
Sep 18 04:06:38.056663 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:38.056553    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zg942" podUID="2d169a38-932c-4d14-8a19-3ce5341fc190"
Sep 18 04:06:38.056663 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:38.056458    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j59zp" podUID="6dc80677-6f9c-44fd-8d5f-e3c9f4846191"
Sep 18 04:06:38.056744 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:38.056658    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z59z5" podUID="395617a1-d084-4753-82d1-8dabf26dc416"
Sep 18 04:06:39.705299 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:39.705089    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6dc80677-6f9c-44fd-8d5f-e3c9f4846191-original-pull-secret\") pod \"global-pull-secret-syncer-j59zp\" (UID: \"6dc80677-6f9c-44fd-8d5f-e3c9f4846191\") " pod="kube-system/global-pull-secret-syncer-j59zp"
Sep 18 04:06:39.705656 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:39.705226    2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 04:06:39.705656 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:39.705356    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dc80677-6f9c-44fd-8d5f-e3c9f4846191-original-pull-secret podName:6dc80677-6f9c-44fd-8d5f-e3c9f4846191 nodeName:}" failed. No retries permitted until 2026-09-18 04:07:11.705342149 +0000 UTC m=+66.162785109 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6dc80677-6f9c-44fd-8d5f-e3c9f4846191-original-pull-secret") pod "global-pull-secret-syncer-j59zp" (UID: "6dc80677-6f9c-44fd-8d5f-e3c9f4846191") : object "kube-system"/"original-pull-secret" not registered
Sep 18 04:06:39.806740 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:39.806709    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d169a38-932c-4d14-8a19-3ce5341fc190-metrics-certs\") pod \"network-metrics-daemon-zg942\" (UID: \"2d169a38-932c-4d14-8a19-3ce5341fc190\") " pod="openshift-multus/network-metrics-daemon-zg942"
Sep 18 04:06:39.806908 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:39.806868    2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 04:06:39.807038 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:39.806957    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d169a38-932c-4d14-8a19-3ce5341fc190-metrics-certs podName:2d169a38-932c-4d14-8a19-3ce5341fc190 nodeName:}" failed. No retries permitted until 2026-09-18 04:07:11.806937021 +0000 UTC m=+66.264379971 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2d169a38-932c-4d14-8a19-3ce5341fc190-metrics-certs") pod "network-metrics-daemon-zg942" (UID: "2d169a38-932c-4d14-8a19-3ce5341fc190") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 04:06:39.896442 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:39.896414    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-207.ec2.internal" event="NodeReady"
Sep 18 04:06:39.896612 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:39.896549    2585 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 18 04:06:39.907770 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:39.907743    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tl9sp\" (UniqueName: \"kubernetes.io/projected/395617a1-d084-4753-82d1-8dabf26dc416-kube-api-access-tl9sp\") pod \"network-check-target-z59z5\" (UID: \"395617a1-d084-4753-82d1-8dabf26dc416\") " pod="openshift-network-diagnostics/network-check-target-z59z5"
Sep 18 04:06:39.907950 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:39.907928    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 04:06:39.908027 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:39.907954    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 04:06:39.908027 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:39.907968    2585 projected.go:196] Error preparing data for projected volume kube-api-access-tl9sp for pod openshift-network-diagnostics/network-check-target-z59z5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 04:06:39.908112 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:39.908027    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/395617a1-d084-4753-82d1-8dabf26dc416-kube-api-access-tl9sp podName:395617a1-d084-4753-82d1-8dabf26dc416 nodeName:}" failed. No retries permitted until 2026-09-18 04:07:11.908008196 +0000 UTC m=+66.365451146 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-tl9sp" (UniqueName: "kubernetes.io/projected/395617a1-d084-4753-82d1-8dabf26dc416-kube-api-access-tl9sp") pod "network-check-target-z59z5" (UID: "395617a1-d084-4753-82d1-8dabf26dc416") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 04:06:39.933721 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:39.933693    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-779df66775-8dkzt"]
Sep 18 04:06:39.937468 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:39.937448    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-779df66775-8dkzt"
Sep 18 04:06:39.939633 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:39.939613    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 18 04:06:39.939741 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:39.939685    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-k8q5g\""
Sep 18 04:06:39.939741 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:39.939735    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 18 04:06:39.939966 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:39.939950    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 18 04:06:39.945207 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:39.945187    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 18 04:06:39.952001 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:39.951888    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-779df66775-8dkzt"]
Sep 18 04:06:39.954333 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:39.954294    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-5rpl9"]
Sep 18 04:06:39.958234 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:39.958194    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-swf4q"]
Sep 18 04:06:39.958336 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:39.958311    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5rpl9"
Sep 18 04:06:39.960373 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:39.960356    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 18 04:06:39.960450 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:39.960420    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6pwqr\""
Sep 18 04:06:39.960497 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:39.960469    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 18 04:06:39.962310 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:39.962280    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5rpl9"]
Sep 18 04:06:39.962408 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:39.962395    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-swf4q"
Sep 18 04:06:39.964620 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:39.964380    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 18 04:06:39.964620 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:39.964394    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 18 04:06:39.964620 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:39.964522    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 18 04:06:39.964620 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:39.964531    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-rfxrq\""
Sep 18 04:06:39.973398 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:39.973382    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-swf4q"]
Sep 18 04:06:40.008392 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:40.008358    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4c93f80c-45eb-481b-bacd-3e6749ed93c8-image-registry-private-configuration\") pod \"image-registry-779df66775-8dkzt\" (UID: \"4c93f80c-45eb-481b-bacd-3e6749ed93c8\") " pod="openshift-image-registry/image-registry-779df66775-8dkzt"
Sep 18 04:06:40.008570 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:40.008411    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4c93f80c-45eb-481b-bacd-3e6749ed93c8-installation-pull-secrets\") pod \"image-registry-779df66775-8dkzt\" (UID: \"4c93f80c-45eb-481b-bacd-3e6749ed93c8\") " pod="openshift-image-registry/image-registry-779df66775-8dkzt"
Sep 18 04:06:40.008570 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:40.008440    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4c93f80c-45eb-481b-bacd-3e6749ed93c8-registry-certificates\") pod \"image-registry-779df66775-8dkzt\" (UID: \"4c93f80c-45eb-481b-bacd-3e6749ed93c8\") " pod="openshift-image-registry/image-registry-779df66775-8dkzt"
Sep 18 04:06:40.008570 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:40.008464    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4c93f80c-45eb-481b-bacd-3e6749ed93c8-ca-trust-extracted\") pod \"image-registry-779df66775-8dkzt\" (UID: \"4c93f80c-45eb-481b-bacd-3e6749ed93c8\") " pod="openshift-image-registry/image-registry-779df66775-8dkzt"
Sep 18 04:06:40.008570 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:40.008490    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4c93f80c-45eb-481b-bacd-3e6749ed93c8-bound-sa-token\") pod \"image-registry-779df66775-8dkzt\" (UID: \"4c93f80c-45eb-481b-bacd-3e6749ed93c8\") " pod="openshift-image-registry/image-registry-779df66775-8dkzt"
Sep 18 04:06:40.008570 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:40.008556    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7m7kj\" (UniqueName: \"kubernetes.io/projected/4c93f80c-45eb-481b-bacd-3e6749ed93c8-kube-api-access-7m7kj\") pod \"image-registry-779df66775-8dkzt\" (UID: \"4c93f80c-45eb-481b-bacd-3e6749ed93c8\") " pod="openshift-image-registry/image-registry-779df66775-8dkzt"
Sep 18 04:06:40.008787 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:40.008633    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4c93f80c-45eb-481b-bacd-3e6749ed93c8-trusted-ca\") pod \"image-registry-779df66775-8dkzt\" (UID: \"4c93f80c-45eb-481b-bacd-3e6749ed93c8\") " pod="openshift-image-registry/image-registry-779df66775-8dkzt"
Sep 18 04:06:40.008787 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:40.008673    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4c93f80c-45eb-481b-bacd-3e6749ed93c8-registry-tls\") pod \"image-registry-779df66775-8dkzt\" (UID: \"4c93f80c-45eb-481b-bacd-3e6749ed93c8\") " pod="openshift-image-registry/image-registry-779df66775-8dkzt"
Sep 18 04:06:40.056333 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:40.056305    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z59z5"
Sep 18 04:06:40.056333 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:40.056321    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zg942"
Sep 18 04:06:40.056734 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:40.056582    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j59zp"
Sep 18 04:06:40.059346 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:40.059177    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 18 04:06:40.059346 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:40.059222    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 18 04:06:40.059346 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:40.059229    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 18 04:06:40.059346 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:40.059267    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cw2bm\""
Sep 18 04:06:40.059346 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:40.059178    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mt76n\""
Sep 18 04:06:40.059610 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:40.059507    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 18 04:06:40.109365 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:40.109338    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4c93f80c-45eb-481b-bacd-3e6749ed93c8-registry-certificates\") pod \"image-registry-779df66775-8dkzt\" (UID: \"4c93f80c-45eb-481b-bacd-3e6749ed93c8\") " pod="openshift-image-registry/image-registry-779df66775-8dkzt"
Sep 18 04:06:40.109489 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:40.109380    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4c93f80c-45eb-481b-bacd-3e6749ed93c8-ca-trust-extracted\") pod \"image-registry-779df66775-8dkzt\" (UID: \"4c93f80c-45eb-481b-bacd-3e6749ed93c8\") " pod="openshift-image-registry/image-registry-779df66775-8dkzt"
Sep 18 04:06:40.109552 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:40.109500    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4c93f80c-45eb-481b-bacd-3e6749ed93c8-bound-sa-token\") pod \"image-registry-779df66775-8dkzt\" (UID: \"4c93f80c-45eb-481b-bacd-3e6749ed93c8\") " pod="openshift-image-registry/image-registry-779df66775-8dkzt"
Sep 18 04:06:40.109552 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:40.109537    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ec3a850b-db56-49b6-a2b7-3dc5b64b9d4f-cert\") pod \"ingress-canary-swf4q\" (UID: \"ec3a850b-db56-49b6-a2b7-3dc5b64b9d4f\") " pod="openshift-ingress-canary/ingress-canary-swf4q"
Sep 18 04:06:40.109651 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:40.109567    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7m7kj\" (UniqueName: \"kubernetes.io/projected/4c93f80c-45eb-481b-bacd-3e6749ed93c8-kube-api-access-7m7kj\") pod \"image-registry-779df66775-8dkzt\" (UID: \"4c93f80c-45eb-481b-bacd-3e6749ed93c8\") " pod="openshift-image-registry/image-registry-779df66775-8dkzt"
Sep 18 04:06:40.109651 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:40.109596    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4c93f80c-45eb-481b-bacd-3e6749ed93c8-trusted-ca\") pod \"image-registry-779df66775-8dkzt\" (UID: \"4c93f80c-45eb-481b-bacd-3e6749ed93c8\") " pod="openshift-image-registry/image-registry-779df66775-8dkzt"
Sep 18 04:06:40.109651 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:40.109620    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nw6vb\" (UniqueName: \"kubernetes.io/projected/ec3a850b-db56-49b6-a2b7-3dc5b64b9d4f-kube-api-access-nw6vb\") pod \"ingress-canary-swf4q\" (UID: \"ec3a850b-db56-49b6-a2b7-3dc5b64b9d4f\") " pod="openshift-ingress-canary/ingress-canary-swf4q"
Sep 18 04:06:40.109651 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:40.109643    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1004a663-1296-428b-838a-72dd37ad0e10-tmp-dir\") pod \"dns-default-5rpl9\" (UID: \"1004a663-1296-428b-838a-72dd37ad0e10\") " pod="openshift-dns/dns-default-5rpl9"
Sep 18 04:06:40.109838 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:40.109672    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4c93f80c-45eb-481b-bacd-3e6749ed93c8-registry-tls\") pod \"image-registry-779df66775-8dkzt\" (UID: \"4c93f80c-45eb-481b-bacd-3e6749ed93c8\") " pod="openshift-image-registry/image-registry-779df66775-8dkzt"
Sep 18 04:06:40.109838 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:40.109700    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1004a663-1296-428b-838a-72dd37ad0e10-metrics-tls\") pod \"dns-default-5rpl9\" (UID: \"1004a663-1296-428b-838a-72dd37ad0e10\") " pod="openshift-dns/dns-default-5rpl9"
Sep 18 04:06:40.109838 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:40.109728    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6sjll\" (UniqueName: \"kubernetes.io/projected/1004a663-1296-428b-838a-72dd37ad0e10-kube-api-access-6sjll\") pod \"dns-default-5rpl9\" (UID: \"1004a663-1296-428b-838a-72dd37ad0e10\") " pod="openshift-dns/dns-default-5rpl9"
Sep 18 04:06:40.109838 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:40.109798    2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 18 04:06:40.109838 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:40.109809    2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-779df66775-8dkzt: secret "image-registry-tls" not found
Sep 18 04:06:40.110094 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:40.109796    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4c93f80c-45eb-481b-bacd-3e6749ed93c8-ca-trust-extracted\") pod \"image-registry-779df66775-8dkzt\" (UID: \"4c93f80c-45eb-481b-bacd-3e6749ed93c8\") " pod="openshift-image-registry/image-registry-779df66775-8dkzt"
Sep 18 04:06:40.110094 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:40.109860    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4c93f80c-45eb-481b-bacd-3e6749ed93c8-registry-tls podName:4c93f80c-45eb-481b-bacd-3e6749ed93c8 nodeName:}" failed. No retries permitted until 2026-09-18 04:06:40.60984702 +0000 UTC m=+35.067289967 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4c93f80c-45eb-481b-bacd-3e6749ed93c8-registry-tls") pod "image-registry-779df66775-8dkzt" (UID: "4c93f80c-45eb-481b-bacd-3e6749ed93c8") : secret "image-registry-tls" not found
Sep 18 04:06:40.110094 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:40.109925    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1004a663-1296-428b-838a-72dd37ad0e10-config-volume\") pod \"dns-default-5rpl9\" (UID: \"1004a663-1296-428b-838a-72dd37ad0e10\") " pod="openshift-dns/dns-default-5rpl9"
Sep 18 04:06:40.110094 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:40.110004    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4c93f80c-45eb-481b-bacd-3e6749ed93c8-image-registry-private-configuration\") pod \"image-registry-779df66775-8dkzt\" (UID: \"4c93f80c-45eb-481b-bacd-3e6749ed93c8\") " pod="openshift-image-registry/image-registry-779df66775-8dkzt"
Sep 18 04:06:40.110094 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:40.110019    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4c93f80c-45eb-481b-bacd-3e6749ed93c8-registry-certificates\") pod \"image-registry-779df66775-8dkzt\" (UID: \"4c93f80c-45eb-481b-bacd-3e6749ed93c8\") " pod="openshift-image-registry/image-registry-779df66775-8dkzt"
Sep 18 04:06:40.110094 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:40.110034    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4c93f80c-45eb-481b-bacd-3e6749ed93c8-installation-pull-secrets\") pod \"image-registry-779df66775-8dkzt\" (UID: \"4c93f80c-45eb-481b-bacd-3e6749ed93c8\") " pod="openshift-image-registry/image-registry-779df66775-8dkzt"
Sep 18 04:06:40.110655 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:40.110637    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4c93f80c-45eb-481b-bacd-3e6749ed93c8-trusted-ca\") pod \"image-registry-779df66775-8dkzt\" (UID: \"4c93f80c-45eb-481b-bacd-3e6749ed93c8\") " pod="openshift-image-registry/image-registry-779df66775-8dkzt"
Sep 18 04:06:40.114356 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:40.114335    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4c93f80c-45eb-481b-bacd-3e6749ed93c8-installation-pull-secrets\") pod \"image-registry-779df66775-8dkzt\" (UID: \"4c93f80c-45eb-481b-bacd-3e6749ed93c8\") " pod="openshift-image-registry/image-registry-779df66775-8dkzt"
Sep 18 04:06:40.114466 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:40.114357    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4c93f80c-45eb-481b-bacd-3e6749ed93c8-image-registry-private-configuration\") pod \"image-registry-779df66775-8dkzt\" (UID: \"4c93f80c-45eb-481b-bacd-3e6749ed93c8\") " pod="openshift-image-registry/image-registry-779df66775-8dkzt"
Sep 18 04:06:40.118076 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:40.118051    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4c93f80c-45eb-481b-bacd-3e6749ed93c8-bound-sa-token\") pod \"image-registry-779df66775-8dkzt\" (UID: \"4c93f80c-45eb-481b-bacd-3e6749ed93c8\") " pod="openshift-image-registry/image-registry-779df66775-8dkzt"
Sep 18 04:06:40.118149 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:40.118124    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7m7kj\" (UniqueName: \"kubernetes.io/projected/4c93f80c-45eb-481b-bacd-3e6749ed93c8-kube-api-access-7m7kj\") pod \"image-registry-779df66775-8dkzt\" (UID: \"4c93f80c-45eb-481b-bacd-3e6749ed93c8\") " pod="openshift-image-registry/image-registry-779df66775-8dkzt"
Sep 18 04:06:40.211284 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:40.211204    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ec3a850b-db56-49b6-a2b7-3dc5b64b9d4f-cert\") pod \"ingress-canary-swf4q\" (UID: \"ec3a850b-db56-49b6-a2b7-3dc5b64b9d4f\") " pod="openshift-ingress-canary/ingress-canary-swf4q"
Sep 18 04:06:40.211284 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:40.211243    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nw6vb\" (UniqueName: \"kubernetes.io/projected/ec3a850b-db56-49b6-a2b7-3dc5b64b9d4f-kube-api-access-nw6vb\") pod \"ingress-canary-swf4q\" (UID: \"ec3a850b-db56-49b6-a2b7-3dc5b64b9d4f\") " pod="openshift-ingress-canary/ingress-canary-swf4q"
Sep 18 04:06:40.211284 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:40.211259    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1004a663-1296-428b-838a-72dd37ad0e10-tmp-dir\") pod \"dns-default-5rpl9\" (UID: \"1004a663-1296-428b-838a-72dd37ad0e10\") " pod="openshift-dns/dns-default-5rpl9"
Sep 18 04:06:40.211557 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:40.211295    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1004a663-1296-428b-838a-72dd37ad0e10-metrics-tls\") pod \"dns-default-5rpl9\" (UID: \"1004a663-1296-428b-838a-72dd37ad0e10\") " pod="openshift-dns/dns-default-5rpl9"
Sep 18 04:06:40.211557 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:40.211313    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6sjll\" (UniqueName: \"kubernetes.io/projected/1004a663-1296-428b-838a-72dd37ad0e10-kube-api-access-6sjll\") pod \"dns-default-5rpl9\" (UID: \"1004a663-1296-428b-838a-72dd37ad0e10\") " pod="openshift-dns/dns-default-5rpl9"
Sep 18 04:06:40.211557 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:40.211337    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1004a663-1296-428b-838a-72dd37ad0e10-config-volume\") pod \"dns-default-5rpl9\" (UID: \"1004a663-1296-428b-838a-72dd37ad0e10\") " pod="openshift-dns/dns-default-5rpl9"
Sep 18 04:06:40.211557 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:40.211414    2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 04:06:40.211557 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:40.211473    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1004a663-1296-428b-838a-72dd37ad0e10-metrics-tls podName:1004a663-1296-428b-838a-72dd37ad0e10 nodeName:}" failed. No retries permitted until 2026-09-18 04:06:40.71145284 +0000 UTC m=+35.168895788 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1004a663-1296-428b-838a-72dd37ad0e10-metrics-tls") pod "dns-default-5rpl9" (UID: "1004a663-1296-428b-838a-72dd37ad0e10") : secret "dns-default-metrics-tls" not found
Sep 18 04:06:40.211817 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:40.211663    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1004a663-1296-428b-838a-72dd37ad0e10-tmp-dir\") pod \"dns-default-5rpl9\" (UID: \"1004a663-1296-428b-838a-72dd37ad0e10\") " pod="openshift-dns/dns-default-5rpl9"
Sep 18 04:06:40.211863 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:40.211845    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1004a663-1296-428b-838a-72dd37ad0e10-config-volume\") pod \"dns-default-5rpl9\" (UID: \"1004a663-1296-428b-838a-72dd37ad0e10\") " pod="openshift-dns/dns-default-5rpl9"
Sep 18 04:06:40.213671 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:40.213648    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ec3a850b-db56-49b6-a2b7-3dc5b64b9d4f-cert\") pod \"ingress-canary-swf4q\" (UID: \"ec3a850b-db56-49b6-a2b7-3dc5b64b9d4f\") " pod="openshift-ingress-canary/ingress-canary-swf4q"
Sep 18 04:06:40.219462 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:40.219440    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6sjll\" (UniqueName: \"kubernetes.io/projected/1004a663-1296-428b-838a-72dd37ad0e10-kube-api-access-6sjll\") pod \"dns-default-5rpl9\" (UID: \"1004a663-1296-428b-838a-72dd37ad0e10\") " pod="openshift-dns/dns-default-5rpl9"
Sep 18 04:06:40.219581 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:40.219563    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nw6vb\" (UniqueName: \"kubernetes.io/projected/ec3a850b-db56-49b6-a2b7-3dc5b64b9d4f-kube-api-access-nw6vb\") pod \"ingress-canary-swf4q\" (UID: \"ec3a850b-db56-49b6-a2b7-3dc5b64b9d4f\") " pod="openshift-ingress-canary/ingress-canary-swf4q"
Sep 18 04:06:40.273708 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:40.273679    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-swf4q"
Sep 18 04:06:40.554547 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:40.554473    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-swf4q"]
Sep 18 04:06:40.558274 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:06:40.558248    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec3a850b_db56_49b6_a2b7_3dc5b64b9d4f.slice/crio-37895c0bc1b43cc17ba610ff6f9d5b15d216c4e0ae041fc59a5be90b3812cbda WatchSource:0}: Error finding container 37895c0bc1b43cc17ba610ff6f9d5b15d216c4e0ae041fc59a5be90b3812cbda: Status 404 returned error can't find the container with id 37895c0bc1b43cc17ba610ff6f9d5b15d216c4e0ae041fc59a5be90b3812cbda
Sep 18 04:06:40.614388 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:40.614362    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4c93f80c-45eb-481b-bacd-3e6749ed93c8-registry-tls\") pod \"image-registry-779df66775-8dkzt\" (UID: \"4c93f80c-45eb-481b-bacd-3e6749ed93c8\") " pod="openshift-image-registry/image-registry-779df66775-8dkzt"
Sep 18 04:06:40.614550 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:40.614520    2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 18 04:06:40.614550 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:40.614546    2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-779df66775-8dkzt: secret "image-registry-tls" not found
Sep 18 04:06:40.614703 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:40.614604    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4c93f80c-45eb-481b-bacd-3e6749ed93c8-registry-tls podName:4c93f80c-45eb-481b-bacd-3e6749ed93c8 nodeName:}" failed. No retries permitted until 2026-09-18 04:06:41.614585208 +0000 UTC m=+36.072028154 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4c93f80c-45eb-481b-bacd-3e6749ed93c8-registry-tls") pod "image-registry-779df66775-8dkzt" (UID: "4c93f80c-45eb-481b-bacd-3e6749ed93c8") : secret "image-registry-tls" not found
Sep 18 04:06:40.715273 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:40.715243    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1004a663-1296-428b-838a-72dd37ad0e10-metrics-tls\") pod \"dns-default-5rpl9\" (UID: \"1004a663-1296-428b-838a-72dd37ad0e10\") " pod="openshift-dns/dns-default-5rpl9"
Sep 18 04:06:40.716094 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:40.715415    2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 04:06:40.716094 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:40.715485    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1004a663-1296-428b-838a-72dd37ad0e10-metrics-tls podName:1004a663-1296-428b-838a-72dd37ad0e10 nodeName:}" failed. No retries permitted until 2026-09-18 04:06:41.715465965 +0000 UTC m=+36.172908932 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1004a663-1296-428b-838a-72dd37ad0e10-metrics-tls") pod "dns-default-5rpl9" (UID: "1004a663-1296-428b-838a-72dd37ad0e10") : secret "dns-default-metrics-tls" not found
Sep 18 04:06:41.272535 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:41.272494    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-swf4q" event={"ID":"ec3a850b-db56-49b6-a2b7-3dc5b64b9d4f","Type":"ContainerStarted","Data":"37895c0bc1b43cc17ba610ff6f9d5b15d216c4e0ae041fc59a5be90b3812cbda"}
Sep 18 04:06:41.622791 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:41.622703    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4c93f80c-45eb-481b-bacd-3e6749ed93c8-registry-tls\") pod \"image-registry-779df66775-8dkzt\" (UID: \"4c93f80c-45eb-481b-bacd-3e6749ed93c8\") " pod="openshift-image-registry/image-registry-779df66775-8dkzt"
Sep 18 04:06:41.622958 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:41.622861    2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 18 04:06:41.622958 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:41.622877    2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-779df66775-8dkzt: secret "image-registry-tls" not found
Sep 18 04:06:41.622958 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:41.622948    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4c93f80c-45eb-481b-bacd-3e6749ed93c8-registry-tls podName:4c93f80c-45eb-481b-bacd-3e6749ed93c8 nodeName:}" failed. No retries permitted until 2026-09-18 04:06:43.62293068 +0000 UTC m=+38.080373634 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4c93f80c-45eb-481b-bacd-3e6749ed93c8-registry-tls") pod "image-registry-779df66775-8dkzt" (UID: "4c93f80c-45eb-481b-bacd-3e6749ed93c8") : secret "image-registry-tls" not found
Sep 18 04:06:41.724067 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:41.724028    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1004a663-1296-428b-838a-72dd37ad0e10-metrics-tls\") pod \"dns-default-5rpl9\" (UID: \"1004a663-1296-428b-838a-72dd37ad0e10\") " pod="openshift-dns/dns-default-5rpl9"
Sep 18 04:06:41.724518 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:41.724162    2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 04:06:41.724518 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:41.724233    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1004a663-1296-428b-838a-72dd37ad0e10-metrics-tls podName:1004a663-1296-428b-838a-72dd37ad0e10 nodeName:}" failed. No retries permitted until 2026-09-18 04:06:43.724214377 +0000 UTC m=+38.181657329 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1004a663-1296-428b-838a-72dd37ad0e10-metrics-tls") pod "dns-default-5rpl9" (UID: "1004a663-1296-428b-838a-72dd37ad0e10") : secret "dns-default-metrics-tls" not found
Sep 18 04:06:43.640119 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:43.639934    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4c93f80c-45eb-481b-bacd-3e6749ed93c8-registry-tls\") pod \"image-registry-779df66775-8dkzt\" (UID: \"4c93f80c-45eb-481b-bacd-3e6749ed93c8\") " pod="openshift-image-registry/image-registry-779df66775-8dkzt"
Sep 18 04:06:43.640470 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:43.640099    2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 18 04:06:43.640470 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:43.640184    2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-779df66775-8dkzt: secret "image-registry-tls" not found
Sep 18 04:06:43.640470 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:43.640236    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4c93f80c-45eb-481b-bacd-3e6749ed93c8-registry-tls podName:4c93f80c-45eb-481b-bacd-3e6749ed93c8 nodeName:}" failed. No retries permitted until 2026-09-18 04:06:47.640222837 +0000 UTC m=+42.097665784 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4c93f80c-45eb-481b-bacd-3e6749ed93c8-registry-tls") pod "image-registry-779df66775-8dkzt" (UID: "4c93f80c-45eb-481b-bacd-3e6749ed93c8") : secret "image-registry-tls" not found
Sep 18 04:06:43.741307 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:43.741275    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1004a663-1296-428b-838a-72dd37ad0e10-metrics-tls\") pod \"dns-default-5rpl9\" (UID: \"1004a663-1296-428b-838a-72dd37ad0e10\") " pod="openshift-dns/dns-default-5rpl9"
Sep 18 04:06:43.741432 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:43.741384    2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 04:06:43.741477 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:43.741434    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1004a663-1296-428b-838a-72dd37ad0e10-metrics-tls podName:1004a663-1296-428b-838a-72dd37ad0e10 nodeName:}" failed. No retries permitted until 2026-09-18 04:06:47.741422342 +0000 UTC m=+42.198865289 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1004a663-1296-428b-838a-72dd37ad0e10-metrics-tls") pod "dns-default-5rpl9" (UID: "1004a663-1296-428b-838a-72dd37ad0e10") : secret "dns-default-metrics-tls" not found
Sep 18 04:06:44.283328 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:44.283287    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-snwbg" event={"ID":"dd11bf2c-ca30-45e3-811b-e7f912087184","Type":"ContainerStarted","Data":"a113b75d45e4fccf0920b0b68cdf94ba79404b3f871c628ff5fa715ad5e20d1c"}
Sep 18 04:06:44.284958 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:44.284931    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-swf4q" event={"ID":"ec3a850b-db56-49b6-a2b7-3dc5b64b9d4f","Type":"ContainerStarted","Data":"48358d4a42b5fc35f948ced592819bcdd438a465b3925d754398ec99da7bb73b"}
Sep 18 04:06:44.323236 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:44.323106    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-swf4q" podStartSLOduration=1.755008755 podStartE2EDuration="5.323082623s" totalImagesPullingTime="3.568073868s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:06:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:06:44.322393867 +0000 UTC m=+38.779836836" watchObservedRunningTime="2026-09-18 04:06:44.323082623 +0000 UTC m=+38.780525593"
Sep 18 04:06:44.683471 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:44.683395    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:06:44.787289 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:44.787253    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:06:44.862836 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:44.862799    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:06:44.932329 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:44.932303    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:06:44.991104 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:44.991043    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:06:45.049622 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:45.049589    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:06:45.289533 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:45.289463    2585 generic.go:356] "Generic (PLEG): container finished" podID="dd11bf2c-ca30-45e3-811b-e7f912087184" containerID="a113b75d45e4fccf0920b0b68cdf94ba79404b3f871c628ff5fa715ad5e20d1c" exitCode=0
Sep 18 04:06:45.289657 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:45.289556    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-snwbg" event={"ID":"dd11bf2c-ca30-45e3-811b-e7f912087184","Type":"ContainerDied","Data":"a113b75d45e4fccf0920b0b68cdf94ba79404b3f871c628ff5fa715ad5e20d1c"}
Sep 18 04:06:45.607634 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:45.607555    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:06:45.664193 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:45.664164    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:06:46.009460 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:46.009357    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:06:46.082624 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:46.082588    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:06:46.297009 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:46.296931    2585 generic.go:356] "Generic (PLEG): container finished" podID="dd11bf2c-ca30-45e3-811b-e7f912087184" containerID="ff155ce2490dd1ff22867e047118cd9c0a714f0bb378c931e03d1b8caec1d561" exitCode=0
Sep 18 04:06:46.297009 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:46.296967    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-snwbg" event={"ID":"dd11bf2c-ca30-45e3-811b-e7f912087184","Type":"ContainerDied","Data":"ff155ce2490dd1ff22867e047118cd9c0a714f0bb378c931e03d1b8caec1d561"}
Sep 18 04:06:47.302491 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:47.302456    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-snwbg" event={"ID":"dd11bf2c-ca30-45e3-811b-e7f912087184","Type":"ContainerStarted","Data":"08a7bc1951e84b2e521359608d260488dba67bf86af0391d3a7c7499e6741a9d"}
Sep 18 04:06:47.323451 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:47.323338    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-snwbg" podStartSLOduration=8.851328699 podStartE2EDuration="41.323320807s" totalImagesPullingTime="32.471992108s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 04:06:06 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:06:47.322253607 +0000 UTC m=+41.779696599" watchObservedRunningTime="2026-09-18 04:06:47.323320807 +0000 UTC m=+41.780763776"
Sep 18 04:06:47.443429 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:47.443382    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:06:47.672689 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:47.672602    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4c93f80c-45eb-481b-bacd-3e6749ed93c8-registry-tls\") pod \"image-registry-779df66775-8dkzt\" (UID: \"4c93f80c-45eb-481b-bacd-3e6749ed93c8\") " pod="openshift-image-registry/image-registry-779df66775-8dkzt"
Sep 18 04:06:47.672878 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:47.672746    2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 18 04:06:47.672878 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:47.672766    2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-779df66775-8dkzt: secret "image-registry-tls" not found
Sep 18 04:06:47.672878 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:47.672819    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4c93f80c-45eb-481b-bacd-3e6749ed93c8-registry-tls podName:4c93f80c-45eb-481b-bacd-3e6749ed93c8 nodeName:}" failed. No retries permitted until 2026-09-18 04:06:55.672804461 +0000 UTC m=+50.130247408 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4c93f80c-45eb-481b-bacd-3e6749ed93c8-registry-tls") pod "image-registry-779df66775-8dkzt" (UID: "4c93f80c-45eb-481b-bacd-3e6749ed93c8") : secret "image-registry-tls" not found
Sep 18 04:06:47.773566 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:47.773527    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1004a663-1296-428b-838a-72dd37ad0e10-metrics-tls\") pod \"dns-default-5rpl9\" (UID: \"1004a663-1296-428b-838a-72dd37ad0e10\") " pod="openshift-dns/dns-default-5rpl9"
Sep 18 04:06:47.773720 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:47.773687    2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 04:06:47.773763 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:47.773747    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1004a663-1296-428b-838a-72dd37ad0e10-metrics-tls podName:1004a663-1296-428b-838a-72dd37ad0e10 nodeName:}" failed. No retries permitted until 2026-09-18 04:06:55.77373047 +0000 UTC m=+50.231173422 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1004a663-1296-428b-838a-72dd37ad0e10-metrics-tls") pod "dns-default-5rpl9" (UID: "1004a663-1296-428b-838a-72dd37ad0e10") : secret "dns-default-metrics-tls" not found
Sep 18 04:06:49.083128 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:49.083094    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:06:50.002157 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:50.002112    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:06:50.137560 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:50.137524    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:06:53.457594 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:53.457560    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:06:53.569933 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:53.569881    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:06:53.665038 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:53.665004    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:06:53.763876 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:53.763785    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:06:53.863349 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:53.863315    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:06:54.452268 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:54.452236    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:06:54.554139 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:54.554103    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:06:54.864985 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:54.864951    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:06:54.968040 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:54.968005    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:06:55.732074 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:55.732033    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4c93f80c-45eb-481b-bacd-3e6749ed93c8-registry-tls\") pod \"image-registry-779df66775-8dkzt\" (UID: \"4c93f80c-45eb-481b-bacd-3e6749ed93c8\") " pod="openshift-image-registry/image-registry-779df66775-8dkzt"
Sep 18 04:06:55.732505 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:55.732191    2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 18 04:06:55.732505 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:55.732207    2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-779df66775-8dkzt: secret "image-registry-tls" not found
Sep 18 04:06:55.732505 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:55.732261    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4c93f80c-45eb-481b-bacd-3e6749ed93c8-registry-tls podName:4c93f80c-45eb-481b-bacd-3e6749ed93c8 nodeName:}" failed. No retries permitted until 2026-09-18 04:07:11.732244723 +0000 UTC m=+66.189687685 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4c93f80c-45eb-481b-bacd-3e6749ed93c8-registry-tls") pod "image-registry-779df66775-8dkzt" (UID: "4c93f80c-45eb-481b-bacd-3e6749ed93c8") : secret "image-registry-tls" not found
Sep 18 04:06:55.833521 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:06:55.833482    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1004a663-1296-428b-838a-72dd37ad0e10-metrics-tls\") pod \"dns-default-5rpl9\" (UID: \"1004a663-1296-428b-838a-72dd37ad0e10\") " pod="openshift-dns/dns-default-5rpl9"
Sep 18 04:06:55.833654 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:55.833601    2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 04:06:55.833654 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:06:55.833653    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1004a663-1296-428b-838a-72dd37ad0e10-metrics-tls podName:1004a663-1296-428b-838a-72dd37ad0e10 nodeName:}" failed. No retries permitted until 2026-09-18 04:07:11.833641164 +0000 UTC m=+66.291084111 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1004a663-1296-428b-838a-72dd37ad0e10-metrics-tls") pod "dns-default-5rpl9" (UID: "1004a663-1296-428b-838a-72dd37ad0e10") : secret "dns-default-metrics-tls" not found
Sep 18 04:07:05.793912 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:05.793871    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:05.860280 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:05.860240    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:06.675599 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:06.675565    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:06.777121 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:06.777087    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:06.840771 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:06.840739    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:07.269726 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:07.269695    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g5hqb"
Sep 18 04:07:07.431588 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:07.431549    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:07.532557 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:07.532467    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:11.737191 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:11.737156    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6dc80677-6f9c-44fd-8d5f-e3c9f4846191-original-pull-secret\") pod \"global-pull-secret-syncer-j59zp\" (UID: \"6dc80677-6f9c-44fd-8d5f-e3c9f4846191\") " pod="kube-system/global-pull-secret-syncer-j59zp"
Sep 18 04:07:11.737638 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:11.737200    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4c93f80c-45eb-481b-bacd-3e6749ed93c8-registry-tls\") pod \"image-registry-779df66775-8dkzt\" (UID: \"4c93f80c-45eb-481b-bacd-3e6749ed93c8\") " pod="openshift-image-registry/image-registry-779df66775-8dkzt"
Sep 18 04:07:11.737638 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:07:11.737331    2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 18 04:07:11.737638 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:07:11.737343    2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-779df66775-8dkzt: secret "image-registry-tls" not found
Sep 18 04:07:11.737638 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:07:11.737405    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4c93f80c-45eb-481b-bacd-3e6749ed93c8-registry-tls podName:4c93f80c-45eb-481b-bacd-3e6749ed93c8 nodeName:}" failed. No retries permitted until 2026-09-18 04:07:43.737388559 +0000 UTC m=+98.194831513 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4c93f80c-45eb-481b-bacd-3e6749ed93c8-registry-tls") pod "image-registry-779df66775-8dkzt" (UID: "4c93f80c-45eb-481b-bacd-3e6749ed93c8") : secret "image-registry-tls" not found
Sep 18 04:07:11.739948 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:11.739928    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 18 04:07:11.750629 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:11.750607    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6dc80677-6f9c-44fd-8d5f-e3c9f4846191-original-pull-secret\") pod \"global-pull-secret-syncer-j59zp\" (UID: \"6dc80677-6f9c-44fd-8d5f-e3c9f4846191\") " pod="kube-system/global-pull-secret-syncer-j59zp"
Sep 18 04:07:11.837630 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:11.837592    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1004a663-1296-428b-838a-72dd37ad0e10-metrics-tls\") pod \"dns-default-5rpl9\" (UID: \"1004a663-1296-428b-838a-72dd37ad0e10\") " pod="openshift-dns/dns-default-5rpl9"
Sep 18 04:07:11.837743 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:11.837649    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d169a38-932c-4d14-8a19-3ce5341fc190-metrics-certs\") pod \"network-metrics-daemon-zg942\" (UID: \"2d169a38-932c-4d14-8a19-3ce5341fc190\") " pod="openshift-multus/network-metrics-daemon-zg942"
Sep 18 04:07:11.837743 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:07:11.837734    2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 04:07:11.840812 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:07:11.838133    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1004a663-1296-428b-838a-72dd37ad0e10-metrics-tls podName:1004a663-1296-428b-838a-72dd37ad0e10 nodeName:}" failed. No retries permitted until 2026-09-18 04:07:43.837772815 +0000 UTC m=+98.295215765 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1004a663-1296-428b-838a-72dd37ad0e10-metrics-tls") pod "dns-default-5rpl9" (UID: "1004a663-1296-428b-838a-72dd37ad0e10") : secret "dns-default-metrics-tls" not found
Sep 18 04:07:11.841189 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:11.841171    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 18 04:07:11.847868 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:07:11.847851    2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 18 04:07:11.847964 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:07:11.847924    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d169a38-932c-4d14-8a19-3ce5341fc190-metrics-certs podName:2d169a38-932c-4d14-8a19-3ce5341fc190 nodeName:}" failed. No retries permitted until 2026-09-18 04:08:15.847893594 +0000 UTC m=+130.305336541 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2d169a38-932c-4d14-8a19-3ce5341fc190-metrics-certs") pod "network-metrics-daemon-zg942" (UID: "2d169a38-932c-4d14-8a19-3ce5341fc190") : secret "metrics-daemon-secret" not found
Sep 18 04:07:11.881459 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:11.881436    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j59zp"
Sep 18 04:07:11.938572 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:11.938538    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tl9sp\" (UniqueName: \"kubernetes.io/projected/395617a1-d084-4753-82d1-8dabf26dc416-kube-api-access-tl9sp\") pod \"network-check-target-z59z5\" (UID: \"395617a1-d084-4753-82d1-8dabf26dc416\") " pod="openshift-network-diagnostics/network-check-target-z59z5"
Sep 18 04:07:11.941597 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:11.941576    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 18 04:07:11.951240 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:11.951212    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 18 04:07:11.961395 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:11.961373    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tl9sp\" (UniqueName: \"kubernetes.io/projected/395617a1-d084-4753-82d1-8dabf26dc416-kube-api-access-tl9sp\") pod \"network-check-target-z59z5\" (UID: \"395617a1-d084-4753-82d1-8dabf26dc416\") " pod="openshift-network-diagnostics/network-check-target-z59z5"
Sep 18 04:07:12.155747 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:12.155714    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-j59zp"]
Sep 18 04:07:12.160558 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:07:12.160534    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dc80677_6f9c_44fd_8d5f_e3c9f4846191.slice/crio-4aad33779782846b36489aeee436fece22f6eaf80eaca0fd36b0a3b52403481c WatchSource:0}: Error finding container 4aad33779782846b36489aeee436fece22f6eaf80eaca0fd36b0a3b52403481c: Status 404 returned error can't find the container with id 4aad33779782846b36489aeee436fece22f6eaf80eaca0fd36b0a3b52403481c
Sep 18 04:07:12.171391 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:12.171369    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cw2bm\""
Sep 18 04:07:12.179441 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:12.179421    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z59z5"
Sep 18 04:07:12.363558 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:12.363527    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-j59zp" event={"ID":"6dc80677-6f9c-44fd-8d5f-e3c9f4846191","Type":"ContainerStarted","Data":"4aad33779782846b36489aeee436fece22f6eaf80eaca0fd36b0a3b52403481c"}
Sep 18 04:07:12.445736 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:12.445667    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-z59z5"]
Sep 18 04:07:12.448568 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:07:12.448541    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod395617a1_d084_4753_82d1_8dabf26dc416.slice/crio-88aec0d34142d08cc88e78065d3c534f834d9d71998d3848a5ac604fde3faf92 WatchSource:0}: Error finding container 88aec0d34142d08cc88e78065d3c534f834d9d71998d3848a5ac604fde3faf92: Status 404 returned error can't find the container with id 88aec0d34142d08cc88e78065d3c534f834d9d71998d3848a5ac604fde3faf92
Sep 18 04:07:13.369388 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:13.368662    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-z59z5" event={"ID":"395617a1-d084-4753-82d1-8dabf26dc416","Type":"ContainerStarted","Data":"88aec0d34142d08cc88e78065d3c534f834d9d71998d3848a5ac604fde3faf92"}
Sep 18 04:07:14.669450 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:14.669370    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:14.731993 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:14.731954    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:14.790918 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:14.790874    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:15.622787 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:15.622749    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:15.722918 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:15.722861    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:15.824129 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:15.824093    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:18.383818 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:18.383779    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-z59z5" event={"ID":"395617a1-d084-4753-82d1-8dabf26dc416","Type":"ContainerStarted","Data":"ec44f4b064eb81aec54cd2bc33a10a5208230a11902d9a612b3e8d6902bb4545"}
Sep 18 04:07:18.384321 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:18.383959    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-z59z5"
Sep 18 04:07:18.385237 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:18.385210    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-j59zp" event={"ID":"6dc80677-6f9c-44fd-8d5f-e3c9f4846191","Type":"ContainerStarted","Data":"031c0edd3a6c51839443ef8be2bbc62d0118d6e9b92c2327d095b798a237692e"}
Sep 18 04:07:18.399048 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:18.399009    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-z59z5" podStartSLOduration=66.887371309 podStartE2EDuration="1m12.398996287s" totalImagesPullingTime="5.511624978s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:06:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:07:18.398558711 +0000 UTC m=+72.856001681" watchObservedRunningTime="2026-09-18 04:07:18.398996287 +0000 UTC m=+72.856439264"
Sep 18 04:07:18.412620 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:18.412577    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-j59zp" podStartSLOduration=66.621070753 podStartE2EDuration="1m12.412563798s" totalImagesPullingTime="5.791493045s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 04:06:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:07:18.411947739 +0000 UTC m=+72.869390709" watchObservedRunningTime="2026-09-18 04:07:18.412563798 +0000 UTC m=+72.870006766"
Sep 18 04:07:19.284098 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:19.284059    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:22.673978 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:22.673944    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:22.774246 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:22.774200    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:23.829856 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:23.829807    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:23.886914 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:23.886863    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:25.556086 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.556053    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7cbc45fddc-mhm87"]
Sep 18 04:07:25.558686 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.558665    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-mhm87"
Sep 18 04:07:25.561016 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.560996    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-4vpjw\""
Sep 18 04:07:25.562732 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.562710    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-6f9c644dd9-4x6gx"]
Sep 18 04:07:25.565148 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.565129    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-6f9c644dd9-4x6gx"
Sep 18 04:07:25.567163 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.567144    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 18 04:07:25.567254 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.567142    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 18 04:07:25.567437 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.567424    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 18 04:07:25.567608 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.567589    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-kv5hp\""
Sep 18 04:07:25.575392 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.575376    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 18 04:07:25.577193 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.577175    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7cbc45fddc-mhm87"]
Sep 18 04:07:25.579395 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.579379    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 18 04:07:25.584968 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.584946    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-6f9c644dd9-4x6gx"]
Sep 18 04:07:25.633510 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.633480    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f92ffe18-1282-4f7c-b4f9-824e7e11dc07-trusted-ca-bundle\") pod \"insights-operator-6f9c644dd9-4x6gx\" (UID: \"f92ffe18-1282-4f7c-b4f9-824e7e11dc07\") " pod="openshift-insights/insights-operator-6f9c644dd9-4x6gx"
Sep 18 04:07:25.633510 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.633508    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f92ffe18-1282-4f7c-b4f9-824e7e11dc07-serving-cert\") pod \"insights-operator-6f9c644dd9-4x6gx\" (UID: \"f92ffe18-1282-4f7c-b4f9-824e7e11dc07\") " pod="openshift-insights/insights-operator-6f9c644dd9-4x6gx"
Sep 18 04:07:25.633700 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.633526    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkf65\" (UniqueName: \"kubernetes.io/projected/f92ffe18-1282-4f7c-b4f9-824e7e11dc07-kube-api-access-wkf65\") pod \"insights-operator-6f9c644dd9-4x6gx\" (UID: \"f92ffe18-1282-4f7c-b4f9-824e7e11dc07\") " pod="openshift-insights/insights-operator-6f9c644dd9-4x6gx"
Sep 18 04:07:25.633700 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.633601    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f92ffe18-1282-4f7c-b4f9-824e7e11dc07-service-ca-bundle\") pod \"insights-operator-6f9c644dd9-4x6gx\" (UID: \"f92ffe18-1282-4f7c-b4f9-824e7e11dc07\") " pod="openshift-insights/insights-operator-6f9c644dd9-4x6gx"
Sep 18 04:07:25.633700 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.633685    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwhkn\" (UniqueName: \"kubernetes.io/projected/b476ed7c-941e-4006-8536-321a4143f637-kube-api-access-gwhkn\") pod \"network-check-source-7cbc45fddc-mhm87\" (UID: \"b476ed7c-941e-4006-8536-321a4143f637\") " pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-mhm87"
Sep 18 04:07:25.633833 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.633720    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f92ffe18-1282-4f7c-b4f9-824e7e11dc07-tmp\") pod \"insights-operator-6f9c644dd9-4x6gx\" (UID: \"f92ffe18-1282-4f7c-b4f9-824e7e11dc07\") " pod="openshift-insights/insights-operator-6f9c644dd9-4x6gx"
Sep 18 04:07:25.633833 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.633745    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f92ffe18-1282-4f7c-b4f9-824e7e11dc07-snapshots\") pod \"insights-operator-6f9c644dd9-4x6gx\" (UID: \"f92ffe18-1282-4f7c-b4f9-824e7e11dc07\") " pod="openshift-insights/insights-operator-6f9c644dd9-4x6gx"
Sep 18 04:07:25.734049 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.734005    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f92ffe18-1282-4f7c-b4f9-824e7e11dc07-trusted-ca-bundle\") pod \"insights-operator-6f9c644dd9-4x6gx\" (UID: \"f92ffe18-1282-4f7c-b4f9-824e7e11dc07\") " pod="openshift-insights/insights-operator-6f9c644dd9-4x6gx"
Sep 18 04:07:25.734049 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.734052    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f92ffe18-1282-4f7c-b4f9-824e7e11dc07-serving-cert\") pod \"insights-operator-6f9c644dd9-4x6gx\" (UID: \"f92ffe18-1282-4f7c-b4f9-824e7e11dc07\") " pod="openshift-insights/insights-operator-6f9c644dd9-4x6gx"
Sep 18 04:07:25.734292 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.734079    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkf65\" (UniqueName: \"kubernetes.io/projected/f92ffe18-1282-4f7c-b4f9-824e7e11dc07-kube-api-access-wkf65\") pod \"insights-operator-6f9c644dd9-4x6gx\" (UID: \"f92ffe18-1282-4f7c-b4f9-824e7e11dc07\") " pod="openshift-insights/insights-operator-6f9c644dd9-4x6gx"
Sep 18 04:07:25.734292 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.734276    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f92ffe18-1282-4f7c-b4f9-824e7e11dc07-service-ca-bundle\") pod \"insights-operator-6f9c644dd9-4x6gx\" (UID: \"f92ffe18-1282-4f7c-b4f9-824e7e11dc07\") " pod="openshift-insights/insights-operator-6f9c644dd9-4x6gx"
Sep 18 04:07:25.734391 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.734358    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwhkn\" (UniqueName: \"kubernetes.io/projected/b476ed7c-941e-4006-8536-321a4143f637-kube-api-access-gwhkn\") pod \"network-check-source-7cbc45fddc-mhm87\" (UID: \"b476ed7c-941e-4006-8536-321a4143f637\") " pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-mhm87"
Sep 18 04:07:25.734391 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.734380    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f92ffe18-1282-4f7c-b4f9-824e7e11dc07-tmp\") pod \"insights-operator-6f9c644dd9-4x6gx\" (UID: \"f92ffe18-1282-4f7c-b4f9-824e7e11dc07\") " pod="openshift-insights/insights-operator-6f9c644dd9-4x6gx"
Sep 18 04:07:25.734497 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.734406    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f92ffe18-1282-4f7c-b4f9-824e7e11dc07-snapshots\") pod \"insights-operator-6f9c644dd9-4x6gx\" (UID: \"f92ffe18-1282-4f7c-b4f9-824e7e11dc07\") " pod="openshift-insights/insights-operator-6f9c644dd9-4x6gx"
Sep 18 04:07:25.734858 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.734820    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f92ffe18-1282-4f7c-b4f9-824e7e11dc07-tmp\") pod \"insights-operator-6f9c644dd9-4x6gx\" (UID: \"f92ffe18-1282-4f7c-b4f9-824e7e11dc07\") " pod="openshift-insights/insights-operator-6f9c644dd9-4x6gx"
Sep 18 04:07:25.735022 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.734988    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f92ffe18-1282-4f7c-b4f9-824e7e11dc07-service-ca-bundle\") pod \"insights-operator-6f9c644dd9-4x6gx\" (UID: \"f92ffe18-1282-4f7c-b4f9-824e7e11dc07\") " pod="openshift-insights/insights-operator-6f9c644dd9-4x6gx"
Sep 18 04:07:25.735090 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.735074    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f92ffe18-1282-4f7c-b4f9-824e7e11dc07-snapshots\") pod \"insights-operator-6f9c644dd9-4x6gx\" (UID: \"f92ffe18-1282-4f7c-b4f9-824e7e11dc07\") " pod="openshift-insights/insights-operator-6f9c644dd9-4x6gx"
Sep 18 04:07:25.735236 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.735219    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f92ffe18-1282-4f7c-b4f9-824e7e11dc07-trusted-ca-bundle\") pod \"insights-operator-6f9c644dd9-4x6gx\" (UID: \"f92ffe18-1282-4f7c-b4f9-824e7e11dc07\") " pod="openshift-insights/insights-operator-6f9c644dd9-4x6gx"
Sep 18 04:07:25.736473 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.736453    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f92ffe18-1282-4f7c-b4f9-824e7e11dc07-serving-cert\") pod \"insights-operator-6f9c644dd9-4x6gx\" (UID: \"f92ffe18-1282-4f7c-b4f9-824e7e11dc07\") " pod="openshift-insights/insights-operator-6f9c644dd9-4x6gx"
Sep 18 04:07:25.743382 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.743362    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwhkn\" (UniqueName: \"kubernetes.io/projected/b476ed7c-941e-4006-8536-321a4143f637-kube-api-access-gwhkn\") pod \"network-check-source-7cbc45fddc-mhm87\" (UID: \"b476ed7c-941e-4006-8536-321a4143f637\") " pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-mhm87"
Sep 18 04:07:25.743489 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.743424    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkf65\" (UniqueName: \"kubernetes.io/projected/f92ffe18-1282-4f7c-b4f9-824e7e11dc07-kube-api-access-wkf65\") pod \"insights-operator-6f9c644dd9-4x6gx\" (UID: \"f92ffe18-1282-4f7c-b4f9-824e7e11dc07\") " pod="openshift-insights/insights-operator-6f9c644dd9-4x6gx"
Sep 18 04:07:25.760425 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.760292    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-bdc687fb-txxfd"]
Sep 18 04:07:25.763763 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.763747    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-jxtk4"]
Sep 18 04:07:25.763872 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.763857    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-bdc687fb-txxfd"
Sep 18 04:07:25.766263 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.766246    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-fd4bb46c-jxtk4"
Sep 18 04:07:25.766750 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.766731    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 18 04:07:25.766839 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.766748    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 18 04:07:25.767772 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.767751    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 18 04:07:25.767988 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.767975    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 18 04:07:25.768245 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.768231    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 18 04:07:25.768288 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.768231    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-hvhbj\""
Sep 18 04:07:25.772545 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.772524    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 18 04:07:25.772681 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.772663    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 18 04:07:25.772681 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.772676    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 18 04:07:25.772824 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.772670    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 18 04:07:25.772824 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.772706    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 18 04:07:25.774918 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.774891    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-2lmvx\""
Sep 18 04:07:25.782004 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.781986    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 18 04:07:25.782958 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.782937    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-jxtk4"]
Sep 18 04:07:25.784036 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.784017    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-bdc687fb-txxfd"]
Sep 18 04:07:25.835112 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.835018    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8j6sh\" (UniqueName: \"kubernetes.io/projected/6d42c4e4-9bc8-4aa3-8056-c871229383e2-kube-api-access-8j6sh\") pod \"console-operator-fd4bb46c-jxtk4\" (UID: \"6d42c4e4-9bc8-4aa3-8056-c871229383e2\") " pod="openshift-console-operator/console-operator-fd4bb46c-jxtk4"
Sep 18 04:07:25.835112 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.835063    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6d42c4e4-9bc8-4aa3-8056-c871229383e2-config\") pod \"console-operator-fd4bb46c-jxtk4\" (UID: \"6d42c4e4-9bc8-4aa3-8056-c871229383e2\") " pod="openshift-console-operator/console-operator-fd4bb46c-jxtk4"
Sep 18 04:07:25.835112 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.835085    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wc4qb\" (UniqueName: \"kubernetes.io/projected/1e106cea-7104-4002-9041-3ee5f7287967-kube-api-access-wc4qb\") pod \"router-default-bdc687fb-txxfd\" (UID: \"1e106cea-7104-4002-9041-3ee5f7287967\") " pod="openshift-ingress/router-default-bdc687fb-txxfd"
Sep 18 04:07:25.835337 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.835152    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1e106cea-7104-4002-9041-3ee5f7287967-stats-auth\") pod \"router-default-bdc687fb-txxfd\" (UID: \"1e106cea-7104-4002-9041-3ee5f7287967\") " pod="openshift-ingress/router-default-bdc687fb-txxfd"
Sep 18 04:07:25.835337 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.835177    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e106cea-7104-4002-9041-3ee5f7287967-metrics-certs\") pod \"router-default-bdc687fb-txxfd\" (UID: \"1e106cea-7104-4002-9041-3ee5f7287967\") " pod="openshift-ingress/router-default-bdc687fb-txxfd"
Sep 18 04:07:25.835337 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.835196    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6d42c4e4-9bc8-4aa3-8056-c871229383e2-serving-cert\") pod \"console-operator-fd4bb46c-jxtk4\" (UID: \"6d42c4e4-9bc8-4aa3-8056-c871229383e2\") " pod="openshift-console-operator/console-operator-fd4bb46c-jxtk4"
Sep 18 04:07:25.835337 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.835263    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6d42c4e4-9bc8-4aa3-8056-c871229383e2-trusted-ca\") pod \"console-operator-fd4bb46c-jxtk4\" (UID: \"6d42c4e4-9bc8-4aa3-8056-c871229383e2\") " pod="openshift-console-operator/console-operator-fd4bb46c-jxtk4"
Sep 18 04:07:25.835337 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.835318    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e106cea-7104-4002-9041-3ee5f7287967-service-ca-bundle\") pod \"router-default-bdc687fb-txxfd\" (UID: \"1e106cea-7104-4002-9041-3ee5f7287967\") " pod="openshift-ingress/router-default-bdc687fb-txxfd"
Sep 18 04:07:25.835489 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.835378    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1e106cea-7104-4002-9041-3ee5f7287967-default-certificate\") pod \"router-default-bdc687fb-txxfd\" (UID: \"1e106cea-7104-4002-9041-3ee5f7287967\") " pod="openshift-ingress/router-default-bdc687fb-txxfd"
Sep 18 04:07:25.867205 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.867173    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-mhm87"
Sep 18 04:07:25.873865 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.873840    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-6f9c644dd9-4x6gx"
Sep 18 04:07:25.906433 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.906282    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:25.940125 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.936269    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e106cea-7104-4002-9041-3ee5f7287967-service-ca-bundle\") pod \"router-default-bdc687fb-txxfd\" (UID: \"1e106cea-7104-4002-9041-3ee5f7287967\") " pod="openshift-ingress/router-default-bdc687fb-txxfd"
Sep 18 04:07:25.940125 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.936320    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1e106cea-7104-4002-9041-3ee5f7287967-default-certificate\") pod \"router-default-bdc687fb-txxfd\" (UID: \"1e106cea-7104-4002-9041-3ee5f7287967\") " pod="openshift-ingress/router-default-bdc687fb-txxfd"
Sep 18 04:07:25.940125 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.936361    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8j6sh\" (UniqueName: \"kubernetes.io/projected/6d42c4e4-9bc8-4aa3-8056-c871229383e2-kube-api-access-8j6sh\") pod \"console-operator-fd4bb46c-jxtk4\" (UID: \"6d42c4e4-9bc8-4aa3-8056-c871229383e2\") " pod="openshift-console-operator/console-operator-fd4bb46c-jxtk4"
Sep 18 04:07:25.940125 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.936388    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6d42c4e4-9bc8-4aa3-8056-c871229383e2-config\") pod \"console-operator-fd4bb46c-jxtk4\" (UID: \"6d42c4e4-9bc8-4aa3-8056-c871229383e2\") " pod="openshift-console-operator/console-operator-fd4bb46c-jxtk4"
Sep 18 04:07:25.940125 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.936413    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wc4qb\" (UniqueName: \"kubernetes.io/projected/1e106cea-7104-4002-9041-3ee5f7287967-kube-api-access-wc4qb\") pod \"router-default-bdc687fb-txxfd\" (UID: \"1e106cea-7104-4002-9041-3ee5f7287967\") " pod="openshift-ingress/router-default-bdc687fb-txxfd"
Sep 18 04:07:25.940125 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.936482    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1e106cea-7104-4002-9041-3ee5f7287967-stats-auth\") pod \"router-default-bdc687fb-txxfd\" (UID: \"1e106cea-7104-4002-9041-3ee5f7287967\") " pod="openshift-ingress/router-default-bdc687fb-txxfd"
Sep 18 04:07:25.940125 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:07:25.936663    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e106cea-7104-4002-9041-3ee5f7287967-service-ca-bundle podName:1e106cea-7104-4002-9041-3ee5f7287967 nodeName:}" failed. No retries permitted until 2026-09-18 04:07:26.43658871 +0000 UTC m=+80.894031667 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1e106cea-7104-4002-9041-3ee5f7287967-service-ca-bundle") pod "router-default-bdc687fb-txxfd" (UID: "1e106cea-7104-4002-9041-3ee5f7287967") : configmap references non-existent config key: service-ca.crt
Sep 18 04:07:25.940125 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.936824    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e106cea-7104-4002-9041-3ee5f7287967-metrics-certs\") pod \"router-default-bdc687fb-txxfd\" (UID: \"1e106cea-7104-4002-9041-3ee5f7287967\") " pod="openshift-ingress/router-default-bdc687fb-txxfd"
Sep 18 04:07:25.940125 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.936862    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6d42c4e4-9bc8-4aa3-8056-c871229383e2-serving-cert\") pod \"console-operator-fd4bb46c-jxtk4\" (UID: \"6d42c4e4-9bc8-4aa3-8056-c871229383e2\") " pod="openshift-console-operator/console-operator-fd4bb46c-jxtk4"
Sep 18 04:07:25.940125 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.937081    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6d42c4e4-9bc8-4aa3-8056-c871229383e2-trusted-ca\") pod \"console-operator-fd4bb46c-jxtk4\" (UID: \"6d42c4e4-9bc8-4aa3-8056-c871229383e2\") " pod="openshift-console-operator/console-operator-fd4bb46c-jxtk4"
Sep 18 04:07:25.940125 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:07:25.937088    2585 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 18 04:07:25.940125 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:07:25.937144    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e106cea-7104-4002-9041-3ee5f7287967-metrics-certs podName:1e106cea-7104-4002-9041-3ee5f7287967 nodeName:}" failed. No retries permitted until 2026-09-18 04:07:26.43712677 +0000 UTC m=+80.894569718 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1e106cea-7104-4002-9041-3ee5f7287967-metrics-certs") pod "router-default-bdc687fb-txxfd" (UID: "1e106cea-7104-4002-9041-3ee5f7287967") : secret "router-metrics-certs-default" not found
Sep 18 04:07:25.940125 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.937323    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6d42c4e4-9bc8-4aa3-8056-c871229383e2-config\") pod \"console-operator-fd4bb46c-jxtk4\" (UID: \"6d42c4e4-9bc8-4aa3-8056-c871229383e2\") " pod="openshift-console-operator/console-operator-fd4bb46c-jxtk4"
Sep 18 04:07:25.940125 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.938133    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6d42c4e4-9bc8-4aa3-8056-c871229383e2-trusted-ca\") pod \"console-operator-fd4bb46c-jxtk4\" (UID: \"6d42c4e4-9bc8-4aa3-8056-c871229383e2\") " pod="openshift-console-operator/console-operator-fd4bb46c-jxtk4"
Sep 18 04:07:25.940125 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.939850    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1e106cea-7104-4002-9041-3ee5f7287967-stats-auth\") pod \"router-default-bdc687fb-txxfd\" (UID: \"1e106cea-7104-4002-9041-3ee5f7287967\") " pod="openshift-ingress/router-default-bdc687fb-txxfd"
Sep 18 04:07:25.940125 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.939861    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6d42c4e4-9bc8-4aa3-8056-c871229383e2-serving-cert\") pod \"console-operator-fd4bb46c-jxtk4\" (UID: \"6d42c4e4-9bc8-4aa3-8056-c871229383e2\") " pod="openshift-console-operator/console-operator-fd4bb46c-jxtk4"
Sep 18 04:07:25.940941 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.940354    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1e106cea-7104-4002-9041-3ee5f7287967-default-certificate\") pod \"router-default-bdc687fb-txxfd\" (UID: \"1e106cea-7104-4002-9041-3ee5f7287967\") " pod="openshift-ingress/router-default-bdc687fb-txxfd"
Sep 18 04:07:25.944948 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.944910    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8j6sh\" (UniqueName: \"kubernetes.io/projected/6d42c4e4-9bc8-4aa3-8056-c871229383e2-kube-api-access-8j6sh\") pod \"console-operator-fd4bb46c-jxtk4\" (UID: \"6d42c4e4-9bc8-4aa3-8056-c871229383e2\") " pod="openshift-console-operator/console-operator-fd4bb46c-jxtk4"
Sep 18 04:07:25.945877 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:25.945795    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wc4qb\" (UniqueName: \"kubernetes.io/projected/1e106cea-7104-4002-9041-3ee5f7287967-kube-api-access-wc4qb\") pod \"router-default-bdc687fb-txxfd\" (UID: \"1e106cea-7104-4002-9041-3ee5f7287967\") " pod="openshift-ingress/router-default-bdc687fb-txxfd"
Sep 18 04:07:26.004388 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:26.004352    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:26.083375 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:26.083344    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-fd4bb46c-jxtk4"
Sep 18 04:07:26.105838 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:26.105802    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:26.136338 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:26.136306    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7cbc45fddc-mhm87"]
Sep 18 04:07:26.141339 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:07:26.141314    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb476ed7c_941e_4006_8536_321a4143f637.slice/crio-5456cf36ec637287710c748408e10ffac63b8b19e0098a543ec2fe8cf11babc5 WatchSource:0}: Error finding container 5456cf36ec637287710c748408e10ffac63b8b19e0098a543ec2fe8cf11babc5: Status 404 returned error can't find the container with id 5456cf36ec637287710c748408e10ffac63b8b19e0098a543ec2fe8cf11babc5
Sep 18 04:07:26.158692 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:26.158667    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-6f9c644dd9-4x6gx"]
Sep 18 04:07:26.161151 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:07:26.161126    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf92ffe18_1282_4f7c_b4f9_824e7e11dc07.slice/crio-505136096dbe1d5990a7c0c1165ab14e046ae224b04ef3b10683a6ff785233f9 WatchSource:0}: Error finding container 505136096dbe1d5990a7c0c1165ab14e046ae224b04ef3b10683a6ff785233f9: Status 404 returned error can't find the container with id 505136096dbe1d5990a7c0c1165ab14e046ae224b04ef3b10683a6ff785233f9
Sep 18 04:07:26.173551 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:26.173519    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:26.352257 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:26.352187    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-jxtk4"]
Sep 18 04:07:26.354939 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:07:26.354912    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d42c4e4_9bc8_4aa3_8056_c871229383e2.slice/crio-db4469958759528a3468e791c2fd47ea4b6dce0b03d0c880bbdcb43bcde8ee0b WatchSource:0}: Error finding container db4469958759528a3468e791c2fd47ea4b6dce0b03d0c880bbdcb43bcde8ee0b: Status 404 returned error can't find the container with id db4469958759528a3468e791c2fd47ea4b6dce0b03d0c880bbdcb43bcde8ee0b
Sep 18 04:07:26.405671 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:26.405635    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-jxtk4" event={"ID":"6d42c4e4-9bc8-4aa3-8056-c871229383e2","Type":"ContainerStarted","Data":"db4469958759528a3468e791c2fd47ea4b6dce0b03d0c880bbdcb43bcde8ee0b"}
Sep 18 04:07:26.406809 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:26.406787    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-4x6gx" event={"ID":"f92ffe18-1282-4f7c-b4f9-824e7e11dc07","Type":"ContainerStarted","Data":"505136096dbe1d5990a7c0c1165ab14e046ae224b04ef3b10683a6ff785233f9"}
Sep 18 04:07:26.408219 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:26.408199    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-mhm87" event={"ID":"b476ed7c-941e-4006-8536-321a4143f637","Type":"ContainerStarted","Data":"b94bc909695807954d01ed44f1bc2e0eb7226af68a0d44bbb9afe9df06e60ad4"}
Sep 18 04:07:26.408295 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:26.408235    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-mhm87" event={"ID":"b476ed7c-941e-4006-8536-321a4143f637","Type":"ContainerStarted","Data":"5456cf36ec637287710c748408e10ffac63b8b19e0098a543ec2fe8cf11babc5"}
Sep 18 04:07:26.424884 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:26.424846    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-mhm87" podStartSLOduration=1.4248349820000001 podStartE2EDuration="1.424834982s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:07:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:07:26.424301123 +0000 UTC m=+80.881744092" watchObservedRunningTime="2026-09-18 04:07:26.424834982 +0000 UTC m=+80.882277950"
Sep 18 04:07:26.443790 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:26.443765    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e106cea-7104-4002-9041-3ee5f7287967-metrics-certs\") pod \"router-default-bdc687fb-txxfd\" (UID: \"1e106cea-7104-4002-9041-3ee5f7287967\") " pod="openshift-ingress/router-default-bdc687fb-txxfd"
Sep 18 04:07:26.443856 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:26.443815    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e106cea-7104-4002-9041-3ee5f7287967-service-ca-bundle\") pod \"router-default-bdc687fb-txxfd\" (UID: \"1e106cea-7104-4002-9041-3ee5f7287967\") " pod="openshift-ingress/router-default-bdc687fb-txxfd"
Sep 18 04:07:26.443942 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:07:26.443924    2585 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 18 04:07:26.443986 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:07:26.443975    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e106cea-7104-4002-9041-3ee5f7287967-service-ca-bundle podName:1e106cea-7104-4002-9041-3ee5f7287967 nodeName:}" failed. No retries permitted until 2026-09-18 04:07:27.443956974 +0000 UTC m=+81.901399941 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1e106cea-7104-4002-9041-3ee5f7287967-service-ca-bundle") pod "router-default-bdc687fb-txxfd" (UID: "1e106cea-7104-4002-9041-3ee5f7287967") : configmap references non-existent config key: service-ca.crt
Sep 18 04:07:26.444029 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:07:26.443994    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e106cea-7104-4002-9041-3ee5f7287967-metrics-certs podName:1e106cea-7104-4002-9041-3ee5f7287967 nodeName:}" failed. No retries permitted until 2026-09-18 04:07:27.443986795 +0000 UTC m=+81.901429742 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1e106cea-7104-4002-9041-3ee5f7287967-metrics-certs") pod "router-default-bdc687fb-txxfd" (UID: "1e106cea-7104-4002-9041-3ee5f7287967") : secret "router-metrics-certs-default" not found
Sep 18 04:07:26.813921 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:26.813869    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:26.914910 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:26.914851    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:27.451915 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:27.451871    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e106cea-7104-4002-9041-3ee5f7287967-metrics-certs\") pod \"router-default-bdc687fb-txxfd\" (UID: \"1e106cea-7104-4002-9041-3ee5f7287967\") " pod="openshift-ingress/router-default-bdc687fb-txxfd"
Sep 18 04:07:27.452099 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:27.451964    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e106cea-7104-4002-9041-3ee5f7287967-service-ca-bundle\") pod \"router-default-bdc687fb-txxfd\" (UID: \"1e106cea-7104-4002-9041-3ee5f7287967\") " pod="openshift-ingress/router-default-bdc687fb-txxfd"
Sep 18 04:07:27.452099 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:07:27.452066    2585 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 18 04:07:27.452099 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:07:27.452094    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e106cea-7104-4002-9041-3ee5f7287967-service-ca-bundle podName:1e106cea-7104-4002-9041-3ee5f7287967 nodeName:}" failed. No retries permitted until 2026-09-18 04:07:29.452076966 +0000 UTC m=+83.909519926 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1e106cea-7104-4002-9041-3ee5f7287967-service-ca-bundle") pod "router-default-bdc687fb-txxfd" (UID: "1e106cea-7104-4002-9041-3ee5f7287967") : configmap references non-existent config key: service-ca.crt
Sep 18 04:07:27.452266 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:07:27.452120    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e106cea-7104-4002-9041-3ee5f7287967-metrics-certs podName:1e106cea-7104-4002-9041-3ee5f7287967 nodeName:}" failed. No retries permitted until 2026-09-18 04:07:29.452107027 +0000 UTC m=+83.909549973 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1e106cea-7104-4002-9041-3ee5f7287967-metrics-certs") pod "router-default-bdc687fb-txxfd" (UID: "1e106cea-7104-4002-9041-3ee5f7287967") : secret "router-metrics-certs-default" not found
Sep 18 04:07:28.802652 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:28.802621    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:28.903885 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:28.903850    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:29.419978 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:29.419952    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-jxtk4_6d42c4e4-9bc8-4aa3-8056-c871229383e2/console-operator/0.log"
Sep 18 04:07:29.420133 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:29.419996    2585 generic.go:356] "Generic (PLEG): container finished" podID="6d42c4e4-9bc8-4aa3-8056-c871229383e2" containerID="56b05d0ac32359a927839b0d8e347a1b338e6adee3c3129e0ab49dde148b0863" exitCode=255
Sep 18 04:07:29.420133 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:29.420064    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-jxtk4" event={"ID":"6d42c4e4-9bc8-4aa3-8056-c871229383e2","Type":"ContainerDied","Data":"56b05d0ac32359a927839b0d8e347a1b338e6adee3c3129e0ab49dde148b0863"}
Sep 18 04:07:29.420396 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:29.420372    2585 scope.go:117] "RemoveContainer" containerID="56b05d0ac32359a927839b0d8e347a1b338e6adee3c3129e0ab49dde148b0863"
Sep 18 04:07:29.421769 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:29.421747    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-4x6gx" event={"ID":"f92ffe18-1282-4f7c-b4f9-824e7e11dc07","Type":"ContainerStarted","Data":"68c40b8f05b3018ad2672e114b244c4356b4338094254f0939200c7478f9f51d"}
Sep 18 04:07:29.452438 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:29.452384    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-6f9c644dd9-4x6gx" podStartSLOduration=1.903606741 podStartE2EDuration="4.452362136s" totalImagesPullingTime="2.548755395s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:07:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:07:29.452047212 +0000 UTC m=+83.909490182" watchObservedRunningTime="2026-09-18 04:07:29.452362136 +0000 UTC m=+83.909805106"
Sep 18 04:07:29.467182 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:29.467156    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e106cea-7104-4002-9041-3ee5f7287967-service-ca-bundle\") pod \"router-default-bdc687fb-txxfd\" (UID: \"1e106cea-7104-4002-9041-3ee5f7287967\") " pod="openshift-ingress/router-default-bdc687fb-txxfd"
Sep 18 04:07:29.467319 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:29.467281    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e106cea-7104-4002-9041-3ee5f7287967-metrics-certs\") pod \"router-default-bdc687fb-txxfd\" (UID: \"1e106cea-7104-4002-9041-3ee5f7287967\") " pod="openshift-ingress/router-default-bdc687fb-txxfd"
Sep 18 04:07:29.467377 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:07:29.467334    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e106cea-7104-4002-9041-3ee5f7287967-service-ca-bundle podName:1e106cea-7104-4002-9041-3ee5f7287967 nodeName:}" failed. No retries permitted until 2026-09-18 04:07:33.467311557 +0000 UTC m=+87.924754507 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1e106cea-7104-4002-9041-3ee5f7287967-service-ca-bundle") pod "router-default-bdc687fb-txxfd" (UID: "1e106cea-7104-4002-9041-3ee5f7287967") : configmap references non-existent config key: service-ca.crt
Sep 18 04:07:29.467947 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:07:29.467727    2585 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 18 04:07:29.467947 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:07:29.467782    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e106cea-7104-4002-9041-3ee5f7287967-metrics-certs podName:1e106cea-7104-4002-9041-3ee5f7287967 nodeName:}" failed. No retries permitted until 2026-09-18 04:07:33.467765148 +0000 UTC m=+87.925208095 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1e106cea-7104-4002-9041-3ee5f7287967-metrics-certs") pod "router-default-bdc687fb-txxfd" (UID: "1e106cea-7104-4002-9041-3ee5f7287967") : secret "router-metrics-certs-default" not found
Sep 18 04:07:30.158826 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:30.158789    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-26rlw"]
Sep 18 04:07:30.161960 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:30.161942    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-26rlw"
Sep 18 04:07:30.164428 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:30.164407    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 18 04:07:30.164530 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:30.164411    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 18 04:07:30.164774 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:30.164750    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-s75gn\""
Sep 18 04:07:30.172692 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:30.172671    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-26rlw"]
Sep 18 04:07:30.182054 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:30.182029    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:30.273941 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:30.273913    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc-crio-socket\") pod \"insights-runtime-extractor-26rlw\" (UID: \"2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc\") " pod="openshift-insights/insights-runtime-extractor-26rlw"
Sep 18 04:07:30.274119 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:30.273992    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc-data-volume\") pod \"insights-runtime-extractor-26rlw\" (UID: \"2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc\") " pod="openshift-insights/insights-runtime-extractor-26rlw"
Sep 18 04:07:30.274119 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:30.274023    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-26rlw\" (UID: \"2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc\") " pod="openshift-insights/insights-runtime-extractor-26rlw"
Sep 18 04:07:30.274119 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:30.274038    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2tm4\" (UniqueName: \"kubernetes.io/projected/2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc-kube-api-access-t2tm4\") pod \"insights-runtime-extractor-26rlw\" (UID: \"2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc\") " pod="openshift-insights/insights-runtime-extractor-26rlw"
Sep 18 04:07:30.274119 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:30.274062    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-26rlw\" (UID: \"2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc\") " pod="openshift-insights/insights-runtime-extractor-26rlw"
Sep 18 04:07:30.342500 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:30.342471    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:30.374989 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:30.374951    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc-data-volume\") pod \"insights-runtime-extractor-26rlw\" (UID: \"2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc\") " pod="openshift-insights/insights-runtime-extractor-26rlw"
Sep 18 04:07:30.375140 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:30.375012    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-26rlw\" (UID: \"2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc\") " pod="openshift-insights/insights-runtime-extractor-26rlw"
Sep 18 04:07:30.375140 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:30.375032    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2tm4\" (UniqueName: \"kubernetes.io/projected/2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc-kube-api-access-t2tm4\") pod \"insights-runtime-extractor-26rlw\" (UID: \"2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc\") " pod="openshift-insights/insights-runtime-extractor-26rlw"
Sep 18 04:07:30.375140 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:30.375054    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-26rlw\" (UID: \"2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc\") " pod="openshift-insights/insights-runtime-extractor-26rlw"
Sep 18 04:07:30.375140 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:07:30.375127    2585 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 18 04:07:30.375324 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:07:30.375154    2585 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 18 04:07:30.375324 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:07:30.375181    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc-kube-rbac-proxy-cm podName:2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc nodeName:}" failed. No retries permitted until 2026-09-18 04:07:30.875163824 +0000 UTC m=+85.332606790 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-26rlw" (UID: "2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc") : configmap "kube-rbac-proxy" not found
Sep 18 04:07:30.375324 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:30.375213    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc-crio-socket\") pod \"insights-runtime-extractor-26rlw\" (UID: \"2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc\") " pod="openshift-insights/insights-runtime-extractor-26rlw"
Sep 18 04:07:30.375324 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:30.375242    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc-crio-socket\") pod \"insights-runtime-extractor-26rlw\" (UID: \"2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc\") " pod="openshift-insights/insights-runtime-extractor-26rlw"
Sep 18 04:07:30.375324 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:07:30.375295    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc-insights-runtime-extractor-tls podName:2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc nodeName:}" failed. No retries permitted until 2026-09-18 04:07:30.875275769 +0000 UTC m=+85.332718720 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-26rlw" (UID: "2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc") : secret "insights-runtime-extractor-tls" not found
Sep 18 04:07:30.375324 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:30.375304    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc-data-volume\") pod \"insights-runtime-extractor-26rlw\" (UID: \"2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc\") " pod="openshift-insights/insights-runtime-extractor-26rlw"
Sep 18 04:07:30.393421 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:30.393399    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2tm4\" (UniqueName: \"kubernetes.io/projected/2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc-kube-api-access-t2tm4\") pod \"insights-runtime-extractor-26rlw\" (UID: \"2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc\") " pod="openshift-insights/insights-runtime-extractor-26rlw"
Sep 18 04:07:30.426468 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:30.426390    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-jxtk4_6d42c4e4-9bc8-4aa3-8056-c871229383e2/console-operator/1.log"
Sep 18 04:07:30.426804 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:30.426791    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-jxtk4_6d42c4e4-9bc8-4aa3-8056-c871229383e2/console-operator/0.log"
Sep 18 04:07:30.426862 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:30.426824    2585 generic.go:356] "Generic (PLEG): container finished" podID="6d42c4e4-9bc8-4aa3-8056-c871229383e2" containerID="a32b15c14eddec636665a8be9936c80cdbc7c7b47eb78f53a637a747a5fd8634" exitCode=255
Sep 18 04:07:30.426915 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:30.426851    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-jxtk4" event={"ID":"6d42c4e4-9bc8-4aa3-8056-c871229383e2","Type":"ContainerDied","Data":"a32b15c14eddec636665a8be9936c80cdbc7c7b47eb78f53a637a747a5fd8634"}
Sep 18 04:07:30.426954 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:30.426932    2585 scope.go:117] "RemoveContainer" containerID="56b05d0ac32359a927839b0d8e347a1b338e6adee3c3129e0ab49dde148b0863"
Sep 18 04:07:30.427182 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:30.427166    2585 scope.go:117] "RemoveContainer" containerID="a32b15c14eddec636665a8be9936c80cdbc7c7b47eb78f53a637a747a5fd8634"
Sep 18 04:07:30.427344 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:07:30.427322    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-jxtk4_openshift-console-operator(6d42c4e4-9bc8-4aa3-8056-c871229383e2)\"" pod="openshift-console-operator/console-operator-fd4bb46c-jxtk4" podUID="6d42c4e4-9bc8-4aa3-8056-c871229383e2"
Sep 18 04:07:30.438946 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:30.438924    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:30.533876 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:30.533833    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:30.601788 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:30.601759    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:30.879078 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:30.879044    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-26rlw\" (UID: \"2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc\") " pod="openshift-insights/insights-runtime-extractor-26rlw"
Sep 18 04:07:30.879078 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:30.879085    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-26rlw\" (UID: \"2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc\") " pod="openshift-insights/insights-runtime-extractor-26rlw"
Sep 18 04:07:30.879287 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:07:30.879167    2585 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 18 04:07:30.879287 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:07:30.879190    2585 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 18 04:07:30.879287 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:07:30.879218    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc-kube-rbac-proxy-cm podName:2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc nodeName:}" failed. No retries permitted until 2026-09-18 04:07:31.879205306 +0000 UTC m=+86.336648253 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-26rlw" (UID: "2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc") : configmap "kube-rbac-proxy" not found
Sep 18 04:07:30.879287 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:07:30.879244    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc-insights-runtime-extractor-tls podName:2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc nodeName:}" failed. No retries permitted until 2026-09-18 04:07:31.879231437 +0000 UTC m=+86.336674399 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-26rlw" (UID: "2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc") : secret "insights-runtime-extractor-tls" not found
Sep 18 04:07:31.206953 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:31.206853    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:31.307494 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:31.307466    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:31.432300 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:31.432270    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-jxtk4_6d42c4e4-9bc8-4aa3-8056-c871229383e2/console-operator/1.log"
Sep 18 04:07:31.432624 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:31.432605    2585 scope.go:117] "RemoveContainer" containerID="a32b15c14eddec636665a8be9936c80cdbc7c7b47eb78f53a637a747a5fd8634"
Sep 18 04:07:31.432775 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:07:31.432753    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-jxtk4_openshift-console-operator(6d42c4e4-9bc8-4aa3-8056-c871229383e2)\"" pod="openshift-console-operator/console-operator-fd4bb46c-jxtk4" podUID="6d42c4e4-9bc8-4aa3-8056-c871229383e2"
Sep 18 04:07:31.765305 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:31.765272    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:31.861766 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:31.861738    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:31.886943 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:31.886889    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-26rlw\" (UID: \"2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc\") " pod="openshift-insights/insights-runtime-extractor-26rlw"
Sep 18 04:07:31.887068 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:31.886953    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-26rlw\" (UID: \"2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc\") " pod="openshift-insights/insights-runtime-extractor-26rlw"
Sep 18 04:07:31.887068 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:07:31.887013    2585 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 18 04:07:31.887068 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:07:31.887040    2585 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 18 04:07:31.887162 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:07:31.887086    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc-kube-rbac-proxy-cm podName:2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc nodeName:}" failed. No retries permitted until 2026-09-18 04:07:33.887070641 +0000 UTC m=+88.344513591 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-26rlw" (UID: "2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc") : configmap "kube-rbac-proxy" not found
Sep 18 04:07:31.887162 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:07:31.887101    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc-insights-runtime-extractor-tls podName:2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc nodeName:}" failed. No retries permitted until 2026-09-18 04:07:33.887094236 +0000 UTC m=+88.344537182 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-26rlw" (UID: "2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc") : secret "insights-runtime-extractor-tls" not found
Sep 18 04:07:32.323481 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:32.323454    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-r47v5_54309f7d-04d4-42f8-8ef3-de8d52091386/dns-node-resolver/0.log"
Sep 18 04:07:32.753589 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:32.753506    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:32.847645 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:32.847615    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:32.907261 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:32.907234    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:33.323658 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:33.323631    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pqmcs_1c08324d-73f3-4f3b-909e-78d4c450e24b/node-ca/0.log"
Sep 18 04:07:33.499867 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:33.499829    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e106cea-7104-4002-9041-3ee5f7287967-metrics-certs\") pod \"router-default-bdc687fb-txxfd\" (UID: \"1e106cea-7104-4002-9041-3ee5f7287967\") " pod="openshift-ingress/router-default-bdc687fb-txxfd"
Sep 18 04:07:33.500057 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:33.499911    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e106cea-7104-4002-9041-3ee5f7287967-service-ca-bundle\") pod \"router-default-bdc687fb-txxfd\" (UID: \"1e106cea-7104-4002-9041-3ee5f7287967\") " pod="openshift-ingress/router-default-bdc687fb-txxfd"
Sep 18 04:07:33.500057 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:07:33.499994    2585 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 18 04:07:33.500057 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:07:33.500029    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e106cea-7104-4002-9041-3ee5f7287967-service-ca-bundle podName:1e106cea-7104-4002-9041-3ee5f7287967 nodeName:}" failed. No retries permitted until 2026-09-18 04:07:41.500010821 +0000 UTC m=+95.957453769 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1e106cea-7104-4002-9041-3ee5f7287967-service-ca-bundle") pod "router-default-bdc687fb-txxfd" (UID: "1e106cea-7104-4002-9041-3ee5f7287967") : configmap references non-existent config key: service-ca.crt
Sep 18 04:07:33.500057 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:07:33.500046    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e106cea-7104-4002-9041-3ee5f7287967-metrics-certs podName:1e106cea-7104-4002-9041-3ee5f7287967 nodeName:}" failed. No retries permitted until 2026-09-18 04:07:41.500038441 +0000 UTC m=+95.957481387 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1e106cea-7104-4002-9041-3ee5f7287967-metrics-certs") pod "router-default-bdc687fb-txxfd" (UID: "1e106cea-7104-4002-9041-3ee5f7287967") : secret "router-metrics-certs-default" not found
Sep 18 04:07:33.897691 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:33.897662    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:33.902637 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:33.902618    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-26rlw\" (UID: \"2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc\") " pod="openshift-insights/insights-runtime-extractor-26rlw"
Sep 18 04:07:33.902701 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:33.902651    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-26rlw\" (UID: \"2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc\") " pod="openshift-insights/insights-runtime-extractor-26rlw"
Sep 18 04:07:33.902776 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:07:33.902763    2585 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 18 04:07:33.902831 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:07:33.902822    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc-insights-runtime-extractor-tls podName:2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc nodeName:}" failed. No retries permitted until 2026-09-18 04:07:37.902810002 +0000 UTC m=+92.360252952 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-26rlw" (UID: "2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc") : secret "insights-runtime-extractor-tls" not found
Sep 18 04:07:33.902873 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:07:33.902763    2585 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 18 04:07:33.902873 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:07:33.902863    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc-kube-rbac-proxy-cm podName:2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc nodeName:}" failed. No retries permitted until 2026-09-18 04:07:37.902854637 +0000 UTC m=+92.360297598 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-26rlw" (UID: "2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc") : configmap "kube-rbac-proxy" not found
Sep 18 04:07:33.925649 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:33.925619    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-swf4q_ec3a850b-db56-49b6-a2b7-3dc5b64b9d4f/serve-healthcheck-canary/0.log"
Sep 18 04:07:36.083970 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:36.083937    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-fd4bb46c-jxtk4"
Sep 18 04:07:36.084378 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:36.083984    2585 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-fd4bb46c-jxtk4"
Sep 18 04:07:36.084378 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:36.084278    2585 scope.go:117] "RemoveContainer" containerID="a32b15c14eddec636665a8be9936c80cdbc7c7b47eb78f53a637a747a5fd8634"
Sep 18 04:07:36.084449 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:07:36.084426    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-jxtk4_openshift-console-operator(6d42c4e4-9bc8-4aa3-8056-c871229383e2)\"" pod="openshift-console-operator/console-operator-fd4bb46c-jxtk4" podUID="6d42c4e4-9bc8-4aa3-8056-c871229383e2"
Sep 18 04:07:36.999558 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:36.999521    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:37.214458 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:37.214417    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:37.341417 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:37.341382    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:37.398943 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:37.398888    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:37.512792 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:37.512752    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:37.613191 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:37.613079    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:37.716064 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:37.716023    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:37.937320 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:37.937227    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-26rlw\" (UID: \"2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc\") " pod="openshift-insights/insights-runtime-extractor-26rlw"
Sep 18 04:07:37.937320 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:37.937272    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-26rlw\" (UID: \"2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc\") " pod="openshift-insights/insights-runtime-extractor-26rlw"
Sep 18 04:07:37.937548 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:07:37.937378    2585 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 18 04:07:37.937548 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:07:37.937385    2585 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 18 04:07:37.937548 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:07:37.937452    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc-kube-rbac-proxy-cm podName:2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc nodeName:}" failed. No retries permitted until 2026-09-18 04:07:45.93743518 +0000 UTC m=+100.394878140 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-26rlw" (UID: "2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc") : configmap "kube-rbac-proxy" not found
Sep 18 04:07:37.937548 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:07:37.937469    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc-insights-runtime-extractor-tls podName:2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc nodeName:}" failed. No retries permitted until 2026-09-18 04:07:45.937460835 +0000 UTC m=+100.394903786 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-26rlw" (UID: "2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc") : secret "insights-runtime-extractor-tls" not found
Sep 18 04:07:37.977077 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:37.977039    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:38.294331 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:38.294282    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:38.897492 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:38.897463    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:39.117165 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:39.117137    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:39.694382 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:39.694354    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:40.090656 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:40.090622    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:40.495946 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:40.495843    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:40.779070 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:40.778992    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:40.836137 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:40.836095    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:40.986618 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:40.986581    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:41.292018 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:41.291985    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:41.564349 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:41.564271    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e106cea-7104-4002-9041-3ee5f7287967-metrics-certs\") pod \"router-default-bdc687fb-txxfd\" (UID: \"1e106cea-7104-4002-9041-3ee5f7287967\") " pod="openshift-ingress/router-default-bdc687fb-txxfd"
Sep 18 04:07:41.564349 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:41.564333    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e106cea-7104-4002-9041-3ee5f7287967-service-ca-bundle\") pod \"router-default-bdc687fb-txxfd\" (UID: \"1e106cea-7104-4002-9041-3ee5f7287967\") " pod="openshift-ingress/router-default-bdc687fb-txxfd"
Sep 18 04:07:41.564522 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:07:41.564469    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e106cea-7104-4002-9041-3ee5f7287967-service-ca-bundle podName:1e106cea-7104-4002-9041-3ee5f7287967 nodeName:}" failed. No retries permitted until 2026-09-18 04:07:57.564452698 +0000 UTC m=+112.021895647 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1e106cea-7104-4002-9041-3ee5f7287967-service-ca-bundle") pod "router-default-bdc687fb-txxfd" (UID: "1e106cea-7104-4002-9041-3ee5f7287967") : configmap references non-existent config key: service-ca.crt
Sep 18 04:07:41.566689 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:41.566669    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e106cea-7104-4002-9041-3ee5f7287967-metrics-certs\") pod \"router-default-bdc687fb-txxfd\" (UID: \"1e106cea-7104-4002-9041-3ee5f7287967\") " pod="openshift-ingress/router-default-bdc687fb-txxfd"
Sep 18 04:07:41.892692 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:41.892612    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:41.953233 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:41.953198    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:42.090319 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:42.090283    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:42.289194 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:42.289162    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:42.694241 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:42.694148    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:43.284773 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:43.284743    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:43.432155 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:43.432123    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:43.780308 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:43.780208    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4c93f80c-45eb-481b-bacd-3e6749ed93c8-registry-tls\") pod \"image-registry-779df66775-8dkzt\" (UID: \"4c93f80c-45eb-481b-bacd-3e6749ed93c8\") " pod="openshift-image-registry/image-registry-779df66775-8dkzt"
Sep 18 04:07:43.782569 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:43.782540    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4c93f80c-45eb-481b-bacd-3e6749ed93c8-registry-tls\") pod \"image-registry-779df66775-8dkzt\" (UID: \"4c93f80c-45eb-481b-bacd-3e6749ed93c8\") " pod="openshift-image-registry/image-registry-779df66775-8dkzt"
Sep 18 04:07:43.855335 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:43.855295    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-k8q5g\""
Sep 18 04:07:43.863164 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:43.863140    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-779df66775-8dkzt"
Sep 18 04:07:43.881535 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:43.881510    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1004a663-1296-428b-838a-72dd37ad0e10-metrics-tls\") pod \"dns-default-5rpl9\" (UID: \"1004a663-1296-428b-838a-72dd37ad0e10\") " pod="openshift-dns/dns-default-5rpl9"
Sep 18 04:07:43.883753 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:43.883726    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1004a663-1296-428b-838a-72dd37ad0e10-metrics-tls\") pod \"dns-default-5rpl9\" (UID: \"1004a663-1296-428b-838a-72dd37ad0e10\") " pod="openshift-dns/dns-default-5rpl9"
Sep 18 04:07:43.892293 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:43.892256    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:44.099098 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:44.099062    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:44.138477 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:44.138437    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-779df66775-8dkzt"]
Sep 18 04:07:44.141464 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:07:44.141439    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c93f80c_45eb_481b_bacd_3e6749ed93c8.slice/crio-b86a194bab23d37603c1a3bfc81fb4a4fa16e650bf716c7c1c194841ff03f78b WatchSource:0}: Error finding container b86a194bab23d37603c1a3bfc81fb4a4fa16e650bf716c7c1c194841ff03f78b: Status 404 returned error can't find the container with id b86a194bab23d37603c1a3bfc81fb4a4fa16e650bf716c7c1c194841ff03f78b
Sep 18 04:07:44.171153 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:44.171136    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6pwqr\""
Sep 18 04:07:44.179366 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:44.179343    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5rpl9"
Sep 18 04:07:44.327699 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:44.327610    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:44.387438 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:44.387398    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:44.447468 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:44.447438    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5rpl9"]
Sep 18 04:07:44.450207 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:07:44.450174    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1004a663_1296_428b_838a_72dd37ad0e10.slice/crio-432c28bbb9669d0069aad07fa756b780dd15980c7f0b7e8f5ed039d6c01c63fb WatchSource:0}: Error finding container 432c28bbb9669d0069aad07fa756b780dd15980c7f0b7e8f5ed039d6c01c63fb: Status 404 returned error can't find the container with id 432c28bbb9669d0069aad07fa756b780dd15980c7f0b7e8f5ed039d6c01c63fb
Sep 18 04:07:44.469815 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:44.469792    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5rpl9" event={"ID":"1004a663-1296-428b-838a-72dd37ad0e10","Type":"ContainerStarted","Data":"432c28bbb9669d0069aad07fa756b780dd15980c7f0b7e8f5ed039d6c01c63fb"}
Sep 18 04:07:44.471446 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:44.471421    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-779df66775-8dkzt" event={"ID":"4c93f80c-45eb-481b-bacd-3e6749ed93c8","Type":"ContainerStarted","Data":"d90256f686778b03be3ceec8a8f9e3fb7cb62fb44e0c853c03a93b1890ccc157"}
Sep 18 04:07:44.471537 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:44.471465    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-779df66775-8dkzt" event={"ID":"4c93f80c-45eb-481b-bacd-3e6749ed93c8","Type":"ContainerStarted","Data":"b86a194bab23d37603c1a3bfc81fb4a4fa16e650bf716c7c1c194841ff03f78b"}
Sep 18 04:07:44.471537 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:44.471504    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-779df66775-8dkzt"
Sep 18 04:07:44.490933 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:44.490869    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-779df66775-8dkzt" podStartSLOduration=77.49085427 podStartE2EDuration="1m17.49085427s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:06:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:07:44.490136925 +0000 UTC m=+98.947579895" watchObservedRunningTime="2026-09-18 04:07:44.49085427 +0000 UTC m=+98.948297239"
Sep 18 04:07:44.702142 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:44.702065    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:45.368866 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:45.368840    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:45.655680 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:45.655560    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:45.723476 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:45.723423    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:46.002201 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:46.002171    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-26rlw\" (UID: \"2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc\") " pod="openshift-insights/insights-runtime-extractor-26rlw"
Sep 18 04:07:46.002321 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:46.002211    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-26rlw\" (UID: \"2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc\") " pod="openshift-insights/insights-runtime-extractor-26rlw"
Sep 18 04:07:46.002369 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:07:46.002314    2585 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 18 04:07:46.002404 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:07:46.002374    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc-insights-runtime-extractor-tls podName:2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc nodeName:}" failed. No retries permitted until 2026-09-18 04:08:02.002358921 +0000 UTC m=+116.459801872 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-26rlw" (UID: "2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc") : secret "insights-runtime-extractor-tls" not found
Sep 18 04:07:46.002648 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:46.002623    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-26rlw\" (UID: \"2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc\") " pod="openshift-insights/insights-runtime-extractor-26rlw"
Sep 18 04:07:46.093645 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:46.093618    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:46.479299 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:46.479265    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5rpl9" event={"ID":"1004a663-1296-428b-838a-72dd37ad0e10","Type":"ContainerStarted","Data":"3bfd5bf1b76aaac97eec99dc65a072570da0e864ba70efafdf34f3adba2e06f2"}
Sep 18 04:07:46.479718 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:46.479321    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5rpl9" event={"ID":"1004a663-1296-428b-838a-72dd37ad0e10","Type":"ContainerStarted","Data":"b750fd3c4d51a5dd6a5176d94ab445ab5d1d7e68edf396fce29b2c80be00a99e"}
Sep 18 04:07:46.479718 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:46.479433    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-5rpl9"
Sep 18 04:07:46.487640 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:46.487615    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:46.499238 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:46.499194    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-5rpl9" podStartSLOduration=66.004841837 podStartE2EDuration="1m7.499179439s" totalImagesPullingTime="1.494337602s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:06:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:07:46.498306541 +0000 UTC m=+100.955749512" watchObservedRunningTime="2026-09-18 04:07:46.499179439 +0000 UTC m=+100.956622407"
Sep 18 04:07:46.693604 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:46.693569    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:47.102185 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:47.102142    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:47.487284 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:47.487207    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:47.694157 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:47.694116    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:49.389523 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:49.389487    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-z59z5"
Sep 18 04:07:50.003665 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:50.003624    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:50.063645 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:50.063609    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:51.781645 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:51.781612    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:51.887349 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:51.887310    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:51.984784 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:51.984759    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:52.060629 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:52.060611    2585 scope.go:117] "RemoveContainer" containerID="a32b15c14eddec636665a8be9936c80cdbc7c7b47eb78f53a637a747a5fd8634"
Sep 18 04:07:52.082125 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:52.082096    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:52.502473 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:52.502393    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-jxtk4_6d42c4e4-9bc8-4aa3-8056-c871229383e2/console-operator/1.log"
Sep 18 04:07:52.502473 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:52.502458    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-jxtk4" event={"ID":"6d42c4e4-9bc8-4aa3-8056-c871229383e2","Type":"ContainerStarted","Data":"2c3821dbd3f73f89271a4138df1d3df82b903940b514c0a459d8ecf4cce66156"}
Sep 18 04:07:52.502785 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:52.502756    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-fd4bb46c-jxtk4"
Sep 18 04:07:52.531624 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:52.531576    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-fd4bb46c-jxtk4" podStartSLOduration=25.172159229 podStartE2EDuration="27.531560787s" totalImagesPullingTime="2.359401558s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:07:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:07:52.530719588 +0000 UTC m=+106.988162556" watchObservedRunningTime="2026-09-18 04:07:52.531560787 +0000 UTC m=+106.989003790"
Sep 18 04:07:52.930580 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:52.930544    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:52.952269 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:52.952238    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-fd4bb46c-jxtk4"
Sep 18 04:07:53.182759 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:53.182674    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6594f4c75-l5pdv"]
Sep 18 04:07:53.188615 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:53.188590    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:53.206294 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:53.206273    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6594f4c75-l5pdv"]
Sep 18 04:07:53.206430 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:53.206375    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6594f4c75-l5pdv"
Sep 18 04:07:53.209191 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:53.209167    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 18 04:07:53.209362 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:53.209342    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-td5z7\""
Sep 18 04:07:53.209410 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:53.209354    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 18 04:07:53.362010 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:53.361971    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gwx9\" (UniqueName: \"kubernetes.io/projected/388bb907-16cf-4b0a-beb8-c3fa40a14153-kube-api-access-5gwx9\") pod \"downloads-6594f4c75-l5pdv\" (UID: \"388bb907-16cf-4b0a-beb8-c3fa40a14153\") " pod="openshift-console/downloads-6594f4c75-l5pdv"
Sep 18 04:07:53.462684 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:53.462594    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gwx9\" (UniqueName: \"kubernetes.io/projected/388bb907-16cf-4b0a-beb8-c3fa40a14153-kube-api-access-5gwx9\") pod \"downloads-6594f4c75-l5pdv\" (UID: \"388bb907-16cf-4b0a-beb8-c3fa40a14153\") " pod="openshift-console/downloads-6594f4c75-l5pdv"
Sep 18 04:07:53.471126 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:53.471094    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gwx9\" (UniqueName: \"kubernetes.io/projected/388bb907-16cf-4b0a-beb8-c3fa40a14153-kube-api-access-5gwx9\") pod \"downloads-6594f4c75-l5pdv\" (UID: \"388bb907-16cf-4b0a-beb8-c3fa40a14153\") " pod="openshift-console/downloads-6594f4c75-l5pdv"
Sep 18 04:07:53.515715 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:53.515685    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6594f4c75-l5pdv"
Sep 18 04:07:53.670840 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:53.670813    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:53.806397 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:53.806363    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6594f4c75-l5pdv"]
Sep 18 04:07:53.809234 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:07:53.809208    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod388bb907_16cf_4b0a_beb8_c3fa40a14153.slice/crio-76ee46116367c4d5bdfbeea688c76ecb53396f3b7dc4294152a4efde4ebca65a WatchSource:0}: Error finding container 76ee46116367c4d5bdfbeea688c76ecb53396f3b7dc4294152a4efde4ebca65a: Status 404 returned error can't find the container with id 76ee46116367c4d5bdfbeea688c76ecb53396f3b7dc4294152a4efde4ebca65a
Sep 18 04:07:54.133820 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:54.133738    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:54.237341 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:54.237301    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:54.405780 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:54.405692    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:54.511593 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:54.511558    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6594f4c75-l5pdv" event={"ID":"388bb907-16cf-4b0a-beb8-c3fa40a14153","Type":"ContainerStarted","Data":"76ee46116367c4d5bdfbeea688c76ecb53396f3b7dc4294152a4efde4ebca65a"}
Sep 18 04:07:54.649481 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:54.649448    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:54.708958 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:54.708862    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:54.822854 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:54.822794    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:55.034067 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:55.034020    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:55.831792 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:55.831763    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:55.887036 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:55.886997    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:55.994647 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:55.994592    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:07:56.487151 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:56.487120    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-5rpl9"
Sep 18 04:07:57.603264 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:57.603224    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e106cea-7104-4002-9041-3ee5f7287967-service-ca-bundle\") pod \"router-default-bdc687fb-txxfd\" (UID: \"1e106cea-7104-4002-9041-3ee5f7287967\") " pod="openshift-ingress/router-default-bdc687fb-txxfd"
Sep 18 04:07:57.603870 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:57.603844    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e106cea-7104-4002-9041-3ee5f7287967-service-ca-bundle\") pod \"router-default-bdc687fb-txxfd\" (UID: \"1e106cea-7104-4002-9041-3ee5f7287967\") " pod="openshift-ingress/router-default-bdc687fb-txxfd"
Sep 18 04:07:57.873934 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:57.873826    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-bdc687fb-txxfd"
Sep 18 04:07:58.151614 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:58.151544    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-bdc687fb-txxfd"]
Sep 18 04:07:58.155080 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:07:58.155050    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e106cea_7104_4002_9041_3ee5f7287967.slice/crio-fbbb79d0f133cc44cc0473f9ee22b5995b57b7a8c3e996766b3dd71bad7b98ae WatchSource:0}: Error finding container fbbb79d0f133cc44cc0473f9ee22b5995b57b7a8c3e996766b3dd71bad7b98ae: Status 404 returned error can't find the container with id fbbb79d0f133cc44cc0473f9ee22b5995b57b7a8c3e996766b3dd71bad7b98ae
Sep 18 04:07:58.529782 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:58.529695    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-bdc687fb-txxfd" event={"ID":"1e106cea-7104-4002-9041-3ee5f7287967","Type":"ContainerStarted","Data":"5840139b88198a170b8804352c1ad8b6e1ede90de62c782fc213519bd69701a1"}
Sep 18 04:07:58.529782 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:58.529754    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-bdc687fb-txxfd" event={"ID":"1e106cea-7104-4002-9041-3ee5f7287967","Type":"ContainerStarted","Data":"fbbb79d0f133cc44cc0473f9ee22b5995b57b7a8c3e996766b3dd71bad7b98ae"}
Sep 18 04:07:58.550396 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:58.550347    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-bdc687fb-txxfd" podStartSLOduration=33.550331585 podStartE2EDuration="33.550331585s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:07:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:07:58.548627459 +0000 UTC m=+113.006070429" watchObservedRunningTime="2026-09-18 04:07:58.550331585 +0000 UTC m=+113.007774553"
Sep 18 04:07:58.874199 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:58.874156    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-bdc687fb-txxfd"
Sep 18 04:07:58.877105 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:58.877086    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-bdc687fb-txxfd"
Sep 18 04:07:59.533973 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:59.533931    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-bdc687fb-txxfd"
Sep 18 04:07:59.535386 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:07:59.535361    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-bdc687fb-txxfd"
Sep 18 04:08:00.977742 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:00.977706    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:08:01.042079 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:01.042031    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:08:01.837163 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:01.837118    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:08:01.881314 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:01.881279    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7cb6bb86bc-4tqcl"]
Sep 18 04:08:01.885522 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:01.885497    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cb6bb86bc-4tqcl"
Sep 18 04:08:01.889018 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:01.888788    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 18 04:08:01.889018 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:01.888788    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 18 04:08:01.889018 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:01.888864    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-6nkzk\""
Sep 18 04:08:01.889018 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:01.888787    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 18 04:08:01.889018 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:01.888801    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 18 04:08:01.889018 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:01.888788    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 18 04:08:01.895911 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:01.895870    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7cb6bb86bc-4tqcl"]
Sep 18 04:08:01.919171 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:01.919136    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:08:02.041661 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:02.041630    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-26rlw\" (UID: \"2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc\") " pod="openshift-insights/insights-runtime-extractor-26rlw"
Sep 18 04:08:02.042070 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:02.041672    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6bb9e09b-4e61-4a14-93d5-61738ecb178b-service-ca\") pod \"console-7cb6bb86bc-4tqcl\" (UID: \"6bb9e09b-4e61-4a14-93d5-61738ecb178b\") " pod="openshift-console/console-7cb6bb86bc-4tqcl"
Sep 18 04:08:02.042070 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:02.041696    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6bb9e09b-4e61-4a14-93d5-61738ecb178b-console-oauth-config\") pod \"console-7cb6bb86bc-4tqcl\" (UID: \"6bb9e09b-4e61-4a14-93d5-61738ecb178b\") " pod="openshift-console/console-7cb6bb86bc-4tqcl"
Sep 18 04:08:02.042070 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:02.041753    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6bb9e09b-4e61-4a14-93d5-61738ecb178b-console-serving-cert\") pod \"console-7cb6bb86bc-4tqcl\" (UID: \"6bb9e09b-4e61-4a14-93d5-61738ecb178b\") " pod="openshift-console/console-7cb6bb86bc-4tqcl"
Sep 18 04:08:02.042070 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:02.041803    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtmdt\" (UniqueName: \"kubernetes.io/projected/6bb9e09b-4e61-4a14-93d5-61738ecb178b-kube-api-access-dtmdt\") pod \"console-7cb6bb86bc-4tqcl\" (UID: \"6bb9e09b-4e61-4a14-93d5-61738ecb178b\") " pod="openshift-console/console-7cb6bb86bc-4tqcl"
Sep 18 04:08:02.042070 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:02.041842    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6bb9e09b-4e61-4a14-93d5-61738ecb178b-console-config\") pod \"console-7cb6bb86bc-4tqcl\" (UID: \"6bb9e09b-4e61-4a14-93d5-61738ecb178b\") " pod="openshift-console/console-7cb6bb86bc-4tqcl"
Sep 18 04:08:02.042070 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:02.041862    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6bb9e09b-4e61-4a14-93d5-61738ecb178b-oauth-serving-cert\") pod \"console-7cb6bb86bc-4tqcl\" (UID: \"6bb9e09b-4e61-4a14-93d5-61738ecb178b\") " pod="openshift-console/console-7cb6bb86bc-4tqcl"
Sep 18 04:08:02.044172 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:02.044152    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-26rlw\" (UID: \"2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc\") " pod="openshift-insights/insights-runtime-extractor-26rlw"
Sep 18 04:08:02.143025 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:02.142932    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6bb9e09b-4e61-4a14-93d5-61738ecb178b-service-ca\") pod \"console-7cb6bb86bc-4tqcl\" (UID: \"6bb9e09b-4e61-4a14-93d5-61738ecb178b\") " pod="openshift-console/console-7cb6bb86bc-4tqcl"
Sep 18 04:08:02.143025 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:02.142985    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6bb9e09b-4e61-4a14-93d5-61738ecb178b-console-oauth-config\") pod \"console-7cb6bb86bc-4tqcl\" (UID: \"6bb9e09b-4e61-4a14-93d5-61738ecb178b\") " pod="openshift-console/console-7cb6bb86bc-4tqcl"
Sep 18 04:08:02.143025 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:02.143014    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6bb9e09b-4e61-4a14-93d5-61738ecb178b-console-serving-cert\") pod \"console-7cb6bb86bc-4tqcl\" (UID: \"6bb9e09b-4e61-4a14-93d5-61738ecb178b\") " pod="openshift-console/console-7cb6bb86bc-4tqcl"
Sep 18 04:08:02.143294 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:02.143059    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtmdt\" (UniqueName: \"kubernetes.io/projected/6bb9e09b-4e61-4a14-93d5-61738ecb178b-kube-api-access-dtmdt\") pod \"console-7cb6bb86bc-4tqcl\" (UID: \"6bb9e09b-4e61-4a14-93d5-61738ecb178b\") " pod="openshift-console/console-7cb6bb86bc-4tqcl"
Sep 18 04:08:02.143294 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:02.143103    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6bb9e09b-4e61-4a14-93d5-61738ecb178b-console-config\") pod \"console-7cb6bb86bc-4tqcl\" (UID: \"6bb9e09b-4e61-4a14-93d5-61738ecb178b\") " pod="openshift-console/console-7cb6bb86bc-4tqcl"
Sep 18 04:08:02.143294 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:02.143132    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6bb9e09b-4e61-4a14-93d5-61738ecb178b-oauth-serving-cert\") pod \"console-7cb6bb86bc-4tqcl\" (UID: \"6bb9e09b-4e61-4a14-93d5-61738ecb178b\") " pod="openshift-console/console-7cb6bb86bc-4tqcl"
Sep 18 04:08:02.143822 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:02.143793    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6bb9e09b-4e61-4a14-93d5-61738ecb178b-service-ca\") pod \"console-7cb6bb86bc-4tqcl\" (UID: \"6bb9e09b-4e61-4a14-93d5-61738ecb178b\") " pod="openshift-console/console-7cb6bb86bc-4tqcl"
Sep 18 04:08:02.144048 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:02.144022    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6bb9e09b-4e61-4a14-93d5-61738ecb178b-oauth-serving-cert\") pod \"console-7cb6bb86bc-4tqcl\" (UID: \"6bb9e09b-4e61-4a14-93d5-61738ecb178b\") " pod="openshift-console/console-7cb6bb86bc-4tqcl"
Sep 18 04:08:02.144155 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:02.144097    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6bb9e09b-4e61-4a14-93d5-61738ecb178b-console-config\") pod \"console-7cb6bb86bc-4tqcl\" (UID: \"6bb9e09b-4e61-4a14-93d5-61738ecb178b\") " pod="openshift-console/console-7cb6bb86bc-4tqcl"
Sep 18 04:08:02.146022 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:02.145858    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6bb9e09b-4e61-4a14-93d5-61738ecb178b-console-serving-cert\") pod \"console-7cb6bb86bc-4tqcl\" (UID: \"6bb9e09b-4e61-4a14-93d5-61738ecb178b\") " pod="openshift-console/console-7cb6bb86bc-4tqcl"
Sep 18 04:08:02.146131 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:02.146065    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6bb9e09b-4e61-4a14-93d5-61738ecb178b-console-oauth-config\") pod \"console-7cb6bb86bc-4tqcl\" (UID: \"6bb9e09b-4e61-4a14-93d5-61738ecb178b\") " pod="openshift-console/console-7cb6bb86bc-4tqcl"
Sep 18 04:08:02.159209 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:02.159186    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtmdt\" (UniqueName: \"kubernetes.io/projected/6bb9e09b-4e61-4a14-93d5-61738ecb178b-kube-api-access-dtmdt\") pod \"console-7cb6bb86bc-4tqcl\" (UID: \"6bb9e09b-4e61-4a14-93d5-61738ecb178b\") " pod="openshift-console/console-7cb6bb86bc-4tqcl"
Sep 18 04:08:02.197075 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:02.197039    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cb6bb86bc-4tqcl"
Sep 18 04:08:02.205532 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:02.205500    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:08:02.271385 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:02.271348    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-26rlw"
Sep 18 04:08:02.306636 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:02.306583    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:08:02.374181 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:02.374056    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-fbvn9"]
Sep 18 04:08:02.377833 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:02.377810    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-fbvn9"
Sep 18 04:08:02.380503 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:02.380479    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 18 04:08:02.380634 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:02.380502    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-qpf9f\""
Sep 18 04:08:02.382511 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:02.382483    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:08:02.389874 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:02.389816    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-fbvn9"]
Sep 18 04:08:02.478778 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:02.478707    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7cb6bb86bc-4tqcl"]
Sep 18 04:08:02.482441 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:08:02.482414    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bb9e09b_4e61_4a14_93d5_61738ecb178b.slice/crio-f36a771c97e0f46f8d396f6ada3dcf8c944395ff277b6fe070ed5a8136dd1243 WatchSource:0}: Error finding container f36a771c97e0f46f8d396f6ada3dcf8c944395ff277b6fe070ed5a8136dd1243: Status 404 returned error can't find the container with id f36a771c97e0f46f8d396f6ada3dcf8c944395ff277b6fe070ed5a8136dd1243
Sep 18 04:08:02.547447 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:02.547416    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/351504a9-4a92-4c8f-b340-b73af9db8450-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-fbvn9\" (UID: \"351504a9-4a92-4c8f-b340-b73af9db8450\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-fbvn9"
Sep 18 04:08:02.548715 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:02.548684    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cb6bb86bc-4tqcl" event={"ID":"6bb9e09b-4e61-4a14-93d5-61738ecb178b","Type":"ContainerStarted","Data":"f36a771c97e0f46f8d396f6ada3dcf8c944395ff277b6fe070ed5a8136dd1243"}
Sep 18 04:08:02.553083 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:02.553059    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-26rlw"]
Sep 18 04:08:02.555541 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:08:02.555518    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cc64964_e5c8_4a71_b65e_d8a8b1c6d6dc.slice/crio-b65f425be3602c12e97faf2558f30747a29f8c6471ae459c1ce6f6be3b0290eb WatchSource:0}: Error finding container b65f425be3602c12e97faf2558f30747a29f8c6471ae459c1ce6f6be3b0290eb: Status 404 returned error can't find the container with id b65f425be3602c12e97faf2558f30747a29f8c6471ae459c1ce6f6be3b0290eb
Sep 18 04:08:02.648594 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:02.648559    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/351504a9-4a92-4c8f-b340-b73af9db8450-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-fbvn9\" (UID: \"351504a9-4a92-4c8f-b340-b73af9db8450\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-fbvn9"
Sep 18 04:08:02.648759 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:08:02.648737    2585 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Sep 18 04:08:02.648830 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:08:02.648820    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/351504a9-4a92-4c8f-b340-b73af9db8450-tls-certificates podName:351504a9-4a92-4c8f-b340-b73af9db8450 nodeName:}" failed. No retries permitted until 2026-09-18 04:08:03.148798448 +0000 UTC m=+117.606241397 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/351504a9-4a92-4c8f-b340-b73af9db8450-tls-certificates") pod "prometheus-operator-admission-webhook-5c6747dc7b-fbvn9" (UID: "351504a9-4a92-4c8f-b340-b73af9db8450") : secret "prometheus-operator-admission-webhook-tls" not found
Sep 18 04:08:02.757195 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:02.757077    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:08:03.153020 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:03.152978    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/351504a9-4a92-4c8f-b340-b73af9db8450-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-fbvn9\" (UID: \"351504a9-4a92-4c8f-b340-b73af9db8450\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-fbvn9"
Sep 18 04:08:03.155741 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:03.155716    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/351504a9-4a92-4c8f-b340-b73af9db8450-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-fbvn9\" (UID: \"351504a9-4a92-4c8f-b340-b73af9db8450\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-fbvn9"
Sep 18 04:08:03.289062 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:03.289022    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-fbvn9"
Sep 18 04:08:03.553733 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:03.553701    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-26rlw" event={"ID":"2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc","Type":"ContainerStarted","Data":"ce0cda79f5d392a6aa22e679c89776e5e36349c6b10d631b71685d4ab174764b"}
Sep 18 04:08:03.553921 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:03.553757    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-26rlw" event={"ID":"2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc","Type":"ContainerStarted","Data":"b65f425be3602c12e97faf2558f30747a29f8c6471ae459c1ce6f6be3b0290eb"}
Sep 18 04:08:03.868203 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:03.868107    2585 patch_prober.go:28] interesting pod/image-registry-779df66775-8dkzt container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 18 04:08:03.868203 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:03.868163    2585 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-779df66775-8dkzt" podUID="4c93f80c-45eb-481b-bacd-3e6749ed93c8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 04:08:04.802289 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:04.802246    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:08:05.009569 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:05.009524    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:08:05.110273 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:05.110186    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:08:05.479288 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:05.479218    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-779df66775-8dkzt"
Sep 18 04:08:05.738869 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:05.738766    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:08:05.806428 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:05.806387    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:08:07.822770 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:07.822724    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:08:07.885609 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:07.885568    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:08:09.640747 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:09.640713    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:08:09.698592 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:09.698561    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:08:09.931844 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:09.931769    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-fbvn9"]
Sep 18 04:08:09.960221 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:09.960187    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:08:10.017184 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:10.017101    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:08:10.438569 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:10.437659    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7b575c66b8-9f97s"]
Sep 18 04:08:10.441242 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:10.441214    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b575c66b8-9f97s"
Sep 18 04:08:10.455929 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:10.455877    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 18 04:08:10.458101 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:10.458029    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b575c66b8-9f97s"]
Sep 18 04:08:10.517953 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:10.517559    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d9a0ebcf-4cf9-4bdc-96ca-121c557461b1-service-ca\") pod \"console-7b575c66b8-9f97s\" (UID: \"d9a0ebcf-4cf9-4bdc-96ca-121c557461b1\") " pod="openshift-console/console-7b575c66b8-9f97s"
Sep 18 04:08:10.517953 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:10.517608    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d9a0ebcf-4cf9-4bdc-96ca-121c557461b1-oauth-serving-cert\") pod \"console-7b575c66b8-9f97s\" (UID: \"d9a0ebcf-4cf9-4bdc-96ca-121c557461b1\") " pod="openshift-console/console-7b575c66b8-9f97s"
Sep 18 04:08:10.517953 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:10.517658    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d9a0ebcf-4cf9-4bdc-96ca-121c557461b1-console-serving-cert\") pod \"console-7b575c66b8-9f97s\" (UID: \"d9a0ebcf-4cf9-4bdc-96ca-121c557461b1\") " pod="openshift-console/console-7b575c66b8-9f97s"
Sep 18 04:08:10.517953 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:10.517686    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d9a0ebcf-4cf9-4bdc-96ca-121c557461b1-console-oauth-config\") pod \"console-7b575c66b8-9f97s\" (UID: \"d9a0ebcf-4cf9-4bdc-96ca-121c557461b1\") " pod="openshift-console/console-7b575c66b8-9f97s"
Sep 18 04:08:10.517953 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:10.517753    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9a0ebcf-4cf9-4bdc-96ca-121c557461b1-trusted-ca-bundle\") pod \"console-7b575c66b8-9f97s\" (UID: \"d9a0ebcf-4cf9-4bdc-96ca-121c557461b1\") " pod="openshift-console/console-7b575c66b8-9f97s"
Sep 18 04:08:10.517953 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:10.517782    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbwfb\" (UniqueName: \"kubernetes.io/projected/d9a0ebcf-4cf9-4bdc-96ca-121c557461b1-kube-api-access-gbwfb\") pod \"console-7b575c66b8-9f97s\" (UID: \"d9a0ebcf-4cf9-4bdc-96ca-121c557461b1\") " pod="openshift-console/console-7b575c66b8-9f97s"
Sep 18 04:08:10.517953 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:10.517822    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d9a0ebcf-4cf9-4bdc-96ca-121c557461b1-console-config\") pod \"console-7b575c66b8-9f97s\" (UID: \"d9a0ebcf-4cf9-4bdc-96ca-121c557461b1\") " pod="openshift-console/console-7b575c66b8-9f97s"
Sep 18 04:08:10.592019 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:10.591936    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-fbvn9" event={"ID":"351504a9-4a92-4c8f-b340-b73af9db8450","Type":"ContainerStarted","Data":"2e32dac9a91a4db74d9eed99657a1616f5c6ef7f65f1424fddfec762a5ca9b17"}
Sep 18 04:08:10.596248 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:10.596155    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-26rlw" event={"ID":"2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc","Type":"ContainerStarted","Data":"20c2889352418a477c8cffc2788a050f76bfd952ae0571b5420684dde9085eb0"}
Sep 18 04:08:10.598370 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:10.598270    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6594f4c75-l5pdv" event={"ID":"388bb907-16cf-4b0a-beb8-c3fa40a14153","Type":"ContainerStarted","Data":"159c7085d7eea8b65885a06d2ec724f2e9ea3f60ea58e74eeb57c5bfdffc6ece"}
Sep 18 04:08:10.599510 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:10.599486    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6594f4c75-l5pdv"
Sep 18 04:08:10.614648 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:10.614623    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6594f4c75-l5pdv"
Sep 18 04:08:10.617776 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:10.617722    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6594f4c75-l5pdv" podStartSLOduration=1.6635144689999999 podStartE2EDuration="17.617702344s" totalImagesPullingTime="15.954187875s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:07:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:08:10.616971343 +0000 UTC m=+125.074414311" watchObservedRunningTime="2026-09-18 04:08:10.617702344 +0000 UTC m=+125.075145376"
Sep 18 04:08:10.618764 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:10.618737    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9a0ebcf-4cf9-4bdc-96ca-121c557461b1-trusted-ca-bundle\") pod \"console-7b575c66b8-9f97s\" (UID: \"d9a0ebcf-4cf9-4bdc-96ca-121c557461b1\") " pod="openshift-console/console-7b575c66b8-9f97s"
Sep 18 04:08:10.618870 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:10.618778    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbwfb\" (UniqueName: \"kubernetes.io/projected/d9a0ebcf-4cf9-4bdc-96ca-121c557461b1-kube-api-access-gbwfb\") pod \"console-7b575c66b8-9f97s\" (UID: \"d9a0ebcf-4cf9-4bdc-96ca-121c557461b1\") " pod="openshift-console/console-7b575c66b8-9f97s"
Sep 18 04:08:10.618870 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:10.618821    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d9a0ebcf-4cf9-4bdc-96ca-121c557461b1-console-config\") pod \"console-7b575c66b8-9f97s\" (UID: \"d9a0ebcf-4cf9-4bdc-96ca-121c557461b1\") " pod="openshift-console/console-7b575c66b8-9f97s"
Sep 18 04:08:10.619008 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:10.618948    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d9a0ebcf-4cf9-4bdc-96ca-121c557461b1-service-ca\") pod \"console-7b575c66b8-9f97s\" (UID: \"d9a0ebcf-4cf9-4bdc-96ca-121c557461b1\") " pod="openshift-console/console-7b575c66b8-9f97s"
Sep 18 04:08:10.619008 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:10.618975    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d9a0ebcf-4cf9-4bdc-96ca-121c557461b1-oauth-serving-cert\") pod \"console-7b575c66b8-9f97s\" (UID: \"d9a0ebcf-4cf9-4bdc-96ca-121c557461b1\") " pod="openshift-console/console-7b575c66b8-9f97s"
Sep 18 04:08:10.619115 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:10.619028    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d9a0ebcf-4cf9-4bdc-96ca-121c557461b1-console-serving-cert\") pod \"console-7b575c66b8-9f97s\" (UID: \"d9a0ebcf-4cf9-4bdc-96ca-121c557461b1\") " pod="openshift-console/console-7b575c66b8-9f97s"
Sep 18 04:08:10.619115 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:10.619057    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d9a0ebcf-4cf9-4bdc-96ca-121c557461b1-console-oauth-config\") pod \"console-7b575c66b8-9f97s\" (UID: \"d9a0ebcf-4cf9-4bdc-96ca-121c557461b1\") " pod="openshift-console/console-7b575c66b8-9f97s"
Sep 18 04:08:10.626928 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:10.625571    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d9a0ebcf-4cf9-4bdc-96ca-121c557461b1-oauth-serving-cert\") pod \"console-7b575c66b8-9f97s\" (UID: \"d9a0ebcf-4cf9-4bdc-96ca-121c557461b1\") " pod="openshift-console/console-7b575c66b8-9f97s"
Sep 18 04:08:10.626928 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:10.626523    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d9a0ebcf-4cf9-4bdc-96ca-121c557461b1-service-ca\") pod \"console-7b575c66b8-9f97s\" (UID: \"d9a0ebcf-4cf9-4bdc-96ca-121c557461b1\") " pod="openshift-console/console-7b575c66b8-9f97s"
Sep 18 04:08:10.627863 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:10.627826    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d9a0ebcf-4cf9-4bdc-96ca-121c557461b1-console-config\") pod \"console-7b575c66b8-9f97s\" (UID: \"d9a0ebcf-4cf9-4bdc-96ca-121c557461b1\") " pod="openshift-console/console-7b575c66b8-9f97s"
Sep 18 04:08:10.632942 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:10.632037    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d9a0ebcf-4cf9-4bdc-96ca-121c557461b1-console-oauth-config\") pod \"console-7b575c66b8-9f97s\" (UID: \"d9a0ebcf-4cf9-4bdc-96ca-121c557461b1\") " pod="openshift-console/console-7b575c66b8-9f97s"
Sep 18 04:08:10.633936 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:10.633911    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbwfb\" (UniqueName: \"kubernetes.io/projected/d9a0ebcf-4cf9-4bdc-96ca-121c557461b1-kube-api-access-gbwfb\") pod \"console-7b575c66b8-9f97s\" (UID: \"d9a0ebcf-4cf9-4bdc-96ca-121c557461b1\") " pod="openshift-console/console-7b575c66b8-9f97s"
Sep 18 04:08:10.634816 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:10.634781    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9a0ebcf-4cf9-4bdc-96ca-121c557461b1-trusted-ca-bundle\") pod \"console-7b575c66b8-9f97s\" (UID: \"d9a0ebcf-4cf9-4bdc-96ca-121c557461b1\") " pod="openshift-console/console-7b575c66b8-9f97s"
Sep 18 04:08:10.643750 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:10.643713    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d9a0ebcf-4cf9-4bdc-96ca-121c557461b1-console-serving-cert\") pod \"console-7b575c66b8-9f97s\" (UID: \"d9a0ebcf-4cf9-4bdc-96ca-121c557461b1\") " pod="openshift-console/console-7b575c66b8-9f97s"
Sep 18 04:08:10.763098 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:10.762787    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b575c66b8-9f97s"
Sep 18 04:08:11.095574 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:11.095438    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b575c66b8-9f97s"]
Sep 18 04:08:11.606363 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:11.606329    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b575c66b8-9f97s" event={"ID":"d9a0ebcf-4cf9-4bdc-96ca-121c557461b1","Type":"ContainerStarted","Data":"071886410e969604ad6dc962cb5655890d32d703d59d4842ea2ec103100a172e"}
Sep 18 04:08:12.855849 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:12.855791    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:08:13.866938 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:13.866233    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-779df66775-8dkzt"]
Sep 18 04:08:13.953494 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:13.953459    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:08:14.055066 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:14.054877    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:08:14.154665 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:14.154483    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:08:15.873663 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:15.873620    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d169a38-932c-4d14-8a19-3ce5341fc190-metrics-certs\") pod \"network-metrics-daemon-zg942\" (UID: \"2d169a38-932c-4d14-8a19-3ce5341fc190\") " pod="openshift-multus/network-metrics-daemon-zg942"
Sep 18 04:08:15.878213 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:15.878158    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d169a38-932c-4d14-8a19-3ce5341fc190-metrics-certs\") pod \"network-metrics-daemon-zg942\" (UID: \"2d169a38-932c-4d14-8a19-3ce5341fc190\") " pod="openshift-multus/network-metrics-daemon-zg942"
Sep 18 04:08:16.078328 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:16.078295    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mt76n\""
Sep 18 04:08:16.086742 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:16.086714    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zg942"
Sep 18 04:08:16.319740 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:16.319695    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:08:16.420376 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:16.420210    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:08:16.898028 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:16.897989    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:08:16.993073 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:16.993025    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:08:17.061438 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:17.061403    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zg942"]
Sep 18 04:08:17.213238 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:08:17.213205    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d169a38_932c_4d14_8a19_3ce5341fc190.slice/crio-18d5703c9499fe70735c72a506893af1f09199f7b5efb8044838dbbe433883d7 WatchSource:0}: Error finding container 18d5703c9499fe70735c72a506893af1f09199f7b5efb8044838dbbe433883d7: Status 404 returned error can't find the container with id 18d5703c9499fe70735c72a506893af1f09199f7b5efb8044838dbbe433883d7
Sep 18 04:08:17.635567 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:17.635427    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-26rlw" event={"ID":"2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc","Type":"ContainerStarted","Data":"179ef77951767d10e3cd288b99fb8880eabec173368ce3ed9cfe86fe49305803"}
Sep 18 04:08:17.637418 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:17.637389    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b575c66b8-9f97s" event={"ID":"d9a0ebcf-4cf9-4bdc-96ca-121c557461b1","Type":"ContainerStarted","Data":"2c27857e2db83464e481154deeb9f4380a7f58353f3088a30341e3bebe5faa91"}
Sep 18 04:08:17.639359 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:17.639329    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cb6bb86bc-4tqcl" event={"ID":"6bb9e09b-4e61-4a14-93d5-61738ecb178b","Type":"ContainerStarted","Data":"9c9a577aa8832444a2e1401be95d25f5e3a4cd492e2f8350c817a19d37bf1d89"}
Sep 18 04:08:17.641137 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:17.641111    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-fbvn9" event={"ID":"351504a9-4a92-4c8f-b340-b73af9db8450","Type":"ContainerStarted","Data":"6fedc59c80d8a0a3c778a384a7ad344e922946848fa81a8f47b658f35a629184"}
Sep 18 04:08:17.641239 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:17.641164    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-fbvn9"
Sep 18 04:08:17.642480 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:17.642450    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zg942" event={"ID":"2d169a38-932c-4d14-8a19-3ce5341fc190","Type":"ContainerStarted","Data":"18d5703c9499fe70735c72a506893af1f09199f7b5efb8044838dbbe433883d7"}
Sep 18 04:08:17.646489 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:17.646470    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-fbvn9"
Sep 18 04:08:17.654790 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:17.654749    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-26rlw" podStartSLOduration=33.580552498 podStartE2EDuration="47.654733546s" totalImagesPullingTime="14.074181048s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 04:07:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:08:17.653037247 +0000 UTC m=+132.110480228" watchObservedRunningTime="2026-09-18 04:08:17.654733546 +0000 UTC m=+132.112176514"
Sep 18 04:08:17.671939 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:17.671876    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7cb6bb86bc-4tqcl" podStartSLOduration=1.77882154 podStartE2EDuration="16.671863347s" totalImagesPullingTime="14.893041807s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:08:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:08:17.670949616 +0000 UTC m=+132.128392585" watchObservedRunningTime="2026-09-18 04:08:17.671863347 +0000 UTC m=+132.129306315"
Sep 18 04:08:17.708055 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:17.708006    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7b575c66b8-9f97s" podStartSLOduration=1.426721605 podStartE2EDuration="7.707989325s" totalImagesPullingTime="6.28126772s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:08:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:08:17.689798873 +0000 UTC m=+132.147241844" watchObservedRunningTime="2026-09-18 04:08:17.707989325 +0000 UTC m=+132.165432295"
Sep 18 04:08:18.250781 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:18.250736    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:08:18.351848 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:18.351794    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:08:18.436991 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:18.436960    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:08:18.440622 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:18.440567    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-fbvn9" podStartSLOduration=9.695199334 podStartE2EDuration="16.440548331s" totalImagesPullingTime="6.745348997s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:08:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:08:17.707070089 +0000 UTC m=+132.164513062" watchObservedRunningTime="2026-09-18 04:08:18.440548331 +0000 UTC m=+132.897991299"
Sep 18 04:08:18.440923 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:18.440891    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-jzhsw"]
Sep 18 04:08:18.460944 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:18.460918    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-jzhsw"]
Sep 18 04:08:18.461059 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:18.461010    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-jzhsw"
Sep 18 04:08:18.463572 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:18.463550    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 18 04:08:18.463935 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:18.463884    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 18 04:08:18.463935 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:18.463924    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 18 04:08:18.464626 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:18.464605    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 18 04:08:18.465042 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:18.465023    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 18 04:08:18.465141 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:18.465096    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-lfd2z\""
Sep 18 04:08:18.497001 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:18.496956    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdlhm\" (UniqueName: \"kubernetes.io/projected/c9950b8d-784a-4f60-a721-fde6c71f76ba-kube-api-access-hdlhm\") pod \"prometheus-operator-7bd5d56d6-jzhsw\" (UID: \"c9950b8d-784a-4f60-a721-fde6c71f76ba\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-jzhsw"
Sep 18 04:08:18.497138 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:18.497009    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c9950b8d-784a-4f60-a721-fde6c71f76ba-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-jzhsw\" (UID: \"c9950b8d-784a-4f60-a721-fde6c71f76ba\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-jzhsw"
Sep 18 04:08:18.497138 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:18.497065    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c9950b8d-784a-4f60-a721-fde6c71f76ba-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-jzhsw\" (UID: \"c9950b8d-784a-4f60-a721-fde6c71f76ba\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-jzhsw"
Sep 18 04:08:18.497138 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:18.497089    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c9950b8d-784a-4f60-a721-fde6c71f76ba-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-jzhsw\" (UID: \"c9950b8d-784a-4f60-a721-fde6c71f76ba\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-jzhsw"
Sep 18 04:08:18.500275 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:18.500250    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:08:18.598142 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:18.598107    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdlhm\" (UniqueName: \"kubernetes.io/projected/c9950b8d-784a-4f60-a721-fde6c71f76ba-kube-api-access-hdlhm\") pod \"prometheus-operator-7bd5d56d6-jzhsw\" (UID: \"c9950b8d-784a-4f60-a721-fde6c71f76ba\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-jzhsw"
Sep 18 04:08:18.598298 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:18.598171    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c9950b8d-784a-4f60-a721-fde6c71f76ba-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-jzhsw\" (UID: \"c9950b8d-784a-4f60-a721-fde6c71f76ba\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-jzhsw"
Sep 18 04:08:18.598298 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:18.598212    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c9950b8d-784a-4f60-a721-fde6c71f76ba-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-jzhsw\" (UID: \"c9950b8d-784a-4f60-a721-fde6c71f76ba\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-jzhsw"
Sep 18 04:08:18.598298 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:18.598233    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c9950b8d-784a-4f60-a721-fde6c71f76ba-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-jzhsw\" (UID: \"c9950b8d-784a-4f60-a721-fde6c71f76ba\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-jzhsw"
Sep 18 04:08:18.598880 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:18.598836    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c9950b8d-784a-4f60-a721-fde6c71f76ba-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-jzhsw\" (UID: \"c9950b8d-784a-4f60-a721-fde6c71f76ba\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-jzhsw"
Sep 18 04:08:18.600807 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:18.600771    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c9950b8d-784a-4f60-a721-fde6c71f76ba-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-jzhsw\" (UID: \"c9950b8d-784a-4f60-a721-fde6c71f76ba\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-jzhsw"
Sep 18 04:08:18.601098 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:18.601077    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c9950b8d-784a-4f60-a721-fde6c71f76ba-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-jzhsw\" (UID: \"c9950b8d-784a-4f60-a721-fde6c71f76ba\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-jzhsw"
Sep 18 04:08:18.606311 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:18.606288    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdlhm\" (UniqueName: \"kubernetes.io/projected/c9950b8d-784a-4f60-a721-fde6c71f76ba-kube-api-access-hdlhm\") pod \"prometheus-operator-7bd5d56d6-jzhsw\" (UID: \"c9950b8d-784a-4f60-a721-fde6c71f76ba\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-jzhsw"
Sep 18 04:08:18.772599 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:18.772568    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-jzhsw"
Sep 18 04:08:19.057385 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:19.057361    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-jzhsw"]
Sep 18 04:08:19.060127 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:08:19.060102    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9950b8d_784a_4f60_a721_fde6c71f76ba.slice/crio-7945c15376c735fd1b5aa758786b2208d2217963a0df085edd82c452544f7e3c WatchSource:0}: Error finding container 7945c15376c735fd1b5aa758786b2208d2217963a0df085edd82c452544f7e3c: Status 404 returned error can't find the container with id 7945c15376c735fd1b5aa758786b2208d2217963a0df085edd82c452544f7e3c
Sep 18 04:08:19.651240 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:19.651207    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zg942" event={"ID":"2d169a38-932c-4d14-8a19-3ce5341fc190","Type":"ContainerStarted","Data":"a44fbfb30cf07546f70c0aa321ed290d1dbfaa75c47edc001563d30ddba92cde"}
Sep 18 04:08:19.651673 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:19.651267    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zg942" event={"ID":"2d169a38-932c-4d14-8a19-3ce5341fc190","Type":"ContainerStarted","Data":"fd0eb40dc24685358516c8b2d4c73ff37bbda2d84e90658f8e6a3b0b21d8cd22"}
Sep 18 04:08:19.652436 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:19.652415    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-jzhsw" event={"ID":"c9950b8d-784a-4f60-a721-fde6c71f76ba","Type":"ContainerStarted","Data":"7945c15376c735fd1b5aa758786b2208d2217963a0df085edd82c452544f7e3c"}
Sep 18 04:08:19.667800 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:19.667759    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-zg942" podStartSLOduration=132.168313234 podStartE2EDuration="2m13.667742778s" totalImagesPullingTime="1.499429544s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:06:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:08:19.666770428 +0000 UTC m=+134.124213398" watchObservedRunningTime="2026-09-18 04:08:19.667742778 +0000 UTC m=+134.125185751"
Sep 18 04:08:19.785506 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:19.785470    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:08:19.886444 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:19.886408    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:08:20.764379 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:20.764342    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7b575c66b8-9f97s"
Sep 18 04:08:20.764842 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:20.764400    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7b575c66b8-9f97s"
Sep 18 04:08:20.769442 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:20.769413    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7b575c66b8-9f97s"
Sep 18 04:08:21.666038 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:21.666014    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7b575c66b8-9f97s"
Sep 18 04:08:21.717121 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:21.717093    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7cb6bb86bc-4tqcl"]
Sep 18 04:08:21.953161 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:21.953108    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:08:22.053472 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:22.053441    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:08:22.197504 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:22.197423    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7cb6bb86bc-4tqcl"
Sep 18 04:08:22.667299 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:22.667263    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-jzhsw" event={"ID":"c9950b8d-784a-4f60-a721-fde6c71f76ba","Type":"ContainerStarted","Data":"38f564dff96c29a2a7a03da60774e953a29f4fa0cd34f8a7975e2ded8bf9a66c"}
Sep 18 04:08:22.667487 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:22.667320    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-jzhsw" event={"ID":"c9950b8d-784a-4f60-a721-fde6c71f76ba","Type":"ContainerStarted","Data":"2c44a3507b8311fe8b3c9fdb6952e77e6cf08c6ea7a5323ae5d547ddcd68972a"}
Sep 18 04:08:22.686030 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:22.685984    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-jzhsw" podStartSLOduration=2.085020434 podStartE2EDuration="4.685968065s" totalImagesPullingTime="2.600947631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:08:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:08:22.685104064 +0000 UTC m=+137.142547038" watchObservedRunningTime="2026-09-18 04:08:22.685968065 +0000 UTC m=+137.143411052"
Sep 18 04:08:22.993312 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:22.993216    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:08:23.051031 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:23.050993    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:08:24.544357 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:24.544318    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:08:24.761253 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:24.761221    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:08:24.808129 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:24.808051    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-mlmq7"]
Sep 18 04:08:24.827462 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:24.827427    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-mlmq7"]
Sep 18 04:08:24.827621 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:24.827476    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-j2pfg"]
Sep 18 04:08:24.827621 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:24.827568    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-84c885658c-mlmq7"
Sep 18 04:08:24.830090 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:24.830069    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-m4cd4\""
Sep 18 04:08:24.830219 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:24.830067    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 18 04:08:24.830219 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:24.830068    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 18 04:08:24.831098 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:24.831080    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 18 04:08:24.843369 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:24.843341    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:08:24.853447 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:24.853427    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-j2pfg"
Sep 18 04:08:24.856131 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:24.856108    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 18 04:08:24.856131 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:24.856119    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 18 04:08:24.856272 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:24.856145    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2wxtl\""
Sep 18 04:08:24.856394 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:24.856381    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 18 04:08:24.919164 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:24.919133    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:08:24.951339 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:24.951310    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/debe327d-65f6-4bfc-96db-19c91dd08d9c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-mlmq7\" (UID: \"debe327d-65f6-4bfc-96db-19c91dd08d9c\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-mlmq7"
Sep 18 04:08:24.951495 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:24.951344    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/debe327d-65f6-4bfc-96db-19c91dd08d9c-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-mlmq7\" (UID: \"debe327d-65f6-4bfc-96db-19c91dd08d9c\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-mlmq7"
Sep 18 04:08:24.951495 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:24.951368    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/debe327d-65f6-4bfc-96db-19c91dd08d9c-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-mlmq7\" (UID: \"debe327d-65f6-4bfc-96db-19c91dd08d9c\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-mlmq7"
Sep 18 04:08:24.951495 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:24.951392    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/81470b84-4f5e-4a81-bac4-7dd270719538-root\") pod \"node-exporter-j2pfg\" (UID: \"81470b84-4f5e-4a81-bac4-7dd270719538\") " pod="openshift-monitoring/node-exporter-j2pfg"
Sep 18 04:08:24.951495 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:24.951428    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xn7k\" (UniqueName: \"kubernetes.io/projected/81470b84-4f5e-4a81-bac4-7dd270719538-kube-api-access-4xn7k\") pod \"node-exporter-j2pfg\" (UID: \"81470b84-4f5e-4a81-bac4-7dd270719538\") " pod="openshift-monitoring/node-exporter-j2pfg"
Sep 18 04:08:24.951495 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:24.951494    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8frkr\" (UniqueName: \"kubernetes.io/projected/debe327d-65f6-4bfc-96db-19c91dd08d9c-kube-api-access-8frkr\") pod \"kube-state-metrics-84c885658c-mlmq7\" (UID: \"debe327d-65f6-4bfc-96db-19c91dd08d9c\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-mlmq7"
Sep 18 04:08:24.951729 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:24.951523    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/81470b84-4f5e-4a81-bac4-7dd270719538-sys\") pod \"node-exporter-j2pfg\" (UID: \"81470b84-4f5e-4a81-bac4-7dd270719538\") " pod="openshift-monitoring/node-exporter-j2pfg"
Sep 18 04:08:24.951729 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:24.951541    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/81470b84-4f5e-4a81-bac4-7dd270719538-node-exporter-textfile\") pod \"node-exporter-j2pfg\" (UID: \"81470b84-4f5e-4a81-bac4-7dd270719538\") " pod="openshift-monitoring/node-exporter-j2pfg"
Sep 18 04:08:24.951729 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:24.951557    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/81470b84-4f5e-4a81-bac4-7dd270719538-metrics-client-ca\") pod \"node-exporter-j2pfg\" (UID: \"81470b84-4f5e-4a81-bac4-7dd270719538\") " pod="openshift-monitoring/node-exporter-j2pfg"
Sep 18 04:08:24.951729 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:24.951601    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/debe327d-65f6-4bfc-96db-19c91dd08d9c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-mlmq7\" (UID: \"debe327d-65f6-4bfc-96db-19c91dd08d9c\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-mlmq7"
Sep 18 04:08:24.951729 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:24.951642    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/81470b84-4f5e-4a81-bac4-7dd270719538-node-exporter-tls\") pod \"node-exporter-j2pfg\" (UID: \"81470b84-4f5e-4a81-bac4-7dd270719538\") " pod="openshift-monitoring/node-exporter-j2pfg"
Sep 18 04:08:24.951729 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:24.951670    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/81470b84-4f5e-4a81-bac4-7dd270719538-node-exporter-wtmp\") pod \"node-exporter-j2pfg\" (UID: \"81470b84-4f5e-4a81-bac4-7dd270719538\") " pod="openshift-monitoring/node-exporter-j2pfg"
Sep 18 04:08:24.951729 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:24.951702    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/debe327d-65f6-4bfc-96db-19c91dd08d9c-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-mlmq7\" (UID: \"debe327d-65f6-4bfc-96db-19c91dd08d9c\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-mlmq7"
Sep 18 04:08:24.952014 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:24.951728    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/81470b84-4f5e-4a81-bac4-7dd270719538-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-j2pfg\" (UID: \"81470b84-4f5e-4a81-bac4-7dd270719538\") " pod="openshift-monitoring/node-exporter-j2pfg"
Sep 18 04:08:24.952014 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:24.951775    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/81470b84-4f5e-4a81-bac4-7dd270719538-node-exporter-accelerators-collector-config\") pod \"node-exporter-j2pfg\" (UID: \"81470b84-4f5e-4a81-bac4-7dd270719538\") " pod="openshift-monitoring/node-exporter-j2pfg"
Sep 18 04:08:25.053060 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:25.053032    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8frkr\" (UniqueName: \"kubernetes.io/projected/debe327d-65f6-4bfc-96db-19c91dd08d9c-kube-api-access-8frkr\") pod \"kube-state-metrics-84c885658c-mlmq7\" (UID: \"debe327d-65f6-4bfc-96db-19c91dd08d9c\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-mlmq7"
Sep 18 04:08:25.053211 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:25.053073    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/81470b84-4f5e-4a81-bac4-7dd270719538-sys\") pod \"node-exporter-j2pfg\" (UID: \"81470b84-4f5e-4a81-bac4-7dd270719538\") " pod="openshift-monitoring/node-exporter-j2pfg"
Sep 18 04:08:25.053211 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:25.053093    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/81470b84-4f5e-4a81-bac4-7dd270719538-node-exporter-textfile\") pod \"node-exporter-j2pfg\" (UID: \"81470b84-4f5e-4a81-bac4-7dd270719538\") " pod="openshift-monitoring/node-exporter-j2pfg"
Sep 18 04:08:25.053211 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:25.053150    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/81470b84-4f5e-4a81-bac4-7dd270719538-sys\") pod \"node-exporter-j2pfg\" (UID: \"81470b84-4f5e-4a81-bac4-7dd270719538\") " pod="openshift-monitoring/node-exporter-j2pfg"
Sep 18 04:08:25.053324 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:25.053207    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/81470b84-4f5e-4a81-bac4-7dd270719538-metrics-client-ca\") pod \"node-exporter-j2pfg\" (UID: \"81470b84-4f5e-4a81-bac4-7dd270719538\") " pod="openshift-monitoring/node-exporter-j2pfg"
Sep 18 04:08:25.053324 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:25.053247    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/debe327d-65f6-4bfc-96db-19c91dd08d9c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-mlmq7\" (UID: \"debe327d-65f6-4bfc-96db-19c91dd08d9c\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-mlmq7"
Sep 18 04:08:25.053324 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:25.053273    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/81470b84-4f5e-4a81-bac4-7dd270719538-node-exporter-tls\") pod \"node-exporter-j2pfg\" (UID: \"81470b84-4f5e-4a81-bac4-7dd270719538\") " pod="openshift-monitoring/node-exporter-j2pfg"
Sep 18 04:08:25.053324 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:25.053295    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/81470b84-4f5e-4a81-bac4-7dd270719538-node-exporter-wtmp\") pod \"node-exporter-j2pfg\" (UID: \"81470b84-4f5e-4a81-bac4-7dd270719538\") " pod="openshift-monitoring/node-exporter-j2pfg"
Sep 18 04:08:25.053324 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:25.053322    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/debe327d-65f6-4bfc-96db-19c91dd08d9c-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-mlmq7\" (UID: \"debe327d-65f6-4bfc-96db-19c91dd08d9c\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-mlmq7"
Sep 18 04:08:25.053560 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:25.053345    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/81470b84-4f5e-4a81-bac4-7dd270719538-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-j2pfg\" (UID: \"81470b84-4f5e-4a81-bac4-7dd270719538\") " pod="openshift-monitoring/node-exporter-j2pfg"
Sep 18 04:08:25.053560 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:25.053375    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/81470b84-4f5e-4a81-bac4-7dd270719538-node-exporter-accelerators-collector-config\") pod \"node-exporter-j2pfg\" (UID: \"81470b84-4f5e-4a81-bac4-7dd270719538\") " pod="openshift-monitoring/node-exporter-j2pfg"
Sep 18 04:08:25.053560 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:25.053385    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/81470b84-4f5e-4a81-bac4-7dd270719538-node-exporter-textfile\") pod \"node-exporter-j2pfg\" (UID: \"81470b84-4f5e-4a81-bac4-7dd270719538\") " pod="openshift-monitoring/node-exporter-j2pfg"
Sep 18 04:08:25.053560 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:08:25.053392    2585 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 18 04:08:25.053560 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:25.053421    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/debe327d-65f6-4bfc-96db-19c91dd08d9c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-mlmq7\" (UID: \"debe327d-65f6-4bfc-96db-19c91dd08d9c\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-mlmq7"
Sep 18 04:08:25.053560 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:25.053466    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/debe327d-65f6-4bfc-96db-19c91dd08d9c-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-mlmq7\" (UID: \"debe327d-65f6-4bfc-96db-19c91dd08d9c\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-mlmq7"
Sep 18 04:08:25.053560 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:25.053486    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/81470b84-4f5e-4a81-bac4-7dd270719538-node-exporter-wtmp\") pod \"node-exporter-j2pfg\" (UID: \"81470b84-4f5e-4a81-bac4-7dd270719538\") " pod="openshift-monitoring/node-exporter-j2pfg"
Sep 18 04:08:25.053560 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:08:25.053492    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81470b84-4f5e-4a81-bac4-7dd270719538-node-exporter-tls podName:81470b84-4f5e-4a81-bac4-7dd270719538 nodeName:}" failed. No retries permitted until 2026-09-18 04:08:25.553469511 +0000 UTC m=+140.010912474 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/81470b84-4f5e-4a81-bac4-7dd270719538-node-exporter-tls") pod "node-exporter-j2pfg" (UID: "81470b84-4f5e-4a81-bac4-7dd270719538") : secret "node-exporter-tls" not found
Sep 18 04:08:25.053560 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:08:25.053535    2585 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Sep 18 04:08:25.053560 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:25.053559    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/debe327d-65f6-4bfc-96db-19c91dd08d9c-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-mlmq7\" (UID: \"debe327d-65f6-4bfc-96db-19c91dd08d9c\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-mlmq7"
Sep 18 04:08:25.054072 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:08:25.053595    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/debe327d-65f6-4bfc-96db-19c91dd08d9c-kube-state-metrics-tls podName:debe327d-65f6-4bfc-96db-19c91dd08d9c nodeName:}" failed. No retries permitted until 2026-09-18 04:08:25.553578517 +0000 UTC m=+140.011021480 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/debe327d-65f6-4bfc-96db-19c91dd08d9c-kube-state-metrics-tls") pod "kube-state-metrics-84c885658c-mlmq7" (UID: "debe327d-65f6-4bfc-96db-19c91dd08d9c") : secret "kube-state-metrics-tls" not found
Sep 18 04:08:25.054072 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:25.053613    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/81470b84-4f5e-4a81-bac4-7dd270719538-root\") pod \"node-exporter-j2pfg\" (UID: \"81470b84-4f5e-4a81-bac4-7dd270719538\") " pod="openshift-monitoring/node-exporter-j2pfg"
Sep 18 04:08:25.054072 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:25.053644    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xn7k\" (UniqueName: \"kubernetes.io/projected/81470b84-4f5e-4a81-bac4-7dd270719538-kube-api-access-4xn7k\") pod \"node-exporter-j2pfg\" (UID: \"81470b84-4f5e-4a81-bac4-7dd270719538\") " pod="openshift-monitoring/node-exporter-j2pfg"
Sep 18 04:08:25.054072 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:25.053710    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/81470b84-4f5e-4a81-bac4-7dd270719538-metrics-client-ca\") pod \"node-exporter-j2pfg\" (UID: \"81470b84-4f5e-4a81-bac4-7dd270719538\") " pod="openshift-monitoring/node-exporter-j2pfg"
Sep 18 04:08:25.054072 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:25.053786    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/81470b84-4f5e-4a81-bac4-7dd270719538-root\") pod \"node-exporter-j2pfg\" (UID: \"81470b84-4f5e-4a81-bac4-7dd270719538\") " pod="openshift-monitoring/node-exporter-j2pfg"
Sep 18 04:08:25.054072 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:25.054020    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/debe327d-65f6-4bfc-96db-19c91dd08d9c-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-mlmq7\" (UID: \"debe327d-65f6-4bfc-96db-19c91dd08d9c\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-mlmq7"
Sep 18 04:08:25.054337 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:25.054215    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/81470b84-4f5e-4a81-bac4-7dd270719538-node-exporter-accelerators-collector-config\") pod \"node-exporter-j2pfg\" (UID: \"81470b84-4f5e-4a81-bac4-7dd270719538\") " pod="openshift-monitoring/node-exporter-j2pfg"
Sep 18 04:08:25.054337 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:25.054234    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/debe327d-65f6-4bfc-96db-19c91dd08d9c-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-mlmq7\" (UID: \"debe327d-65f6-4bfc-96db-19c91dd08d9c\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-mlmq7"
Sep 18 04:08:25.054532 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:25.054505    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/debe327d-65f6-4bfc-96db-19c91dd08d9c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-mlmq7\" (UID: \"debe327d-65f6-4bfc-96db-19c91dd08d9c\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-mlmq7"
Sep 18 04:08:25.055746 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:25.055726    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/81470b84-4f5e-4a81-bac4-7dd270719538-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-j2pfg\" (UID: \"81470b84-4f5e-4a81-bac4-7dd270719538\") " pod="openshift-monitoring/node-exporter-j2pfg"
Sep 18 04:08:25.055935 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:25.055915    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/debe327d-65f6-4bfc-96db-19c91dd08d9c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-mlmq7\" (UID: \"debe327d-65f6-4bfc-96db-19c91dd08d9c\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-mlmq7"
Sep 18 04:08:25.061671 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:25.061621    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xn7k\" (UniqueName: \"kubernetes.io/projected/81470b84-4f5e-4a81-bac4-7dd270719538-kube-api-access-4xn7k\") pod \"node-exporter-j2pfg\" (UID: \"81470b84-4f5e-4a81-bac4-7dd270719538\") " pod="openshift-monitoring/node-exporter-j2pfg"
Sep 18 04:08:25.061671 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:25.061624    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8frkr\" (UniqueName: \"kubernetes.io/projected/debe327d-65f6-4bfc-96db-19c91dd08d9c-kube-api-access-8frkr\") pod \"kube-state-metrics-84c885658c-mlmq7\" (UID: \"debe327d-65f6-4bfc-96db-19c91dd08d9c\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-mlmq7"
Sep 18 04:08:25.066117 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:25.066094    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:08:25.167437 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:25.167398    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:08:25.450857 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:25.450772    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:08:25.555339 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:25.555298    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:08:25.558232 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:25.558206    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/81470b84-4f5e-4a81-bac4-7dd270719538-node-exporter-tls\") pod \"node-exporter-j2pfg\" (UID: \"81470b84-4f5e-4a81-bac4-7dd270719538\") " pod="openshift-monitoring/node-exporter-j2pfg"
Sep 18 04:08:25.558337 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:25.558260    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/debe327d-65f6-4bfc-96db-19c91dd08d9c-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-mlmq7\" (UID: \"debe327d-65f6-4bfc-96db-19c91dd08d9c\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-mlmq7"
Sep 18 04:08:25.560506 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:25.560472    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/81470b84-4f5e-4a81-bac4-7dd270719538-node-exporter-tls\") pod \"node-exporter-j2pfg\" (UID: \"81470b84-4f5e-4a81-bac4-7dd270719538\") " pod="openshift-monitoring/node-exporter-j2pfg"
Sep 18 04:08:25.560651 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:25.560629    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/debe327d-65f6-4bfc-96db-19c91dd08d9c-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-mlmq7\" (UID: \"debe327d-65f6-4bfc-96db-19c91dd08d9c\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-mlmq7"
Sep 18 04:08:25.736563 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:25.736479    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-84c885658c-mlmq7"
Sep 18 04:08:25.762782 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:25.762754    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-j2pfg"
Sep 18 04:08:25.776699 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:25.776669    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:08:25.812377 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:08:25.812344    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81470b84_4f5e_4a81_bac4_7dd270719538.slice/crio-032dd961a1286a0298d09b0e79fd2d387f52709ddc8099df172bca8709e6b3e7 WatchSource:0}: Error finding container 032dd961a1286a0298d09b0e79fd2d387f52709ddc8099df172bca8709e6b3e7: Status 404 returned error can't find the container with id 032dd961a1286a0298d09b0e79fd2d387f52709ddc8099df172bca8709e6b3e7
Sep 18 04:08:25.852762 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:25.852726    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:08:26.038660 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:26.038634    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-mlmq7"]
Sep 18 04:08:26.041184 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:08:26.041160    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddebe327d_65f6_4bfc_96db_19c91dd08d9c.slice/crio-454e7f586077c6cd092abfdf24f8cf4f5a7e2eb08d5981b3e093906a83265393 WatchSource:0}: Error finding container 454e7f586077c6cd092abfdf24f8cf4f5a7e2eb08d5981b3e093906a83265393: Status 404 returned error can't find the container with id 454e7f586077c6cd092abfdf24f8cf4f5a7e2eb08d5981b3e093906a83265393
Sep 18 04:08:26.220008 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:26.219974    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:08:26.683408 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:26.683361    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j2pfg" event={"ID":"81470b84-4f5e-4a81-bac4-7dd270719538","Type":"ContainerStarted","Data":"032dd961a1286a0298d09b0e79fd2d387f52709ddc8099df172bca8709e6b3e7"}
Sep 18 04:08:26.684944 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:26.684912    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-mlmq7" event={"ID":"debe327d-65f6-4bfc-96db-19c91dd08d9c","Type":"ContainerStarted","Data":"454e7f586077c6cd092abfdf24f8cf4f5a7e2eb08d5981b3e093906a83265393"}
Sep 18 04:08:27.710696 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:27.710665    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:08:27.780552 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:27.780520    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:08:27.784754 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:27.784728    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6b644748c9-dwgnr"]
Sep 18 04:08:27.806546 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:27.806517    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6b644748c9-dwgnr"]
Sep 18 04:08:27.806714 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:27.806676    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6b644748c9-dwgnr"
Sep 18 04:08:27.809095 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:27.809071    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 18 04:08:27.809411 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:27.809213    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 18 04:08:27.809411 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:27.809217    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 18 04:08:27.809411 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:27.809294    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-7qzsd\""
Sep 18 04:08:27.809411 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:27.809338    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 18 04:08:27.809411 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:27.809348    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-7ooij4sk7vee9\""
Sep 18 04:08:27.809786 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:27.809768    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 18 04:08:27.879083 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:27.879051    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e2c13eaf-b679-43f5-8e3d-5b22a4ac43af-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6b644748c9-dwgnr\" (UID: \"e2c13eaf-b679-43f5-8e3d-5b22a4ac43af\") " pod="openshift-monitoring/thanos-querier-6b644748c9-dwgnr"
Sep 18 04:08:27.879204 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:27.879092    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkpdd\" (UniqueName: \"kubernetes.io/projected/e2c13eaf-b679-43f5-8e3d-5b22a4ac43af-kube-api-access-pkpdd\") pod \"thanos-querier-6b644748c9-dwgnr\" (UID: \"e2c13eaf-b679-43f5-8e3d-5b22a4ac43af\") " pod="openshift-monitoring/thanos-querier-6b644748c9-dwgnr"
Sep 18 04:08:27.879204 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:27.879151    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e2c13eaf-b679-43f5-8e3d-5b22a4ac43af-secret-grpc-tls\") pod \"thanos-querier-6b644748c9-dwgnr\" (UID: \"e2c13eaf-b679-43f5-8e3d-5b22a4ac43af\") " pod="openshift-monitoring/thanos-querier-6b644748c9-dwgnr"
Sep 18 04:08:27.879278 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:27.879244    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e2c13eaf-b679-43f5-8e3d-5b22a4ac43af-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6b644748c9-dwgnr\" (UID: \"e2c13eaf-b679-43f5-8e3d-5b22a4ac43af\") " pod="openshift-monitoring/thanos-querier-6b644748c9-dwgnr"
Sep 18 04:08:27.879311 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:27.879276    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e2c13eaf-b679-43f5-8e3d-5b22a4ac43af-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6b644748c9-dwgnr\" (UID: \"e2c13eaf-b679-43f5-8e3d-5b22a4ac43af\") " pod="openshift-monitoring/thanos-querier-6b644748c9-dwgnr"
Sep 18 04:08:27.879344 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:27.879320    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e2c13eaf-b679-43f5-8e3d-5b22a4ac43af-secret-thanos-querier-tls\") pod \"thanos-querier-6b644748c9-dwgnr\" (UID: \"e2c13eaf-b679-43f5-8e3d-5b22a4ac43af\") " pod="openshift-monitoring/thanos-querier-6b644748c9-dwgnr"
Sep 18 04:08:27.879379 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:27.879343    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e2c13eaf-b679-43f5-8e3d-5b22a4ac43af-metrics-client-ca\") pod \"thanos-querier-6b644748c9-dwgnr\" (UID: \"e2c13eaf-b679-43f5-8e3d-5b22a4ac43af\") " pod="openshift-monitoring/thanos-querier-6b644748c9-dwgnr"
Sep 18 04:08:27.879379 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:27.879369    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e2c13eaf-b679-43f5-8e3d-5b22a4ac43af-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6b644748c9-dwgnr\" (UID: \"e2c13eaf-b679-43f5-8e3d-5b22a4ac43af\") " pod="openshift-monitoring/thanos-querier-6b644748c9-dwgnr"
Sep 18 04:08:27.980218 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:27.980177    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e2c13eaf-b679-43f5-8e3d-5b22a4ac43af-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6b644748c9-dwgnr\" (UID: \"e2c13eaf-b679-43f5-8e3d-5b22a4ac43af\") " pod="openshift-monitoring/thanos-querier-6b644748c9-dwgnr"
Sep 18 04:08:27.980326 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:27.980227    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e2c13eaf-b679-43f5-8e3d-5b22a4ac43af-secret-thanos-querier-tls\") pod \"thanos-querier-6b644748c9-dwgnr\" (UID: \"e2c13eaf-b679-43f5-8e3d-5b22a4ac43af\") " pod="openshift-monitoring/thanos-querier-6b644748c9-dwgnr"
Sep 18 04:08:27.980326 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:27.980252    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e2c13eaf-b679-43f5-8e3d-5b22a4ac43af-metrics-client-ca\") pod \"thanos-querier-6b644748c9-dwgnr\" (UID: \"e2c13eaf-b679-43f5-8e3d-5b22a4ac43af\") " pod="openshift-monitoring/thanos-querier-6b644748c9-dwgnr"
Sep 18 04:08:27.980326 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:27.980282    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e2c13eaf-b679-43f5-8e3d-5b22a4ac43af-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6b644748c9-dwgnr\" (UID: \"e2c13eaf-b679-43f5-8e3d-5b22a4ac43af\") " pod="openshift-monitoring/thanos-querier-6b644748c9-dwgnr"
Sep 18 04:08:27.980484 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:27.980335    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e2c13eaf-b679-43f5-8e3d-5b22a4ac43af-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6b644748c9-dwgnr\" (UID: \"e2c13eaf-b679-43f5-8e3d-5b22a4ac43af\") " pod="openshift-monitoring/thanos-querier-6b644748c9-dwgnr"
Sep 18 04:08:27.980484 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:27.980362    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkpdd\" (UniqueName: \"kubernetes.io/projected/e2c13eaf-b679-43f5-8e3d-5b22a4ac43af-kube-api-access-pkpdd\") pod \"thanos-querier-6b644748c9-dwgnr\" (UID: \"e2c13eaf-b679-43f5-8e3d-5b22a4ac43af\") " pod="openshift-monitoring/thanos-querier-6b644748c9-dwgnr"
Sep 18 04:08:27.980484 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:27.980393    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e2c13eaf-b679-43f5-8e3d-5b22a4ac43af-secret-grpc-tls\") pod \"thanos-querier-6b644748c9-dwgnr\" (UID: \"e2c13eaf-b679-43f5-8e3d-5b22a4ac43af\") " pod="openshift-monitoring/thanos-querier-6b644748c9-dwgnr"
Sep 18 04:08:27.980484 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:27.980449    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e2c13eaf-b679-43f5-8e3d-5b22a4ac43af-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6b644748c9-dwgnr\" (UID: \"e2c13eaf-b679-43f5-8e3d-5b22a4ac43af\") " pod="openshift-monitoring/thanos-querier-6b644748c9-dwgnr"
Sep 18 04:08:27.981270 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:27.981246    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e2c13eaf-b679-43f5-8e3d-5b22a4ac43af-metrics-client-ca\") pod \"thanos-querier-6b644748c9-dwgnr\" (UID: \"e2c13eaf-b679-43f5-8e3d-5b22a4ac43af\") " pod="openshift-monitoring/thanos-querier-6b644748c9-dwgnr"
Sep 18 04:08:27.983284 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:27.983207    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e2c13eaf-b679-43f5-8e3d-5b22a4ac43af-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6b644748c9-dwgnr\" (UID: \"e2c13eaf-b679-43f5-8e3d-5b22a4ac43af\") " pod="openshift-monitoring/thanos-querier-6b644748c9-dwgnr"
Sep 18 04:08:27.983284 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:27.983276    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e2c13eaf-b679-43f5-8e3d-5b22a4ac43af-secret-thanos-querier-tls\") pod \"thanos-querier-6b644748c9-dwgnr\" (UID: \"e2c13eaf-b679-43f5-8e3d-5b22a4ac43af\") " pod="openshift-monitoring/thanos-querier-6b644748c9-dwgnr"
Sep 18 04:08:27.983410 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:27.983387    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e2c13eaf-b679-43f5-8e3d-5b22a4ac43af-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6b644748c9-dwgnr\" (UID: \"e2c13eaf-b679-43f5-8e3d-5b22a4ac43af\") " pod="openshift-monitoring/thanos-querier-6b644748c9-dwgnr"
Sep 18 04:08:27.983479 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:27.983445    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e2c13eaf-b679-43f5-8e3d-5b22a4ac43af-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6b644748c9-dwgnr\" (UID: \"e2c13eaf-b679-43f5-8e3d-5b22a4ac43af\") " pod="openshift-monitoring/thanos-querier-6b644748c9-dwgnr"
Sep 18 04:08:27.983541 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:27.983521    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e2c13eaf-b679-43f5-8e3d-5b22a4ac43af-secret-grpc-tls\") pod \"thanos-querier-6b644748c9-dwgnr\" (UID: \"e2c13eaf-b679-43f5-8e3d-5b22a4ac43af\") " pod="openshift-monitoring/thanos-querier-6b644748c9-dwgnr"
Sep 18 04:08:27.983636 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:27.983613    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e2c13eaf-b679-43f5-8e3d-5b22a4ac43af-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6b644748c9-dwgnr\" (UID: \"e2c13eaf-b679-43f5-8e3d-5b22a4ac43af\") " pod="openshift-monitoring/thanos-querier-6b644748c9-dwgnr"
Sep 18 04:08:27.987643 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:27.987620    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkpdd\" (UniqueName: \"kubernetes.io/projected/e2c13eaf-b679-43f5-8e3d-5b22a4ac43af-kube-api-access-pkpdd\") pod \"thanos-querier-6b644748c9-dwgnr\" (UID: \"e2c13eaf-b679-43f5-8e3d-5b22a4ac43af\") " pod="openshift-monitoring/thanos-querier-6b644748c9-dwgnr"
Sep 18 04:08:28.116948 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:28.116885    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6b644748c9-dwgnr"
Sep 18 04:08:28.358712 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:28.358679    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:08:28.420484 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:28.420350    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6b644748c9-dwgnr"]
Sep 18 04:08:28.423178 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:08:28.423146    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2c13eaf_b679_43f5_8e3d_5b22a4ac43af.slice/crio-0931f4266a4d7e8d79b63dd43fc0bcd6ead4718cc9e1d22c34157710ad01216e WatchSource:0}: Error finding container 0931f4266a4d7e8d79b63dd43fc0bcd6ead4718cc9e1d22c34157710ad01216e: Status 404 returned error can't find the container with id 0931f4266a4d7e8d79b63dd43fc0bcd6ead4718cc9e1d22c34157710ad01216e
Sep 18 04:08:28.630565 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:28.630531    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:08:28.694973 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:28.694936    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-mlmq7" event={"ID":"debe327d-65f6-4bfc-96db-19c91dd08d9c","Type":"ContainerStarted","Data":"528ebd4e6510b719d4419830305b2211c98a6f376f0de28d3b1553e1f1cbd188"}
Sep 18 04:08:28.695148 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:28.694993    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-mlmq7" event={"ID":"debe327d-65f6-4bfc-96db-19c91dd08d9c","Type":"ContainerStarted","Data":"a67e9c648363ff4e6dd408670b88fd1fc2fb552f9279642b89832073cf8d78a2"}
Sep 18 04:08:28.695148 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:28.695014    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-mlmq7" event={"ID":"debe327d-65f6-4bfc-96db-19c91dd08d9c","Type":"ContainerStarted","Data":"e323b55d0a0943b77b08e5fbf1f1cf7e71f4fc2704dc040ec581d5cd32cb59b7"}
Sep 18 04:08:28.696143 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:28.696117    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b644748c9-dwgnr" event={"ID":"e2c13eaf-b679-43f5-8e3d-5b22a4ac43af","Type":"ContainerStarted","Data":"0931f4266a4d7e8d79b63dd43fc0bcd6ead4718cc9e1d22c34157710ad01216e"}
Sep 18 04:08:28.700280 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:28.700256    2585 generic.go:356] "Generic (PLEG): container finished" podID="81470b84-4f5e-4a81-bac4-7dd270719538" containerID="b905510333e5c90df271c0291bca030a7bdf5444d46b554826c8b09ba70dc9e7" exitCode=0
Sep 18 04:08:28.700359 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:28.700292    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j2pfg" event={"ID":"81470b84-4f5e-4a81-bac4-7dd270719538","Type":"ContainerDied","Data":"b905510333e5c90df271c0291bca030a7bdf5444d46b554826c8b09ba70dc9e7"}
Sep 18 04:08:28.715413 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:28.715369    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-84c885658c-mlmq7" podStartSLOduration=2.808087967 podStartE2EDuration="4.715354885s" totalImagesPullingTime="1.907266918s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:08:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:08:28.713689749 +0000 UTC m=+143.171132718" watchObservedRunningTime="2026-09-18 04:08:28.715354885 +0000 UTC m=+143.172797853"
Sep 18 04:08:29.142587 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:29.142551    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:08:29.227336 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:29.227264    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:08:29.603500 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:29.603466    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-dm9zq"]
Sep 18 04:08:29.607728 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:29.607694    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:08:29.632719 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:29.632686    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-dm9zq"]
Sep 18 04:08:29.632881 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:29.632814    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-dm9zq"
Sep 18 04:08:29.635481 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:29.635457    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-wxksr\""
Sep 18 04:08:29.636461 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:29.636437    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 18 04:08:29.671945 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:29.671914    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:08:29.697996 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:29.697934    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tttm5\" (UniqueName: \"kubernetes.io/projected/9e1ae9d8-4154-48d0-a53c-0f09ccf90ede-kube-api-access-tttm5\") pod \"monitoring-plugin-5984459ff8-dm9zq\" (UID: \"9e1ae9d8-4154-48d0-a53c-0f09ccf90ede\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-dm9zq"
Sep 18 04:08:29.698144 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:29.698067    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9e1ae9d8-4154-48d0-a53c-0f09ccf90ede-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-dm9zq\" (UID: \"9e1ae9d8-4154-48d0-a53c-0f09ccf90ede\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-dm9zq"
Sep 18 04:08:29.706122 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:29.706097    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j2pfg" event={"ID":"81470b84-4f5e-4a81-bac4-7dd270719538","Type":"ContainerStarted","Data":"fd44068ee4fc4487caced2098e0d4f306392f85f6578f04d981bf68db57b6736"}
Sep 18 04:08:29.706239 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:29.706147    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j2pfg" event={"ID":"81470b84-4f5e-4a81-bac4-7dd270719538","Type":"ContainerStarted","Data":"9803d62570176866b259472a1356380c37b2e595eb4c5d570c742ef0f789d120"}
Sep 18 04:08:29.725388 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:29.725341    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-j2pfg" podStartSLOduration=3.833013883 podStartE2EDuration="5.725326924s" totalImagesPullingTime="1.834520559s" totalInitContainerRuntime="57.792482ms" isStatefulPod=true podCreationTimestamp="2026-09-18 04:08:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:08:29.724379386 +0000 UTC m=+144.181822356" watchObservedRunningTime="2026-09-18 04:08:29.725326924 +0000 UTC m=+144.182769894"
Sep 18 04:08:29.761015 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:29.760975    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:08:29.798754 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:29.798717    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tttm5\" (UniqueName: \"kubernetes.io/projected/9e1ae9d8-4154-48d0-a53c-0f09ccf90ede-kube-api-access-tttm5\") pod \"monitoring-plugin-5984459ff8-dm9zq\" (UID: \"9e1ae9d8-4154-48d0-a53c-0f09ccf90ede\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-dm9zq"
Sep 18 04:08:29.798950 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:29.798925    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9e1ae9d8-4154-48d0-a53c-0f09ccf90ede-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-dm9zq\" (UID: \"9e1ae9d8-4154-48d0-a53c-0f09ccf90ede\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-dm9zq"
Sep 18 04:08:29.801427 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:29.801400    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9e1ae9d8-4154-48d0-a53c-0f09ccf90ede-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-dm9zq\" (UID: \"9e1ae9d8-4154-48d0-a53c-0f09ccf90ede\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-dm9zq"
Sep 18 04:08:29.813056 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:29.813035    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tttm5\" (UniqueName: \"kubernetes.io/projected/9e1ae9d8-4154-48d0-a53c-0f09ccf90ede-kube-api-access-tttm5\") pod \"monitoring-plugin-5984459ff8-dm9zq\" (UID: \"9e1ae9d8-4154-48d0-a53c-0f09ccf90ede\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-dm9zq"
Sep 18 04:08:29.862724 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:29.862649    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:08:29.945183 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:29.945152    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-dm9zq"
Sep 18 04:08:30.239598 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:30.239560    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-dm9zq"]
Sep 18 04:08:30.635429 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:08:30.635399    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e1ae9d8_4154_48d0_a53c_0f09ccf90ede.slice/crio-5b268658a42adc959f22a5d3d95f4ae213d88e1232c8df3d44291465dec9634d WatchSource:0}: Error finding container 5b268658a42adc959f22a5d3d95f4ae213d88e1232c8df3d44291465dec9634d: Status 404 returned error can't find the container with id 5b268658a42adc959f22a5d3d95f4ae213d88e1232c8df3d44291465dec9634d
Sep 18 04:08:30.712939 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:30.712888    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-dm9zq" event={"ID":"9e1ae9d8-4154-48d0-a53c-0f09ccf90ede","Type":"ContainerStarted","Data":"5b268658a42adc959f22a5d3d95f4ae213d88e1232c8df3d44291465dec9634d"}
Sep 18 04:08:30.999404 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:30.999356    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 18 04:08:31.004724 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.004688    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:08:31.023473 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.023447    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 18 04:08:31.023604 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.023591    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 04:08:31.028073 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.028045    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 18 04:08:31.028503 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.028364    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 18 04:08:31.028579 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.028368    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 18 04:08:31.029400 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.028915    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 18 04:08:31.029400 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.028933    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 18 04:08:31.029400 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.028963    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 18 04:08:31.029400 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.029104    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 18 04:08:31.029400 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.029113    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-shnxp\""
Sep 18 04:08:31.029400 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.029123    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 18 04:08:31.029400 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.029247    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 18 04:08:31.029400 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.029276    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 18 04:08:31.029838 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.029643    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-62993vevgrr42\""
Sep 18 04:08:31.029838 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.029696    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 18 04:08:31.029984 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.029939    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 18 04:08:31.030429 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.030192    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 18 04:08:31.031597 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.031577    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 18 04:08:31.034644 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.034568    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 18 04:08:31.110691 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.110667    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/62598b60-531e-4ce4-9a1a-258bbed8cd3d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"62598b60-531e-4ce4-9a1a-258bbed8cd3d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 04:08:31.110891 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.110875    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/62598b60-531e-4ce4-9a1a-258bbed8cd3d-web-config\") pod \"prometheus-k8s-0\" (UID: \"62598b60-531e-4ce4-9a1a-258bbed8cd3d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 04:08:31.111032 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.111019    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62598b60-531e-4ce4-9a1a-258bbed8cd3d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"62598b60-531e-4ce4-9a1a-258bbed8cd3d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 04:08:31.111128 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.111118    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62598b60-531e-4ce4-9a1a-258bbed8cd3d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"62598b60-531e-4ce4-9a1a-258bbed8cd3d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 04:08:31.111214 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.111206    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/62598b60-531e-4ce4-9a1a-258bbed8cd3d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"62598b60-531e-4ce4-9a1a-258bbed8cd3d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 04:08:31.111299 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.111290    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/62598b60-531e-4ce4-9a1a-258bbed8cd3d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"62598b60-531e-4ce4-9a1a-258bbed8cd3d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 04:08:31.111377 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.111369    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/62598b60-531e-4ce4-9a1a-258bbed8cd3d-config\") pod \"prometheus-k8s-0\" (UID: \"62598b60-531e-4ce4-9a1a-258bbed8cd3d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 04:08:31.111465 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.111456    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/62598b60-531e-4ce4-9a1a-258bbed8cd3d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"62598b60-531e-4ce4-9a1a-258bbed8cd3d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 04:08:31.111551 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.111541    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/62598b60-531e-4ce4-9a1a-258bbed8cd3d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"62598b60-531e-4ce4-9a1a-258bbed8cd3d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 04:08:31.111627 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.111619    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62598b60-531e-4ce4-9a1a-258bbed8cd3d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"62598b60-531e-4ce4-9a1a-258bbed8cd3d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 04:08:31.111717 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.111708    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/62598b60-531e-4ce4-9a1a-258bbed8cd3d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"62598b60-531e-4ce4-9a1a-258bbed8cd3d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 04:08:31.111796 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.111787    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/62598b60-531e-4ce4-9a1a-258bbed8cd3d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"62598b60-531e-4ce4-9a1a-258bbed8cd3d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 04:08:31.112312 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.111915    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/62598b60-531e-4ce4-9a1a-258bbed8cd3d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"62598b60-531e-4ce4-9a1a-258bbed8cd3d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 04:08:31.112312 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.111956    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/62598b60-531e-4ce4-9a1a-258bbed8cd3d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"62598b60-531e-4ce4-9a1a-258bbed8cd3d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 04:08:31.112312 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.111992    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/62598b60-531e-4ce4-9a1a-258bbed8cd3d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"62598b60-531e-4ce4-9a1a-258bbed8cd3d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 04:08:31.112312 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.112019    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/62598b60-531e-4ce4-9a1a-258bbed8cd3d-config-out\") pod \"prometheus-k8s-0\" (UID: \"62598b60-531e-4ce4-9a1a-258bbed8cd3d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 04:08:31.112312 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.112042    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/62598b60-531e-4ce4-9a1a-258bbed8cd3d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"62598b60-531e-4ce4-9a1a-258bbed8cd3d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 04:08:31.112312 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.112073    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbtl2\" (UniqueName: \"kubernetes.io/projected/62598b60-531e-4ce4-9a1a-258bbed8cd3d-kube-api-access-sbtl2\") pod \"prometheus-k8s-0\" (UID: \"62598b60-531e-4ce4-9a1a-258bbed8cd3d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 04:08:31.112312 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.112100    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/62598b60-531e-4ce4-9a1a-258bbed8cd3d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"62598b60-531e-4ce4-9a1a-258bbed8cd3d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 04:08:31.112312 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.112130    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62598b60-531e-4ce4-9a1a-258bbed8cd3d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"62598b60-531e-4ce4-9a1a-258bbed8cd3d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 04:08:31.213393 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.213368    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/62598b60-531e-4ce4-9a1a-258bbed8cd3d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"62598b60-531e-4ce4-9a1a-258bbed8cd3d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 04:08:31.213511 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.213408    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/62598b60-531e-4ce4-9a1a-258bbed8cd3d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"62598b60-531e-4ce4-9a1a-258bbed8cd3d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 04:08:31.213511 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.213441    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/62598b60-531e-4ce4-9a1a-258bbed8cd3d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"62598b60-531e-4ce4-9a1a-258bbed8cd3d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 04:08:31.213621 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.213507    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/62598b60-531e-4ce4-9a1a-258bbed8cd3d-config-out\") pod \"prometheus-k8s-0\" (UID: \"62598b60-531e-4ce4-9a1a-258bbed8cd3d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 04:08:31.213621 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.213546    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/62598b60-531e-4ce4-9a1a-258bbed8cd3d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"62598b60-531e-4ce4-9a1a-258bbed8cd3d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 04:08:31.213621 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.213583    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbtl2\" (UniqueName: \"kubernetes.io/projected/62598b60-531e-4ce4-9a1a-258bbed8cd3d-kube-api-access-sbtl2\") pod \"prometheus-k8s-0\" (UID: \"62598b60-531e-4ce4-9a1a-258bbed8cd3d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 04:08:31.213621 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.213611    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/62598b60-531e-4ce4-9a1a-258bbed8cd3d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"62598b60-531e-4ce4-9a1a-258bbed8cd3d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 04:08:31.213811 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.213656    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62598b60-531e-4ce4-9a1a-258bbed8cd3d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"62598b60-531e-4ce4-9a1a-258bbed8cd3d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 04:08:31.213811 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.213725    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/62598b60-531e-4ce4-9a1a-258bbed8cd3d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"62598b60-531e-4ce4-9a1a-258bbed8cd3d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 04:08:31.213811 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.213753    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/62598b60-531e-4ce4-9a1a-258bbed8cd3d-web-config\") pod \"prometheus-k8s-0\" (UID: \"62598b60-531e-4ce4-9a1a-258bbed8cd3d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 04:08:31.213811 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.213772    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62598b60-531e-4ce4-9a1a-258bbed8cd3d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"62598b60-531e-4ce4-9a1a-258bbed8cd3d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 04:08:31.213811 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.213808    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62598b60-531e-4ce4-9a1a-258bbed8cd3d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"62598b60-531e-4ce4-9a1a-258bbed8cd3d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 04:08:31.214092 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.213834    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/62598b60-531e-4ce4-9a1a-258bbed8cd3d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"62598b60-531e-4ce4-9a1a-258bbed8cd3d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 04:08:31.214092 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.213861    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/62598b60-531e-4ce4-9a1a-258bbed8cd3d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"62598b60-531e-4ce4-9a1a-258bbed8cd3d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 04:08:31.214092 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.213887    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/62598b60-531e-4ce4-9a1a-258bbed8cd3d-config\") pod \"prometheus-k8s-0\" (UID: \"62598b60-531e-4ce4-9a1a-258bbed8cd3d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 04:08:31.214092 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.213942    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/62598b60-531e-4ce4-9a1a-258bbed8cd3d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"62598b60-531e-4ce4-9a1a-258bbed8cd3d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 04:08:31.214092 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.213983    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/62598b60-531e-4ce4-9a1a-258bbed8cd3d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"62598b60-531e-4ce4-9a1a-258bbed8cd3d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 04:08:31.214092 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.214013    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62598b60-531e-4ce4-9a1a-258bbed8cd3d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"62598b60-531e-4ce4-9a1a-258bbed8cd3d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 04:08:31.214092 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.214062    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/62598b60-531e-4ce4-9a1a-258bbed8cd3d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"62598b60-531e-4ce4-9a1a-258bbed8cd3d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 04:08:31.214092 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.214087    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/62598b60-531e-4ce4-9a1a-258bbed8cd3d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"62598b60-531e-4ce4-9a1a-258bbed8cd3d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 04:08:31.214480 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.214184    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/62598b60-531e-4ce4-9a1a-258bbed8cd3d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"62598b60-531e-4ce4-9a1a-258bbed8cd3d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 04:08:31.214480 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.214368    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/62598b60-531e-4ce4-9a1a-258bbed8cd3d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"62598b60-531e-4ce4-9a1a-258bbed8cd3d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 04:08:31.214595 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.214516    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62598b60-531e-4ce4-9a1a-258bbed8cd3d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"62598b60-531e-4ce4-9a1a-258bbed8cd3d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 04:08:31.214960 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.214936    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/62598b60-531e-4ce4-9a1a-258bbed8cd3d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"62598b60-531e-4ce4-9a1a-258bbed8cd3d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 04:08:31.216025 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.215732    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62598b60-531e-4ce4-9a1a-258bbed8cd3d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"62598b60-531e-4ce4-9a1a-258bbed8cd3d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 04:08:31.217195 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.216537    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62598b60-531e-4ce4-9a1a-258bbed8cd3d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"62598b60-531e-4ce4-9a1a-258bbed8cd3d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 04:08:31.219497 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.219470    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/62598b60-531e-4ce4-9a1a-258bbed8cd3d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"62598b60-531e-4ce4-9a1a-258bbed8cd3d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 04:08:31.219597 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.219475    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/62598b60-531e-4ce4-9a1a-258bbed8cd3d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"62598b60-531e-4ce4-9a1a-258bbed8cd3d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 04:08:31.219969 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.219947    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62598b60-531e-4ce4-9a1a-258bbed8cd3d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"62598b60-531e-4ce4-9a1a-258bbed8cd3d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 04:08:31.220930 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.220888    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/62598b60-531e-4ce4-9a1a-258bbed8cd3d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"62598b60-531e-4ce4-9a1a-258bbed8cd3d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 04:08:31.221138 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.221093    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/62598b60-531e-4ce4-9a1a-258bbed8cd3d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"62598b60-531e-4ce4-9a1a-258bbed8cd3d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 04:08:31.221771 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.221713    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/62598b60-531e-4ce4-9a1a-258bbed8cd3d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"62598b60-531e-4ce4-9a1a-258bbed8cd3d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 04:08:31.222284 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.222256    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/62598b60-531e-4ce4-9a1a-258bbed8cd3d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"62598b60-531e-4ce4-9a1a-258bbed8cd3d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 04:08:31.222477 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.222449    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/62598b60-531e-4ce4-9a1a-258bbed8cd3d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"62598b60-531e-4ce4-9a1a-258bbed8cd3d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 04:08:31.223315 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.223272    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbtl2\" (UniqueName: \"kubernetes.io/projected/62598b60-531e-4ce4-9a1a-258bbed8cd3d-kube-api-access-sbtl2\") pod \"prometheus-k8s-0\" (UID: \"62598b60-531e-4ce4-9a1a-258bbed8cd3d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 04:08:31.223413 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.223394    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/62598b60-531e-4ce4-9a1a-258bbed8cd3d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"62598b60-531e-4ce4-9a1a-258bbed8cd3d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 04:08:31.225073 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.224798    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/62598b60-531e-4ce4-9a1a-258bbed8cd3d-web-config\") pod \"prometheus-k8s-0\" (UID: \"62598b60-531e-4ce4-9a1a-258bbed8cd3d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 04:08:31.227251 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.227211    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/62598b60-531e-4ce4-9a1a-258bbed8cd3d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"62598b60-531e-4ce4-9a1a-258bbed8cd3d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 04:08:31.230859 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.230833    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/62598b60-531e-4ce4-9a1a-258bbed8cd3d-config-out\") pod \"prometheus-k8s-0\" (UID: \"62598b60-531e-4ce4-9a1a-258bbed8cd3d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 04:08:31.235144 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.234939    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/62598b60-531e-4ce4-9a1a-258bbed8cd3d-config\") pod \"prometheus-k8s-0\" (UID: \"62598b60-531e-4ce4-9a1a-258bbed8cd3d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 04:08:31.355018 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.354968    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 04:08:31.672496 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.672473    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 18 04:08:31.674449 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:08:31.674420    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62598b60_531e_4ce4_9a1a_258bbed8cd3d.slice/crio-91ec63676a3d7f336a5ef0e9f62ee47c4872af87237047701a436500d1f73b44 WatchSource:0}: Error finding container 91ec63676a3d7f336a5ef0e9f62ee47c4872af87237047701a436500d1f73b44: Status 404 returned error can't find the container with id 91ec63676a3d7f336a5ef0e9f62ee47c4872af87237047701a436500d1f73b44
Sep 18 04:08:31.718113 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.718083    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"62598b60-531e-4ce4-9a1a-258bbed8cd3d","Type":"ContainerStarted","Data":"91ec63676a3d7f336a5ef0e9f62ee47c4872af87237047701a436500d1f73b44"}
Sep 18 04:08:31.720314 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.720291    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b644748c9-dwgnr" event={"ID":"e2c13eaf-b679-43f5-8e3d-5b22a4ac43af","Type":"ContainerStarted","Data":"fab858ca8269a3f2d4c4d43a7e602547663e032c84f69f9dfcd329a0ead7f24d"}
Sep 18 04:08:31.720409 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.720345    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b644748c9-dwgnr" event={"ID":"e2c13eaf-b679-43f5-8e3d-5b22a4ac43af","Type":"ContainerStarted","Data":"7989c3dbdbf29cadb3fca4022cbeefb72812f9be1e6df8889d60b3e99a6f95c3"}
Sep 18 04:08:31.720409 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:31.720370    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b644748c9-dwgnr" event={"ID":"e2c13eaf-b679-43f5-8e3d-5b22a4ac43af","Type":"ContainerStarted","Data":"56fdb048774a9ac2ac349b9e280574c524ca879ab0210c261b2c2eeff8e03fbf"}
Sep 18 04:08:32.726439 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:32.726404    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-dm9zq" event={"ID":"9e1ae9d8-4154-48d0-a53c-0f09ccf90ede","Type":"ContainerStarted","Data":"6699aa59b4f7ccbd1623004e4f7c5e976006c472ad569e18ff83c46b642a6d26"}
Sep 18 04:08:32.726886 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:32.726729    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-dm9zq"
Sep 18 04:08:32.732513 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:32.732489    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-dm9zq"
Sep 18 04:08:32.744010 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:32.743961    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5984459ff8-dm9zq" podStartSLOduration=1.884944281 podStartE2EDuration="3.743947212s" totalImagesPullingTime="1.859002931s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:08:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:08:32.742829697 +0000 UTC m=+147.200272666" watchObservedRunningTime="2026-09-18 04:08:32.743947212 +0000 UTC m=+147.201390211"
Sep 18 04:08:34.737039 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:34.736999    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b644748c9-dwgnr" event={"ID":"e2c13eaf-b679-43f5-8e3d-5b22a4ac43af","Type":"ContainerStarted","Data":"108eb6a3bd10e98e5ab387b0a23b8d8b4f39e21af07875c7432d35b712a7b73d"}
Sep 18 04:08:34.737608 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:34.737077    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b644748c9-dwgnr" event={"ID":"e2c13eaf-b679-43f5-8e3d-5b22a4ac43af","Type":"ContainerStarted","Data":"4a5e32e6982c6ef30347629b58cb893cabae3ae2e347db000b9ce03eb3529779"}
Sep 18 04:08:34.737608 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:34.737122    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6b644748c9-dwgnr"
Sep 18 04:08:34.737608 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:34.737164    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b644748c9-dwgnr" event={"ID":"e2c13eaf-b679-43f5-8e3d-5b22a4ac43af","Type":"ContainerStarted","Data":"d0e041ecb092d2c57fff5d0f9667cf221677405572590af0d01ec78e067cfbed"}
Sep 18 04:08:34.738475 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:34.738442    2585 generic.go:356] "Generic (PLEG): container finished" podID="62598b60-531e-4ce4-9a1a-258bbed8cd3d" containerID="aad63b00a58e384a89637c966f69ddfeee273bc429ab1146ec74de8056441b39" exitCode=0
Sep 18 04:08:34.738581 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:34.738527    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"62598b60-531e-4ce4-9a1a-258bbed8cd3d","Type":"ContainerDied","Data":"aad63b00a58e384a89637c966f69ddfeee273bc429ab1146ec74de8056441b39"}
Sep 18 04:08:34.768464 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:34.768399    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6b644748c9-dwgnr" podStartSLOduration=2.775230494 podStartE2EDuration="7.768383101s" totalImagesPullingTime="4.993152607s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:08:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:08:34.767173197 +0000 UTC m=+149.224616166" watchObservedRunningTime="2026-09-18 04:08:34.768383101 +0000 UTC m=+149.225826095"
Sep 18 04:08:35.006693 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:35.006623    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:08:35.070836 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:35.070792    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:08:38.759100 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:38.759069    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"62598b60-531e-4ce4-9a1a-258bbed8cd3d","Type":"ContainerStarted","Data":"15d51a65b733ba6e8ffc69c16b964f1bcdf7e930acc6d50ef8457ce6b893bc68"}
Sep 18 04:08:38.759397 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:38.759135    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"62598b60-531e-4ce4-9a1a-258bbed8cd3d","Type":"ContainerStarted","Data":"09aaedc2aee290acbb18b50e6ba8d9ec37ad0835f404761452ed38b7a82dbdb8"}
Sep 18 04:08:38.759397 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:38.759161    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"62598b60-531e-4ce4-9a1a-258bbed8cd3d","Type":"ContainerStarted","Data":"5d886b37e799002c85b92fce5d3535e54a9c9f425fad66aa7a63bc30cd28cd8b"}
Sep 18 04:08:38.895076 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:38.895024    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-779df66775-8dkzt" podUID="4c93f80c-45eb-481b-bacd-3e6749ed93c8" containerName="registry" containerID="cri-o://d90256f686778b03be3ceec8a8f9e3fb7cb62fb44e0c853c03a93b1890ccc157" gracePeriod=30
Sep 18 04:08:39.167229 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:39.167200    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-779df66775-8dkzt"
Sep 18 04:08:39.287280 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:39.287248    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4c93f80c-45eb-481b-bacd-3e6749ed93c8-ca-trust-extracted\") pod \"4c93f80c-45eb-481b-bacd-3e6749ed93c8\" (UID: \"4c93f80c-45eb-481b-bacd-3e6749ed93c8\") "
Sep 18 04:08:39.287441 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:39.287314    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4c93f80c-45eb-481b-bacd-3e6749ed93c8-installation-pull-secrets\") pod \"4c93f80c-45eb-481b-bacd-3e6749ed93c8\" (UID: \"4c93f80c-45eb-481b-bacd-3e6749ed93c8\") "
Sep 18 04:08:39.287441 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:39.287356    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7m7kj\" (UniqueName: \"kubernetes.io/projected/4c93f80c-45eb-481b-bacd-3e6749ed93c8-kube-api-access-7m7kj\") pod \"4c93f80c-45eb-481b-bacd-3e6749ed93c8\" (UID: \"4c93f80c-45eb-481b-bacd-3e6749ed93c8\") "
Sep 18 04:08:39.287441 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:39.287384    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4c93f80c-45eb-481b-bacd-3e6749ed93c8-image-registry-private-configuration\") pod \"4c93f80c-45eb-481b-bacd-3e6749ed93c8\" (UID: \"4c93f80c-45eb-481b-bacd-3e6749ed93c8\") "
Sep 18 04:08:39.287441 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:39.287410    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4c93f80c-45eb-481b-bacd-3e6749ed93c8-trusted-ca\") pod \"4c93f80c-45eb-481b-bacd-3e6749ed93c8\" (UID: \"4c93f80c-45eb-481b-bacd-3e6749ed93c8\") "
Sep 18 04:08:39.287722 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:39.287454    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4c93f80c-45eb-481b-bacd-3e6749ed93c8-bound-sa-token\") pod \"4c93f80c-45eb-481b-bacd-3e6749ed93c8\" (UID: \"4c93f80c-45eb-481b-bacd-3e6749ed93c8\") "
Sep 18 04:08:39.287722 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:39.287500    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4c93f80c-45eb-481b-bacd-3e6749ed93c8-registry-certificates\") pod \"4c93f80c-45eb-481b-bacd-3e6749ed93c8\" (UID: \"4c93f80c-45eb-481b-bacd-3e6749ed93c8\") "
Sep 18 04:08:39.287722 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:39.287600    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4c93f80c-45eb-481b-bacd-3e6749ed93c8-registry-tls\") pod \"4c93f80c-45eb-481b-bacd-3e6749ed93c8\" (UID: \"4c93f80c-45eb-481b-bacd-3e6749ed93c8\") "
Sep 18 04:08:39.288026 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:39.287963    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c93f80c-45eb-481b-bacd-3e6749ed93c8-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "4c93f80c-45eb-481b-bacd-3e6749ed93c8" (UID: "4c93f80c-45eb-481b-bacd-3e6749ed93c8"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 04:08:39.288026 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:39.287974    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c93f80c-45eb-481b-bacd-3e6749ed93c8-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "4c93f80c-45eb-481b-bacd-3e6749ed93c8" (UID: "4c93f80c-45eb-481b-bacd-3e6749ed93c8"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 04:08:39.289862 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:39.289839    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c93f80c-45eb-481b-bacd-3e6749ed93c8-kube-api-access-7m7kj" (OuterVolumeSpecName: "kube-api-access-7m7kj") pod "4c93f80c-45eb-481b-bacd-3e6749ed93c8" (UID: "4c93f80c-45eb-481b-bacd-3e6749ed93c8"). InnerVolumeSpecName "kube-api-access-7m7kj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 04:08:39.290000 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:39.289840    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c93f80c-45eb-481b-bacd-3e6749ed93c8-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "4c93f80c-45eb-481b-bacd-3e6749ed93c8" (UID: "4c93f80c-45eb-481b-bacd-3e6749ed93c8"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 04:08:39.290000 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:39.289965    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c93f80c-45eb-481b-bacd-3e6749ed93c8-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "4c93f80c-45eb-481b-bacd-3e6749ed93c8" (UID: "4c93f80c-45eb-481b-bacd-3e6749ed93c8"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 04:08:39.290142 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:39.290126    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c93f80c-45eb-481b-bacd-3e6749ed93c8-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "4c93f80c-45eb-481b-bacd-3e6749ed93c8" (UID: "4c93f80c-45eb-481b-bacd-3e6749ed93c8"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 04:08:39.290243 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:39.290223    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c93f80c-45eb-481b-bacd-3e6749ed93c8-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "4c93f80c-45eb-481b-bacd-3e6749ed93c8" (UID: "4c93f80c-45eb-481b-bacd-3e6749ed93c8"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 04:08:39.296031 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:39.296009    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c93f80c-45eb-481b-bacd-3e6749ed93c8-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "4c93f80c-45eb-481b-bacd-3e6749ed93c8" (UID: "4c93f80c-45eb-481b-bacd-3e6749ed93c8"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 04:08:39.388361 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:39.388306    2585 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4c93f80c-45eb-481b-bacd-3e6749ed93c8-image-registry-private-configuration\") on node \"ip-10-0-129-207.ec2.internal\" DevicePath \"\""
Sep 18 04:08:39.388361 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:39.388330    2585 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4c93f80c-45eb-481b-bacd-3e6749ed93c8-trusted-ca\") on node \"ip-10-0-129-207.ec2.internal\" DevicePath \"\""
Sep 18 04:08:39.388361 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:39.388340    2585 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4c93f80c-45eb-481b-bacd-3e6749ed93c8-bound-sa-token\") on node \"ip-10-0-129-207.ec2.internal\" DevicePath \"\""
Sep 18 04:08:39.388361 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:39.388348    2585 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4c93f80c-45eb-481b-bacd-3e6749ed93c8-registry-certificates\") on node \"ip-10-0-129-207.ec2.internal\" DevicePath \"\""
Sep 18 04:08:39.388361 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:39.388357    2585 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4c93f80c-45eb-481b-bacd-3e6749ed93c8-registry-tls\") on node \"ip-10-0-129-207.ec2.internal\" DevicePath \"\""
Sep 18 04:08:39.388607 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:39.388365    2585 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4c93f80c-45eb-481b-bacd-3e6749ed93c8-ca-trust-extracted\") on node \"ip-10-0-129-207.ec2.internal\" DevicePath \"\""
Sep 18 04:08:39.388607 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:39.388374    2585 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4c93f80c-45eb-481b-bacd-3e6749ed93c8-installation-pull-secrets\") on node \"ip-10-0-129-207.ec2.internal\" DevicePath \"\""
Sep 18 04:08:39.388607 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:39.388382    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7m7kj\" (UniqueName: \"kubernetes.io/projected/4c93f80c-45eb-481b-bacd-3e6749ed93c8-kube-api-access-7m7kj\") on node \"ip-10-0-129-207.ec2.internal\" DevicePath \"\""
Sep 18 04:08:39.766606 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:39.766513    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"62598b60-531e-4ce4-9a1a-258bbed8cd3d","Type":"ContainerStarted","Data":"ca8c5d60b24777264f8a6b9a482ef277dfb74a6b98c908844d51f774d4157ade"}
Sep 18 04:08:39.766606 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:39.766598    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"62598b60-531e-4ce4-9a1a-258bbed8cd3d","Type":"ContainerStarted","Data":"0ef74c728d425e518bcd1ff4b992ca16b8bb54b0f306e9baf3c6f322f05d952f"}
Sep 18 04:08:39.767071 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:39.766628    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"62598b60-531e-4ce4-9a1a-258bbed8cd3d","Type":"ContainerStarted","Data":"a7672b97d53a60b2fdda5e6c07487ef5a50534714be70cf9f6f60a27a6508990"}
Sep 18 04:08:39.767800 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:39.767772    2585 generic.go:356] "Generic (PLEG): container finished" podID="4c93f80c-45eb-481b-bacd-3e6749ed93c8" containerID="d90256f686778b03be3ceec8a8f9e3fb7cb62fb44e0c853c03a93b1890ccc157" exitCode=0
Sep 18 04:08:39.767888 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:39.767810    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-779df66775-8dkzt"
Sep 18 04:08:39.767888 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:39.767828    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-779df66775-8dkzt" event={"ID":"4c93f80c-45eb-481b-bacd-3e6749ed93c8","Type":"ContainerDied","Data":"d90256f686778b03be3ceec8a8f9e3fb7cb62fb44e0c853c03a93b1890ccc157"}
Sep 18 04:08:39.767888 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:39.767873    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-779df66775-8dkzt" event={"ID":"4c93f80c-45eb-481b-bacd-3e6749ed93c8","Type":"ContainerDied","Data":"b86a194bab23d37603c1a3bfc81fb4a4fa16e650bf716c7c1c194841ff03f78b"}
Sep 18 04:08:39.768008 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:39.767912    2585 scope.go:117] "RemoveContainer" containerID="d90256f686778b03be3ceec8a8f9e3fb7cb62fb44e0c853c03a93b1890ccc157"
Sep 18 04:08:39.783168 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:39.783148    2585 scope.go:117] "RemoveContainer" containerID="d90256f686778b03be3ceec8a8f9e3fb7cb62fb44e0c853c03a93b1890ccc157"
Sep 18 04:08:39.783413 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:08:39.783392    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d90256f686778b03be3ceec8a8f9e3fb7cb62fb44e0c853c03a93b1890ccc157\": container with ID starting with d90256f686778b03be3ceec8a8f9e3fb7cb62fb44e0c853c03a93b1890ccc157 not found: ID does not exist" containerID="d90256f686778b03be3ceec8a8f9e3fb7cb62fb44e0c853c03a93b1890ccc157"
Sep 18 04:08:39.783460 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:39.783421    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d90256f686778b03be3ceec8a8f9e3fb7cb62fb44e0c853c03a93b1890ccc157"} err="failed to get container status \"d90256f686778b03be3ceec8a8f9e3fb7cb62fb44e0c853c03a93b1890ccc157\": rpc error: code = NotFound desc = could not find container \"d90256f686778b03be3ceec8a8f9e3fb7cb62fb44e0c853c03a93b1890ccc157\": container with ID starting with d90256f686778b03be3ceec8a8f9e3fb7cb62fb44e0c853c03a93b1890ccc157 not found: ID does not exist"
Sep 18 04:08:39.803669 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:39.803621    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=4.103263788 podStartE2EDuration="9.803606931s" totalImagesPullingTime="5.68356798s" totalInitContainerRuntime="16.775163ms" isStatefulPod=false podCreationTimestamp="2026-09-18 04:08:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:08:39.800804933 +0000 UTC m=+154.258247901" watchObservedRunningTime="2026-09-18 04:08:39.803606931 +0000 UTC m=+154.261049899"
Sep 18 04:08:39.814963 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:39.814938    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-779df66775-8dkzt"]
Sep 18 04:08:39.818295 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:39.818274    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-779df66775-8dkzt"]
Sep 18 04:08:40.062428 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:40.062396    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c93f80c-45eb-481b-bacd-3e6749ed93c8" path="/var/lib/kubelet/pods/4c93f80c-45eb-481b-bacd-3e6749ed93c8/volumes"
Sep 18 04:08:40.101724 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:40.101692    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b575c66b8-9f97s"]
Sep 18 04:08:40.199004 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:40.198972    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:08:40.257103 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:40.257073    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:08:40.324722 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:40.324642    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:08:40.750320 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:40.750240    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6b644748c9-dwgnr"
Sep 18 04:08:41.355839 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:41.355804    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 04:08:42.036565 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:42.036521    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:08:42.137196 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:42.137162    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:08:42.257698 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:42.257661    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:08:44.793508 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:44.793468    2585 generic.go:356] "Generic (PLEG): container finished" podID="f92ffe18-1282-4f7c-b4f9-824e7e11dc07" containerID="68c40b8f05b3018ad2672e114b244c4356b4338094254f0939200c7478f9f51d" exitCode=0
Sep 18 04:08:44.793987 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:44.793547    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-4x6gx" event={"ID":"f92ffe18-1282-4f7c-b4f9-824e7e11dc07","Type":"ContainerDied","Data":"68c40b8f05b3018ad2672e114b244c4356b4338094254f0939200c7478f9f51d"}
Sep 18 04:08:44.794056 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:44.794015    2585 scope.go:117] "RemoveContainer" containerID="68c40b8f05b3018ad2672e114b244c4356b4338094254f0939200c7478f9f51d"
Sep 18 04:08:45.803298 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:45.803264    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-4x6gx" event={"ID":"f92ffe18-1282-4f7c-b4f9-824e7e11dc07","Type":"ContainerStarted","Data":"7c10bd47460a78f94f91938425d5948ae82bb282b8263141c813fc20808a0a7c"}
Sep 18 04:08:46.738756 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:46.738706    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7cb6bb86bc-4tqcl" podUID="6bb9e09b-4e61-4a14-93d5-61738ecb178b" containerName="console" containerID="cri-o://9c9a577aa8832444a2e1401be95d25f5e3a4cd492e2f8350c817a19d37bf1d89" gracePeriod=15
Sep 18 04:08:47.008540 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:47.008470    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cb6bb86bc-4tqcl"
Sep 18 04:08:47.057016 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:47.056986    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6bb9e09b-4e61-4a14-93d5-61738ecb178b-console-oauth-config\") pod \"6bb9e09b-4e61-4a14-93d5-61738ecb178b\" (UID: \"6bb9e09b-4e61-4a14-93d5-61738ecb178b\") "
Sep 18 04:08:47.057016 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:47.057017    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dtmdt\" (UniqueName: \"kubernetes.io/projected/6bb9e09b-4e61-4a14-93d5-61738ecb178b-kube-api-access-dtmdt\") pod \"6bb9e09b-4e61-4a14-93d5-61738ecb178b\" (UID: \"6bb9e09b-4e61-4a14-93d5-61738ecb178b\") "
Sep 18 04:08:47.057280 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:47.057042    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6bb9e09b-4e61-4a14-93d5-61738ecb178b-console-config\") pod \"6bb9e09b-4e61-4a14-93d5-61738ecb178b\" (UID: \"6bb9e09b-4e61-4a14-93d5-61738ecb178b\") "
Sep 18 04:08:47.057280 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:47.057175    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6bb9e09b-4e61-4a14-93d5-61738ecb178b-oauth-serving-cert\") pod \"6bb9e09b-4e61-4a14-93d5-61738ecb178b\" (UID: \"6bb9e09b-4e61-4a14-93d5-61738ecb178b\") "
Sep 18 04:08:47.057280 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:47.057221    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6bb9e09b-4e61-4a14-93d5-61738ecb178b-console-serving-cert\") pod \"6bb9e09b-4e61-4a14-93d5-61738ecb178b\" (UID: \"6bb9e09b-4e61-4a14-93d5-61738ecb178b\") "
Sep 18 04:08:47.057433 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:47.057280    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6bb9e09b-4e61-4a14-93d5-61738ecb178b-service-ca\") pod \"6bb9e09b-4e61-4a14-93d5-61738ecb178b\" (UID: \"6bb9e09b-4e61-4a14-93d5-61738ecb178b\") "
Sep 18 04:08:47.057497 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:47.057427    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6bb9e09b-4e61-4a14-93d5-61738ecb178b-console-config" (OuterVolumeSpecName: "console-config") pod "6bb9e09b-4e61-4a14-93d5-61738ecb178b" (UID: "6bb9e09b-4e61-4a14-93d5-61738ecb178b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 04:08:47.057661 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:47.057522    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6bb9e09b-4e61-4a14-93d5-61738ecb178b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6bb9e09b-4e61-4a14-93d5-61738ecb178b" (UID: "6bb9e09b-4e61-4a14-93d5-61738ecb178b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 04:08:47.057661 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:47.057632    2585 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6bb9e09b-4e61-4a14-93d5-61738ecb178b-console-config\") on node \"ip-10-0-129-207.ec2.internal\" DevicePath \"\""
Sep 18 04:08:47.057787 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:47.057691    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6bb9e09b-4e61-4a14-93d5-61738ecb178b-service-ca" (OuterVolumeSpecName: "service-ca") pod "6bb9e09b-4e61-4a14-93d5-61738ecb178b" (UID: "6bb9e09b-4e61-4a14-93d5-61738ecb178b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 04:08:47.059401 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:47.059372    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6bb9e09b-4e61-4a14-93d5-61738ecb178b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6bb9e09b-4e61-4a14-93d5-61738ecb178b" (UID: "6bb9e09b-4e61-4a14-93d5-61738ecb178b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 04:08:47.059593 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:47.059576    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6bb9e09b-4e61-4a14-93d5-61738ecb178b-kube-api-access-dtmdt" (OuterVolumeSpecName: "kube-api-access-dtmdt") pod "6bb9e09b-4e61-4a14-93d5-61738ecb178b" (UID: "6bb9e09b-4e61-4a14-93d5-61738ecb178b"). InnerVolumeSpecName "kube-api-access-dtmdt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 04:08:47.059673 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:47.059642    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6bb9e09b-4e61-4a14-93d5-61738ecb178b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6bb9e09b-4e61-4a14-93d5-61738ecb178b" (UID: "6bb9e09b-4e61-4a14-93d5-61738ecb178b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 04:08:47.158227 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:47.158194    2585 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6bb9e09b-4e61-4a14-93d5-61738ecb178b-oauth-serving-cert\") on node \"ip-10-0-129-207.ec2.internal\" DevicePath \"\""
Sep 18 04:08:47.158227 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:47.158222    2585 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6bb9e09b-4e61-4a14-93d5-61738ecb178b-console-serving-cert\") on node \"ip-10-0-129-207.ec2.internal\" DevicePath \"\""
Sep 18 04:08:47.158227 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:47.158235    2585 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6bb9e09b-4e61-4a14-93d5-61738ecb178b-service-ca\") on node \"ip-10-0-129-207.ec2.internal\" DevicePath \"\""
Sep 18 04:08:47.158448 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:47.158247    2585 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6bb9e09b-4e61-4a14-93d5-61738ecb178b-console-oauth-config\") on node \"ip-10-0-129-207.ec2.internal\" DevicePath \"\""
Sep 18 04:08:47.158448 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:47.158259    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dtmdt\" (UniqueName: \"kubernetes.io/projected/6bb9e09b-4e61-4a14-93d5-61738ecb178b-kube-api-access-dtmdt\") on node \"ip-10-0-129-207.ec2.internal\" DevicePath \"\""
Sep 18 04:08:47.815190 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:47.815148    2585 generic.go:356] "Generic (PLEG): container finished" podID="6bb9e09b-4e61-4a14-93d5-61738ecb178b" containerID="9c9a577aa8832444a2e1401be95d25f5e3a4cd492e2f8350c817a19d37bf1d89" exitCode=0
Sep 18 04:08:47.815392 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:47.815208    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cb6bb86bc-4tqcl" event={"ID":"6bb9e09b-4e61-4a14-93d5-61738ecb178b","Type":"ContainerDied","Data":"9c9a577aa8832444a2e1401be95d25f5e3a4cd492e2f8350c817a19d37bf1d89"}
Sep 18 04:08:47.815392 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:47.815256    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cb6bb86bc-4tqcl" event={"ID":"6bb9e09b-4e61-4a14-93d5-61738ecb178b","Type":"ContainerDied","Data":"f36a771c97e0f46f8d396f6ada3dcf8c944395ff277b6fe070ed5a8136dd1243"}
Sep 18 04:08:47.815392 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:47.815279    2585 scope.go:117] "RemoveContainer" containerID="9c9a577aa8832444a2e1401be95d25f5e3a4cd492e2f8350c817a19d37bf1d89"
Sep 18 04:08:47.815537 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:47.815451    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cb6bb86bc-4tqcl"
Sep 18 04:08:47.830621 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:47.830593    2585 scope.go:117] "RemoveContainer" containerID="9c9a577aa8832444a2e1401be95d25f5e3a4cd492e2f8350c817a19d37bf1d89"
Sep 18 04:08:47.830961 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:08:47.830933    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c9a577aa8832444a2e1401be95d25f5e3a4cd492e2f8350c817a19d37bf1d89\": container with ID starting with 9c9a577aa8832444a2e1401be95d25f5e3a4cd492e2f8350c817a19d37bf1d89 not found: ID does not exist" containerID="9c9a577aa8832444a2e1401be95d25f5e3a4cd492e2f8350c817a19d37bf1d89"
Sep 18 04:08:47.831065 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:47.830970    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c9a577aa8832444a2e1401be95d25f5e3a4cd492e2f8350c817a19d37bf1d89"} err="failed to get container status \"9c9a577aa8832444a2e1401be95d25f5e3a4cd492e2f8350c817a19d37bf1d89\": rpc error: code = NotFound desc = could not find container \"9c9a577aa8832444a2e1401be95d25f5e3a4cd492e2f8350c817a19d37bf1d89\": container with ID starting with 9c9a577aa8832444a2e1401be95d25f5e3a4cd492e2f8350c817a19d37bf1d89 not found: ID does not exist"
Sep 18 04:08:47.842529 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:47.842503    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7cb6bb86bc-4tqcl"]
Sep 18 04:08:47.844575 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:47.844551    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7cb6bb86bc-4tqcl"]
Sep 18 04:08:48.061265 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:48.061231    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6bb9e09b-4e61-4a14-93d5-61738ecb178b" path="/var/lib/kubelet/pods/6bb9e09b-4e61-4a14-93d5-61738ecb178b/volumes"
Sep 18 04:08:50.005839 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:50.005798    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:08:50.106657 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:08:50.106624    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:09:00.913917 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:09:00.913826    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:09:05.121343 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:09:05.121300    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7b575c66b8-9f97s" podUID="d9a0ebcf-4cf9-4bdc-96ca-121c557461b1" containerName="console" containerID="cri-o://2c27857e2db83464e481154deeb9f4380a7f58353f3088a30341e3bebe5faa91" gracePeriod=15
Sep 18 04:09:05.362874 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:09:05.362852    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b575c66b8-9f97s"
Sep 18 04:09:05.412627 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:09:05.412560    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gbwfb\" (UniqueName: \"kubernetes.io/projected/d9a0ebcf-4cf9-4bdc-96ca-121c557461b1-kube-api-access-gbwfb\") pod \"d9a0ebcf-4cf9-4bdc-96ca-121c557461b1\" (UID: \"d9a0ebcf-4cf9-4bdc-96ca-121c557461b1\") "
Sep 18 04:09:05.412627 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:09:05.412607    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d9a0ebcf-4cf9-4bdc-96ca-121c557461b1-service-ca\") pod \"d9a0ebcf-4cf9-4bdc-96ca-121c557461b1\" (UID: \"d9a0ebcf-4cf9-4bdc-96ca-121c557461b1\") "
Sep 18 04:09:05.412821 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:09:05.412633    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d9a0ebcf-4cf9-4bdc-96ca-121c557461b1-oauth-serving-cert\") pod \"d9a0ebcf-4cf9-4bdc-96ca-121c557461b1\" (UID: \"d9a0ebcf-4cf9-4bdc-96ca-121c557461b1\") "
Sep 18 04:09:05.412821 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:09:05.412658    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d9a0ebcf-4cf9-4bdc-96ca-121c557461b1-console-oauth-config\") pod \"d9a0ebcf-4cf9-4bdc-96ca-121c557461b1\" (UID: \"d9a0ebcf-4cf9-4bdc-96ca-121c557461b1\") "
Sep 18 04:09:05.412821 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:09:05.412686    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9a0ebcf-4cf9-4bdc-96ca-121c557461b1-trusted-ca-bundle\") pod \"d9a0ebcf-4cf9-4bdc-96ca-121c557461b1\" (UID: \"d9a0ebcf-4cf9-4bdc-96ca-121c557461b1\") "
Sep 18 04:09:05.412821 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:09:05.412719    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d9a0ebcf-4cf9-4bdc-96ca-121c557461b1-console-config\") pod \"d9a0ebcf-4cf9-4bdc-96ca-121c557461b1\" (UID: \"d9a0ebcf-4cf9-4bdc-96ca-121c557461b1\") "
Sep 18 04:09:05.412821 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:09:05.412805    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d9a0ebcf-4cf9-4bdc-96ca-121c557461b1-console-serving-cert\") pod \"d9a0ebcf-4cf9-4bdc-96ca-121c557461b1\" (UID: \"d9a0ebcf-4cf9-4bdc-96ca-121c557461b1\") "
Sep 18 04:09:05.413113 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:09:05.413050    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9a0ebcf-4cf9-4bdc-96ca-121c557461b1-service-ca" (OuterVolumeSpecName: "service-ca") pod "d9a0ebcf-4cf9-4bdc-96ca-121c557461b1" (UID: "d9a0ebcf-4cf9-4bdc-96ca-121c557461b1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 04:09:05.413113 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:09:05.413098    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9a0ebcf-4cf9-4bdc-96ca-121c557461b1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d9a0ebcf-4cf9-4bdc-96ca-121c557461b1" (UID: "d9a0ebcf-4cf9-4bdc-96ca-121c557461b1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 04:09:05.413223 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:09:05.413178    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9a0ebcf-4cf9-4bdc-96ca-121c557461b1-console-config" (OuterVolumeSpecName: "console-config") pod "d9a0ebcf-4cf9-4bdc-96ca-121c557461b1" (UID: "d9a0ebcf-4cf9-4bdc-96ca-121c557461b1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 04:09:05.413223 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:09:05.413186    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9a0ebcf-4cf9-4bdc-96ca-121c557461b1-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d9a0ebcf-4cf9-4bdc-96ca-121c557461b1" (UID: "d9a0ebcf-4cf9-4bdc-96ca-121c557461b1"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 04:09:05.414837 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:09:05.414810    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9a0ebcf-4cf9-4bdc-96ca-121c557461b1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d9a0ebcf-4cf9-4bdc-96ca-121c557461b1" (UID: "d9a0ebcf-4cf9-4bdc-96ca-121c557461b1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 04:09:05.414989 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:09:05.414956    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9a0ebcf-4cf9-4bdc-96ca-121c557461b1-kube-api-access-gbwfb" (OuterVolumeSpecName: "kube-api-access-gbwfb") pod "d9a0ebcf-4cf9-4bdc-96ca-121c557461b1" (UID: "d9a0ebcf-4cf9-4bdc-96ca-121c557461b1"). InnerVolumeSpecName "kube-api-access-gbwfb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 04:09:05.414989 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:09:05.414959    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9a0ebcf-4cf9-4bdc-96ca-121c557461b1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d9a0ebcf-4cf9-4bdc-96ca-121c557461b1" (UID: "d9a0ebcf-4cf9-4bdc-96ca-121c557461b1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 04:09:05.514350 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:09:05.514313    2585 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d9a0ebcf-4cf9-4bdc-96ca-121c557461b1-console-config\") on node \"ip-10-0-129-207.ec2.internal\" DevicePath \"\""
Sep 18 04:09:05.514350 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:09:05.514344    2585 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d9a0ebcf-4cf9-4bdc-96ca-121c557461b1-console-serving-cert\") on node \"ip-10-0-129-207.ec2.internal\" DevicePath \"\""
Sep 18 04:09:05.514350 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:09:05.514354    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gbwfb\" (UniqueName: \"kubernetes.io/projected/d9a0ebcf-4cf9-4bdc-96ca-121c557461b1-kube-api-access-gbwfb\") on node \"ip-10-0-129-207.ec2.internal\" DevicePath \"\""
Sep 18 04:09:05.514582 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:09:05.514364    2585 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d9a0ebcf-4cf9-4bdc-96ca-121c557461b1-service-ca\") on node \"ip-10-0-129-207.ec2.internal\" DevicePath \"\""
Sep 18 04:09:05.514582 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:09:05.514372    2585 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d9a0ebcf-4cf9-4bdc-96ca-121c557461b1-oauth-serving-cert\") on node \"ip-10-0-129-207.ec2.internal\" DevicePath \"\""
Sep 18 04:09:05.514582 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:09:05.514380    2585 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d9a0ebcf-4cf9-4bdc-96ca-121c557461b1-console-oauth-config\") on node \"ip-10-0-129-207.ec2.internal\" DevicePath \"\""
Sep 18 04:09:05.514582 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:09:05.514388    2585 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9a0ebcf-4cf9-4bdc-96ca-121c557461b1-trusted-ca-bundle\") on node \"ip-10-0-129-207.ec2.internal\" DevicePath \"\""
Sep 18 04:09:05.905449 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:09:05.905411    2585 generic.go:356] "Generic (PLEG): container finished" podID="d9a0ebcf-4cf9-4bdc-96ca-121c557461b1" containerID="2c27857e2db83464e481154deeb9f4380a7f58353f3088a30341e3bebe5faa91" exitCode=0
Sep 18 04:09:05.905605 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:09:05.905460    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b575c66b8-9f97s"
Sep 18 04:09:05.905605 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:09:05.905502    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b575c66b8-9f97s" event={"ID":"d9a0ebcf-4cf9-4bdc-96ca-121c557461b1","Type":"ContainerDied","Data":"2c27857e2db83464e481154deeb9f4380a7f58353f3088a30341e3bebe5faa91"}
Sep 18 04:09:05.905605 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:09:05.905558    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b575c66b8-9f97s" event={"ID":"d9a0ebcf-4cf9-4bdc-96ca-121c557461b1","Type":"ContainerDied","Data":"071886410e969604ad6dc962cb5655890d32d703d59d4842ea2ec103100a172e"}
Sep 18 04:09:05.905605 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:09:05.905579    2585 scope.go:117] "RemoveContainer" containerID="2c27857e2db83464e481154deeb9f4380a7f58353f3088a30341e3bebe5faa91"
Sep 18 04:09:05.914530 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:09:05.914513    2585 scope.go:117] "RemoveContainer" containerID="2c27857e2db83464e481154deeb9f4380a7f58353f3088a30341e3bebe5faa91"
Sep 18 04:09:05.914824 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:09:05.914806    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c27857e2db83464e481154deeb9f4380a7f58353f3088a30341e3bebe5faa91\": container with ID starting with 2c27857e2db83464e481154deeb9f4380a7f58353f3088a30341e3bebe5faa91 not found: ID does not exist" containerID="2c27857e2db83464e481154deeb9f4380a7f58353f3088a30341e3bebe5faa91"
Sep 18 04:09:05.914888 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:09:05.914837    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c27857e2db83464e481154deeb9f4380a7f58353f3088a30341e3bebe5faa91"} err="failed to get container status \"2c27857e2db83464e481154deeb9f4380a7f58353f3088a30341e3bebe5faa91\": rpc error: code = NotFound desc = could not find container \"2c27857e2db83464e481154deeb9f4380a7f58353f3088a30341e3bebe5faa91\": container with ID starting with 2c27857e2db83464e481154deeb9f4380a7f58353f3088a30341e3bebe5faa91 not found: ID does not exist"
Sep 18 04:09:05.926892 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:09:05.926857    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b575c66b8-9f97s"]
Sep 18 04:09:05.932044 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:09:05.932019    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7b575c66b8-9f97s"]
Sep 18 04:09:06.061693 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:09:06.061652    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9a0ebcf-4cf9-4bdc-96ca-121c557461b1" path="/var/lib/kubelet/pods/d9a0ebcf-4cf9-4bdc-96ca-121c557461b1/volumes"
Sep 18 04:09:31.355296 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:09:31.355255    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 04:09:31.370887 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:09:31.370862    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 04:09:32.020257 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:09:32.020225    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 04:09:44.004701 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:09:44.004644    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:09:44.407233 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:09:44.407206    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:09:52.507724 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:09:52.507688    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:09:59.236648 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:09:59.236610    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:09:59.295647 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:09:59.295610    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:10:08.153990 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:08.153953    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:10:11.135365 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:11.135287    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:10:11.195391 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:11.195350    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:10:14.597092 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:14.597061    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:10:14.707509 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:14.707474    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:10:14.808949 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:14.808911    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:10:15.538956 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:15.538911    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:10:19.762889 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:19.762842    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:10:19.862954 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:19.862922    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:10:49.523251 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:49.523204    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:10:49.620037 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:49.620003    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:10:51.004257 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:51.004219    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:10:51.086648 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:51.086617    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:10:52.089586 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:52.089543    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:10:56.580207 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:56.580174    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847as4fpm"]
Sep 18 04:10:56.580651 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:56.580469    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6bb9e09b-4e61-4a14-93d5-61738ecb178b" containerName="console"
Sep 18 04:10:56.580651 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:56.580480    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bb9e09b-4e61-4a14-93d5-61738ecb178b" containerName="console"
Sep 18 04:10:56.580651 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:56.580494    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9a0ebcf-4cf9-4bdc-96ca-121c557461b1" containerName="console"
Sep 18 04:10:56.580651 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:56.580500    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9a0ebcf-4cf9-4bdc-96ca-121c557461b1" containerName="console"
Sep 18 04:10:56.580651 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:56.580513    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c93f80c-45eb-481b-bacd-3e6749ed93c8" containerName="registry"
Sep 18 04:10:56.580651 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:56.580519    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c93f80c-45eb-481b-bacd-3e6749ed93c8" containerName="registry"
Sep 18 04:10:56.580651 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:56.580572    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="6bb9e09b-4e61-4a14-93d5-61738ecb178b" containerName="console"
Sep 18 04:10:56.580651 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:56.580580    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9a0ebcf-4cf9-4bdc-96ca-121c557461b1" containerName="console"
Sep 18 04:10:56.580651 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:56.580587    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c93f80c-45eb-481b-bacd-3e6749ed93c8" containerName="registry"
Sep 18 04:10:56.584861 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:56.584843    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847as4fpm"
Sep 18 04:10:56.587214 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:56.587191    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 18 04:10:56.587323 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:56.587245    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 18 04:10:56.588006 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:56.587990    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-fvctb\""
Sep 18 04:10:56.590936 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:56.590913    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847as4fpm"]
Sep 18 04:10:56.637656 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:56.637625    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12f2aad4-90be-42f7-bb90-8e117aedf053-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847as4fpm\" (UID: \"12f2aad4-90be-42f7-bb90-8e117aedf053\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847as4fpm"
Sep 18 04:10:56.637788 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:56.637666    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lfcg\" (UniqueName: \"kubernetes.io/projected/12f2aad4-90be-42f7-bb90-8e117aedf053-kube-api-access-9lfcg\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847as4fpm\" (UID: \"12f2aad4-90be-42f7-bb90-8e117aedf053\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847as4fpm"
Sep 18 04:10:56.637788 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:56.637687    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12f2aad4-90be-42f7-bb90-8e117aedf053-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847as4fpm\" (UID: \"12f2aad4-90be-42f7-bb90-8e117aedf053\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847as4fpm"
Sep 18 04:10:56.738240 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:56.738205    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12f2aad4-90be-42f7-bb90-8e117aedf053-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847as4fpm\" (UID: \"12f2aad4-90be-42f7-bb90-8e117aedf053\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847as4fpm"
Sep 18 04:10:56.738412 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:56.738253    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lfcg\" (UniqueName: \"kubernetes.io/projected/12f2aad4-90be-42f7-bb90-8e117aedf053-kube-api-access-9lfcg\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847as4fpm\" (UID: \"12f2aad4-90be-42f7-bb90-8e117aedf053\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847as4fpm"
Sep 18 04:10:56.738412 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:56.738285    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12f2aad4-90be-42f7-bb90-8e117aedf053-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847as4fpm\" (UID: \"12f2aad4-90be-42f7-bb90-8e117aedf053\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847as4fpm"
Sep 18 04:10:56.738692 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:56.738667    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12f2aad4-90be-42f7-bb90-8e117aedf053-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847as4fpm\" (UID: \"12f2aad4-90be-42f7-bb90-8e117aedf053\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847as4fpm"
Sep 18 04:10:56.738732 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:56.738694    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12f2aad4-90be-42f7-bb90-8e117aedf053-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847as4fpm\" (UID: \"12f2aad4-90be-42f7-bb90-8e117aedf053\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847as4fpm"
Sep 18 04:10:56.746590 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:56.746562    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lfcg\" (UniqueName: \"kubernetes.io/projected/12f2aad4-90be-42f7-bb90-8e117aedf053-kube-api-access-9lfcg\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847as4fpm\" (UID: \"12f2aad4-90be-42f7-bb90-8e117aedf053\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847as4fpm"
Sep 18 04:10:56.894572 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:56.894490    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847as4fpm"
Sep 18 04:10:57.163537 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:57.163438    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847as4fpm"]
Sep 18 04:10:57.166641 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:10:57.166611    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12f2aad4_90be_42f7_bb90_8e117aedf053.slice/crio-b83efbda05f83e5f4e1e6e07c4f77f3046e4961d3bdf9f9bcb75d83935589ff4 WatchSource:0}: Error finding container b83efbda05f83e5f4e1e6e07c4f77f3046e4961d3bdf9f9bcb75d83935589ff4: Status 404 returned error can't find the container with id b83efbda05f83e5f4e1e6e07c4f77f3046e4961d3bdf9f9bcb75d83935589ff4
Sep 18 04:10:57.338973 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:57.338937    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847as4fpm" event={"ID":"12f2aad4-90be-42f7-bb90-8e117aedf053","Type":"ContainerStarted","Data":"b83efbda05f83e5f4e1e6e07c4f77f3046e4961d3bdf9f9bcb75d83935589ff4"}
Sep 18 04:10:58.177861 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:58.177823    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:10:58.249976 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:58.249932    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:10:58.398653 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:58.398604    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:10:58.490071 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:58.490038    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-skglm"]
Sep 18 04:10:58.493608 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:58.493583    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-skglm"
Sep 18 04:10:58.497107 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:58.497084    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 18 04:10:58.497537 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:58.497451    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"openshift-ai-inference-openshift-ai-inference-dockercfg-2g8q8\""
Sep 18 04:10:58.519113 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:58.519081    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-skglm"]
Sep 18 04:10:58.536543 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:58.536505    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:10:58.552207 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:58.552176    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bsb5\" (UniqueName: \"kubernetes.io/projected/4f6fe3b0-73cf-49d9-970f-78826cff79d5-kube-api-access-4bsb5\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-skglm\" (UID: \"4f6fe3b0-73cf-49d9-970f-78826cff79d5\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-skglm"
Sep 18 04:10:58.552207 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:58.552214    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f6fe3b0-73cf-49d9-970f-78826cff79d5-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-skglm\" (UID: \"4f6fe3b0-73cf-49d9-970f-78826cff79d5\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-skglm"
Sep 18 04:10:58.552438 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:58.552255    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f6fe3b0-73cf-49d9-970f-78826cff79d5-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-skglm\" (UID: \"4f6fe3b0-73cf-49d9-970f-78826cff79d5\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-skglm"
Sep 18 04:10:58.552438 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:58.552295    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f6fe3b0-73cf-49d9-970f-78826cff79d5-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-skglm\" (UID: \"4f6fe3b0-73cf-49d9-970f-78826cff79d5\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-skglm"
Sep 18 04:10:58.552438 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:58.552314    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f6fe3b0-73cf-49d9-970f-78826cff79d5-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-skglm\" (UID: \"4f6fe3b0-73cf-49d9-970f-78826cff79d5\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-skglm"
Sep 18 04:10:58.552438 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:58.552351    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f6fe3b0-73cf-49d9-970f-78826cff79d5-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-skglm\" (UID: \"4f6fe3b0-73cf-49d9-970f-78826cff79d5\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-skglm"
Sep 18 04:10:58.552438 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:58.552397    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f6fe3b0-73cf-49d9-970f-78826cff79d5-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-skglm\" (UID: \"4f6fe3b0-73cf-49d9-970f-78826cff79d5\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-skglm"
Sep 18 04:10:58.552438 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:58.552421    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f6fe3b0-73cf-49d9-970f-78826cff79d5-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-skglm\" (UID: \"4f6fe3b0-73cf-49d9-970f-78826cff79d5\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-skglm"
Sep 18 04:10:58.552744 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:58.552445    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f6fe3b0-73cf-49d9-970f-78826cff79d5-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-skglm\" (UID: \"4f6fe3b0-73cf-49d9-970f-78826cff79d5\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-skglm"
Sep 18 04:10:58.622492 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:58.622448    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:10:58.653453 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:58.653412    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f6fe3b0-73cf-49d9-970f-78826cff79d5-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-skglm\" (UID: \"4f6fe3b0-73cf-49d9-970f-78826cff79d5\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-skglm"
Sep 18 04:10:58.653639 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:58.653468    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f6fe3b0-73cf-49d9-970f-78826cff79d5-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-skglm\" (UID: \"4f6fe3b0-73cf-49d9-970f-78826cff79d5\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-skglm"
Sep 18 04:10:58.653639 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:58.653489    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f6fe3b0-73cf-49d9-970f-78826cff79d5-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-skglm\" (UID: \"4f6fe3b0-73cf-49d9-970f-78826cff79d5\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-skglm"
Sep 18 04:10:58.653639 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:58.653517    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f6fe3b0-73cf-49d9-970f-78826cff79d5-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-skglm\" (UID: \"4f6fe3b0-73cf-49d9-970f-78826cff79d5\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-skglm"
Sep 18 04:10:58.653639 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:58.653557    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f6fe3b0-73cf-49d9-970f-78826cff79d5-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-skglm\" (UID: \"4f6fe3b0-73cf-49d9-970f-78826cff79d5\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-skglm"
Sep 18 04:10:58.653639 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:58.653594    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f6fe3b0-73cf-49d9-970f-78826cff79d5-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-skglm\" (UID: \"4f6fe3b0-73cf-49d9-970f-78826cff79d5\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-skglm"
Sep 18 04:10:58.653639 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:58.653628    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f6fe3b0-73cf-49d9-970f-78826cff79d5-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-skglm\" (UID: \"4f6fe3b0-73cf-49d9-970f-78826cff79d5\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-skglm"
Sep 18 04:10:58.653976 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:58.653685    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bsb5\" (UniqueName: \"kubernetes.io/projected/4f6fe3b0-73cf-49d9-970f-78826cff79d5-kube-api-access-4bsb5\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-skglm\" (UID: \"4f6fe3b0-73cf-49d9-970f-78826cff79d5\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-skglm"
Sep 18 04:10:58.653976 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:58.653715    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f6fe3b0-73cf-49d9-970f-78826cff79d5-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-skglm\" (UID: \"4f6fe3b0-73cf-49d9-970f-78826cff79d5\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-skglm"
Sep 18 04:10:58.654085 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:58.654015    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f6fe3b0-73cf-49d9-970f-78826cff79d5-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-skglm\" (UID: \"4f6fe3b0-73cf-49d9-970f-78826cff79d5\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-skglm"
Sep 18 04:10:58.654141 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:58.654106    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f6fe3b0-73cf-49d9-970f-78826cff79d5-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-skglm\" (UID: \"4f6fe3b0-73cf-49d9-970f-78826cff79d5\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-skglm"
Sep 18 04:10:58.654195 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:58.654161    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f6fe3b0-73cf-49d9-970f-78826cff79d5-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-skglm\" (UID: \"4f6fe3b0-73cf-49d9-970f-78826cff79d5\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-skglm"
Sep 18 04:10:58.654345 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:58.654320    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f6fe3b0-73cf-49d9-970f-78826cff79d5-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-skglm\" (UID: \"4f6fe3b0-73cf-49d9-970f-78826cff79d5\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-skglm"
Sep 18 04:10:58.654471 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:58.654428    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f6fe3b0-73cf-49d9-970f-78826cff79d5-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-skglm\" (UID: \"4f6fe3b0-73cf-49d9-970f-78826cff79d5\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-skglm"
Sep 18 04:10:58.656296 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:58.656273    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f6fe3b0-73cf-49d9-970f-78826cff79d5-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-skglm\" (UID: \"4f6fe3b0-73cf-49d9-970f-78826cff79d5\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-skglm"
Sep 18 04:10:58.656610 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:58.656591    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f6fe3b0-73cf-49d9-970f-78826cff79d5-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-skglm\" (UID: \"4f6fe3b0-73cf-49d9-970f-78826cff79d5\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-skglm"
Sep 18 04:10:58.664532 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:58.664486    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qbdbv"]
Sep 18 04:10:58.673303 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:58.673264    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qbdbv"
Sep 18 04:10:58.675205 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:58.675184    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f6fe3b0-73cf-49d9-970f-78826cff79d5-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-skglm\" (UID: \"4f6fe3b0-73cf-49d9-970f-78826cff79d5\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-skglm"
Sep 18 04:10:58.675351 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:58.675328    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bsb5\" (UniqueName: \"kubernetes.io/projected/4f6fe3b0-73cf-49d9-970f-78826cff79d5-kube-api-access-4bsb5\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-skglm\" (UID: \"4f6fe3b0-73cf-49d9-970f-78826cff79d5\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-skglm"
Sep 18 04:10:58.676009 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:58.675990    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-9pcdr\""
Sep 18 04:10:58.682033 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:58.681999    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qbdbv"]
Sep 18 04:10:58.754515 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:58.754416    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlhcb\" (UniqueName: \"kubernetes.io/projected/3d248c16-db7b-4d6d-ae14-4a321609e0ba-kube-api-access-hlhcb\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qbdbv\" (UID: \"3d248c16-db7b-4d6d-ae14-4a321609e0ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qbdbv"
Sep 18 04:10:58.754515 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:58.754470    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d248c16-db7b-4d6d-ae14-4a321609e0ba-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qbdbv\" (UID: \"3d248c16-db7b-4d6d-ae14-4a321609e0ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qbdbv"
Sep 18 04:10:58.754712 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:58.754529    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d248c16-db7b-4d6d-ae14-4a321609e0ba-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qbdbv\" (UID: \"3d248c16-db7b-4d6d-ae14-4a321609e0ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qbdbv"
Sep 18 04:10:58.754712 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:58.754544    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d248c16-db7b-4d6d-ae14-4a321609e0ba-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qbdbv\" (UID: \"3d248c16-db7b-4d6d-ae14-4a321609e0ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qbdbv"
Sep 18 04:10:58.754712 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:58.754644    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d248c16-db7b-4d6d-ae14-4a321609e0ba-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qbdbv\" (UID: \"3d248c16-db7b-4d6d-ae14-4a321609e0ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qbdbv"
Sep 18 04:10:58.754712 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:58.754684    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d248c16-db7b-4d6d-ae14-4a321609e0ba-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qbdbv\" (UID: \"3d248c16-db7b-4d6d-ae14-4a321609e0ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qbdbv"
Sep 18 04:10:58.754950 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:58.754715    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d248c16-db7b-4d6d-ae14-4a321609e0ba-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qbdbv\" (UID: \"3d248c16-db7b-4d6d-ae14-4a321609e0ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qbdbv"
Sep 18 04:10:58.754950 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:58.754750    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d248c16-db7b-4d6d-ae14-4a321609e0ba-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qbdbv\" (UID: \"3d248c16-db7b-4d6d-ae14-4a321609e0ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qbdbv"
Sep 18 04:10:58.754950 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:58.754773    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d248c16-db7b-4d6d-ae14-4a321609e0ba-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qbdbv\" (UID: \"3d248c16-db7b-4d6d-ae14-4a321609e0ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qbdbv"
Sep 18 04:10:58.761398 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:58.761369    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:10:58.808385 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:58.808347    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-skglm"
Sep 18 04:10:58.855849 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:58.855806    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlhcb\" (UniqueName: \"kubernetes.io/projected/3d248c16-db7b-4d6d-ae14-4a321609e0ba-kube-api-access-hlhcb\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qbdbv\" (UID: \"3d248c16-db7b-4d6d-ae14-4a321609e0ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qbdbv"
Sep 18 04:10:58.856024 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:58.855865    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d248c16-db7b-4d6d-ae14-4a321609e0ba-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qbdbv\" (UID: \"3d248c16-db7b-4d6d-ae14-4a321609e0ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qbdbv"
Sep 18 04:10:58.856024 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:58.855922    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d248c16-db7b-4d6d-ae14-4a321609e0ba-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qbdbv\" (UID: \"3d248c16-db7b-4d6d-ae14-4a321609e0ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qbdbv"
Sep 18 04:10:58.856024 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:58.855947    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d248c16-db7b-4d6d-ae14-4a321609e0ba-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qbdbv\" (UID: \"3d248c16-db7b-4d6d-ae14-4a321609e0ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qbdbv"
Sep 18 04:10:58.856024 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:58.856003    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d248c16-db7b-4d6d-ae14-4a321609e0ba-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qbdbv\" (UID: \"3d248c16-db7b-4d6d-ae14-4a321609e0ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qbdbv"
Sep 18 04:10:58.856233 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:58.856039    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d248c16-db7b-4d6d-ae14-4a321609e0ba-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qbdbv\" (UID: \"3d248c16-db7b-4d6d-ae14-4a321609e0ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qbdbv"
Sep 18 04:10:58.856233 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:58.856073    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d248c16-db7b-4d6d-ae14-4a321609e0ba-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qbdbv\" (UID: \"3d248c16-db7b-4d6d-ae14-4a321609e0ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qbdbv"
Sep 18 04:10:58.856233 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:58.856109    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d248c16-db7b-4d6d-ae14-4a321609e0ba-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qbdbv\" (UID: \"3d248c16-db7b-4d6d-ae14-4a321609e0ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qbdbv"
Sep 18 04:10:58.856233 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:58.856138    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d248c16-db7b-4d6d-ae14-4a321609e0ba-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qbdbv\" (UID: \"3d248c16-db7b-4d6d-ae14-4a321609e0ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qbdbv"
Sep 18 04:10:58.856702 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:58.856672    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d248c16-db7b-4d6d-ae14-4a321609e0ba-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qbdbv\" (UID: \"3d248c16-db7b-4d6d-ae14-4a321609e0ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qbdbv"
Sep 18 04:10:58.856859 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:58.856833    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d248c16-db7b-4d6d-ae14-4a321609e0ba-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qbdbv\" (UID: \"3d248c16-db7b-4d6d-ae14-4a321609e0ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qbdbv"
Sep 18 04:10:58.856981 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:58.856958    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d248c16-db7b-4d6d-ae14-4a321609e0ba-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qbdbv\" (UID: \"3d248c16-db7b-4d6d-ae14-4a321609e0ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qbdbv"
Sep 18 04:10:58.857192 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:58.857137    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d248c16-db7b-4d6d-ae14-4a321609e0ba-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qbdbv\" (UID: \"3d248c16-db7b-4d6d-ae14-4a321609e0ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qbdbv"
Sep 18 04:10:58.857303 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:58.857197    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d248c16-db7b-4d6d-ae14-4a321609e0ba-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qbdbv\" (UID: \"3d248c16-db7b-4d6d-ae14-4a321609e0ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qbdbv"
Sep 18 04:10:58.858985 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:58.858960    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d248c16-db7b-4d6d-ae14-4a321609e0ba-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qbdbv\" (UID: \"3d248c16-db7b-4d6d-ae14-4a321609e0ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qbdbv"
Sep 18 04:10:58.859572 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:58.859547    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d248c16-db7b-4d6d-ae14-4a321609e0ba-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qbdbv\" (UID: \"3d248c16-db7b-4d6d-ae14-4a321609e0ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qbdbv"
Sep 18 04:10:58.869131 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:58.869081    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d248c16-db7b-4d6d-ae14-4a321609e0ba-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qbdbv\" (UID: \"3d248c16-db7b-4d6d-ae14-4a321609e0ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qbdbv"
Sep 18 04:10:58.872383 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:58.872202    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlhcb\" (UniqueName: \"kubernetes.io/projected/3d248c16-db7b-4d6d-ae14-4a321609e0ba-kube-api-access-hlhcb\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qbdbv\" (UID: \"3d248c16-db7b-4d6d-ae14-4a321609e0ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qbdbv"
Sep 18 04:10:59.006987 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:59.006893    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qbdbv"
Sep 18 04:10:59.115414 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:59.115385    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-skglm"]
Sep 18 04:10:59.117551 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:10:59.117522    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f6fe3b0_73cf_49d9_970f_78826cff79d5.slice/crio-af34841410929b52f1efaed9f5609250e908c01c9796dcce673e29f33655acd4 WatchSource:0}: Error finding container af34841410929b52f1efaed9f5609250e908c01c9796dcce673e29f33655acd4: Status 404 returned error can't find the container with id af34841410929b52f1efaed9f5609250e908c01c9796dcce673e29f33655acd4
Sep 18 04:10:59.292404 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:59.292377    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qbdbv"]
Sep 18 04:10:59.295258 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:10:59.295224    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d248c16_db7b_4d6d_ae14_4a321609e0ba.slice/crio-0fb5070ba241eb784c716681a4ce3ad9760a0474a5ebbaeef7f63b0ff332da0b WatchSource:0}: Error finding container 0fb5070ba241eb784c716681a4ce3ad9760a0474a5ebbaeef7f63b0ff332da0b: Status 404 returned error can't find the container with id 0fb5070ba241eb784c716681a4ce3ad9760a0474a5ebbaeef7f63b0ff332da0b
Sep 18 04:10:59.350496 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:59.350456    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-skglm" event={"ID":"4f6fe3b0-73cf-49d9-970f-78826cff79d5","Type":"ContainerStarted","Data":"af34841410929b52f1efaed9f5609250e908c01c9796dcce673e29f33655acd4"}
Sep 18 04:10:59.351843 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:10:59.351811    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qbdbv" event={"ID":"3d248c16-db7b-4d6d-ae14-4a321609e0ba","Type":"ContainerStarted","Data":"0fb5070ba241eb784c716681a4ce3ad9760a0474a5ebbaeef7f63b0ff332da0b"}
Sep 18 04:11:01.581466 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:01.581431    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:11:03.478087 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:03.478053    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-skglm"]
Sep 18 04:11:03.674914 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:03.674857    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 04:11:03.675021 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:03.674964    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 04:11:03.675021 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:03.675010    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 04:11:03.680458 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:03.680426    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 04:11:03.680535 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:03.680515    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 04:11:03.680584 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:03.680566    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 04:11:04.377756 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:04.377720    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-skglm" event={"ID":"4f6fe3b0-73cf-49d9-970f-78826cff79d5","Type":"ContainerStarted","Data":"ee83163aaab3c4063418fb467e087bb859c09483158d0de591a69bde02e36ef7"}
Sep 18 04:11:04.377756 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:04.377747    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-skglm" podUID="4f6fe3b0-73cf-49d9-970f-78826cff79d5" containerName="istio-proxy" containerID="cri-o://ee83163aaab3c4063418fb467e087bb859c09483158d0de591a69bde02e36ef7" gracePeriod=30
Sep 18 04:11:04.379405 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:04.379369    2585 generic.go:356] "Generic (PLEG): container finished" podID="12f2aad4-90be-42f7-bb90-8e117aedf053" containerID="98511b5df43b93829db4f7ea83d218103a46409e59fe5ca3919369d8bedcb4be" exitCode=0
Sep 18 04:11:04.379530 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:04.379445    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847as4fpm" event={"ID":"12f2aad4-90be-42f7-bb90-8e117aedf053","Type":"ContainerDied","Data":"98511b5df43b93829db4f7ea83d218103a46409e59fe5ca3919369d8bedcb4be"}
Sep 18 04:11:04.381056 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:04.381037    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qbdbv" event={"ID":"3d248c16-db7b-4d6d-ae14-4a321609e0ba","Type":"ContainerStarted","Data":"c5be5f49121264bd012670a7d39777cc54b65bcdf2ab9da34261aab1d5d91634"}
Sep 18 04:11:04.400241 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:04.400199    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-skglm" podStartSLOduration=1.845584211 podStartE2EDuration="6.40018491s" totalImagesPullingTime="4.554600699s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:10:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:11:04.399393521 +0000 UTC m=+298.856836492" watchObservedRunningTime="2026-09-18 04:11:04.40018491 +0000 UTC m=+298.857627879"
Sep 18 04:11:04.418977 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:04.418935    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qbdbv" podStartSLOduration=2.036373552 podStartE2EDuration="6.418921428s" totalImagesPullingTime="4.382547876s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:10:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:11:04.417780693 +0000 UTC m=+298.875223663" watchObservedRunningTime="2026-09-18 04:11:04.418921428 +0000 UTC m=+298.876364395"
Sep 18 04:11:05.008103 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:05.008055    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qbdbv"
Sep 18 04:11:05.012536 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:05.012510    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qbdbv"
Sep 18 04:11:05.385408 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:05.385384    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qbdbv"
Sep 18 04:11:05.386190 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:05.386171    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qbdbv"
Sep 18 04:11:05.966298 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:05.966211    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-jxtk4_6d42c4e4-9bc8-4aa3-8056-c871229383e2/console-operator/1.log"
Sep 18 04:11:05.970017 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:05.969989    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-jxtk4_6d42c4e4-9bc8-4aa3-8056-c871229383e2/console-operator/1.log"
Sep 18 04:11:05.977524 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:05.977505    2585 kubelet.go:1648] "Image garbage collection succeeded"
Sep 18 04:11:06.390910 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:06.390864    2585 generic.go:356] "Generic (PLEG): container finished" podID="12f2aad4-90be-42f7-bb90-8e117aedf053" containerID="13b5e3696336c0f4df338d59face535b62a1fcadaf48174a1267ad676accd156" exitCode=0
Sep 18 04:11:06.393285 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:06.390930    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847as4fpm" event={"ID":"12f2aad4-90be-42f7-bb90-8e117aedf053","Type":"ContainerDied","Data":"13b5e3696336c0f4df338d59face535b62a1fcadaf48174a1267ad676accd156"}
Sep 18 04:11:09.636096 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:09.636068    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-skglm"
Sep 18 04:11:09.754319 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:09.754228    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f6fe3b0-73cf-49d9-970f-78826cff79d5-credential-socket\") pod \"4f6fe3b0-73cf-49d9-970f-78826cff79d5\" (UID: \"4f6fe3b0-73cf-49d9-970f-78826cff79d5\") "
Sep 18 04:11:09.754319 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:09.754268    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f6fe3b0-73cf-49d9-970f-78826cff79d5-workload-socket\") pod \"4f6fe3b0-73cf-49d9-970f-78826cff79d5\" (UID: \"4f6fe3b0-73cf-49d9-970f-78826cff79d5\") "
Sep 18 04:11:09.754319 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:09.754303    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f6fe3b0-73cf-49d9-970f-78826cff79d5-workload-certs\") pod \"4f6fe3b0-73cf-49d9-970f-78826cff79d5\" (UID: \"4f6fe3b0-73cf-49d9-970f-78826cff79d5\") "
Sep 18 04:11:09.754604 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:09.754337    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f6fe3b0-73cf-49d9-970f-78826cff79d5-istio-token\") pod \"4f6fe3b0-73cf-49d9-970f-78826cff79d5\" (UID: \"4f6fe3b0-73cf-49d9-970f-78826cff79d5\") "
Sep 18 04:11:09.754604 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:09.754388    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f6fe3b0-73cf-49d9-970f-78826cff79d5-istio-data\") pod \"4f6fe3b0-73cf-49d9-970f-78826cff79d5\" (UID: \"4f6fe3b0-73cf-49d9-970f-78826cff79d5\") "
Sep 18 04:11:09.754604 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:09.754425    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f6fe3b0-73cf-49d9-970f-78826cff79d5-istiod-ca-cert\") pod \"4f6fe3b0-73cf-49d9-970f-78826cff79d5\" (UID: \"4f6fe3b0-73cf-49d9-970f-78826cff79d5\") "
Sep 18 04:11:09.754604 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:09.754528    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4bsb5\" (UniqueName: \"kubernetes.io/projected/4f6fe3b0-73cf-49d9-970f-78826cff79d5-kube-api-access-4bsb5\") pod \"4f6fe3b0-73cf-49d9-970f-78826cff79d5\" (UID: \"4f6fe3b0-73cf-49d9-970f-78826cff79d5\") "
Sep 18 04:11:09.754604 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:09.754536    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f6fe3b0-73cf-49d9-970f-78826cff79d5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4f6fe3b0-73cf-49d9-970f-78826cff79d5" (UID: "4f6fe3b0-73cf-49d9-970f-78826cff79d5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 04:11:09.754604 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:09.754557    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f6fe3b0-73cf-49d9-970f-78826cff79d5-istio-podinfo\") pod \"4f6fe3b0-73cf-49d9-970f-78826cff79d5\" (UID: \"4f6fe3b0-73cf-49d9-970f-78826cff79d5\") "
Sep 18 04:11:09.754604 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:09.754596    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f6fe3b0-73cf-49d9-970f-78826cff79d5-istio-envoy\") pod \"4f6fe3b0-73cf-49d9-970f-78826cff79d5\" (UID: \"4f6fe3b0-73cf-49d9-970f-78826cff79d5\") "
Sep 18 04:11:09.754970 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:09.754658    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f6fe3b0-73cf-49d9-970f-78826cff79d5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4f6fe3b0-73cf-49d9-970f-78826cff79d5" (UID: "4f6fe3b0-73cf-49d9-970f-78826cff79d5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 04:11:09.754970 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:09.754758    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f6fe3b0-73cf-49d9-970f-78826cff79d5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4f6fe3b0-73cf-49d9-970f-78826cff79d5" (UID: "4f6fe3b0-73cf-49d9-970f-78826cff79d5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 04:11:09.754970 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:09.754866    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f6fe3b0-73cf-49d9-970f-78826cff79d5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4f6fe3b0-73cf-49d9-970f-78826cff79d5" (UID: "4f6fe3b0-73cf-49d9-970f-78826cff79d5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 04:11:09.754970 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:09.754870    2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f6fe3b0-73cf-49d9-970f-78826cff79d5-credential-socket\") on node \"ip-10-0-129-207.ec2.internal\" DevicePath \"\""
Sep 18 04:11:09.754970 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:09.754920    2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f6fe3b0-73cf-49d9-970f-78826cff79d5-workload-socket\") on node \"ip-10-0-129-207.ec2.internal\" DevicePath \"\""
Sep 18 04:11:09.754970 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:09.754939    2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f6fe3b0-73cf-49d9-970f-78826cff79d5-workload-certs\") on node \"ip-10-0-129-207.ec2.internal\" DevicePath \"\""
Sep 18 04:11:09.755273 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:09.755189    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f6fe3b0-73cf-49d9-970f-78826cff79d5-istio-data" (OuterVolumeSpecName: "istio-data") pod "4f6fe3b0-73cf-49d9-970f-78826cff79d5" (UID: "4f6fe3b0-73cf-49d9-970f-78826cff79d5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 04:11:09.757247 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:09.757217    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f6fe3b0-73cf-49d9-970f-78826cff79d5-kube-api-access-4bsb5" (OuterVolumeSpecName: "kube-api-access-4bsb5") pod "4f6fe3b0-73cf-49d9-970f-78826cff79d5" (UID: "4f6fe3b0-73cf-49d9-970f-78826cff79d5"). InnerVolumeSpecName "kube-api-access-4bsb5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 04:11:09.757449 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:09.757420    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4f6fe3b0-73cf-49d9-970f-78826cff79d5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4f6fe3b0-73cf-49d9-970f-78826cff79d5" (UID: "4f6fe3b0-73cf-49d9-970f-78826cff79d5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 04:11:09.757567 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:09.757454    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f6fe3b0-73cf-49d9-970f-78826cff79d5-istio-token" (OuterVolumeSpecName: "istio-token") pod "4f6fe3b0-73cf-49d9-970f-78826cff79d5" (UID: "4f6fe3b0-73cf-49d9-970f-78826cff79d5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 04:11:09.757567 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:09.757543    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f6fe3b0-73cf-49d9-970f-78826cff79d5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4f6fe3b0-73cf-49d9-970f-78826cff79d5" (UID: "4f6fe3b0-73cf-49d9-970f-78826cff79d5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 04:11:09.855642 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:09.855607    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4bsb5\" (UniqueName: \"kubernetes.io/projected/4f6fe3b0-73cf-49d9-970f-78826cff79d5-kube-api-access-4bsb5\") on node \"ip-10-0-129-207.ec2.internal\" DevicePath \"\""
Sep 18 04:11:09.855642 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:09.855638    2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f6fe3b0-73cf-49d9-970f-78826cff79d5-istio-podinfo\") on node \"ip-10-0-129-207.ec2.internal\" DevicePath \"\""
Sep 18 04:11:09.855835 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:09.855653    2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f6fe3b0-73cf-49d9-970f-78826cff79d5-istio-envoy\") on node \"ip-10-0-129-207.ec2.internal\" DevicePath \"\""
Sep 18 04:11:09.855835 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:09.855665    2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f6fe3b0-73cf-49d9-970f-78826cff79d5-istio-token\") on node \"ip-10-0-129-207.ec2.internal\" DevicePath \"\""
Sep 18 04:11:09.855835 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:09.855676    2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f6fe3b0-73cf-49d9-970f-78826cff79d5-istio-data\") on node \"ip-10-0-129-207.ec2.internal\" DevicePath \"\""
Sep 18 04:11:09.855835 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:09.855686    2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f6fe3b0-73cf-49d9-970f-78826cff79d5-istiod-ca-cert\") on node \"ip-10-0-129-207.ec2.internal\" DevicePath \"\""
Sep 18 04:11:10.413438 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:10.413343    2585 generic.go:356] "Generic (PLEG): container finished" podID="4f6fe3b0-73cf-49d9-970f-78826cff79d5" containerID="ee83163aaab3c4063418fb467e087bb859c09483158d0de591a69bde02e36ef7" exitCode=0
Sep 18 04:11:10.413438 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:10.413403    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-skglm" event={"ID":"4f6fe3b0-73cf-49d9-970f-78826cff79d5","Type":"ContainerDied","Data":"ee83163aaab3c4063418fb467e087bb859c09483158d0de591a69bde02e36ef7"}
Sep 18 04:11:10.413634 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:10.413445    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-skglm" event={"ID":"4f6fe3b0-73cf-49d9-970f-78826cff79d5","Type":"ContainerDied","Data":"af34841410929b52f1efaed9f5609250e908c01c9796dcce673e29f33655acd4"}
Sep 18 04:11:10.413634 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:10.413469    2585 scope.go:117] "RemoveContainer" containerID="ee83163aaab3c4063418fb467e087bb859c09483158d0de591a69bde02e36ef7"
Sep 18 04:11:10.413634 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:10.413404    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-skglm"
Sep 18 04:11:10.435071 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:10.434949    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-skglm"]
Sep 18 04:11:10.436666 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:10.436644    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-skglm"]
Sep 18 04:11:12.063286 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:12.063252    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f6fe3b0-73cf-49d9-970f-78826cff79d5" path="/var/lib/kubelet/pods/4f6fe3b0-73cf-49d9-970f-78826cff79d5/volumes"
Sep 18 04:11:12.084824 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:12.084626    2585 scope.go:117] "RemoveContainer" containerID="ee83163aaab3c4063418fb467e087bb859c09483158d0de591a69bde02e36ef7"
Sep 18 04:11:12.085037 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:11:12.085016    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee83163aaab3c4063418fb467e087bb859c09483158d0de591a69bde02e36ef7\": container with ID starting with ee83163aaab3c4063418fb467e087bb859c09483158d0de591a69bde02e36ef7 not found: ID does not exist" containerID="ee83163aaab3c4063418fb467e087bb859c09483158d0de591a69bde02e36ef7"
Sep 18 04:11:12.085096 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:12.085047    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee83163aaab3c4063418fb467e087bb859c09483158d0de591a69bde02e36ef7"} err="failed to get container status \"ee83163aaab3c4063418fb467e087bb859c09483158d0de591a69bde02e36ef7\": rpc error: code = NotFound desc = could not find container \"ee83163aaab3c4063418fb467e087bb859c09483158d0de591a69bde02e36ef7\": container with ID starting with ee83163aaab3c4063418fb467e087bb859c09483158d0de591a69bde02e36ef7 not found: ID does not exist"
Sep 18 04:11:12.424619 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:12.424539    2585 generic.go:356] "Generic (PLEG): container finished" podID="12f2aad4-90be-42f7-bb90-8e117aedf053" containerID="7d42f7348fb9e637cce100528c35e9b3644d2b26b0377007052e0b1b125c3461" exitCode=0
Sep 18 04:11:12.424787 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:12.424630    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847as4fpm" event={"ID":"12f2aad4-90be-42f7-bb90-8e117aedf053","Type":"ContainerDied","Data":"7d42f7348fb9e637cce100528c35e9b3644d2b26b0377007052e0b1b125c3461"}
Sep 18 04:11:12.952364 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:12.952333    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:11:13.561383 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:13.561352    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847as4fpm"
Sep 18 04:11:13.691157 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:13.691068    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9lfcg\" (UniqueName: \"kubernetes.io/projected/12f2aad4-90be-42f7-bb90-8e117aedf053-kube-api-access-9lfcg\") pod \"12f2aad4-90be-42f7-bb90-8e117aedf053\" (UID: \"12f2aad4-90be-42f7-bb90-8e117aedf053\") "
Sep 18 04:11:13.691298 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:13.691174    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12f2aad4-90be-42f7-bb90-8e117aedf053-util\") pod \"12f2aad4-90be-42f7-bb90-8e117aedf053\" (UID: \"12f2aad4-90be-42f7-bb90-8e117aedf053\") "
Sep 18 04:11:13.691298 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:13.691219    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12f2aad4-90be-42f7-bb90-8e117aedf053-bundle\") pod \"12f2aad4-90be-42f7-bb90-8e117aedf053\" (UID: \"12f2aad4-90be-42f7-bb90-8e117aedf053\") "
Sep 18 04:11:13.691861 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:13.691827    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12f2aad4-90be-42f7-bb90-8e117aedf053-bundle" (OuterVolumeSpecName: "bundle") pod "12f2aad4-90be-42f7-bb90-8e117aedf053" (UID: "12f2aad4-90be-42f7-bb90-8e117aedf053"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 04:11:13.693302 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:13.693268    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12f2aad4-90be-42f7-bb90-8e117aedf053-kube-api-access-9lfcg" (OuterVolumeSpecName: "kube-api-access-9lfcg") pod "12f2aad4-90be-42f7-bb90-8e117aedf053" (UID: "12f2aad4-90be-42f7-bb90-8e117aedf053"). InnerVolumeSpecName "kube-api-access-9lfcg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 04:11:13.695644 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:13.695621    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12f2aad4-90be-42f7-bb90-8e117aedf053-util" (OuterVolumeSpecName: "util") pod "12f2aad4-90be-42f7-bb90-8e117aedf053" (UID: "12f2aad4-90be-42f7-bb90-8e117aedf053"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 04:11:13.792699 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:13.792667    2585 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12f2aad4-90be-42f7-bb90-8e117aedf053-util\") on node \"ip-10-0-129-207.ec2.internal\" DevicePath \"\""
Sep 18 04:11:13.792699 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:13.792693    2585 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12f2aad4-90be-42f7-bb90-8e117aedf053-bundle\") on node \"ip-10-0-129-207.ec2.internal\" DevicePath \"\""
Sep 18 04:11:13.792699 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:13.792703    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9lfcg\" (UniqueName: \"kubernetes.io/projected/12f2aad4-90be-42f7-bb90-8e117aedf053-kube-api-access-9lfcg\") on node \"ip-10-0-129-207.ec2.internal\" DevicePath \"\""
Sep 18 04:11:14.436357 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:14.436281    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847as4fpm"
Sep 18 04:11:14.436493 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:14.436280    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847as4fpm" event={"ID":"12f2aad4-90be-42f7-bb90-8e117aedf053","Type":"ContainerDied","Data":"b83efbda05f83e5f4e1e6e07c4f77f3046e4961d3bdf9f9bcb75d83935589ff4"}
Sep 18 04:11:14.436493 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:14.436395    2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b83efbda05f83e5f4e1e6e07c4f77f3046e4961d3bdf9f9bcb75d83935589ff4"
Sep 18 04:11:15.163526 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:15.163490    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:11:17.173740 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:17.173700    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:11:17.297046 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:17.297014    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:11:17.973567 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:17.973534    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:11:18.032768 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:18.032732    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:11:19.657501 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:19.657467    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-operator-56d489b4b8-dgq4q"]
Sep 18 04:11:19.657976 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:19.657806    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12f2aad4-90be-42f7-bb90-8e117aedf053" containerName="extract"
Sep 18 04:11:19.657976 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:19.657816    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="12f2aad4-90be-42f7-bb90-8e117aedf053" containerName="extract"
Sep 18 04:11:19.657976 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:19.657835    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f6fe3b0-73cf-49d9-970f-78826cff79d5" containerName="istio-proxy"
Sep 18 04:11:19.657976 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:19.657842    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f6fe3b0-73cf-49d9-970f-78826cff79d5" containerName="istio-proxy"
Sep 18 04:11:19.657976 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:19.657849    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12f2aad4-90be-42f7-bb90-8e117aedf053" containerName="util"
Sep 18 04:11:19.657976 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:19.657854    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="12f2aad4-90be-42f7-bb90-8e117aedf053" containerName="util"
Sep 18 04:11:19.657976 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:19.657860    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12f2aad4-90be-42f7-bb90-8e117aedf053" containerName="pull"
Sep 18 04:11:19.657976 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:19.657866    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="12f2aad4-90be-42f7-bb90-8e117aedf053" containerName="pull"
Sep 18 04:11:19.657976 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:19.657926    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="12f2aad4-90be-42f7-bb90-8e117aedf053" containerName="extract"
Sep 18 04:11:19.657976 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:19.657934    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f6fe3b0-73cf-49d9-970f-78826cff79d5" containerName="istio-proxy"
Sep 18 04:11:19.685671 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:19.685642    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-56d489b4b8-dgq4q"]
Sep 18 04:11:19.685818 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:19.685740    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-56d489b4b8-dgq4q"
Sep 18 04:11:19.688949 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:19.688927    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\""
Sep 18 04:11:19.689913 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:19.689879    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-operator-dockercfg-czdm2\""
Sep 18 04:11:19.690122 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:19.690102    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\""
Sep 18 04:11:19.842260 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:19.842228    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-png69\" (UniqueName: \"kubernetes.io/projected/d44b08a7-089f-4472-a663-99aa9d5d2873-kube-api-access-png69\") pod \"jobset-operator-56d489b4b8-dgq4q\" (UID: \"d44b08a7-089f-4472-a663-99aa9d5d2873\") " pod="openshift-jobset-operator/jobset-operator-56d489b4b8-dgq4q"
Sep 18 04:11:19.842416 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:19.842277    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d44b08a7-089f-4472-a663-99aa9d5d2873-tmp\") pod \"jobset-operator-56d489b4b8-dgq4q\" (UID: \"d44b08a7-089f-4472-a663-99aa9d5d2873\") " pod="openshift-jobset-operator/jobset-operator-56d489b4b8-dgq4q"
Sep 18 04:11:19.943771 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:19.943681    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d44b08a7-089f-4472-a663-99aa9d5d2873-tmp\") pod \"jobset-operator-56d489b4b8-dgq4q\" (UID: \"d44b08a7-089f-4472-a663-99aa9d5d2873\") " pod="openshift-jobset-operator/jobset-operator-56d489b4b8-dgq4q"
Sep 18 04:11:19.943771 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:19.943770    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-png69\" (UniqueName: \"kubernetes.io/projected/d44b08a7-089f-4472-a663-99aa9d5d2873-kube-api-access-png69\") pod \"jobset-operator-56d489b4b8-dgq4q\" (UID: \"d44b08a7-089f-4472-a663-99aa9d5d2873\") " pod="openshift-jobset-operator/jobset-operator-56d489b4b8-dgq4q"
Sep 18 04:11:19.944089 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:19.944067    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d44b08a7-089f-4472-a663-99aa9d5d2873-tmp\") pod \"jobset-operator-56d489b4b8-dgq4q\" (UID: \"d44b08a7-089f-4472-a663-99aa9d5d2873\") " pod="openshift-jobset-operator/jobset-operator-56d489b4b8-dgq4q"
Sep 18 04:11:19.952063 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:19.952034    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-png69\" (UniqueName: \"kubernetes.io/projected/d44b08a7-089f-4472-a663-99aa9d5d2873-kube-api-access-png69\") pod \"jobset-operator-56d489b4b8-dgq4q\" (UID: \"d44b08a7-089f-4472-a663-99aa9d5d2873\") " pod="openshift-jobset-operator/jobset-operator-56d489b4b8-dgq4q"
Sep 18 04:11:20.005009 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:20.004971    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-56d489b4b8-dgq4q"
Sep 18 04:11:20.294131 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:20.294105    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-56d489b4b8-dgq4q"]
Sep 18 04:11:20.296791 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:11:20.296759    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd44b08a7_089f_4472_a663_99aa9d5d2873.slice/crio-3913280200dc9ce358ef1351568a2868e4a01833b95262c700c5782e5c63c710 WatchSource:0}: Error finding container 3913280200dc9ce358ef1351568a2868e4a01833b95262c700c5782e5c63c710: Status 404 returned error can't find the container with id 3913280200dc9ce358ef1351568a2868e4a01833b95262c700c5782e5c63c710
Sep 18 04:11:20.298515 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:20.298492    2585 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 04:11:20.462114 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:20.462075    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-56d489b4b8-dgq4q" event={"ID":"d44b08a7-089f-4472-a663-99aa9d5d2873","Type":"ContainerStarted","Data":"3913280200dc9ce358ef1351568a2868e4a01833b95262c700c5782e5c63c710"}
Sep 18 04:11:20.797621 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:20.797581    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:11:20.892890 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:20.892852    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:11:21.806368 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:21.806324    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:11:22.067635 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:22.067547    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:11:22.631316 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:22.631279    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:11:22.930827 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:22.930750    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:11:23.092659 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:23.092624    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-7c7cdfcfb9-pg58m"]
Sep 18 04:11:23.118745 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:23.118715    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-7c7cdfcfb9-pg58m"]
Sep 18 04:11:23.119008 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:23.118871    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7cdfcfb9-pg58m"
Sep 18 04:11:23.122273 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:23.122252    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\""
Sep 18 04:11:23.122477 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:23.122297    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 18 04:11:23.122557 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:23.122366    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 18 04:11:23.122831 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:23.122811    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-gskpr\""
Sep 18 04:11:23.122973 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:23.122853    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\""
Sep 18 04:11:23.123312 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:23.123273    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\""
Sep 18 04:11:23.220329 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:23.220241    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:11:23.274437 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:23.274409    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlvfr\" (UniqueName: \"kubernetes.io/projected/a6cf62a7-8702-46ae-90cd-44dd758924a0-kube-api-access-zlvfr\") pod \"opendatahub-operator-controller-manager-7c7cdfcfb9-pg58m\" (UID: \"a6cf62a7-8702-46ae-90cd-44dd758924a0\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7cdfcfb9-pg58m"
Sep 18 04:11:23.274584 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:23.274461    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a6cf62a7-8702-46ae-90cd-44dd758924a0-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c7cdfcfb9-pg58m\" (UID: \"a6cf62a7-8702-46ae-90cd-44dd758924a0\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7cdfcfb9-pg58m"
Sep 18 04:11:23.274584 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:23.274501    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a6cf62a7-8702-46ae-90cd-44dd758924a0-manifests\") pod \"opendatahub-operator-controller-manager-7c7cdfcfb9-pg58m\" (UID: \"a6cf62a7-8702-46ae-90cd-44dd758924a0\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7cdfcfb9-pg58m"
Sep 18 04:11:23.274584 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:23.274532    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a6cf62a7-8702-46ae-90cd-44dd758924a0-tmp\") pod \"opendatahub-operator-controller-manager-7c7cdfcfb9-pg58m\" (UID: \"a6cf62a7-8702-46ae-90cd-44dd758924a0\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7cdfcfb9-pg58m"
Sep 18 04:11:23.274584 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:23.274564    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a6cf62a7-8702-46ae-90cd-44dd758924a0-metrics-cert\") pod \"opendatahub-operator-controller-manager-7c7cdfcfb9-pg58m\" (UID: \"a6cf62a7-8702-46ae-90cd-44dd758924a0\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7cdfcfb9-pg58m"
Sep 18 04:11:23.274584 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:23.274581    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a6cf62a7-8702-46ae-90cd-44dd758924a0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c7cdfcfb9-pg58m\" (UID: \"a6cf62a7-8702-46ae-90cd-44dd758924a0\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7cdfcfb9-pg58m"
Sep 18 04:11:23.337134 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:23.337098    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:11:23.375163 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:23.375130    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlvfr\" (UniqueName: \"kubernetes.io/projected/a6cf62a7-8702-46ae-90cd-44dd758924a0-kube-api-access-zlvfr\") pod \"opendatahub-operator-controller-manager-7c7cdfcfb9-pg58m\" (UID: \"a6cf62a7-8702-46ae-90cd-44dd758924a0\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7cdfcfb9-pg58m"
Sep 18 04:11:23.375307 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:23.375195    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a6cf62a7-8702-46ae-90cd-44dd758924a0-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c7cdfcfb9-pg58m\" (UID: \"a6cf62a7-8702-46ae-90cd-44dd758924a0\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7cdfcfb9-pg58m"
Sep 18 04:11:23.375307 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:23.375226    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a6cf62a7-8702-46ae-90cd-44dd758924a0-manifests\") pod \"opendatahub-operator-controller-manager-7c7cdfcfb9-pg58m\" (UID: \"a6cf62a7-8702-46ae-90cd-44dd758924a0\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7cdfcfb9-pg58m"
Sep 18 04:11:23.375307 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:23.375260    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a6cf62a7-8702-46ae-90cd-44dd758924a0-tmp\") pod \"opendatahub-operator-controller-manager-7c7cdfcfb9-pg58m\" (UID: \"a6cf62a7-8702-46ae-90cd-44dd758924a0\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7cdfcfb9-pg58m"
Sep 18 04:11:23.375471 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:23.375318    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a6cf62a7-8702-46ae-90cd-44dd758924a0-metrics-cert\") pod \"opendatahub-operator-controller-manager-7c7cdfcfb9-pg58m\" (UID: \"a6cf62a7-8702-46ae-90cd-44dd758924a0\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7cdfcfb9-pg58m"
Sep 18 04:11:23.375471 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:23.375346    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a6cf62a7-8702-46ae-90cd-44dd758924a0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c7cdfcfb9-pg58m\" (UID: \"a6cf62a7-8702-46ae-90cd-44dd758924a0\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7cdfcfb9-pg58m"
Sep 18 04:11:23.375667 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:23.375641    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a6cf62a7-8702-46ae-90cd-44dd758924a0-manifests\") pod \"opendatahub-operator-controller-manager-7c7cdfcfb9-pg58m\" (UID: \"a6cf62a7-8702-46ae-90cd-44dd758924a0\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7cdfcfb9-pg58m"
Sep 18 04:11:23.377628 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:23.377596    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a6cf62a7-8702-46ae-90cd-44dd758924a0-tmp\") pod \"opendatahub-operator-controller-manager-7c7cdfcfb9-pg58m\" (UID: \"a6cf62a7-8702-46ae-90cd-44dd758924a0\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7cdfcfb9-pg58m"
Sep 18 04:11:23.377840 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:23.377822    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a6cf62a7-8702-46ae-90cd-44dd758924a0-metrics-cert\") pod \"opendatahub-operator-controller-manager-7c7cdfcfb9-pg58m\" (UID: \"a6cf62a7-8702-46ae-90cd-44dd758924a0\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7cdfcfb9-pg58m"
Sep 18 04:11:23.377993 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:23.377973    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a6cf62a7-8702-46ae-90cd-44dd758924a0-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c7cdfcfb9-pg58m\" (UID: \"a6cf62a7-8702-46ae-90cd-44dd758924a0\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7cdfcfb9-pg58m"
Sep 18 04:11:23.378037 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:23.377973    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a6cf62a7-8702-46ae-90cd-44dd758924a0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c7cdfcfb9-pg58m\" (UID: \"a6cf62a7-8702-46ae-90cd-44dd758924a0\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7cdfcfb9-pg58m"
Sep 18 04:11:23.389579 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:23.389558    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlvfr\" (UniqueName: \"kubernetes.io/projected/a6cf62a7-8702-46ae-90cd-44dd758924a0-kube-api-access-zlvfr\") pod \"opendatahub-operator-controller-manager-7c7cdfcfb9-pg58m\" (UID: \"a6cf62a7-8702-46ae-90cd-44dd758924a0\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7cdfcfb9-pg58m"
Sep 18 04:11:23.433679 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:23.433644    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7cdfcfb9-pg58m"
Sep 18 04:11:23.435651 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:23.435625    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:11:23.545120 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:23.545087    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:11:23.690973 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:23.690943    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:11:23.796582 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:23.796512    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:11:23.981502 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:23.981475    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-7c7cdfcfb9-pg58m"]
Sep 18 04:11:23.982401 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:11:23.982379    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6cf62a7_8702_46ae_90cd_44dd758924a0.slice/crio-8b883c8110931ad89f4cfab258d52343b5243585f56cb9cb8f7d9537795b1200 WatchSource:0}: Error finding container 8b883c8110931ad89f4cfab258d52343b5243585f56cb9cb8f7d9537795b1200: Status 404 returned error can't find the container with id 8b883c8110931ad89f4cfab258d52343b5243585f56cb9cb8f7d9537795b1200
Sep 18 04:11:24.255571 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:24.255480    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:11:24.386318 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:24.386279    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:11:24.484447 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:24.484415    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-56d489b4b8-dgq4q" event={"ID":"d44b08a7-089f-4472-a663-99aa9d5d2873","Type":"ContainerStarted","Data":"410dd3d22e1023f1086865c970b2515c95c302d30bdc5bb8c2aa9737a4a05c1a"}
Sep 18 04:11:24.485943 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:24.485915    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7cdfcfb9-pg58m" event={"ID":"a6cf62a7-8702-46ae-90cd-44dd758924a0","Type":"ContainerStarted","Data":"8b883c8110931ad89f4cfab258d52343b5243585f56cb9cb8f7d9537795b1200"}
Sep 18 04:11:24.501941 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:24.501888    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-operator-56d489b4b8-dgq4q" podStartSLOduration=2.082285345 podStartE2EDuration="5.501872989s" totalImagesPullingTime="3.419587644s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:11:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:11:24.500616457 +0000 UTC m=+318.958059426" watchObservedRunningTime="2026-09-18 04:11:24.501872989 +0000 UTC m=+318.959315957"
Sep 18 04:11:27.503201 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:27.503168    2585 generic.go:356] "Generic (PLEG): container finished" podID="a6cf62a7-8702-46ae-90cd-44dd758924a0" containerID="3b7f97b5cf6534b009ea5d00192e335b4b1d777f0fa7f671facc31dd53b39813" exitCode=0
Sep 18 04:11:27.503581 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:27.503236    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7cdfcfb9-pg58m" event={"ID":"a6cf62a7-8702-46ae-90cd-44dd758924a0","Type":"ContainerDied","Data":"3b7f97b5cf6534b009ea5d00192e335b4b1d777f0fa7f671facc31dd53b39813"}
Sep 18 04:11:28.511279 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:28.511246    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7cdfcfb9-pg58m" event={"ID":"a6cf62a7-8702-46ae-90cd-44dd758924a0","Type":"ContainerStarted","Data":"b55e91a6903c8203ef1140e5f14eff027740179381b34c63f6b0ea9e623f568c"}
Sep 18 04:11:28.511673 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:28.511384    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7cdfcfb9-pg58m"
Sep 18 04:11:28.534246 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:28.534187    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7cdfcfb9-pg58m" podStartSLOduration=1.8849191950000002 podStartE2EDuration="5.534169218s" totalImagesPullingTime="3.203684877s" totalInitContainerRuntime="445.565146ms" isStatefulPod=false podCreationTimestamp="2026-09-18 04:11:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:11:28.5329602 +0000 UTC m=+322.990403170" watchObservedRunningTime="2026-09-18 04:11:28.534169218 +0000 UTC m=+322.991612188"
Sep 18 04:11:28.790789 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:28.790756    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:11:28.866955 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:28.866921    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:11:29.383226 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:29.383197    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:11:29.485618 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:29.485582    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:11:31.371472 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:31.371433    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:11:32.017132 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:32.017081    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:11:34.126301 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:34.126262    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:11:34.194541 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:34.194498    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:11:34.700736 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:34.700700    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b449b7679-hlvr5"]
Sep 18 04:11:34.706036 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:34.706018    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b449b7679-hlvr5"
Sep 18 04:11:34.708756 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:34.708730    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 18 04:11:34.708882 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:34.708854    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-lqn87\""
Sep 18 04:11:34.709001 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:34.708984    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 18 04:11:34.709663 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:34.709649    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 18 04:11:34.730872 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:34.730851    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b449b7679-hlvr5"]
Sep 18 04:11:34.763286 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:34.763256    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5xk5\" (UniqueName: \"kubernetes.io/projected/73b6a921-ab82-44b4-a3fb-c6626a9d94c1-kube-api-access-d5xk5\") pod \"dns-operator-controller-manager-7b449b7679-hlvr5\" (UID: \"73b6a921-ab82-44b4-a3fb-c6626a9d94c1\") " pod="kuadrant-system/dns-operator-controller-manager-7b449b7679-hlvr5"
Sep 18 04:11:34.864311 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:34.864277    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5xk5\" (UniqueName: \"kubernetes.io/projected/73b6a921-ab82-44b4-a3fb-c6626a9d94c1-kube-api-access-d5xk5\") pod \"dns-operator-controller-manager-7b449b7679-hlvr5\" (UID: \"73b6a921-ab82-44b4-a3fb-c6626a9d94c1\") " pod="kuadrant-system/dns-operator-controller-manager-7b449b7679-hlvr5"
Sep 18 04:11:34.874404 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:34.874371    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5xk5\" (UniqueName: \"kubernetes.io/projected/73b6a921-ab82-44b4-a3fb-c6626a9d94c1-kube-api-access-d5xk5\") pod \"dns-operator-controller-manager-7b449b7679-hlvr5\" (UID: \"73b6a921-ab82-44b4-a3fb-c6626a9d94c1\") " pod="kuadrant-system/dns-operator-controller-manager-7b449b7679-hlvr5"
Sep 18 04:11:35.016142 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:35.016062    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b449b7679-hlvr5"
Sep 18 04:11:35.295390 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:35.295364    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b449b7679-hlvr5"]
Sep 18 04:11:35.297458 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:11:35.297432    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73b6a921_ab82_44b4_a3fb_c6626a9d94c1.slice/crio-d9778ef8357d5ccc56e8217f2688a475f3cbb5e1501752eccfaf50772e7f4030 WatchSource:0}: Error finding container d9778ef8357d5ccc56e8217f2688a475f3cbb5e1501752eccfaf50772e7f4030: Status 404 returned error can't find the container with id d9778ef8357d5ccc56e8217f2688a475f3cbb5e1501752eccfaf50772e7f4030
Sep 18 04:11:35.358796 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:35.358766    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:11:35.543388 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:35.543353    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b449b7679-hlvr5" event={"ID":"73b6a921-ab82-44b4-a3fb-c6626a9d94c1","Type":"ContainerStarted","Data":"d9778ef8357d5ccc56e8217f2688a475f3cbb5e1501752eccfaf50772e7f4030"}
Sep 18 04:11:35.956736 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:35.956689    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:11:36.746180 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:36.746139    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:11:37.124574 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:37.124535    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:11:37.555133 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:37.555101    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b449b7679-hlvr5" event={"ID":"73b6a921-ab82-44b4-a3fb-c6626a9d94c1","Type":"ContainerStarted","Data":"2c88ff1c4ab961b23cb66d759c6909b4c06ad0d4fc174c73de85ef6dd9e98f36"}
Sep 18 04:11:37.555304 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:37.555192    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b449b7679-hlvr5"
Sep 18 04:11:37.574930 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:37.574866    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b449b7679-hlvr5" podStartSLOduration=1.87039542 podStartE2EDuration="3.574849008s" totalImagesPullingTime="1.704453588s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:11:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:11:37.57255893 +0000 UTC m=+332.030001900" watchObservedRunningTime="2026-09-18 04:11:37.574849008 +0000 UTC m=+332.032291977"
Sep 18 04:11:38.602521 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:38.602481    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:11:39.517973 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:39.517926    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7cdfcfb9-pg58m"
Sep 18 04:11:40.994937 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:40.994907    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7cbf85f5f5-kzhx5"]
Sep 18 04:11:40.998231 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:40.998215    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7cbf85f5f5-kzhx5"
Sep 18 04:11:41.000888 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:41.000866    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-chrlt\""
Sep 18 04:11:41.016545 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:41.016517    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7cbf85f5f5-kzhx5"]
Sep 18 04:11:41.121539 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:41.121506    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4b3cc118-f403-4cd5-8ab4-d7347cfa145a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7cbf85f5f5-kzhx5\" (UID: \"4b3cc118-f403-4cd5-8ab4-d7347cfa145a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7cbf85f5f5-kzhx5"
Sep 18 04:11:41.121701 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:41.121545    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h88d6\" (UniqueName: \"kubernetes.io/projected/4b3cc118-f403-4cd5-8ab4-d7347cfa145a-kube-api-access-h88d6\") pod \"kuadrant-operator-controller-manager-7cbf85f5f5-kzhx5\" (UID: \"4b3cc118-f403-4cd5-8ab4-d7347cfa145a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7cbf85f5f5-kzhx5"
Sep 18 04:11:41.212465 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:41.212435    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:11:41.222966 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:41.222932    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4b3cc118-f403-4cd5-8ab4-d7347cfa145a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7cbf85f5f5-kzhx5\" (UID: \"4b3cc118-f403-4cd5-8ab4-d7347cfa145a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7cbf85f5f5-kzhx5"
Sep 18 04:11:41.223109 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:41.222989    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h88d6\" (UniqueName: \"kubernetes.io/projected/4b3cc118-f403-4cd5-8ab4-d7347cfa145a-kube-api-access-h88d6\") pod \"kuadrant-operator-controller-manager-7cbf85f5f5-kzhx5\" (UID: \"4b3cc118-f403-4cd5-8ab4-d7347cfa145a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7cbf85f5f5-kzhx5"
Sep 18 04:11:41.223380 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:41.223358    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4b3cc118-f403-4cd5-8ab4-d7347cfa145a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7cbf85f5f5-kzhx5\" (UID: \"4b3cc118-f403-4cd5-8ab4-d7347cfa145a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7cbf85f5f5-kzhx5"
Sep 18 04:11:41.237396 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:41.237366    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h88d6\" (UniqueName: \"kubernetes.io/projected/4b3cc118-f403-4cd5-8ab4-d7347cfa145a-kube-api-access-h88d6\") pod \"kuadrant-operator-controller-manager-7cbf85f5f5-kzhx5\" (UID: \"4b3cc118-f403-4cd5-8ab4-d7347cfa145a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7cbf85f5f5-kzhx5"
Sep 18 04:11:41.308063 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:41.308037    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7cbf85f5f5-kzhx5"
Sep 18 04:11:41.393598 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:41.393546    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:11:41.611308 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:41.611247    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7cbf85f5f5-kzhx5"]
Sep 18 04:11:41.613448 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:11:41.613414    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b3cc118_f403_4cd5_8ab4_d7347cfa145a.slice/crio-3c07efe1e17734e89bd6866f9e4ad0fdf9f3410789d67b1cc84ce8fd4987dc84 WatchSource:0}: Error finding container 3c07efe1e17734e89bd6866f9e4ad0fdf9f3410789d67b1cc84ce8fd4987dc84: Status 404 returned error can't find the container with id 3c07efe1e17734e89bd6866f9e4ad0fdf9f3410789d67b1cc84ce8fd4987dc84
Sep 18 04:11:41.957735 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:41.957653    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:11:42.579803 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:42.579768    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7cbf85f5f5-kzhx5" event={"ID":"4b3cc118-f403-4cd5-8ab4-d7347cfa145a","Type":"ContainerStarted","Data":"3c07efe1e17734e89bd6866f9e4ad0fdf9f3410789d67b1cc84ce8fd4987dc84"}
Sep 18 04:11:44.164439 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:44.164375    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:11:44.260033 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:44.259935    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:11:44.374768 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:44.374674    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-6c7cb5c9cb-jn5j6"]
Sep 18 04:11:44.383064 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:44.383034    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-6c7cb5c9cb-jn5j6"
Sep 18 04:11:44.385565 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:44.385542    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-jsrph\""
Sep 18 04:11:44.392463 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:44.392434    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-6c7cb5c9cb-jn5j6"]
Sep 18 04:11:44.453427 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:44.453389    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t44pw\" (UniqueName: \"kubernetes.io/projected/fc7a1c0a-8478-4739-b08f-d2eade2bf342-kube-api-access-t44pw\") pod \"authorino-operator-6c7cb5c9cb-jn5j6\" (UID: \"fc7a1c0a-8478-4739-b08f-d2eade2bf342\") " pod="kuadrant-system/authorino-operator-6c7cb5c9cb-jn5j6"
Sep 18 04:11:44.554766 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:44.554730    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t44pw\" (UniqueName: \"kubernetes.io/projected/fc7a1c0a-8478-4739-b08f-d2eade2bf342-kube-api-access-t44pw\") pod \"authorino-operator-6c7cb5c9cb-jn5j6\" (UID: \"fc7a1c0a-8478-4739-b08f-d2eade2bf342\") " pod="kuadrant-system/authorino-operator-6c7cb5c9cb-jn5j6"
Sep 18 04:11:44.563867 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:44.563829    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t44pw\" (UniqueName: \"kubernetes.io/projected/fc7a1c0a-8478-4739-b08f-d2eade2bf342-kube-api-access-t44pw\") pod \"authorino-operator-6c7cb5c9cb-jn5j6\" (UID: \"fc7a1c0a-8478-4739-b08f-d2eade2bf342\") " pod="kuadrant-system/authorino-operator-6c7cb5c9cb-jn5j6"
Sep 18 04:11:44.696386 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:44.696287    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-6c7cb5c9cb-jn5j6"
Sep 18 04:11:44.760786 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:44.760741    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:11:45.476341 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:45.476318    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-6c7cb5c9cb-jn5j6"]
Sep 18 04:11:45.478807 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:11:45.478782    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc7a1c0a_8478_4739_b08f_d2eade2bf342.slice/crio-0558749890a4f008a5b06d619cff143428260d3eb3221184f4e0a8b5c523d2f5 WatchSource:0}: Error finding container 0558749890a4f008a5b06d619cff143428260d3eb3221184f4e0a8b5c523d2f5: Status 404 returned error can't find the container with id 0558749890a4f008a5b06d619cff143428260d3eb3221184f4e0a8b5c523d2f5
Sep 18 04:11:45.599456 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:45.599415    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-6c7cb5c9cb-jn5j6" event={"ID":"fc7a1c0a-8478-4739-b08f-d2eade2bf342","Type":"ContainerStarted","Data":"0558749890a4f008a5b06d619cff143428260d3eb3221184f4e0a8b5c523d2f5"}
Sep 18 04:11:45.601596 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:45.601571    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7cbf85f5f5-kzhx5" event={"ID":"4b3cc118-f403-4cd5-8ab4-d7347cfa145a","Type":"ContainerStarted","Data":"ace6347908cdde9cfbbcafda84a2cf0e623d4872fade3cf9b52aae56280e4e00"}
Sep 18 04:11:45.601732 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:45.601679    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-7cbf85f5f5-kzhx5"
Sep 18 04:11:45.625221 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:45.625175    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-7cbf85f5f5-kzhx5" podStartSLOduration=1.959771182 podStartE2EDuration="5.625161174s" totalImagesPullingTime="3.665389992s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:11:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:11:45.622935394 +0000 UTC m=+340.080378355" watchObservedRunningTime="2026-09-18 04:11:45.625161174 +0000 UTC m=+340.082604143"
Sep 18 04:11:45.795289 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:45.795254    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:11:46.251328 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:46.251248    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6d9b9f85cb-qgcj9"]
Sep 18 04:11:46.254938 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:46.254919    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6d9b9f85cb-qgcj9"
Sep 18 04:11:46.259196 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:46.259164    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-m99fk\""
Sep 18 04:11:46.269934 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:46.269889    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6d9b9f85cb-qgcj9"]
Sep 18 04:11:46.373488 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:46.373458    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bgjg\" (UniqueName: \"kubernetes.io/projected/68902f18-1762-44b8-b517-bfe372253106-kube-api-access-8bgjg\") pod \"limitador-operator-controller-manager-6d9b9f85cb-qgcj9\" (UID: \"68902f18-1762-44b8-b517-bfe372253106\") " pod="kuadrant-system/limitador-operator-controller-manager-6d9b9f85cb-qgcj9"
Sep 18 04:11:46.475014 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:46.474981    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bgjg\" (UniqueName: \"kubernetes.io/projected/68902f18-1762-44b8-b517-bfe372253106-kube-api-access-8bgjg\") pod \"limitador-operator-controller-manager-6d9b9f85cb-qgcj9\" (UID: \"68902f18-1762-44b8-b517-bfe372253106\") " pod="kuadrant-system/limitador-operator-controller-manager-6d9b9f85cb-qgcj9"
Sep 18 04:11:46.486931 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:46.486890    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bgjg\" (UniqueName: \"kubernetes.io/projected/68902f18-1762-44b8-b517-bfe372253106-kube-api-access-8bgjg\") pod \"limitador-operator-controller-manager-6d9b9f85cb-qgcj9\" (UID: \"68902f18-1762-44b8-b517-bfe372253106\") " pod="kuadrant-system/limitador-operator-controller-manager-6d9b9f85cb-qgcj9"
Sep 18 04:11:46.565969 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:46.565932    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6d9b9f85cb-qgcj9"
Sep 18 04:11:46.859799 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:46.859751    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6d9b9f85cb-qgcj9"]
Sep 18 04:11:46.862693 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:11:46.862660    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68902f18_1762_44b8_b517_bfe372253106.slice/crio-cca68726aa71c7f2387e69324f705482e6b9250bd0cfefb33e217edd3a53f644 WatchSource:0}: Error finding container cca68726aa71c7f2387e69324f705482e6b9250bd0cfefb33e217edd3a53f644: Status 404 returned error can't find the container with id cca68726aa71c7f2387e69324f705482e6b9250bd0cfefb33e217edd3a53f644
Sep 18 04:11:47.613322 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:47.613286    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6d9b9f85cb-qgcj9" event={"ID":"68902f18-1762-44b8-b517-bfe372253106","Type":"ContainerStarted","Data":"cca68726aa71c7f2387e69324f705482e6b9250bd0cfefb33e217edd3a53f644"}
Sep 18 04:11:47.614881 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:47.614859    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-6c7cb5c9cb-jn5j6" event={"ID":"fc7a1c0a-8478-4739-b08f-d2eade2bf342","Type":"ContainerStarted","Data":"dddbe88837642ea379c6001b7cf47da7ee533cc7ca4296ad3439764f81eee1c4"}
Sep 18 04:11:47.615043 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:47.615028    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-6c7cb5c9cb-jn5j6"
Sep 18 04:11:47.631820 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:47.631771    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-6c7cb5c9cb-jn5j6" podStartSLOduration=1.896713295 podStartE2EDuration="3.631756585s" totalImagesPullingTime="1.73504329s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:11:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:11:47.630329287 +0000 UTC m=+342.087772256" watchObservedRunningTime="2026-09-18 04:11:47.631756585 +0000 UTC m=+342.089199554"
Sep 18 04:11:47.781691 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:47.781656    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:11:47.887521 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:47.887408    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:11:48.244570 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:48.244485    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:11:48.563026 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:48.563001    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b449b7679-hlvr5"
Sep 18 04:11:48.621468 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:48.621420    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6d9b9f85cb-qgcj9" event={"ID":"68902f18-1762-44b8-b517-bfe372253106","Type":"ContainerStarted","Data":"524b17607ba5ce0d109878d83a6897f46fa33d17c45132d76982c7feef9e1572"}
Sep 18 04:11:48.621857 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:48.621716    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6d9b9f85cb-qgcj9"
Sep 18 04:11:48.643280 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:48.643231    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6d9b9f85cb-qgcj9" podStartSLOduration=0.964698603 podStartE2EDuration="2.643214199s" totalImagesPullingTime="1.678515596s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:11:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:11:48.640935993 +0000 UTC m=+343.098378955" watchObservedRunningTime="2026-09-18 04:11:48.643214199 +0000 UTC m=+343.100657167"
Sep 18 04:11:52.719916 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:52.719864    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:11:53.927644 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:53.927607    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:11:54.002717 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:54.002683    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-module-controller-manager-54765d59fd-g2vkd"]
Sep 18 04:11:54.010029 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:54.010007    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-module-controller-manager-54765d59fd-g2vkd"
Sep 18 04:11:54.012346 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:54.012288    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:11:54.013120 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:54.013095    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-module-controller-manager-dockercfg-jszlk\""
Sep 18 04:11:54.013422 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:54.013397    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"odh-trusted-ca-bundle\""
Sep 18 04:11:54.013732 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:54.013716    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 18 04:11:54.014030 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:54.013717    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 18 04:11:54.014545 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:54.014525    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-module-controller-manager-54765d59fd-g2vkd"]
Sep 18 04:11:54.138912 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:54.138865    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:11:54.143880 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:54.143854    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/477814cd-44b9-4c09-82ba-051664f4805c-trusted-ca\") pod \"kserve-module-controller-manager-54765d59fd-g2vkd\" (UID: \"477814cd-44b9-4c09-82ba-051664f4805c\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-g2vkd"
Sep 18 04:11:54.144021 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:54.143923    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/477814cd-44b9-4c09-82ba-051664f4805c-tmp\") pod \"kserve-module-controller-manager-54765d59fd-g2vkd\" (UID: \"477814cd-44b9-4c09-82ba-051664f4805c\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-g2vkd"
Sep 18 04:11:54.144021 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:54.143954    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfpjk\" (UniqueName: \"kubernetes.io/projected/477814cd-44b9-4c09-82ba-051664f4805c-kube-api-access-wfpjk\") pod \"kserve-module-controller-manager-54765d59fd-g2vkd\" (UID: \"477814cd-44b9-4c09-82ba-051664f4805c\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-g2vkd"
Sep 18 04:11:54.144126 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:54.144042    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/477814cd-44b9-4c09-82ba-051664f4805c-manifests\") pod \"kserve-module-controller-manager-54765d59fd-g2vkd\" (UID: \"477814cd-44b9-4c09-82ba-051664f4805c\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-g2vkd"
Sep 18 04:11:54.242098 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:54.242007    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:11:54.245122 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:54.245097    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/477814cd-44b9-4c09-82ba-051664f4805c-manifests\") pod \"kserve-module-controller-manager-54765d59fd-g2vkd\" (UID: \"477814cd-44b9-4c09-82ba-051664f4805c\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-g2vkd"
Sep 18 04:11:54.245278 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:54.245145    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/477814cd-44b9-4c09-82ba-051664f4805c-trusted-ca\") pod \"kserve-module-controller-manager-54765d59fd-g2vkd\" (UID: \"477814cd-44b9-4c09-82ba-051664f4805c\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-g2vkd"
Sep 18 04:11:54.245278 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:54.245170    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/477814cd-44b9-4c09-82ba-051664f4805c-tmp\") pod \"kserve-module-controller-manager-54765d59fd-g2vkd\" (UID: \"477814cd-44b9-4c09-82ba-051664f4805c\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-g2vkd"
Sep 18 04:11:54.245278 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:54.245187    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfpjk\" (UniqueName: \"kubernetes.io/projected/477814cd-44b9-4c09-82ba-051664f4805c-kube-api-access-wfpjk\") pod \"kserve-module-controller-manager-54765d59fd-g2vkd\" (UID: \"477814cd-44b9-4c09-82ba-051664f4805c\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-g2vkd"
Sep 18 04:11:54.245577 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:54.245556    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/477814cd-44b9-4c09-82ba-051664f4805c-manifests\") pod \"kserve-module-controller-manager-54765d59fd-g2vkd\" (UID: \"477814cd-44b9-4c09-82ba-051664f4805c\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-g2vkd"
Sep 18 04:11:54.245645 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:54.245609    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/477814cd-44b9-4c09-82ba-051664f4805c-tmp\") pod \"kserve-module-controller-manager-54765d59fd-g2vkd\" (UID: \"477814cd-44b9-4c09-82ba-051664f4805c\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-g2vkd"
Sep 18 04:11:54.245999 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:54.245977    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/477814cd-44b9-4c09-82ba-051664f4805c-trusted-ca\") pod \"kserve-module-controller-manager-54765d59fd-g2vkd\" (UID: \"477814cd-44b9-4c09-82ba-051664f4805c\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-g2vkd"
Sep 18 04:11:54.254819 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:54.254797    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfpjk\" (UniqueName: \"kubernetes.io/projected/477814cd-44b9-4c09-82ba-051664f4805c-kube-api-access-wfpjk\") pod \"kserve-module-controller-manager-54765d59fd-g2vkd\" (UID: \"477814cd-44b9-4c09-82ba-051664f4805c\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-g2vkd"
Sep 18 04:11:54.322832 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:54.322803    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-module-controller-manager-54765d59fd-g2vkd"
Sep 18 04:11:54.568874 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:54.568840    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:11:54.598280 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:54.598247    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-module-controller-manager-54765d59fd-g2vkd"]
Sep 18 04:11:54.651788 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:54.651753    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-module-controller-manager-54765d59fd-g2vkd" event={"ID":"477814cd-44b9-4c09-82ba-051664f4805c","Type":"ContainerStarted","Data":"27ed7f86c0ebc87ca9aba666c1a43efe129d74b796f345c8b366cf3595313179"}
Sep 18 04:11:54.675282 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:54.675251    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:11:54.855971 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:54.855849    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:11:56.610120 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:56.610091    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-7cbf85f5f5-kzhx5"
Sep 18 04:11:57.063532 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:57.063503    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-54b6d5c989-7l9sz"]
Sep 18 04:11:57.067931 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:57.067912    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-54b6d5c989-7l9sz"
Sep 18 04:11:57.082116 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:57.081501    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-54b6d5c989-7l9sz"]
Sep 18 04:11:57.171377 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:57.171342    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7v7s6\" (UniqueName: \"kubernetes.io/projected/e78eff66-320f-44f4-8f2f-c554e30b2eb2-kube-api-access-7v7s6\") pod \"kuadrant-operator-controller-manager-54b6d5c989-7l9sz\" (UID: \"e78eff66-320f-44f4-8f2f-c554e30b2eb2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-54b6d5c989-7l9sz"
Sep 18 04:11:57.171541 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:57.171389    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e78eff66-320f-44f4-8f2f-c554e30b2eb2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-54b6d5c989-7l9sz\" (UID: \"e78eff66-320f-44f4-8f2f-c554e30b2eb2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-54b6d5c989-7l9sz"
Sep 18 04:11:57.272925 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:57.272864    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7v7s6\" (UniqueName: \"kubernetes.io/projected/e78eff66-320f-44f4-8f2f-c554e30b2eb2-kube-api-access-7v7s6\") pod \"kuadrant-operator-controller-manager-54b6d5c989-7l9sz\" (UID: \"e78eff66-320f-44f4-8f2f-c554e30b2eb2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-54b6d5c989-7l9sz"
Sep 18 04:11:57.273105 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:57.272941    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e78eff66-320f-44f4-8f2f-c554e30b2eb2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-54b6d5c989-7l9sz\" (UID: \"e78eff66-320f-44f4-8f2f-c554e30b2eb2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-54b6d5c989-7l9sz"
Sep 18 04:11:57.273332 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:57.273315    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e78eff66-320f-44f4-8f2f-c554e30b2eb2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-54b6d5c989-7l9sz\" (UID: \"e78eff66-320f-44f4-8f2f-c554e30b2eb2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-54b6d5c989-7l9sz"
Sep 18 04:11:57.281360 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:57.281328    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7v7s6\" (UniqueName: \"kubernetes.io/projected/e78eff66-320f-44f4-8f2f-c554e30b2eb2-kube-api-access-7v7s6\") pod \"kuadrant-operator-controller-manager-54b6d5c989-7l9sz\" (UID: \"e78eff66-320f-44f4-8f2f-c554e30b2eb2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-54b6d5c989-7l9sz"
Sep 18 04:11:57.387123 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:57.387037    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-54b6d5c989-7l9sz"
Sep 18 04:11:57.662273 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:57.662192    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-54b6d5c989-7l9sz"]
Sep 18 04:11:57.665252 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:11:57.665224    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode78eff66_320f_44f4_8f2f_c554e30b2eb2.slice/crio-11266f128f1f23ca40b9f0eec186dafad771503a3c972777c1a4c43478d765b1 WatchSource:0}: Error finding container 11266f128f1f23ca40b9f0eec186dafad771503a3c972777c1a4c43478d765b1: Status 404 returned error can't find the container with id 11266f128f1f23ca40b9f0eec186dafad771503a3c972777c1a4c43478d765b1
Sep 18 04:11:57.671848 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:57.671807    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-module-controller-manager-54765d59fd-g2vkd" event={"ID":"477814cd-44b9-4c09-82ba-051664f4805c","Type":"ContainerStarted","Data":"d63165a68d078797a45abd122b53063c6654cb59af62e04bca589165c67ebd41"}
Sep 18 04:11:57.674993 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:57.674968    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-module-controller-manager-54765d59fd-g2vkd"
Sep 18 04:11:57.695644 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:57.695599    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-module-controller-manager-54765d59fd-g2vkd" podStartSLOduration=2.263025572 podStartE2EDuration="4.695583559s" totalImagesPullingTime="2.432557987s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:11:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:11:57.693860727 +0000 UTC m=+352.151303698" watchObservedRunningTime="2026-09-18 04:11:57.695583559 +0000 UTC m=+352.153026528"
Sep 18 04:11:58.623986 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:58.623917    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-6c7cb5c9cb-jn5j6"
Sep 18 04:11:58.685075 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:58.685036    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-54b6d5c989-7l9sz" event={"ID":"e78eff66-320f-44f4-8f2f-c554e30b2eb2","Type":"ContainerStarted","Data":"0f0e381c229c7e594d18405a3c30fb74f219d80d5ab6d132d70b400d1e20625c"}
Sep 18 04:11:58.685547 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:58.685228    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-54b6d5c989-7l9sz"
Sep 18 04:11:58.685547 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:58.685261    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-54b6d5c989-7l9sz" event={"ID":"e78eff66-320f-44f4-8f2f-c554e30b2eb2","Type":"ContainerStarted","Data":"11266f128f1f23ca40b9f0eec186dafad771503a3c972777c1a4c43478d765b1"}
Sep 18 04:11:58.713626 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:58.713570    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-54b6d5c989-7l9sz" podStartSLOduration=1.713549613 podStartE2EDuration="1.713549613s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:11:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:11:58.711658261 +0000 UTC m=+353.169101234" watchObservedRunningTime="2026-09-18 04:11:58.713549613 +0000 UTC m=+353.170992581"
Sep 18 04:11:59.628778 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:11:59.628747    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6d9b9f85cb-qgcj9"
Sep 18 04:12:00.338697 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:00.338666    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:12:00.440304 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:00.440262    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:12:03.053942 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:03.053886    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:12:03.154349 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:03.154301    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:12:03.367780 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:03.367708    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:12:03.458769 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:03.458724    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:12:05.976792 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:05.976754    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:12:06.078037 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:06.078006    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:12:08.572279 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:08.572227    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:12:08.672696 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:08.672662    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:12:09.696421 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:09.696390    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-54b6d5c989-7l9sz"
Sep 18 04:12:09.751683 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:09.751652    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7cbf85f5f5-kzhx5"]
Sep 18 04:12:09.751879 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:09.751856    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-7cbf85f5f5-kzhx5" podUID="4b3cc118-f403-4cd5-8ab4-d7347cfa145a" containerName="manager" containerID="cri-o://ace6347908cdde9cfbbcafda84a2cf0e623d4872fade3cf9b52aae56280e4e00" gracePeriod=10
Sep 18 04:12:09.994790 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:09.994763    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7cbf85f5f5-kzhx5"
Sep 18 04:12:10.186456 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:10.186406    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4b3cc118-f403-4cd5-8ab4-d7347cfa145a-extensions-socket-volume\") pod \"4b3cc118-f403-4cd5-8ab4-d7347cfa145a\" (UID: \"4b3cc118-f403-4cd5-8ab4-d7347cfa145a\") "
Sep 18 04:12:10.186660 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:10.186545    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h88d6\" (UniqueName: \"kubernetes.io/projected/4b3cc118-f403-4cd5-8ab4-d7347cfa145a-kube-api-access-h88d6\") pod \"4b3cc118-f403-4cd5-8ab4-d7347cfa145a\" (UID: \"4b3cc118-f403-4cd5-8ab4-d7347cfa145a\") "
Sep 18 04:12:10.186824 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:10.186798    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b3cc118-f403-4cd5-8ab4-d7347cfa145a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4b3cc118-f403-4cd5-8ab4-d7347cfa145a" (UID: "4b3cc118-f403-4cd5-8ab4-d7347cfa145a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 04:12:10.186972 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:10.186948    2585 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4b3cc118-f403-4cd5-8ab4-d7347cfa145a-extensions-socket-volume\") on node \"ip-10-0-129-207.ec2.internal\" DevicePath \"\""
Sep 18 04:12:10.188755 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:10.188729    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b3cc118-f403-4cd5-8ab4-d7347cfa145a-kube-api-access-h88d6" (OuterVolumeSpecName: "kube-api-access-h88d6") pod "4b3cc118-f403-4cd5-8ab4-d7347cfa145a" (UID: "4b3cc118-f403-4cd5-8ab4-d7347cfa145a"). InnerVolumeSpecName "kube-api-access-h88d6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 04:12:10.287629 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:10.287597    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h88d6\" (UniqueName: \"kubernetes.io/projected/4b3cc118-f403-4cd5-8ab4-d7347cfa145a-kube-api-access-h88d6\") on node \"ip-10-0-129-207.ec2.internal\" DevicePath \"\""
Sep 18 04:12:10.749311 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:10.749214    2585 generic.go:356] "Generic (PLEG): container finished" podID="4b3cc118-f403-4cd5-8ab4-d7347cfa145a" containerID="ace6347908cdde9cfbbcafda84a2cf0e623d4872fade3cf9b52aae56280e4e00" exitCode=0
Sep 18 04:12:10.749311 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:10.749262    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7cbf85f5f5-kzhx5"
Sep 18 04:12:10.749813 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:10.749265    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7cbf85f5f5-kzhx5" event={"ID":"4b3cc118-f403-4cd5-8ab4-d7347cfa145a","Type":"ContainerDied","Data":"ace6347908cdde9cfbbcafda84a2cf0e623d4872fade3cf9b52aae56280e4e00"}
Sep 18 04:12:10.749813 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:10.749372    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7cbf85f5f5-kzhx5" event={"ID":"4b3cc118-f403-4cd5-8ab4-d7347cfa145a","Type":"ContainerDied","Data":"3c07efe1e17734e89bd6866f9e4ad0fdf9f3410789d67b1cc84ce8fd4987dc84"}
Sep 18 04:12:10.749813 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:10.749409    2585 scope.go:117] "RemoveContainer" containerID="ace6347908cdde9cfbbcafda84a2cf0e623d4872fade3cf9b52aae56280e4e00"
Sep 18 04:12:10.758541 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:10.758364    2585 scope.go:117] "RemoveContainer" containerID="ace6347908cdde9cfbbcafda84a2cf0e623d4872fade3cf9b52aae56280e4e00"
Sep 18 04:12:10.758664 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:12:10.758641    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ace6347908cdde9cfbbcafda84a2cf0e623d4872fade3cf9b52aae56280e4e00\": container with ID starting with ace6347908cdde9cfbbcafda84a2cf0e623d4872fade3cf9b52aae56280e4e00 not found: ID does not exist" containerID="ace6347908cdde9cfbbcafda84a2cf0e623d4872fade3cf9b52aae56280e4e00"
Sep 18 04:12:10.758704 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:10.758673    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ace6347908cdde9cfbbcafda84a2cf0e623d4872fade3cf9b52aae56280e4e00"} err="failed to get container status \"ace6347908cdde9cfbbcafda84a2cf0e623d4872fade3cf9b52aae56280e4e00\": rpc error: code = NotFound desc = could not find container \"ace6347908cdde9cfbbcafda84a2cf0e623d4872fade3cf9b52aae56280e4e00\": container with ID starting with ace6347908cdde9cfbbcafda84a2cf0e623d4872fade3cf9b52aae56280e4e00 not found: ID does not exist"
Sep 18 04:12:10.772137 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:10.772110    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7cbf85f5f5-kzhx5"]
Sep 18 04:12:10.775882 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:10.775859    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7cbf85f5f5-kzhx5"]
Sep 18 04:12:11.547353 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:11.547316    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:12:11.600754 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:11.600718    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-68f4897f98-f5hv7"]
Sep 18 04:12:11.601198 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:11.601176    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b3cc118-f403-4cd5-8ab4-d7347cfa145a" containerName="manager"
Sep 18 04:12:11.601198 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:11.601196    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b3cc118-f403-4cd5-8ab4-d7347cfa145a" containerName="manager"
Sep 18 04:12:11.601397 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:11.601267    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b3cc118-f403-4cd5-8ab4-d7347cfa145a" containerName="manager"
Sep 18 04:12:11.607037 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:11.607019    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68f4897f98-f5hv7"
Sep 18 04:12:11.609512 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:11.609483    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 18 04:12:11.609512 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:11.609504    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 18 04:12:11.609708 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:11.609542    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 18 04:12:11.609708 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:11.609611    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-wt8zp\""
Sep 18 04:12:11.616789 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:11.616766    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-68f4897f98-f5hv7"]
Sep 18 04:12:11.625515 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:11.625491    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:12:11.738301 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:11.738267    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:12:11.793188 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:11.793156    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-85cbcd4954-pd9g4"]
Sep 18 04:12:11.797944 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:11.797866    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85cbcd4954-pd9g4"
Sep 18 04:12:11.803306 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:11.803283    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60a46253-b445-47b6-a7b7-5eab0ff54fe3-metrics-certs\") pod \"maas-controller-68f4897f98-f5hv7\" (UID: \"60a46253-b445-47b6-a7b7-5eab0ff54fe3\") " pod="opendatahub/maas-controller-68f4897f98-f5hv7"
Sep 18 04:12:11.803406 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:11.803342    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/60a46253-b445-47b6-a7b7-5eab0ff54fe3-webhook-cert\") pod \"maas-controller-68f4897f98-f5hv7\" (UID: \"60a46253-b445-47b6-a7b7-5eab0ff54fe3\") " pod="opendatahub/maas-controller-68f4897f98-f5hv7"
Sep 18 04:12:11.803406 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:11.803380    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76dg5\" (UniqueName: \"kubernetes.io/projected/60a46253-b445-47b6-a7b7-5eab0ff54fe3-kube-api-access-76dg5\") pod \"maas-controller-68f4897f98-f5hv7\" (UID: \"60a46253-b445-47b6-a7b7-5eab0ff54fe3\") " pod="opendatahub/maas-controller-68f4897f98-f5hv7"
Sep 18 04:12:11.807136 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:11.807117    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-85cbcd4954-pd9g4"]
Sep 18 04:12:11.821936 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:11.821886    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:12:11.903790 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:11.903757    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49996cfe-9e97-4e95-98b9-69817e9ba977-metrics-certs\") pod \"maas-controller-85cbcd4954-pd9g4\" (UID: \"49996cfe-9e97-4e95-98b9-69817e9ba977\") " pod="opendatahub/maas-controller-85cbcd4954-pd9g4"
Sep 18 04:12:11.903960 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:11.903831    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60a46253-b445-47b6-a7b7-5eab0ff54fe3-metrics-certs\") pod \"maas-controller-68f4897f98-f5hv7\" (UID: \"60a46253-b445-47b6-a7b7-5eab0ff54fe3\") " pod="opendatahub/maas-controller-68f4897f98-f5hv7"
Sep 18 04:12:11.903960 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:11.903927    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lq47\" (UniqueName: \"kubernetes.io/projected/49996cfe-9e97-4e95-98b9-69817e9ba977-kube-api-access-2lq47\") pod \"maas-controller-85cbcd4954-pd9g4\" (UID: \"49996cfe-9e97-4e95-98b9-69817e9ba977\") " pod="opendatahub/maas-controller-85cbcd4954-pd9g4"
Sep 18 04:12:11.904082 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:11.903969    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/60a46253-b445-47b6-a7b7-5eab0ff54fe3-webhook-cert\") pod \"maas-controller-68f4897f98-f5hv7\" (UID: \"60a46253-b445-47b6-a7b7-5eab0ff54fe3\") " pod="opendatahub/maas-controller-68f4897f98-f5hv7"
Sep 18 04:12:11.904082 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:11.904004    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76dg5\" (UniqueName: \"kubernetes.io/projected/60a46253-b445-47b6-a7b7-5eab0ff54fe3-kube-api-access-76dg5\") pod \"maas-controller-68f4897f98-f5hv7\" (UID: \"60a46253-b445-47b6-a7b7-5eab0ff54fe3\") " pod="opendatahub/maas-controller-68f4897f98-f5hv7"
Sep 18 04:12:11.904082 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:11.904044    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/49996cfe-9e97-4e95-98b9-69817e9ba977-webhook-cert\") pod \"maas-controller-85cbcd4954-pd9g4\" (UID: \"49996cfe-9e97-4e95-98b9-69817e9ba977\") " pod="opendatahub/maas-controller-85cbcd4954-pd9g4"
Sep 18 04:12:11.906742 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:11.906719    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/60a46253-b445-47b6-a7b7-5eab0ff54fe3-webhook-cert\") pod \"maas-controller-68f4897f98-f5hv7\" (UID: \"60a46253-b445-47b6-a7b7-5eab0ff54fe3\") " pod="opendatahub/maas-controller-68f4897f98-f5hv7"
Sep 18 04:12:11.906846 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:11.906754    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60a46253-b445-47b6-a7b7-5eab0ff54fe3-metrics-certs\") pod \"maas-controller-68f4897f98-f5hv7\" (UID: \"60a46253-b445-47b6-a7b7-5eab0ff54fe3\") " pod="opendatahub/maas-controller-68f4897f98-f5hv7"
Sep 18 04:12:11.912438 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:11.912413    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76dg5\" (UniqueName: \"kubernetes.io/projected/60a46253-b445-47b6-a7b7-5eab0ff54fe3-kube-api-access-76dg5\") pod \"maas-controller-68f4897f98-f5hv7\" (UID: \"60a46253-b445-47b6-a7b7-5eab0ff54fe3\") " pod="opendatahub/maas-controller-68f4897f98-f5hv7"
Sep 18 04:12:11.918170 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:11.918146    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68f4897f98-f5hv7"
Sep 18 04:12:11.946799 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:11.946774    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:12:12.005284 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:12.005252    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49996cfe-9e97-4e95-98b9-69817e9ba977-metrics-certs\") pod \"maas-controller-85cbcd4954-pd9g4\" (UID: \"49996cfe-9e97-4e95-98b9-69817e9ba977\") " pod="opendatahub/maas-controller-85cbcd4954-pd9g4"
Sep 18 04:12:12.005458 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:12.005307    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lq47\" (UniqueName: \"kubernetes.io/projected/49996cfe-9e97-4e95-98b9-69817e9ba977-kube-api-access-2lq47\") pod \"maas-controller-85cbcd4954-pd9g4\" (UID: \"49996cfe-9e97-4e95-98b9-69817e9ba977\") " pod="opendatahub/maas-controller-85cbcd4954-pd9g4"
Sep 18 04:12:12.005458 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:12.005352    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/49996cfe-9e97-4e95-98b9-69817e9ba977-webhook-cert\") pod \"maas-controller-85cbcd4954-pd9g4\" (UID: \"49996cfe-9e97-4e95-98b9-69817e9ba977\") " pod="opendatahub/maas-controller-85cbcd4954-pd9g4"
Sep 18 04:12:12.007882 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:12.007855    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49996cfe-9e97-4e95-98b9-69817e9ba977-metrics-certs\") pod \"maas-controller-85cbcd4954-pd9g4\" (UID: \"49996cfe-9e97-4e95-98b9-69817e9ba977\") " pod="opendatahub/maas-controller-85cbcd4954-pd9g4"
Sep 18 04:12:12.007882 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:12.007876    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/49996cfe-9e97-4e95-98b9-69817e9ba977-webhook-cert\") pod \"maas-controller-85cbcd4954-pd9g4\" (UID: \"49996cfe-9e97-4e95-98b9-69817e9ba977\") " pod="opendatahub/maas-controller-85cbcd4954-pd9g4"
Sep 18 04:12:12.014596 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:12.014570    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lq47\" (UniqueName: \"kubernetes.io/projected/49996cfe-9e97-4e95-98b9-69817e9ba977-kube-api-access-2lq47\") pod \"maas-controller-85cbcd4954-pd9g4\" (UID: \"49996cfe-9e97-4e95-98b9-69817e9ba977\") " pod="opendatahub/maas-controller-85cbcd4954-pd9g4"
Sep 18 04:12:12.062320 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:12.062243    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b3cc118-f403-4cd5-8ab4-d7347cfa145a" path="/var/lib/kubelet/pods/4b3cc118-f403-4cd5-8ab4-d7347cfa145a/volumes"
Sep 18 04:12:12.108672 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:12.108650    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85cbcd4954-pd9g4"
Sep 18 04:12:12.193772 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:12.193746    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-68f4897f98-f5hv7"]
Sep 18 04:12:12.195954 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:12:12.195918    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60a46253_b445_47b6_a7b7_5eab0ff54fe3.slice/crio-747577dd8d7e8531f1d1bbba6ed7e0e848cd0fdf53f7e8de95b297a03d36895f WatchSource:0}: Error finding container 747577dd8d7e8531f1d1bbba6ed7e0e848cd0fdf53f7e8de95b297a03d36895f: Status 404 returned error can't find the container with id 747577dd8d7e8531f1d1bbba6ed7e0e848cd0fdf53f7e8de95b297a03d36895f
Sep 18 04:12:12.381074 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:12.381048    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-85cbcd4954-pd9g4"]
Sep 18 04:12:12.383345 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:12:12.383314    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49996cfe_9e97_4e95_98b9_69817e9ba977.slice/crio-c588e3aca25706640fff59d47b55e0f3dd7d12b8b18cfc788524510b5c67ed59 WatchSource:0}: Error finding container c588e3aca25706640fff59d47b55e0f3dd7d12b8b18cfc788524510b5c67ed59: Status 404 returned error can't find the container with id c588e3aca25706640fff59d47b55e0f3dd7d12b8b18cfc788524510b5c67ed59
Sep 18 04:12:12.761251 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:12.761156    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68f4897f98-f5hv7" event={"ID":"60a46253-b445-47b6-a7b7-5eab0ff54fe3","Type":"ContainerStarted","Data":"747577dd8d7e8531f1d1bbba6ed7e0e848cd0fdf53f7e8de95b297a03d36895f"}
Sep 18 04:12:12.762282 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:12.762258    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85cbcd4954-pd9g4" event={"ID":"49996cfe-9e97-4e95-98b9-69817e9ba977","Type":"ContainerStarted","Data":"c588e3aca25706640fff59d47b55e0f3dd7d12b8b18cfc788524510b5c67ed59"}
Sep 18 04:12:13.973765 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:13.973733    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:12:14.078681 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:14.078641    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:12:14.175485 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:14.175441    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:12:14.409662 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:14.409621    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:12:14.484674 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:14.484638    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:12:14.775031 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:14.774930    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68f4897f98-f5hv7" event={"ID":"60a46253-b445-47b6-a7b7-5eab0ff54fe3","Type":"ContainerStarted","Data":"7ae355ce6073a798ca8c99962118d77f3e72c431f5e1b62a12ec03c9a2051d6a"}
Sep 18 04:12:14.775031 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:14.774993    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-68f4897f98-f5hv7"
Sep 18 04:12:14.776474 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:14.776450    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85cbcd4954-pd9g4" event={"ID":"49996cfe-9e97-4e95-98b9-69817e9ba977","Type":"ContainerStarted","Data":"84f7055138742435e2c4ad653f2edc4dc94dcf7e68cc3654d2f8dadcfd1b7aa8"}
Sep 18 04:12:14.776617 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:14.776505    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-85cbcd4954-pd9g4"
Sep 18 04:12:14.798077 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:14.798031    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-68f4897f98-f5hv7" podStartSLOduration=2.048090633 podStartE2EDuration="3.798017939s" totalImagesPullingTime="1.749927306s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:12:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:12:14.796307536 +0000 UTC m=+369.253750514" watchObservedRunningTime="2026-09-18 04:12:14.798017939 +0000 UTC m=+369.255460907"
Sep 18 04:12:14.813598 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:14.813553    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-85cbcd4954-pd9g4" podStartSLOduration=2.255694944 podStartE2EDuration="3.8135411s" totalImagesPullingTime="1.557846156s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:12:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:12:14.812156884 +0000 UTC m=+369.269599854" watchObservedRunningTime="2026-09-18 04:12:14.8135411 +0000 UTC m=+369.270984118"
Sep 18 04:12:14.973276 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:14.973225    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:12:15.044717 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:15.044684    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:12:18.686513 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:18.686470    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-module-controller-manager-54765d59fd-g2vkd"
Sep 18 04:12:23.196262 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:23.196216    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:12:23.297533 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:23.297496    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:12:23.398702 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:23.398662    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:12:23.498262 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:23.498186    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:12:25.784911 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:25.784862    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-68f4897f98-f5hv7"
Sep 18 04:12:25.785329 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:25.784974    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-85cbcd4954-pd9g4"
Sep 18 04:12:25.851570 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:25.851536    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-68f4897f98-f5hv7"]
Sep 18 04:12:25.852332 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:25.852300    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-68f4897f98-f5hv7" podUID="60a46253-b445-47b6-a7b7-5eab0ff54fe3" containerName="manager" containerID="cri-o://7ae355ce6073a798ca8c99962118d77f3e72c431f5e1b62a12ec03c9a2051d6a" gracePeriod=30
Sep 18 04:12:26.101792 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:26.101765    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68f4897f98-f5hv7"
Sep 18 04:12:26.138716 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:26.138682    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60a46253-b445-47b6-a7b7-5eab0ff54fe3-metrics-certs\") pod \"60a46253-b445-47b6-a7b7-5eab0ff54fe3\" (UID: \"60a46253-b445-47b6-a7b7-5eab0ff54fe3\") "
Sep 18 04:12:26.139071 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:26.139046    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/60a46253-b445-47b6-a7b7-5eab0ff54fe3-webhook-cert\") pod \"60a46253-b445-47b6-a7b7-5eab0ff54fe3\" (UID: \"60a46253-b445-47b6-a7b7-5eab0ff54fe3\") "
Sep 18 04:12:26.139205 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:26.139090    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-76dg5\" (UniqueName: \"kubernetes.io/projected/60a46253-b445-47b6-a7b7-5eab0ff54fe3-kube-api-access-76dg5\") pod \"60a46253-b445-47b6-a7b7-5eab0ff54fe3\" (UID: \"60a46253-b445-47b6-a7b7-5eab0ff54fe3\") "
Sep 18 04:12:26.141745 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:26.141702    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60a46253-b445-47b6-a7b7-5eab0ff54fe3-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "60a46253-b445-47b6-a7b7-5eab0ff54fe3" (UID: "60a46253-b445-47b6-a7b7-5eab0ff54fe3"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 04:12:26.142447 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:26.142410    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60a46253-b445-47b6-a7b7-5eab0ff54fe3-kube-api-access-76dg5" (OuterVolumeSpecName: "kube-api-access-76dg5") pod "60a46253-b445-47b6-a7b7-5eab0ff54fe3" (UID: "60a46253-b445-47b6-a7b7-5eab0ff54fe3"). InnerVolumeSpecName "kube-api-access-76dg5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 04:12:26.143124 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:26.142933    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60a46253-b445-47b6-a7b7-5eab0ff54fe3-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "60a46253-b445-47b6-a7b7-5eab0ff54fe3" (UID: "60a46253-b445-47b6-a7b7-5eab0ff54fe3"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 04:12:26.159217 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:26.159183    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:12:26.163573 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:26.163549    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-72j7r"]
Sep 18 04:12:26.163958 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:26.163945    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60a46253-b445-47b6-a7b7-5eab0ff54fe3" containerName="manager"
Sep 18 04:12:26.164010 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:26.163960    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="60a46253-b445-47b6-a7b7-5eab0ff54fe3" containerName="manager"
Sep 18 04:12:26.164046 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:26.164026    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="60a46253-b445-47b6-a7b7-5eab0ff54fe3" containerName="manager"
Sep 18 04:12:26.167716 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:26.167700    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-72j7r"
Sep 18 04:12:26.170161 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:26.170140    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 18 04:12:26.170249 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:26.170167    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-htjm9\""
Sep 18 04:12:26.176633 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:26.176609    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-72j7r"]
Sep 18 04:12:26.240753 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:26.240713    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g658v\" (UniqueName: \"kubernetes.io/projected/78277b08-be4a-4657-aa22-fab819ea6aeb-kube-api-access-g658v\") pod \"limitador-limitador-8588749977-72j7r\" (UID: \"78277b08-be4a-4657-aa22-fab819ea6aeb\") " pod="kuadrant-system/limitador-limitador-8588749977-72j7r"
Sep 18 04:12:26.240963 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:26.240835    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/78277b08-be4a-4657-aa22-fab819ea6aeb-config-file\") pod \"limitador-limitador-8588749977-72j7r\" (UID: \"78277b08-be4a-4657-aa22-fab819ea6aeb\") " pod="kuadrant-system/limitador-limitador-8588749977-72j7r"
Sep 18 04:12:26.241042 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:26.241007    2585 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/60a46253-b445-47b6-a7b7-5eab0ff54fe3-webhook-cert\") on node \"ip-10-0-129-207.ec2.internal\" DevicePath \"\""
Sep 18 04:12:26.241042 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:26.241031    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-76dg5\" (UniqueName: \"kubernetes.io/projected/60a46253-b445-47b6-a7b7-5eab0ff54fe3-kube-api-access-76dg5\") on node \"ip-10-0-129-207.ec2.internal\" DevicePath \"\""
Sep 18 04:12:26.241129 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:26.241046    2585 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60a46253-b445-47b6-a7b7-5eab0ff54fe3-metrics-certs\") on node \"ip-10-0-129-207.ec2.internal\" DevicePath \"\""
Sep 18 04:12:26.261151 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:26.261116    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-72j7r"]
Sep 18 04:12:26.271590 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:26.271554    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:12:26.342451 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:26.341701    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g658v\" (UniqueName: \"kubernetes.io/projected/78277b08-be4a-4657-aa22-fab819ea6aeb-kube-api-access-g658v\") pod \"limitador-limitador-8588749977-72j7r\" (UID: \"78277b08-be4a-4657-aa22-fab819ea6aeb\") " pod="kuadrant-system/limitador-limitador-8588749977-72j7r"
Sep 18 04:12:26.342451 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:26.341798    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/78277b08-be4a-4657-aa22-fab819ea6aeb-config-file\") pod \"limitador-limitador-8588749977-72j7r\" (UID: \"78277b08-be4a-4657-aa22-fab819ea6aeb\") " pod="kuadrant-system/limitador-limitador-8588749977-72j7r"
Sep 18 04:12:26.342730 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:26.342703    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/78277b08-be4a-4657-aa22-fab819ea6aeb-config-file\") pod \"limitador-limitador-8588749977-72j7r\" (UID: \"78277b08-be4a-4657-aa22-fab819ea6aeb\") " pod="kuadrant-system/limitador-limitador-8588749977-72j7r"
Sep 18 04:12:26.352138 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:26.352103    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g658v\" (UniqueName: \"kubernetes.io/projected/78277b08-be4a-4657-aa22-fab819ea6aeb-kube-api-access-g658v\") pod \"limitador-limitador-8588749977-72j7r\" (UID: \"78277b08-be4a-4657-aa22-fab819ea6aeb\") " pod="kuadrant-system/limitador-limitador-8588749977-72j7r"
Sep 18 04:12:26.371861 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:26.371826    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:12:26.472775 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:26.472724    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:12:26.478514 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:26.478480    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-72j7r"
Sep 18 04:12:26.613654 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:26.613580    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xcpj4"]
Sep 18 04:12:26.619035 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:26.619015    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-xcpj4"
Sep 18 04:12:26.629160 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:26.629086    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xcpj4"]
Sep 18 04:12:26.657478 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:26.657435    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xcpj4"]
Sep 18 04:12:26.745818 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:26.745780    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8xmb\" (UniqueName: \"kubernetes.io/projected/d32ceddc-f742-4e3b-8e63-df2592e64dc9-kube-api-access-z8xmb\") pod \"limitador-limitador-84994f7ffc-xcpj4\" (UID: \"d32ceddc-f742-4e3b-8e63-df2592e64dc9\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-xcpj4"
Sep 18 04:12:26.745995 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:26.745841    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d32ceddc-f742-4e3b-8e63-df2592e64dc9-config-file\") pod \"limitador-limitador-84994f7ffc-xcpj4\" (UID: \"d32ceddc-f742-4e3b-8e63-df2592e64dc9\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-xcpj4"
Sep 18 04:12:26.752269 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:26.752245    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-72j7r"]
Sep 18 04:12:26.754352 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:12:26.754329    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78277b08_be4a_4657_aa22_fab819ea6aeb.slice/crio-062ad3c0c71d4eb85cbb02219b90dedd44c0632e3faefeff11fb6438fe5d61f0 WatchSource:0}: Error finding container 062ad3c0c71d4eb85cbb02219b90dedd44c0632e3faefeff11fb6438fe5d61f0: Status 404 returned error can't find the container with id 062ad3c0c71d4eb85cbb02219b90dedd44c0632e3faefeff11fb6438fe5d61f0
Sep 18 04:12:26.846422 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:26.846376    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d32ceddc-f742-4e3b-8e63-df2592e64dc9-config-file\") pod \"limitador-limitador-84994f7ffc-xcpj4\" (UID: \"d32ceddc-f742-4e3b-8e63-df2592e64dc9\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-xcpj4"
Sep 18 04:12:26.846944 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:26.846513    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8xmb\" (UniqueName: \"kubernetes.io/projected/d32ceddc-f742-4e3b-8e63-df2592e64dc9-kube-api-access-z8xmb\") pod \"limitador-limitador-84994f7ffc-xcpj4\" (UID: \"d32ceddc-f742-4e3b-8e63-df2592e64dc9\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-xcpj4"
Sep 18 04:12:26.847173 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:26.847155    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d32ceddc-f742-4e3b-8e63-df2592e64dc9-config-file\") pod \"limitador-limitador-84994f7ffc-xcpj4\" (UID: \"d32ceddc-f742-4e3b-8e63-df2592e64dc9\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-xcpj4"
Sep 18 04:12:26.847428 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:26.847405    2585 generic.go:356] "Generic (PLEG): container finished" podID="60a46253-b445-47b6-a7b7-5eab0ff54fe3" containerID="7ae355ce6073a798ca8c99962118d77f3e72c431f5e1b62a12ec03c9a2051d6a" exitCode=0
Sep 18 04:12:26.847478 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:26.847452    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68f4897f98-f5hv7"
Sep 18 04:12:26.847723 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:26.847488    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68f4897f98-f5hv7" event={"ID":"60a46253-b445-47b6-a7b7-5eab0ff54fe3","Type":"ContainerDied","Data":"7ae355ce6073a798ca8c99962118d77f3e72c431f5e1b62a12ec03c9a2051d6a"}
Sep 18 04:12:26.847723 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:26.847550    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68f4897f98-f5hv7" event={"ID":"60a46253-b445-47b6-a7b7-5eab0ff54fe3","Type":"ContainerDied","Data":"747577dd8d7e8531f1d1bbba6ed7e0e848cd0fdf53f7e8de95b297a03d36895f"}
Sep 18 04:12:26.847723 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:26.847581    2585 scope.go:117] "RemoveContainer" containerID="7ae355ce6073a798ca8c99962118d77f3e72c431f5e1b62a12ec03c9a2051d6a"
Sep 18 04:12:26.849129 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:26.849101    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-72j7r" event={"ID":"78277b08-be4a-4657-aa22-fab819ea6aeb","Type":"ContainerStarted","Data":"062ad3c0c71d4eb85cbb02219b90dedd44c0632e3faefeff11fb6438fe5d61f0"}
Sep 18 04:12:26.854447 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:26.854429    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8xmb\" (UniqueName: \"kubernetes.io/projected/d32ceddc-f742-4e3b-8e63-df2592e64dc9-kube-api-access-z8xmb\") pod \"limitador-limitador-84994f7ffc-xcpj4\" (UID: \"d32ceddc-f742-4e3b-8e63-df2592e64dc9\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-xcpj4"
Sep 18 04:12:26.859021 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:26.859001    2585 scope.go:117] "RemoveContainer" containerID="7ae355ce6073a798ca8c99962118d77f3e72c431f5e1b62a12ec03c9a2051d6a"
Sep 18 04:12:26.861170 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:12:26.860887    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ae355ce6073a798ca8c99962118d77f3e72c431f5e1b62a12ec03c9a2051d6a\": container with ID starting with 7ae355ce6073a798ca8c99962118d77f3e72c431f5e1b62a12ec03c9a2051d6a not found: ID does not exist" containerID="7ae355ce6073a798ca8c99962118d77f3e72c431f5e1b62a12ec03c9a2051d6a"
Sep 18 04:12:26.861170 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:26.860961    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ae355ce6073a798ca8c99962118d77f3e72c431f5e1b62a12ec03c9a2051d6a"} err="failed to get container status \"7ae355ce6073a798ca8c99962118d77f3e72c431f5e1b62a12ec03c9a2051d6a\": rpc error: code = NotFound desc = could not find container \"7ae355ce6073a798ca8c99962118d77f3e72c431f5e1b62a12ec03c9a2051d6a\": container with ID starting with 7ae355ce6073a798ca8c99962118d77f3e72c431f5e1b62a12ec03c9a2051d6a not found: ID does not exist"
Sep 18 04:12:26.873859 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:26.873806    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-68f4897f98-f5hv7"]
Sep 18 04:12:26.877777 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:26.877755    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-68f4897f98-f5hv7"]
Sep 18 04:12:26.929654 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:26.929610    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-xcpj4"
Sep 18 04:12:26.990384 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:26.990102    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:12:27.093954 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:27.093886    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:12:27.094932 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:27.094879    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59c974bd48-gfwcz"]
Sep 18 04:12:27.100225 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:27.100204    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-gfwcz"
Sep 18 04:12:27.102577 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:27.102554    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-gxqfl\""
Sep 18 04:12:27.104466 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:27.104444    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-gfwcz"]
Sep 18 04:12:27.148932 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:27.148829    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skgxd\" (UniqueName: \"kubernetes.io/projected/19632fbd-c293-4f9c-981f-02c25a0cfc5d-kube-api-access-skgxd\") pod \"authorino-59c974bd48-gfwcz\" (UID: \"19632fbd-c293-4f9c-981f-02c25a0cfc5d\") " pod="kuadrant-system/authorino-59c974bd48-gfwcz"
Sep 18 04:12:27.205057 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:27.205030    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xcpj4"]
Sep 18 04:12:27.206644 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:12:27.206588    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd32ceddc_f742_4e3b_8e63_df2592e64dc9.slice/crio-f3b6548c8ff5417795258aebf3de4579d8f41cb9296b52726c057b219bc41767 WatchSource:0}: Error finding container f3b6548c8ff5417795258aebf3de4579d8f41cb9296b52726c057b219bc41767: Status 404 returned error can't find the container with id f3b6548c8ff5417795258aebf3de4579d8f41cb9296b52726c057b219bc41767
Sep 18 04:12:27.250378 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:27.250338    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skgxd\" (UniqueName: \"kubernetes.io/projected/19632fbd-c293-4f9c-981f-02c25a0cfc5d-kube-api-access-skgxd\") pod \"authorino-59c974bd48-gfwcz\" (UID: \"19632fbd-c293-4f9c-981f-02c25a0cfc5d\") " pod="kuadrant-system/authorino-59c974bd48-gfwcz"
Sep 18 04:12:27.260824 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:27.260790    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-skgxd\" (UniqueName: \"kubernetes.io/projected/19632fbd-c293-4f9c-981f-02c25a0cfc5d-kube-api-access-skgxd\") pod \"authorino-59c974bd48-gfwcz\" (UID: \"19632fbd-c293-4f9c-981f-02c25a0cfc5d\") " pod="kuadrant-system/authorino-59c974bd48-gfwcz"
Sep 18 04:12:27.410925 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:27.410829    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-gfwcz"
Sep 18 04:12:27.688155 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:27.688121    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-gfwcz"]
Sep 18 04:12:27.800921 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:12:27.800874    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod19632fbd_c293_4f9c_981f_02c25a0cfc5d.slice/crio-5f44e9c7d45df19709ca644a6b73933651a47af13e9ae61dd5a96f10d916cbe7 WatchSource:0}: Error finding container 5f44e9c7d45df19709ca644a6b73933651a47af13e9ae61dd5a96f10d916cbe7: Status 404 returned error can't find the container with id 5f44e9c7d45df19709ca644a6b73933651a47af13e9ae61dd5a96f10d916cbe7
Sep 18 04:12:27.856351 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:27.856313    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-gfwcz" event={"ID":"19632fbd-c293-4f9c-981f-02c25a0cfc5d","Type":"ContainerStarted","Data":"5f44e9c7d45df19709ca644a6b73933651a47af13e9ae61dd5a96f10d916cbe7"}
Sep 18 04:12:27.857689 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:27.857661    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-xcpj4" event={"ID":"d32ceddc-f742-4e3b-8e63-df2592e64dc9","Type":"ContainerStarted","Data":"f3b6548c8ff5417795258aebf3de4579d8f41cb9296b52726c057b219bc41767"}
Sep 18 04:12:28.063500 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:28.063462    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60a46253-b445-47b6-a7b7-5eab0ff54fe3" path="/var/lib/kubelet/pods/60a46253-b445-47b6-a7b7-5eab0ff54fe3/volumes"
Sep 18 04:12:28.865996 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:28.865938    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-xcpj4" event={"ID":"d32ceddc-f742-4e3b-8e63-df2592e64dc9","Type":"ContainerStarted","Data":"6b94573056b4591446624b5d52199c711bfe3eaa3120f1927ac5facdd9941589"}
Sep 18 04:12:28.866419 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:28.866040    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-xcpj4"
Sep 18 04:12:28.867805 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:28.867779    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-72j7r" event={"ID":"78277b08-be4a-4657-aa22-fab819ea6aeb","Type":"ContainerStarted","Data":"91cea9c8c96a24f3af166ba5a37b36269218fdcadd01aeea7d8c99e3096a4804"}
Sep 18 04:12:28.867951 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:28.867836    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-72j7r"
Sep 18 04:12:28.893185 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:28.893135    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-xcpj4" podStartSLOduration=2.212714038 podStartE2EDuration="2.893117549s" totalImagesPullingTime="680.403511ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:12:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:12:28.889591942 +0000 UTC m=+383.347034912" watchObservedRunningTime="2026-09-18 04:12:28.893117549 +0000 UTC m=+383.350560518"
Sep 18 04:12:28.914605 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:28.914432    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-72j7r" podStartSLOduration=1.78330161 podStartE2EDuration="2.914413204s" totalImagesPullingTime="1.131111594s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:12:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:12:28.914002189 +0000 UTC m=+383.371445159" watchObservedRunningTime="2026-09-18 04:12:28.914413204 +0000 UTC m=+383.371856175"
Sep 18 04:12:29.874737 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:29.874689    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-gfwcz" event={"ID":"19632fbd-c293-4f9c-981f-02c25a0cfc5d","Type":"ContainerStarted","Data":"35ab4a5b5975e1bea37b46e006342aa67a41f52bcfd8435b6f3f517ee42ad12a"}
Sep 18 04:12:29.890789 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:29.890738    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59c974bd48-gfwcz" podStartSLOduration=1.036058416 podStartE2EDuration="2.89072203s" totalImagesPullingTime="1.854663614s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:12:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:12:29.889746129 +0000 UTC m=+384.347189100" watchObservedRunningTime="2026-09-18 04:12:29.89072203 +0000 UTC m=+384.348164998"
Sep 18 04:12:39.875488 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:39.875454    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-xcpj4"
Sep 18 04:12:39.875862 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:39.875533    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-72j7r"
Sep 18 04:12:39.965590 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:39.965560    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-72j7r"]
Sep 18 04:12:39.965785 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:39.965744    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-72j7r" podUID="78277b08-be4a-4657-aa22-fab819ea6aeb" containerName="limitador" containerID="cri-o://91cea9c8c96a24f3af166ba5a37b36269218fdcadd01aeea7d8c99e3096a4804" gracePeriod=30
Sep 18 04:12:40.504517 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:40.504489    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-72j7r"
Sep 18 04:12:40.569577 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:40.569540    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/78277b08-be4a-4657-aa22-fab819ea6aeb-config-file\") pod \"78277b08-be4a-4657-aa22-fab819ea6aeb\" (UID: \"78277b08-be4a-4657-aa22-fab819ea6aeb\") "
Sep 18 04:12:40.569752 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:40.569624    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g658v\" (UniqueName: \"kubernetes.io/projected/78277b08-be4a-4657-aa22-fab819ea6aeb-kube-api-access-g658v\") pod \"78277b08-be4a-4657-aa22-fab819ea6aeb\" (UID: \"78277b08-be4a-4657-aa22-fab819ea6aeb\") "
Sep 18 04:12:40.569983 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:40.569963    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78277b08-be4a-4657-aa22-fab819ea6aeb-config-file" (OuterVolumeSpecName: "config-file") pod "78277b08-be4a-4657-aa22-fab819ea6aeb" (UID: "78277b08-be4a-4657-aa22-fab819ea6aeb"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 04:12:40.571805 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:40.571771    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78277b08-be4a-4657-aa22-fab819ea6aeb-kube-api-access-g658v" (OuterVolumeSpecName: "kube-api-access-g658v") pod "78277b08-be4a-4657-aa22-fab819ea6aeb" (UID: "78277b08-be4a-4657-aa22-fab819ea6aeb"). InnerVolumeSpecName "kube-api-access-g658v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 04:12:40.671327 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:40.671288    2585 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/78277b08-be4a-4657-aa22-fab819ea6aeb-config-file\") on node \"ip-10-0-129-207.ec2.internal\" DevicePath \"\""
Sep 18 04:12:40.671327 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:40.671328    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g658v\" (UniqueName: \"kubernetes.io/projected/78277b08-be4a-4657-aa22-fab819ea6aeb-kube-api-access-g658v\") on node \"ip-10-0-129-207.ec2.internal\" DevicePath \"\""
Sep 18 04:12:40.937585 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:40.937504    2585 generic.go:356] "Generic (PLEG): container finished" podID="78277b08-be4a-4657-aa22-fab819ea6aeb" containerID="91cea9c8c96a24f3af166ba5a37b36269218fdcadd01aeea7d8c99e3096a4804" exitCode=0
Sep 18 04:12:40.937585 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:40.937548    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-72j7r"
Sep 18 04:12:40.937585 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:40.937561    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-72j7r" event={"ID":"78277b08-be4a-4657-aa22-fab819ea6aeb","Type":"ContainerDied","Data":"91cea9c8c96a24f3af166ba5a37b36269218fdcadd01aeea7d8c99e3096a4804"}
Sep 18 04:12:40.938068 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:40.937600    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-72j7r" event={"ID":"78277b08-be4a-4657-aa22-fab819ea6aeb","Type":"ContainerDied","Data":"062ad3c0c71d4eb85cbb02219b90dedd44c0632e3faefeff11fb6438fe5d61f0"}
Sep 18 04:12:40.938068 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:40.937623    2585 scope.go:117] "RemoveContainer" containerID="91cea9c8c96a24f3af166ba5a37b36269218fdcadd01aeea7d8c99e3096a4804"
Sep 18 04:12:40.946259 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:40.946241    2585 scope.go:117] "RemoveContainer" containerID="91cea9c8c96a24f3af166ba5a37b36269218fdcadd01aeea7d8c99e3096a4804"
Sep 18 04:12:40.946506 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:12:40.946486    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91cea9c8c96a24f3af166ba5a37b36269218fdcadd01aeea7d8c99e3096a4804\": container with ID starting with 91cea9c8c96a24f3af166ba5a37b36269218fdcadd01aeea7d8c99e3096a4804 not found: ID does not exist" containerID="91cea9c8c96a24f3af166ba5a37b36269218fdcadd01aeea7d8c99e3096a4804"
Sep 18 04:12:40.946559 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:40.946520    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91cea9c8c96a24f3af166ba5a37b36269218fdcadd01aeea7d8c99e3096a4804"} err="failed to get container status \"91cea9c8c96a24f3af166ba5a37b36269218fdcadd01aeea7d8c99e3096a4804\": rpc error: code = NotFound desc = could not find container \"91cea9c8c96a24f3af166ba5a37b36269218fdcadd01aeea7d8c99e3096a4804\": container with ID starting with 91cea9c8c96a24f3af166ba5a37b36269218fdcadd01aeea7d8c99e3096a4804 not found: ID does not exist"
Sep 18 04:12:40.958785 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:40.958764    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-72j7r"]
Sep 18 04:12:40.962817 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:40.962795    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-72j7r"]
Sep 18 04:12:41.956861 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:41.956825    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:12:42.052017 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:42.051977    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:12:42.065033 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:42.064998    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78277b08-be4a-4657-aa22-fab819ea6aeb" path="/var/lib/kubelet/pods/78277b08-be4a-4657-aa22-fab819ea6aeb/volumes"
Sep 18 04:12:43.982763 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:43.982710    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:12:44.078440 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:44.078404    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:12:45.481650 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:45.481614    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:12:45.584977 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:45.584942    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:12:47.313559 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:47.313527    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:12:47.413766 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:47.413728    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:12:47.470511 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:47.470469    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-79c6fd8665-7gs6w"]
Sep 18 04:12:47.470880 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:47.470865    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78277b08-be4a-4657-aa22-fab819ea6aeb" containerName="limitador"
Sep 18 04:12:47.471010 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:47.470890    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="78277b08-be4a-4657-aa22-fab819ea6aeb" containerName="limitador"
Sep 18 04:12:47.471010 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:47.470998    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="78277b08-be4a-4657-aa22-fab819ea6aeb" containerName="limitador"
Sep 18 04:12:47.478595 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:47.478569    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-79c6fd8665-7gs6w"
Sep 18 04:12:47.482033 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:47.482007    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 18 04:12:47.482033 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:47.482007    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 18 04:12:47.482215 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:47.482045    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 18 04:12:47.482215 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:47.482075    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 18 04:12:47.482215 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:47.482083    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-pj9r2\""
Sep 18 04:12:47.491068 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:47.491045    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-79c6fd8665-7gs6w"]
Sep 18 04:12:47.518173 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:47.518142    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:12:47.623572 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:47.623486    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:12:47.630992 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:47.630959    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5184c282-e5cf-4cd0-b678-7f8ba4c20841-metrics-certs\") pod \"maas-api-79c6fd8665-7gs6w\" (UID: \"5184c282-e5cf-4cd0-b678-7f8ba4c20841\") " pod="odh-ai-gateway-infra/maas-api-79c6fd8665-7gs6w"
Sep 18 04:12:47.631128 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:47.631007    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5184c282-e5cf-4cd0-b678-7f8ba4c20841-maas-api-tls\") pod \"maas-api-79c6fd8665-7gs6w\" (UID: \"5184c282-e5cf-4cd0-b678-7f8ba4c20841\") " pod="odh-ai-gateway-infra/maas-api-79c6fd8665-7gs6w"
Sep 18 04:12:47.631128 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:47.631087    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dvkw\" (UniqueName: \"kubernetes.io/projected/5184c282-e5cf-4cd0-b678-7f8ba4c20841-kube-api-access-9dvkw\") pod \"maas-api-79c6fd8665-7gs6w\" (UID: \"5184c282-e5cf-4cd0-b678-7f8ba4c20841\") " pod="odh-ai-gateway-infra/maas-api-79c6fd8665-7gs6w"
Sep 18 04:12:47.631239 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:47.631220    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5184c282-e5cf-4cd0-b678-7f8ba4c20841-openshift-service-ca\") pod \"maas-api-79c6fd8665-7gs6w\" (UID: \"5184c282-e5cf-4cd0-b678-7f8ba4c20841\") " pod="odh-ai-gateway-infra/maas-api-79c6fd8665-7gs6w"
Sep 18 04:12:47.719065 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:47.719027    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:12:47.732102 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:47.732071    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5184c282-e5cf-4cd0-b678-7f8ba4c20841-openshift-service-ca\") pod \"maas-api-79c6fd8665-7gs6w\" (UID: \"5184c282-e5cf-4cd0-b678-7f8ba4c20841\") " pod="odh-ai-gateway-infra/maas-api-79c6fd8665-7gs6w"
Sep 18 04:12:47.732268 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:47.732209    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5184c282-e5cf-4cd0-b678-7f8ba4c20841-metrics-certs\") pod \"maas-api-79c6fd8665-7gs6w\" (UID: \"5184c282-e5cf-4cd0-b678-7f8ba4c20841\") " pod="odh-ai-gateway-infra/maas-api-79c6fd8665-7gs6w"
Sep 18 04:12:47.732268 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:47.732227    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5184c282-e5cf-4cd0-b678-7f8ba4c20841-maas-api-tls\") pod \"maas-api-79c6fd8665-7gs6w\" (UID: \"5184c282-e5cf-4cd0-b678-7f8ba4c20841\") " pod="odh-ai-gateway-infra/maas-api-79c6fd8665-7gs6w"
Sep 18 04:12:47.732268 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:47.732247    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dvkw\" (UniqueName: \"kubernetes.io/projected/5184c282-e5cf-4cd0-b678-7f8ba4c20841-kube-api-access-9dvkw\") pod \"maas-api-79c6fd8665-7gs6w\" (UID: \"5184c282-e5cf-4cd0-b678-7f8ba4c20841\") " pod="odh-ai-gateway-infra/maas-api-79c6fd8665-7gs6w"
Sep 18 04:12:47.732543 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:12:47.732519    2585 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-metrics-tls: secret "maas-api-metrics-tls" not found
Sep 18 04:12:47.732629 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:12:47.732608    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5184c282-e5cf-4cd0-b678-7f8ba4c20841-metrics-certs podName:5184c282-e5cf-4cd0-b678-7f8ba4c20841 nodeName:}" failed. No retries permitted until 2026-09-18 04:12:48.232588027 +0000 UTC m=+402.690030985 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5184c282-e5cf-4cd0-b678-7f8ba4c20841-metrics-certs") pod "maas-api-79c6fd8665-7gs6w" (UID: "5184c282-e5cf-4cd0-b678-7f8ba4c20841") : secret "maas-api-metrics-tls" not found
Sep 18 04:12:47.732819 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:47.732797    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5184c282-e5cf-4cd0-b678-7f8ba4c20841-openshift-service-ca\") pod \"maas-api-79c6fd8665-7gs6w\" (UID: \"5184c282-e5cf-4cd0-b678-7f8ba4c20841\") " pod="odh-ai-gateway-infra/maas-api-79c6fd8665-7gs6w"
Sep 18 04:12:47.734788 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:47.734763    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5184c282-e5cf-4cd0-b678-7f8ba4c20841-maas-api-tls\") pod \"maas-api-79c6fd8665-7gs6w\" (UID: \"5184c282-e5cf-4cd0-b678-7f8ba4c20841\") " pod="odh-ai-gateway-infra/maas-api-79c6fd8665-7gs6w"
Sep 18 04:12:47.749251 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:47.749223    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-78f7d99c47-4pmfd"]
Sep 18 04:12:47.753262 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:47.753241    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-78f7d99c47-4pmfd"
Sep 18 04:12:47.755334 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:47.755312    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dvkw\" (UniqueName: \"kubernetes.io/projected/5184c282-e5cf-4cd0-b678-7f8ba4c20841-kube-api-access-9dvkw\") pod \"maas-api-79c6fd8665-7gs6w\" (UID: \"5184c282-e5cf-4cd0-b678-7f8ba4c20841\") " pod="odh-ai-gateway-infra/maas-api-79c6fd8665-7gs6w"
Sep 18 04:12:47.756000 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:47.755976    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 18 04:12:47.756107 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:47.756057    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-fs2tm\""
Sep 18 04:12:47.763400 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:47.763374    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-78f7d99c47-4pmfd"]
Sep 18 04:12:47.811578 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:47.811548    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:12:47.901871 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:47.901775    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:12:47.933990 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:47.933962    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgdrx\" (UniqueName: \"kubernetes.io/projected/8e4fceb9-0054-4238-8fc5-d92f652c89ec-kube-api-access-rgdrx\") pod \"llmisvc-controller-manager-78f7d99c47-4pmfd\" (UID: \"8e4fceb9-0054-4238-8fc5-d92f652c89ec\") " pod="opendatahub/llmisvc-controller-manager-78f7d99c47-4pmfd"
Sep 18 04:12:47.934105 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:47.934002    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8e4fceb9-0054-4238-8fc5-d92f652c89ec-cert\") pod \"llmisvc-controller-manager-78f7d99c47-4pmfd\" (UID: \"8e4fceb9-0054-4238-8fc5-d92f652c89ec\") " pod="opendatahub/llmisvc-controller-manager-78f7d99c47-4pmfd"
Sep 18 04:12:48.001091 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:48.001060    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:12:48.034839 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:48.034799    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8e4fceb9-0054-4238-8fc5-d92f652c89ec-cert\") pod \"llmisvc-controller-manager-78f7d99c47-4pmfd\" (UID: \"8e4fceb9-0054-4238-8fc5-d92f652c89ec\") " pod="opendatahub/llmisvc-controller-manager-78f7d99c47-4pmfd"
Sep 18 04:12:48.035038 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:48.034941    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgdrx\" (UniqueName: \"kubernetes.io/projected/8e4fceb9-0054-4238-8fc5-d92f652c89ec-kube-api-access-rgdrx\") pod \"llmisvc-controller-manager-78f7d99c47-4pmfd\" (UID: \"8e4fceb9-0054-4238-8fc5-d92f652c89ec\") " pod="opendatahub/llmisvc-controller-manager-78f7d99c47-4pmfd"
Sep 18 04:12:48.037591 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:48.037563    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8e4fceb9-0054-4238-8fc5-d92f652c89ec-cert\") pod \"llmisvc-controller-manager-78f7d99c47-4pmfd\" (UID: \"8e4fceb9-0054-4238-8fc5-d92f652c89ec\") " pod="opendatahub/llmisvc-controller-manager-78f7d99c47-4pmfd"
Sep 18 04:12:48.046109 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:48.046084    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgdrx\" (UniqueName: \"kubernetes.io/projected/8e4fceb9-0054-4238-8fc5-d92f652c89ec-kube-api-access-rgdrx\") pod \"llmisvc-controller-manager-78f7d99c47-4pmfd\" (UID: \"8e4fceb9-0054-4238-8fc5-d92f652c89ec\") " pod="opendatahub/llmisvc-controller-manager-78f7d99c47-4pmfd"
Sep 18 04:12:48.077092 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:48.077049    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-78f7d99c47-4pmfd"
Sep 18 04:12:48.096447 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:48.096421    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:12:48.164380 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:48.164270    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xcpj4"]
Sep 18 04:12:48.200243 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:48.200206    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:12:48.236520 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:48.236488    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5184c282-e5cf-4cd0-b678-7f8ba4c20841-metrics-certs\") pod \"maas-api-79c6fd8665-7gs6w\" (UID: \"5184c282-e5cf-4cd0-b678-7f8ba4c20841\") " pod="odh-ai-gateway-infra/maas-api-79c6fd8665-7gs6w"
Sep 18 04:12:48.239413 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:48.239389    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5184c282-e5cf-4cd0-b678-7f8ba4c20841-metrics-certs\") pod \"maas-api-79c6fd8665-7gs6w\" (UID: \"5184c282-e5cf-4cd0-b678-7f8ba4c20841\") " pod="odh-ai-gateway-infra/maas-api-79c6fd8665-7gs6w"
Sep 18 04:12:48.297234 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:48.297199    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:12:48.364082 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:48.364047    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-78f7d99c47-4pmfd"]
Sep 18 04:12:48.366110 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:12:48.366062    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8e4fceb9_0054_4238_8fc5_d92f652c89ec.slice/crio-404f3f1b42eac7a28865688dea0e557b75da6373f6957c0c1b3dc4b2f8ee5273 WatchSource:0}: Error finding container 404f3f1b42eac7a28865688dea0e557b75da6373f6957c0c1b3dc4b2f8ee5273: Status 404 returned error can't find the container with id 404f3f1b42eac7a28865688dea0e557b75da6373f6957c0c1b3dc4b2f8ee5273
Sep 18 04:12:48.393324 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:48.393279    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-79c6fd8665-7gs6w"
Sep 18 04:12:48.681393 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:48.681362    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-79c6fd8665-7gs6w"]
Sep 18 04:12:48.684103 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:12:48.684067    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5184c282_e5cf_4cd0_b678_7f8ba4c20841.slice/crio-9b49525a34bca8fdda094dcaee2f407514094d60c65ff07e0307aaabe31e5a11 WatchSource:0}: Error finding container 9b49525a34bca8fdda094dcaee2f407514094d60c65ff07e0307aaabe31e5a11: Status 404 returned error can't find the container with id 9b49525a34bca8fdda094dcaee2f407514094d60c65ff07e0307aaabe31e5a11
Sep 18 04:12:48.988778 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:48.988736    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-79c6fd8665-7gs6w" event={"ID":"5184c282-e5cf-4cd0-b678-7f8ba4c20841","Type":"ContainerStarted","Data":"9b49525a34bca8fdda094dcaee2f407514094d60c65ff07e0307aaabe31e5a11"}
Sep 18 04:12:48.991967 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:48.991930    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-78f7d99c47-4pmfd" event={"ID":"8e4fceb9-0054-4238-8fc5-d92f652c89ec","Type":"ContainerStarted","Data":"404f3f1b42eac7a28865688dea0e557b75da6373f6957c0c1b3dc4b2f8ee5273"}
Sep 18 04:12:48.999453 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:48.999421    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:12:49.103627 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:49.103562    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:12:49.207619 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:49.207539    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:12:49.358464 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:49.358398    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:12:52.012636 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:52.012554    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-78f7d99c47-4pmfd" event={"ID":"8e4fceb9-0054-4238-8fc5-d92f652c89ec","Type":"ContainerStarted","Data":"e8bf6c113fc6abbd6282de930ff483546bbd122a3cd9561545aeb1e850e4e46c"}
Sep 18 04:12:52.012636 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:52.012608    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-78f7d99c47-4pmfd"
Sep 18 04:12:52.014155 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:52.014132    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-79c6fd8665-7gs6w" event={"ID":"5184c282-e5cf-4cd0-b678-7f8ba4c20841","Type":"ContainerStarted","Data":"62d0787bcc86d6b5fffaacd600ec02814b49e9a4dc7aacb9bcdabaec004db193"}
Sep 18 04:12:52.014259 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:52.014248    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-79c6fd8665-7gs6w"
Sep 18 04:12:52.033939 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:52.031703    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-78f7d99c47-4pmfd" podStartSLOduration=1.7906231460000002 podStartE2EDuration="5.031684671s" totalImagesPullingTime="3.241061525s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:12:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:12:52.030401593 +0000 UTC m=+406.487844563" watchObservedRunningTime="2026-09-18 04:12:52.031684671 +0000 UTC m=+406.489127641"
Sep 18 04:12:52.050928 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:52.050107    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-79c6fd8665-7gs6w" podStartSLOduration=2.132024278 podStartE2EDuration="5.050085753s" totalImagesPullingTime="2.918061475s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:12:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:12:52.047758987 +0000 UTC m=+406.505201957" watchObservedRunningTime="2026-09-18 04:12:52.050085753 +0000 UTC m=+406.507528724"
Sep 18 04:12:58.025748 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:58.025678    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-79c6fd8665-7gs6w"
Sep 18 04:12:58.048618 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:58.048584    2585 generic.go:356] "Generic (PLEG): container finished" podID="3d248c16-db7b-4d6d-ae14-4a321609e0ba" containerID="c5be5f49121264bd012670a7d39777cc54b65bcdf2ab9da34261aab1d5d91634" exitCode=0
Sep 18 04:12:58.048785 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:58.048626    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qbdbv" event={"ID":"3d248c16-db7b-4d6d-ae14-4a321609e0ba","Type":"ContainerDied","Data":"c5be5f49121264bd012670a7d39777cc54b65bcdf2ab9da34261aab1d5d91634"}
Sep 18 04:12:58.048990 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:58.048976    2585 scope.go:117] "RemoveContainer" containerID="c5be5f49121264bd012670a7d39777cc54b65bcdf2ab9da34261aab1d5d91634"
Sep 18 04:12:58.049983 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:58.049955    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 04:12:58.050060 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:58.050023    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 04:12:58.050104 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:58.050059    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 04:12:58.342227 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:58.342132    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:12:58.565446 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:58.565406    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-557f876f69-hvv42"]
Sep 18 04:12:58.569760 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:58.569735    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-hvv42"
Sep 18 04:12:58.575052 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:58.575027    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-557f876f69-hvv42"]
Sep 18 04:12:58.643509 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:58.643383    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9pck\" (UniqueName: \"kubernetes.io/projected/9f319bea-fae5-4f58-87e9-c5a298ecf477-kube-api-access-c9pck\") pod \"authorino-557f876f69-hvv42\" (UID: \"9f319bea-fae5-4f58-87e9-c5a298ecf477\") " pod="kuadrant-system/authorino-557f876f69-hvv42"
Sep 18 04:12:58.746922 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:58.744342    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9pck\" (UniqueName: \"kubernetes.io/projected/9f319bea-fae5-4f58-87e9-c5a298ecf477-kube-api-access-c9pck\") pod \"authorino-557f876f69-hvv42\" (UID: \"9f319bea-fae5-4f58-87e9-c5a298ecf477\") " pod="kuadrant-system/authorino-557f876f69-hvv42"
Sep 18 04:12:58.757919 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:58.754756    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9pck\" (UniqueName: \"kubernetes.io/projected/9f319bea-fae5-4f58-87e9-c5a298ecf477-kube-api-access-c9pck\") pod \"authorino-557f876f69-hvv42\" (UID: \"9f319bea-fae5-4f58-87e9-c5a298ecf477\") " pod="kuadrant-system/authorino-557f876f69-hvv42"
Sep 18 04:12:58.806912 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:58.806857    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-hvv42"]
Sep 18 04:12:58.807169 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:58.807154    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-hvv42"
Sep 18 04:12:58.842712 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:58.842671    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-54cd978956-khsct"]
Sep 18 04:12:58.868309 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:58.868277    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-54cd978956-khsct"]
Sep 18 04:12:58.868522 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:58.868497    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54cd978956-khsct"
Sep 18 04:12:58.958982 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:58.958386    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:12:58.960313 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:58.960284    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwldg\" (UniqueName: \"kubernetes.io/projected/cf5af72b-d626-47ac-bcbb-77458b580e83-kube-api-access-hwldg\") pod \"authorino-54cd978956-khsct\" (UID: \"cf5af72b-d626-47ac-bcbb-77458b580e83\") " pod="kuadrant-system/authorino-54cd978956-khsct"
Sep 18 04:12:59.061563 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:59.061509    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwldg\" (UniqueName: \"kubernetes.io/projected/cf5af72b-d626-47ac-bcbb-77458b580e83-kube-api-access-hwldg\") pod \"authorino-54cd978956-khsct\" (UID: \"cf5af72b-d626-47ac-bcbb-77458b580e83\") " pod="kuadrant-system/authorino-54cd978956-khsct"
Sep 18 04:12:59.063224 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:59.063193    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qbdbv" event={"ID":"3d248c16-db7b-4d6d-ae14-4a321609e0ba","Type":"ContainerStarted","Data":"e3fb4109f008d290064fd57aedb8d24003fef77a15f330b0099f2d081da4ecce"}
Sep 18 04:12:59.071123 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:59.071089    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwldg\" (UniqueName: \"kubernetes.io/projected/cf5af72b-d626-47ac-bcbb-77458b580e83-kube-api-access-hwldg\") pod \"authorino-54cd978956-khsct\" (UID: \"cf5af72b-d626-47ac-bcbb-77458b580e83\") " pod="kuadrant-system/authorino-54cd978956-khsct"
Sep 18 04:12:59.108845 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:59.108817    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-hvv42"]
Sep 18 04:12:59.110964 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:12:59.110936    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9f319bea_fae5_4f58_87e9_c5a298ecf477.slice/crio-36385ac6fe4d3e1eaa9f28c1ad91ad566b08c91cfaac643a92d61f6f8dc5b8a0 WatchSource:0}: Error finding container 36385ac6fe4d3e1eaa9f28c1ad91ad566b08c91cfaac643a92d61f6f8dc5b8a0: Status 404 returned error can't find the container with id 36385ac6fe4d3e1eaa9f28c1ad91ad566b08c91cfaac643a92d61f6f8dc5b8a0
Sep 18 04:12:59.182939 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:59.182907    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54cd978956-khsct"
Sep 18 04:12:59.475794 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:12:59.475769    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-54cd978956-khsct"]
Sep 18 04:12:59.477937 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:12:59.477891    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcf5af72b_d626_47ac_bcbb_77458b580e83.slice/crio-c178be9e8eafb6fb4b59960ec41d311e8d5e1f3e8ce46a9e5b3d60d99b04abf8 WatchSource:0}: Error finding container c178be9e8eafb6fb4b59960ec41d311e8d5e1f3e8ce46a9e5b3d60d99b04abf8: Status 404 returned error can't find the container with id c178be9e8eafb6fb4b59960ec41d311e8d5e1f3e8ce46a9e5b3d60d99b04abf8
Sep 18 04:13:00.007545 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:00.007501    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qbdbv"
Sep 18 04:13:00.008036 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:00.008000    2585 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-qbdbv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.25:15021/healthz/ready\": dial tcp 10.132.0.25:15021: connect: connection refused" start-of-body=
Sep 18 04:13:00.008162 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:00.008070    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qbdbv" podUID="3d248c16-db7b-4d6d-ae14-4a321609e0ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.25:15021/healthz/ready\": dial tcp 10.132.0.25:15021: connect: connection refused"
Sep 18 04:13:00.073890 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:00.072661    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-54cd978956-khsct" event={"ID":"cf5af72b-d626-47ac-bcbb-77458b580e83","Type":"ContainerStarted","Data":"1a8e0440dcc80df125370210ca9eb20a9446c39011ef96a42e053ec4143e7a1b"}
Sep 18 04:13:00.073890 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:00.072704    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-54cd978956-khsct" event={"ID":"cf5af72b-d626-47ac-bcbb-77458b580e83","Type":"ContainerStarted","Data":"c178be9e8eafb6fb4b59960ec41d311e8d5e1f3e8ce46a9e5b3d60d99b04abf8"}
Sep 18 04:13:00.075257 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:00.075198    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557f876f69-hvv42" event={"ID":"9f319bea-fae5-4f58-87e9-c5a298ecf477","Type":"ContainerStarted","Data":"e6fec7ae405660009d735e15cc1824e45c9cc2cce7d3f904d35dbbff4bae9ca5"}
Sep 18 04:13:00.075391 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:00.075257    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-557f876f69-hvv42" podUID="9f319bea-fae5-4f58-87e9-c5a298ecf477" containerName="authorino" containerID="cri-o://e6fec7ae405660009d735e15cc1824e45c9cc2cce7d3f904d35dbbff4bae9ca5" gracePeriod=30
Sep 18 04:13:00.075391 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:00.075268    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557f876f69-hvv42" event={"ID":"9f319bea-fae5-4f58-87e9-c5a298ecf477","Type":"ContainerStarted","Data":"36385ac6fe4d3e1eaa9f28c1ad91ad566b08c91cfaac643a92d61f6f8dc5b8a0"}
Sep 18 04:13:00.088589 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:00.087888    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-54cd978956-khsct" podStartSLOduration=1.673189574 podStartE2EDuration="2.087867371s" totalImagesPullingTime="414.677797ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:12:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:13:00.086873053 +0000 UTC m=+414.544316021" watchObservedRunningTime="2026-09-18 04:13:00.087867371 +0000 UTC m=+414.545310341"
Sep 18 04:13:00.104649 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:00.104589    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-557f876f69-hvv42" podStartSLOduration=1.713615804 podStartE2EDuration="2.104567753s" totalImagesPullingTime="390.951949ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:12:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:13:00.102222549 +0000 UTC m=+414.559665519" watchObservedRunningTime="2026-09-18 04:13:00.104567753 +0000 UTC m=+414.562010722"
Sep 18 04:13:00.122770 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:00.122030    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-gfwcz"]
Sep 18 04:13:00.122770 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:00.122238    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-59c974bd48-gfwcz" podUID="19632fbd-c293-4f9c-981f-02c25a0cfc5d" containerName="authorino" containerID="cri-o://35ab4a5b5975e1bea37b46e006342aa67a41f52bcfd8435b6f3f517ee42ad12a" gracePeriod=30
Sep 18 04:13:00.217849 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:00.217811    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-95b676546-v9qm4"]
Sep 18 04:13:00.222179 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:00.222152    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-95b676546-v9qm4"
Sep 18 04:13:00.224657 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:00.224627    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 18 04:13:00.226889 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:00.226860    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-95b676546-v9qm4"]
Sep 18 04:13:00.380542 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:00.380492    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4b555d5a-3f8b-4671-a2bf-4cd002afd0a9-tls-cert\") pod \"authorino-95b676546-v9qm4\" (UID: \"4b555d5a-3f8b-4671-a2bf-4cd002afd0a9\") " pod="kuadrant-system/authorino-95b676546-v9qm4"
Sep 18 04:13:00.380708 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:00.380569    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwgqd\" (UniqueName: \"kubernetes.io/projected/4b555d5a-3f8b-4671-a2bf-4cd002afd0a9-kube-api-access-pwgqd\") pod \"authorino-95b676546-v9qm4\" (UID: \"4b555d5a-3f8b-4671-a2bf-4cd002afd0a9\") " pod="kuadrant-system/authorino-95b676546-v9qm4"
Sep 18 04:13:00.429331 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:00.429263    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-hvv42"
Sep 18 04:13:00.468326 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:00.467977    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-gfwcz"
Sep 18 04:13:00.483958 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:00.483922    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwgqd\" (UniqueName: \"kubernetes.io/projected/4b555d5a-3f8b-4671-a2bf-4cd002afd0a9-kube-api-access-pwgqd\") pod \"authorino-95b676546-v9qm4\" (UID: \"4b555d5a-3f8b-4671-a2bf-4cd002afd0a9\") " pod="kuadrant-system/authorino-95b676546-v9qm4"
Sep 18 04:13:00.484125 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:00.484047    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4b555d5a-3f8b-4671-a2bf-4cd002afd0a9-tls-cert\") pod \"authorino-95b676546-v9qm4\" (UID: \"4b555d5a-3f8b-4671-a2bf-4cd002afd0a9\") " pod="kuadrant-system/authorino-95b676546-v9qm4"
Sep 18 04:13:00.487033 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:00.486990    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4b555d5a-3f8b-4671-a2bf-4cd002afd0a9-tls-cert\") pod \"authorino-95b676546-v9qm4\" (UID: \"4b555d5a-3f8b-4671-a2bf-4cd002afd0a9\") " pod="kuadrant-system/authorino-95b676546-v9qm4"
Sep 18 04:13:00.500612 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:00.500569    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwgqd\" (UniqueName: \"kubernetes.io/projected/4b555d5a-3f8b-4671-a2bf-4cd002afd0a9-kube-api-access-pwgqd\") pod \"authorino-95b676546-v9qm4\" (UID: \"4b555d5a-3f8b-4671-a2bf-4cd002afd0a9\") " pod="kuadrant-system/authorino-95b676546-v9qm4"
Sep 18 04:13:00.574994 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:00.574957    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-95b676546-v9qm4"
Sep 18 04:13:00.585261 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:00.585226    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c9pck\" (UniqueName: \"kubernetes.io/projected/9f319bea-fae5-4f58-87e9-c5a298ecf477-kube-api-access-c9pck\") pod \"9f319bea-fae5-4f58-87e9-c5a298ecf477\" (UID: \"9f319bea-fae5-4f58-87e9-c5a298ecf477\") "
Sep 18 04:13:00.585395 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:00.585349    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-skgxd\" (UniqueName: \"kubernetes.io/projected/19632fbd-c293-4f9c-981f-02c25a0cfc5d-kube-api-access-skgxd\") pod \"19632fbd-c293-4f9c-981f-02c25a0cfc5d\" (UID: \"19632fbd-c293-4f9c-981f-02c25a0cfc5d\") "
Sep 18 04:13:00.587646 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:00.587620    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f319bea-fae5-4f58-87e9-c5a298ecf477-kube-api-access-c9pck" (OuterVolumeSpecName: "kube-api-access-c9pck") pod "9f319bea-fae5-4f58-87e9-c5a298ecf477" (UID: "9f319bea-fae5-4f58-87e9-c5a298ecf477"). InnerVolumeSpecName "kube-api-access-c9pck". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 04:13:00.587831 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:00.587805    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19632fbd-c293-4f9c-981f-02c25a0cfc5d-kube-api-access-skgxd" (OuterVolumeSpecName: "kube-api-access-skgxd") pod "19632fbd-c293-4f9c-981f-02c25a0cfc5d" (UID: "19632fbd-c293-4f9c-981f-02c25a0cfc5d"). InnerVolumeSpecName "kube-api-access-skgxd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 04:13:00.687397 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:00.687309    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-skgxd\" (UniqueName: \"kubernetes.io/projected/19632fbd-c293-4f9c-981f-02c25a0cfc5d-kube-api-access-skgxd\") on node \"ip-10-0-129-207.ec2.internal\" DevicePath \"\""
Sep 18 04:13:00.687397 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:00.687339    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c9pck\" (UniqueName: \"kubernetes.io/projected/9f319bea-fae5-4f58-87e9-c5a298ecf477-kube-api-access-c9pck\") on node \"ip-10-0-129-207.ec2.internal\" DevicePath \"\""
Sep 18 04:13:00.857792 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:00.857753    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-95b676546-v9qm4"]
Sep 18 04:13:00.864175 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:13:00.864141    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4b555d5a_3f8b_4671_a2bf_4cd002afd0a9.slice/crio-aeb89eb29a5e4587b9b5d729113961ebeab448337f297575b8cea4c3fe6f2a07 WatchSource:0}: Error finding container aeb89eb29a5e4587b9b5d729113961ebeab448337f297575b8cea4c3fe6f2a07: Status 404 returned error can't find the container with id aeb89eb29a5e4587b9b5d729113961ebeab448337f297575b8cea4c3fe6f2a07
Sep 18 04:13:01.007435 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:01.007354    2585 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-qbdbv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.25:15021/healthz/ready\": dial tcp 10.132.0.25:15021: connect: connection refused" start-of-body=
Sep 18 04:13:01.007435 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:01.007414    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qbdbv" podUID="3d248c16-db7b-4d6d-ae14-4a321609e0ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.25:15021/healthz/ready\": dial tcp 10.132.0.25:15021: connect: connection refused"
Sep 18 04:13:01.082147 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:01.082107    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-95b676546-v9qm4" event={"ID":"4b555d5a-3f8b-4671-a2bf-4cd002afd0a9","Type":"ContainerStarted","Data":"aeb89eb29a5e4587b9b5d729113961ebeab448337f297575b8cea4c3fe6f2a07"}
Sep 18 04:13:01.084071 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:01.084035    2585 generic.go:356] "Generic (PLEG): container finished" podID="19632fbd-c293-4f9c-981f-02c25a0cfc5d" containerID="35ab4a5b5975e1bea37b46e006342aa67a41f52bcfd8435b6f3f517ee42ad12a" exitCode=0
Sep 18 04:13:01.084193 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:01.084135    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-gfwcz"
Sep 18 04:13:01.084241 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:01.084214    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-gfwcz" event={"ID":"19632fbd-c293-4f9c-981f-02c25a0cfc5d","Type":"ContainerDied","Data":"35ab4a5b5975e1bea37b46e006342aa67a41f52bcfd8435b6f3f517ee42ad12a"}
Sep 18 04:13:01.084283 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:01.084246    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-gfwcz" event={"ID":"19632fbd-c293-4f9c-981f-02c25a0cfc5d","Type":"ContainerDied","Data":"5f44e9c7d45df19709ca644a6b73933651a47af13e9ae61dd5a96f10d916cbe7"}
Sep 18 04:13:01.084283 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:01.084266    2585 scope.go:117] "RemoveContainer" containerID="35ab4a5b5975e1bea37b46e006342aa67a41f52bcfd8435b6f3f517ee42ad12a"
Sep 18 04:13:01.086047 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:01.086010    2585 generic.go:356] "Generic (PLEG): container finished" podID="9f319bea-fae5-4f58-87e9-c5a298ecf477" containerID="e6fec7ae405660009d735e15cc1824e45c9cc2cce7d3f904d35dbbff4bae9ca5" exitCode=0
Sep 18 04:13:01.086135 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:01.086061    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-hvv42"
Sep 18 04:13:01.086135 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:01.086093    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557f876f69-hvv42" event={"ID":"9f319bea-fae5-4f58-87e9-c5a298ecf477","Type":"ContainerDied","Data":"e6fec7ae405660009d735e15cc1824e45c9cc2cce7d3f904d35dbbff4bae9ca5"}
Sep 18 04:13:01.086135 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:01.086119    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557f876f69-hvv42" event={"ID":"9f319bea-fae5-4f58-87e9-c5a298ecf477","Type":"ContainerDied","Data":"36385ac6fe4d3e1eaa9f28c1ad91ad566b08c91cfaac643a92d61f6f8dc5b8a0"}
Sep 18 04:13:01.096100 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:01.096080    2585 scope.go:117] "RemoveContainer" containerID="35ab4a5b5975e1bea37b46e006342aa67a41f52bcfd8435b6f3f517ee42ad12a"
Sep 18 04:13:01.096582 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:13:01.096556    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35ab4a5b5975e1bea37b46e006342aa67a41f52bcfd8435b6f3f517ee42ad12a\": container with ID starting with 35ab4a5b5975e1bea37b46e006342aa67a41f52bcfd8435b6f3f517ee42ad12a not found: ID does not exist" containerID="35ab4a5b5975e1bea37b46e006342aa67a41f52bcfd8435b6f3f517ee42ad12a"
Sep 18 04:13:01.096679 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:01.096591    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35ab4a5b5975e1bea37b46e006342aa67a41f52bcfd8435b6f3f517ee42ad12a"} err="failed to get container status \"35ab4a5b5975e1bea37b46e006342aa67a41f52bcfd8435b6f3f517ee42ad12a\": rpc error: code = NotFound desc = could not find container \"35ab4a5b5975e1bea37b46e006342aa67a41f52bcfd8435b6f3f517ee42ad12a\": container with ID starting with 35ab4a5b5975e1bea37b46e006342aa67a41f52bcfd8435b6f3f517ee42ad12a not found: ID does not exist"
Sep 18 04:13:01.096679 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:01.096609    2585 scope.go:117] "RemoveContainer" containerID="e6fec7ae405660009d735e15cc1824e45c9cc2cce7d3f904d35dbbff4bae9ca5"
Sep 18 04:13:01.105363 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:01.105347    2585 scope.go:117] "RemoveContainer" containerID="e6fec7ae405660009d735e15cc1824e45c9cc2cce7d3f904d35dbbff4bae9ca5"
Sep 18 04:13:01.105705 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:13:01.105643    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6fec7ae405660009d735e15cc1824e45c9cc2cce7d3f904d35dbbff4bae9ca5\": container with ID starting with e6fec7ae405660009d735e15cc1824e45c9cc2cce7d3f904d35dbbff4bae9ca5 not found: ID does not exist" containerID="e6fec7ae405660009d735e15cc1824e45c9cc2cce7d3f904d35dbbff4bae9ca5"
Sep 18 04:13:01.105865 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:01.105826    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6fec7ae405660009d735e15cc1824e45c9cc2cce7d3f904d35dbbff4bae9ca5"} err="failed to get container status \"e6fec7ae405660009d735e15cc1824e45c9cc2cce7d3f904d35dbbff4bae9ca5\": rpc error: code = NotFound desc = could not find container \"e6fec7ae405660009d735e15cc1824e45c9cc2cce7d3f904d35dbbff4bae9ca5\": container with ID starting with e6fec7ae405660009d735e15cc1824e45c9cc2cce7d3f904d35dbbff4bae9ca5 not found: ID does not exist"
Sep 18 04:13:01.107779 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:01.107761    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-gfwcz"]
Sep 18 04:13:01.111495 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:01.111474    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59c974bd48-gfwcz"]
Sep 18 04:13:01.122162 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:01.122143    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-hvv42"]
Sep 18 04:13:01.126677 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:01.126653    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-557f876f69-hvv42"]
Sep 18 04:13:02.007388 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:02.007349    2585 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-qbdbv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.25:15021/healthz/ready\": dial tcp 10.132.0.25:15021: connect: connection refused" start-of-body=
Sep 18 04:13:02.007569 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:02.007423    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qbdbv" podUID="3d248c16-db7b-4d6d-ae14-4a321609e0ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.25:15021/healthz/ready\": dial tcp 10.132.0.25:15021: connect: connection refused"
Sep 18 04:13:02.065319 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:02.065285    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19632fbd-c293-4f9c-981f-02c25a0cfc5d" path="/var/lib/kubelet/pods/19632fbd-c293-4f9c-981f-02c25a0cfc5d/volumes"
Sep 18 04:13:02.065623 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:02.065610    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f319bea-fae5-4f58-87e9-c5a298ecf477" path="/var/lib/kubelet/pods/9f319bea-fae5-4f58-87e9-c5a298ecf477/volumes"
Sep 18 04:13:02.093239 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:02.093203    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-95b676546-v9qm4" event={"ID":"4b555d5a-3f8b-4671-a2bf-4cd002afd0a9","Type":"ContainerStarted","Data":"44c203cd37cab4fb3b7157d3e2ed360f31e3608e9b534583fb384c6808eb348d"}
Sep 18 04:13:02.111612 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:02.111566    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-95b676546-v9qm4" podStartSLOduration=1.634682559 podStartE2EDuration="2.111550571s" totalImagesPullingTime="476.868012ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:13:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:13:02.110089262 +0000 UTC m=+416.567532231" watchObservedRunningTime="2026-09-18 04:13:02.111550571 +0000 UTC m=+416.568993582"
Sep 18 04:13:02.143106 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:02.143055    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-54cd978956-khsct"]
Sep 18 04:13:02.150425 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:02.150378    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-54cd978956-khsct" podUID="cf5af72b-d626-47ac-bcbb-77458b580e83" containerName="authorino" containerID="cri-o://1a8e0440dcc80df125370210ca9eb20a9446c39011ef96a42e053ec4143e7a1b" gracePeriod=30
Sep 18 04:13:02.456928 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:02.456418    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54cd978956-khsct"
Sep 18 04:13:02.501459 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:02.501425    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-cff97b4b7-kp8c7"]
Sep 18 04:13:02.502273 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:02.502085    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19632fbd-c293-4f9c-981f-02c25a0cfc5d" containerName="authorino"
Sep 18 04:13:02.502273 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:02.502106    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="19632fbd-c293-4f9c-981f-02c25a0cfc5d" containerName="authorino"
Sep 18 04:13:02.502273 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:02.502122    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf5af72b-d626-47ac-bcbb-77458b580e83" containerName="authorino"
Sep 18 04:13:02.502273 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:02.502130    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf5af72b-d626-47ac-bcbb-77458b580e83" containerName="authorino"
Sep 18 04:13:02.502273 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:02.502143    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f319bea-fae5-4f58-87e9-c5a298ecf477" containerName="authorino"
Sep 18 04:13:02.502273 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:02.502151    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f319bea-fae5-4f58-87e9-c5a298ecf477" containerName="authorino"
Sep 18 04:13:02.502273 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:02.502237    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf5af72b-d626-47ac-bcbb-77458b580e83" containerName="authorino"
Sep 18 04:13:02.502273 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:02.502256    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="19632fbd-c293-4f9c-981f-02c25a0cfc5d" containerName="authorino"
Sep 18 04:13:02.502273 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:02.502266    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f319bea-fae5-4f58-87e9-c5a298ecf477" containerName="authorino"
Sep 18 04:13:02.503941 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:02.503911    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hwldg\" (UniqueName: \"kubernetes.io/projected/cf5af72b-d626-47ac-bcbb-77458b580e83-kube-api-access-hwldg\") pod \"cf5af72b-d626-47ac-bcbb-77458b580e83\" (UID: \"cf5af72b-d626-47ac-bcbb-77458b580e83\") "
Sep 18 04:13:02.506206 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:02.506122    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cff97b4b7-kp8c7"
Sep 18 04:13:02.506810 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:02.506769    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf5af72b-d626-47ac-bcbb-77458b580e83-kube-api-access-hwldg" (OuterVolumeSpecName: "kube-api-access-hwldg") pod "cf5af72b-d626-47ac-bcbb-77458b580e83" (UID: "cf5af72b-d626-47ac-bcbb-77458b580e83"). InnerVolumeSpecName "kube-api-access-hwldg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 04:13:02.508552 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:02.508418    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 18 04:13:02.508961 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:02.508946    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-6nkzk\""
Sep 18 04:13:02.509345 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:02.509294    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 18 04:13:02.509490 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:02.509469    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 18 04:13:02.510183 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:02.509683    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 18 04:13:02.510183 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:02.510005    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 18 04:13:02.515913 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:02.515869    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 18 04:13:02.517052 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:02.517030    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cff97b4b7-kp8c7"]
Sep 18 04:13:02.604142 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:02.604107    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:13:02.605060 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:02.605027    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7b4ee9fd-980c-45b2-96a8-5515e3364283-console-serving-cert\") pod \"console-cff97b4b7-kp8c7\" (UID: \"7b4ee9fd-980c-45b2-96a8-5515e3364283\") " pod="openshift-console/console-cff97b4b7-kp8c7"
Sep 18 04:13:02.605060 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:02.605058    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7b4ee9fd-980c-45b2-96a8-5515e3364283-console-config\") pod \"console-cff97b4b7-kp8c7\" (UID: \"7b4ee9fd-980c-45b2-96a8-5515e3364283\") " pod="openshift-console/console-cff97b4b7-kp8c7"
Sep 18 04:13:02.605227 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:02.605084    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7b4ee9fd-980c-45b2-96a8-5515e3364283-oauth-serving-cert\") pod \"console-cff97b4b7-kp8c7\" (UID: \"7b4ee9fd-980c-45b2-96a8-5515e3364283\") " pod="openshift-console/console-cff97b4b7-kp8c7"
Sep 18 04:13:02.605227 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:02.605186    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7b4ee9fd-980c-45b2-96a8-5515e3364283-service-ca\") pod \"console-cff97b4b7-kp8c7\" (UID: \"7b4ee9fd-980c-45b2-96a8-5515e3364283\") " pod="openshift-console/console-cff97b4b7-kp8c7"
Sep 18 04:13:02.605343 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:02.605241    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b4ee9fd-980c-45b2-96a8-5515e3364283-trusted-ca-bundle\") pod \"console-cff97b4b7-kp8c7\" (UID: \"7b4ee9fd-980c-45b2-96a8-5515e3364283\") " pod="openshift-console/console-cff97b4b7-kp8c7"
Sep 18 04:13:02.605343 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:02.605319    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzsrh\" (UniqueName: \"kubernetes.io/projected/7b4ee9fd-980c-45b2-96a8-5515e3364283-kube-api-access-dzsrh\") pod \"console-cff97b4b7-kp8c7\" (UID: \"7b4ee9fd-980c-45b2-96a8-5515e3364283\") " pod="openshift-console/console-cff97b4b7-kp8c7"
Sep 18 04:13:02.605467 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:02.605345    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7b4ee9fd-980c-45b2-96a8-5515e3364283-console-oauth-config\") pod \"console-cff97b4b7-kp8c7\" (UID: \"7b4ee9fd-980c-45b2-96a8-5515e3364283\") " pod="openshift-console/console-cff97b4b7-kp8c7"
Sep 18 04:13:02.605467 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:02.605414    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hwldg\" (UniqueName: \"kubernetes.io/projected/cf5af72b-d626-47ac-bcbb-77458b580e83-kube-api-access-hwldg\") on node \"ip-10-0-129-207.ec2.internal\" DevicePath \"\""
Sep 18 04:13:02.706114 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:02.706083    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7b4ee9fd-980c-45b2-96a8-5515e3364283-service-ca\") pod \"console-cff97b4b7-kp8c7\" (UID: \"7b4ee9fd-980c-45b2-96a8-5515e3364283\") " pod="openshift-console/console-cff97b4b7-kp8c7"
Sep 18 04:13:02.706262 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:02.706127    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b4ee9fd-980c-45b2-96a8-5515e3364283-trusted-ca-bundle\") pod \"console-cff97b4b7-kp8c7\" (UID: \"7b4ee9fd-980c-45b2-96a8-5515e3364283\") " pod="openshift-console/console-cff97b4b7-kp8c7"
Sep 18 04:13:02.706262 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:02.706172    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzsrh\" (UniqueName: \"kubernetes.io/projected/7b4ee9fd-980c-45b2-96a8-5515e3364283-kube-api-access-dzsrh\") pod \"console-cff97b4b7-kp8c7\" (UID: \"7b4ee9fd-980c-45b2-96a8-5515e3364283\") " pod="openshift-console/console-cff97b4b7-kp8c7"
Sep 18 04:13:02.706262 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:02.706189    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7b4ee9fd-980c-45b2-96a8-5515e3364283-console-oauth-config\") pod \"console-cff97b4b7-kp8c7\" (UID: \"7b4ee9fd-980c-45b2-96a8-5515e3364283\") " pod="openshift-console/console-cff97b4b7-kp8c7"
Sep 18 04:13:02.706262 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:02.706216    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7b4ee9fd-980c-45b2-96a8-5515e3364283-console-serving-cert\") pod \"console-cff97b4b7-kp8c7\" (UID: \"7b4ee9fd-980c-45b2-96a8-5515e3364283\") " pod="openshift-console/console-cff97b4b7-kp8c7"
Sep 18 04:13:02.706262 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:02.706236    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7b4ee9fd-980c-45b2-96a8-5515e3364283-console-config\") pod \"console-cff97b4b7-kp8c7\" (UID: \"7b4ee9fd-980c-45b2-96a8-5515e3364283\") " pod="openshift-console/console-cff97b4b7-kp8c7"
Sep 18 04:13:02.706556 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:02.706396    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7b4ee9fd-980c-45b2-96a8-5515e3364283-oauth-serving-cert\") pod \"console-cff97b4b7-kp8c7\" (UID: \"7b4ee9fd-980c-45b2-96a8-5515e3364283\") " pod="openshift-console/console-cff97b4b7-kp8c7"
Sep 18 04:13:02.706962 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:02.706935    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7b4ee9fd-980c-45b2-96a8-5515e3364283-service-ca\") pod \"console-cff97b4b7-kp8c7\" (UID: \"7b4ee9fd-980c-45b2-96a8-5515e3364283\") " pod="openshift-console/console-cff97b4b7-kp8c7"
Sep 18 04:13:02.707060 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:02.707024    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7b4ee9fd-980c-45b2-96a8-5515e3364283-console-config\") pod \"console-cff97b4b7-kp8c7\" (UID: \"7b4ee9fd-980c-45b2-96a8-5515e3364283\") " pod="openshift-console/console-cff97b4b7-kp8c7"
Sep 18 04:13:02.707117 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:02.707093    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7b4ee9fd-980c-45b2-96a8-5515e3364283-oauth-serving-cert\") pod \"console-cff97b4b7-kp8c7\" (UID: \"7b4ee9fd-980c-45b2-96a8-5515e3364283\") " pod="openshift-console/console-cff97b4b7-kp8c7"
Sep 18 04:13:02.707156 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:02.707114    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b4ee9fd-980c-45b2-96a8-5515e3364283-trusted-ca-bundle\") pod \"console-cff97b4b7-kp8c7\" (UID: \"7b4ee9fd-980c-45b2-96a8-5515e3364283\") " pod="openshift-console/console-cff97b4b7-kp8c7"
Sep 18 04:13:02.708636 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:02.708613    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7b4ee9fd-980c-45b2-96a8-5515e3364283-console-oauth-config\") pod \"console-cff97b4b7-kp8c7\" (UID: \"7b4ee9fd-980c-45b2-96a8-5515e3364283\") " pod="openshift-console/console-cff97b4b7-kp8c7"
Sep 18 04:13:02.708783 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:02.708765    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7b4ee9fd-980c-45b2-96a8-5515e3364283-console-serving-cert\") pod \"console-cff97b4b7-kp8c7\" (UID: \"7b4ee9fd-980c-45b2-96a8-5515e3364283\") " pod="openshift-console/console-cff97b4b7-kp8c7"
Sep 18 04:13:02.717132 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:02.717106    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzsrh\" (UniqueName: \"kubernetes.io/projected/7b4ee9fd-980c-45b2-96a8-5515e3364283-kube-api-access-dzsrh\") pod \"console-cff97b4b7-kp8c7\" (UID: \"7b4ee9fd-980c-45b2-96a8-5515e3364283\") " pod="openshift-console/console-cff97b4b7-kp8c7"
Sep 18 04:13:02.722328 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:02.722306    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:13:02.788916 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:02.788867    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:13:02.828127 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:02.828096    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cff97b4b7-kp8c7"
Sep 18 04:13:03.007511 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:03.007468    2585 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-qbdbv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.25:15021/healthz/ready\": dial tcp 10.132.0.25:15021: connect: connection refused" start-of-body=
Sep 18 04:13:03.007698 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:03.007525    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qbdbv" podUID="3d248c16-db7b-4d6d-ae14-4a321609e0ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.25:15021/healthz/ready\": dial tcp 10.132.0.25:15021: connect: connection refused"
Sep 18 04:13:03.100549 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:03.100515    2585 generic.go:356] "Generic (PLEG): container finished" podID="cf5af72b-d626-47ac-bcbb-77458b580e83" containerID="1a8e0440dcc80df125370210ca9eb20a9446c39011ef96a42e053ec4143e7a1b" exitCode=0
Sep 18 04:13:03.101030 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:03.100564    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54cd978956-khsct"
Sep 18 04:13:03.101030 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:03.100592    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-54cd978956-khsct" event={"ID":"cf5af72b-d626-47ac-bcbb-77458b580e83","Type":"ContainerDied","Data":"1a8e0440dcc80df125370210ca9eb20a9446c39011ef96a42e053ec4143e7a1b"}
Sep 18 04:13:03.101030 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:03.100632    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-54cd978956-khsct" event={"ID":"cf5af72b-d626-47ac-bcbb-77458b580e83","Type":"ContainerDied","Data":"c178be9e8eafb6fb4b59960ec41d311e8d5e1f3e8ce46a9e5b3d60d99b04abf8"}
Sep 18 04:13:03.101030 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:03.100652    2585 scope.go:117] "RemoveContainer" containerID="1a8e0440dcc80df125370210ca9eb20a9446c39011ef96a42e053ec4143e7a1b"
Sep 18 04:13:03.110121 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:03.110096    2585 scope.go:117] "RemoveContainer" containerID="1a8e0440dcc80df125370210ca9eb20a9446c39011ef96a42e053ec4143e7a1b"
Sep 18 04:13:03.110406 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:13:03.110388    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a8e0440dcc80df125370210ca9eb20a9446c39011ef96a42e053ec4143e7a1b\": container with ID starting with 1a8e0440dcc80df125370210ca9eb20a9446c39011ef96a42e053ec4143e7a1b not found: ID does not exist" containerID="1a8e0440dcc80df125370210ca9eb20a9446c39011ef96a42e053ec4143e7a1b"
Sep 18 04:13:03.110471 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:03.110412    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a8e0440dcc80df125370210ca9eb20a9446c39011ef96a42e053ec4143e7a1b"} err="failed to get container status \"1a8e0440dcc80df125370210ca9eb20a9446c39011ef96a42e053ec4143e7a1b\": rpc error: code = NotFound desc = could not find container \"1a8e0440dcc80df125370210ca9eb20a9446c39011ef96a42e053ec4143e7a1b\": container with ID starting with 1a8e0440dcc80df125370210ca9eb20a9446c39011ef96a42e053ec4143e7a1b not found: ID does not exist"
Sep 18 04:13:03.120793 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:03.120770    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cff97b4b7-kp8c7"]
Sep 18 04:13:03.122667 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:13:03.122640    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b4ee9fd_980c_45b2_96a8_5515e3364283.slice/crio-292ee4c16020c637b2d8832260ecafc79dad5a11f2a600d50c27968bf1795b7d WatchSource:0}: Error finding container 292ee4c16020c637b2d8832260ecafc79dad5a11f2a600d50c27968bf1795b7d: Status 404 returned error can't find the container with id 292ee4c16020c637b2d8832260ecafc79dad5a11f2a600d50c27968bf1795b7d
Sep 18 04:13:03.126890 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:03.126868    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-54cd978956-khsct"]
Sep 18 04:13:03.144675 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:03.144507    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-54cd978956-khsct"]
Sep 18 04:13:03.283028 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:03.282982    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:13:03.339924 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:03.339819    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:13:04.007868 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:04.007828    2585 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-qbdbv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.25:15021/healthz/ready\": dial tcp 10.132.0.25:15021: connect: connection refused" start-of-body=
Sep 18 04:13:04.008082 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:04.007884    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qbdbv" podUID="3d248c16-db7b-4d6d-ae14-4a321609e0ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.25:15021/healthz/ready\": dial tcp 10.132.0.25:15021: connect: connection refused"
Sep 18 04:13:04.062855 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:04.062818    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf5af72b-d626-47ac-bcbb-77458b580e83" path="/var/lib/kubelet/pods/cf5af72b-d626-47ac-bcbb-77458b580e83/volumes"
Sep 18 04:13:04.106871 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:04.106830    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cff97b4b7-kp8c7" event={"ID":"7b4ee9fd-980c-45b2-96a8-5515e3364283","Type":"ContainerStarted","Data":"70f24984d9297f32b20796e9d42416aa8932557e20934674bfdf52fd18ea34fe"}
Sep 18 04:13:04.107348 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:04.106883    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cff97b4b7-kp8c7" event={"ID":"7b4ee9fd-980c-45b2-96a8-5515e3364283","Type":"ContainerStarted","Data":"292ee4c16020c637b2d8832260ecafc79dad5a11f2a600d50c27968bf1795b7d"}
Sep 18 04:13:04.127972 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:04.127889    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-cff97b4b7-kp8c7" podStartSLOduration=2.127875421 podStartE2EDuration="2.127875421s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:13:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:13:04.126945514 +0000 UTC m=+418.584388484" watchObservedRunningTime="2026-09-18 04:13:04.127875421 +0000 UTC m=+418.585318390"
Sep 18 04:13:05.011717 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:05.011686    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qbdbv"
Sep 18 04:13:05.012029 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:05.012006    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qbdbv"
Sep 18 04:13:05.012580 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:05.012562    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qbdbv"
Sep 18 04:13:07.091689 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:07.091651    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-79c6fd8665-7gs6w"]
Sep 18 04:13:07.092127 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:07.091940    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-79c6fd8665-7gs6w" podUID="5184c282-e5cf-4cd0-b678-7f8ba4c20841" containerName="maas-api" containerID="cri-o://62d0787bcc86d6b5fffaacd600ec02814b49e9a4dc7aacb9bcdabaec004db193" gracePeriod=30
Sep 18 04:13:07.339378 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:07.339348    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-79c6fd8665-7gs6w"
Sep 18 04:13:07.449033 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:07.448959    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9dvkw\" (UniqueName: \"kubernetes.io/projected/5184c282-e5cf-4cd0-b678-7f8ba4c20841-kube-api-access-9dvkw\") pod \"5184c282-e5cf-4cd0-b678-7f8ba4c20841\" (UID: \"5184c282-e5cf-4cd0-b678-7f8ba4c20841\") "
Sep 18 04:13:07.449033 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:07.449011    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5184c282-e5cf-4cd0-b678-7f8ba4c20841-maas-api-tls\") pod \"5184c282-e5cf-4cd0-b678-7f8ba4c20841\" (UID: \"5184c282-e5cf-4cd0-b678-7f8ba4c20841\") "
Sep 18 04:13:07.449218 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:07.449088    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5184c282-e5cf-4cd0-b678-7f8ba4c20841-openshift-service-ca\") pod \"5184c282-e5cf-4cd0-b678-7f8ba4c20841\" (UID: \"5184c282-e5cf-4cd0-b678-7f8ba4c20841\") "
Sep 18 04:13:07.449218 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:07.449164    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5184c282-e5cf-4cd0-b678-7f8ba4c20841-metrics-certs\") pod \"5184c282-e5cf-4cd0-b678-7f8ba4c20841\" (UID: \"5184c282-e5cf-4cd0-b678-7f8ba4c20841\") "
Sep 18 04:13:07.449457 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:07.449427    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5184c282-e5cf-4cd0-b678-7f8ba4c20841-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5184c282-e5cf-4cd0-b678-7f8ba4c20841" (UID: "5184c282-e5cf-4cd0-b678-7f8ba4c20841"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 04:13:07.451331 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:07.451305    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5184c282-e5cf-4cd0-b678-7f8ba4c20841-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "5184c282-e5cf-4cd0-b678-7f8ba4c20841" (UID: "5184c282-e5cf-4cd0-b678-7f8ba4c20841"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 04:13:07.451421 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:07.451378    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5184c282-e5cf-4cd0-b678-7f8ba4c20841-kube-api-access-9dvkw" (OuterVolumeSpecName: "kube-api-access-9dvkw") pod "5184c282-e5cf-4cd0-b678-7f8ba4c20841" (UID: "5184c282-e5cf-4cd0-b678-7f8ba4c20841"). InnerVolumeSpecName "kube-api-access-9dvkw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 04:13:07.451421 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:07.451383    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5184c282-e5cf-4cd0-b678-7f8ba4c20841-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5184c282-e5cf-4cd0-b678-7f8ba4c20841" (UID: "5184c282-e5cf-4cd0-b678-7f8ba4c20841"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 04:13:07.550488 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:07.550458    2585 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5184c282-e5cf-4cd0-b678-7f8ba4c20841-openshift-service-ca\") on node \"ip-10-0-129-207.ec2.internal\" DevicePath \"\""
Sep 18 04:13:07.550488 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:07.550482    2585 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5184c282-e5cf-4cd0-b678-7f8ba4c20841-metrics-certs\") on node \"ip-10-0-129-207.ec2.internal\" DevicePath \"\""
Sep 18 04:13:07.550488 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:07.550493    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9dvkw\" (UniqueName: \"kubernetes.io/projected/5184c282-e5cf-4cd0-b678-7f8ba4c20841-kube-api-access-9dvkw\") on node \"ip-10-0-129-207.ec2.internal\" DevicePath \"\""
Sep 18 04:13:07.550671 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:07.550501    2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5184c282-e5cf-4cd0-b678-7f8ba4c20841-maas-api-tls\") on node \"ip-10-0-129-207.ec2.internal\" DevicePath \"\""
Sep 18 04:13:08.128995 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:08.128958    2585 generic.go:356] "Generic (PLEG): container finished" podID="5184c282-e5cf-4cd0-b678-7f8ba4c20841" containerID="62d0787bcc86d6b5fffaacd600ec02814b49e9a4dc7aacb9bcdabaec004db193" exitCode=0
Sep 18 04:13:08.129384 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:08.129004    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-79c6fd8665-7gs6w"
Sep 18 04:13:08.129384 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:08.129042    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-79c6fd8665-7gs6w" event={"ID":"5184c282-e5cf-4cd0-b678-7f8ba4c20841","Type":"ContainerDied","Data":"62d0787bcc86d6b5fffaacd600ec02814b49e9a4dc7aacb9bcdabaec004db193"}
Sep 18 04:13:08.129384 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:08.129101    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-79c6fd8665-7gs6w" event={"ID":"5184c282-e5cf-4cd0-b678-7f8ba4c20841","Type":"ContainerDied","Data":"9b49525a34bca8fdda094dcaee2f407514094d60c65ff07e0307aaabe31e5a11"}
Sep 18 04:13:08.129384 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:08.129124    2585 scope.go:117] "RemoveContainer" containerID="62d0787bcc86d6b5fffaacd600ec02814b49e9a4dc7aacb9bcdabaec004db193"
Sep 18 04:13:08.140049 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:08.140025    2585 scope.go:117] "RemoveContainer" containerID="62d0787bcc86d6b5fffaacd600ec02814b49e9a4dc7aacb9bcdabaec004db193"
Sep 18 04:13:08.140391 ip-10-0-129-207 kubenswrapper[2585]: E0918 04:13:08.140370    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62d0787bcc86d6b5fffaacd600ec02814b49e9a4dc7aacb9bcdabaec004db193\": container with ID starting with 62d0787bcc86d6b5fffaacd600ec02814b49e9a4dc7aacb9bcdabaec004db193 not found: ID does not exist" containerID="62d0787bcc86d6b5fffaacd600ec02814b49e9a4dc7aacb9bcdabaec004db193"
Sep 18 04:13:08.140479 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:08.140398    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62d0787bcc86d6b5fffaacd600ec02814b49e9a4dc7aacb9bcdabaec004db193"} err="failed to get container status \"62d0787bcc86d6b5fffaacd600ec02814b49e9a4dc7aacb9bcdabaec004db193\": rpc error: code = NotFound desc = could not find container \"62d0787bcc86d6b5fffaacd600ec02814b49e9a4dc7aacb9bcdabaec004db193\": container with ID starting with 62d0787bcc86d6b5fffaacd600ec02814b49e9a4dc7aacb9bcdabaec004db193 not found: ID does not exist"
Sep 18 04:13:08.153489 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:08.153464    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-79c6fd8665-7gs6w"]
Sep 18 04:13:08.157143 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:08.157122    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-79c6fd8665-7gs6w"]
Sep 18 04:13:10.063455 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:10.063421    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5184c282-e5cf-4cd0-b678-7f8ba4c20841" path="/var/lib/kubelet/pods/5184c282-e5cf-4cd0-b678-7f8ba4c20841/volumes"
Sep 18 04:13:12.828787 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:12.828748    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-cff97b4b7-kp8c7"
Sep 18 04:13:12.829173 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:12.828816    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-cff97b4b7-kp8c7"
Sep 18 04:13:12.833694 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:12.833671    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-cff97b4b7-kp8c7"
Sep 18 04:13:12.946863 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:12.946831    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:13:13.022428 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:13.022396    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:13:13.160225 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:13.160142    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-cff97b4b7-kp8c7"
Sep 18 04:13:13.338056 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:13.338021    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:13:13.438654 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:13.438572    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:13:13.514093 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:13.514057    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:13:23.022246 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:13:23.022217    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-78f7d99c47-4pmfd"
Sep 18 04:14:01.403480 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:14:01.403438    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:14:01.501878 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:14:01.501842    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:14:19.498556 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:14:19.498505    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-dlkbw"]
Sep 18 04:14:19.499193 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:14:19.499173    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5184c282-e5cf-4cd0-b678-7f8ba4c20841" containerName="maas-api"
Sep 18 04:14:19.499281 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:14:19.499195    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="5184c282-e5cf-4cd0-b678-7f8ba4c20841" containerName="maas-api"
Sep 18 04:14:19.499359 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:14:19.499346    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="5184c282-e5cf-4cd0-b678-7f8ba4c20841" containerName="maas-api"
Sep 18 04:14:19.503889 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:14:19.503868    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-dlkbw"
Sep 18 04:14:19.507489 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:14:19.507467    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 18 04:14:19.507635 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:14:19.507512    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-vpnt7\""
Sep 18 04:14:19.507635 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:14:19.507568    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 18 04:14:19.507635 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:14:19.507578    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 18 04:14:19.514852 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:14:19.514829    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-dlkbw"]
Sep 18 04:14:19.534107 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:14:19.534068    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:14:19.593893 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:14:19.593859    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcjp5\" (UniqueName: \"kubernetes.io/projected/d66bbc8e-d92e-4e8a-a7ae-878b55b0ff73-kube-api-access-lcjp5\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-dlkbw\" (UID: \"d66bbc8e-d92e-4e8a-a7ae-878b55b0ff73\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-dlkbw"
Sep 18 04:14:19.594069 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:14:19.593949    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d66bbc8e-d92e-4e8a-a7ae-878b55b0ff73-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-dlkbw\" (UID: \"d66bbc8e-d92e-4e8a-a7ae-878b55b0ff73\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-dlkbw"
Sep 18 04:14:19.594069 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:14:19.593974    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d66bbc8e-d92e-4e8a-a7ae-878b55b0ff73-dshm\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-dlkbw\" (UID: \"d66bbc8e-d92e-4e8a-a7ae-878b55b0ff73\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-dlkbw"
Sep 18 04:14:19.594069 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:14:19.594004    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d66bbc8e-d92e-4e8a-a7ae-878b55b0ff73-model-cache\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-dlkbw\" (UID: \"d66bbc8e-d92e-4e8a-a7ae-878b55b0ff73\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-dlkbw"
Sep 18 04:14:19.594179 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:14:19.594072    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d66bbc8e-d92e-4e8a-a7ae-878b55b0ff73-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-dlkbw\" (UID: \"d66bbc8e-d92e-4e8a-a7ae-878b55b0ff73\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-dlkbw"
Sep 18 04:14:19.594179 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:14:19.594096    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d66bbc8e-d92e-4e8a-a7ae-878b55b0ff73-home\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-dlkbw\" (UID: \"d66bbc8e-d92e-4e8a-a7ae-878b55b0ff73\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-dlkbw"
Sep 18 04:14:19.694887 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:14:19.694843    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d66bbc8e-d92e-4e8a-a7ae-878b55b0ff73-model-cache\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-dlkbw\" (UID: \"d66bbc8e-d92e-4e8a-a7ae-878b55b0ff73\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-dlkbw"
Sep 18 04:14:19.695107 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:14:19.694978    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d66bbc8e-d92e-4e8a-a7ae-878b55b0ff73-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-dlkbw\" (UID: \"d66bbc8e-d92e-4e8a-a7ae-878b55b0ff73\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-dlkbw"
Sep 18 04:14:19.695107 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:14:19.695021    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d66bbc8e-d92e-4e8a-a7ae-878b55b0ff73-home\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-dlkbw\" (UID: \"d66bbc8e-d92e-4e8a-a7ae-878b55b0ff73\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-dlkbw"
Sep 18 04:14:19.695107 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:14:19.695090    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcjp5\" (UniqueName: \"kubernetes.io/projected/d66bbc8e-d92e-4e8a-a7ae-878b55b0ff73-kube-api-access-lcjp5\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-dlkbw\" (UID: \"d66bbc8e-d92e-4e8a-a7ae-878b55b0ff73\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-dlkbw"
Sep 18 04:14:19.695270 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:14:19.695150    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d66bbc8e-d92e-4e8a-a7ae-878b55b0ff73-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-dlkbw\" (UID: \"d66bbc8e-d92e-4e8a-a7ae-878b55b0ff73\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-dlkbw"
Sep 18 04:14:19.695270 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:14:19.695181    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d66bbc8e-d92e-4e8a-a7ae-878b55b0ff73-dshm\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-dlkbw\" (UID: \"d66bbc8e-d92e-4e8a-a7ae-878b55b0ff73\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-dlkbw"
Sep 18 04:14:19.695270 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:14:19.695245    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d66bbc8e-d92e-4e8a-a7ae-878b55b0ff73-model-cache\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-dlkbw\" (UID: \"d66bbc8e-d92e-4e8a-a7ae-878b55b0ff73\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-dlkbw"
Sep 18 04:14:19.695430 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:14:19.695277    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d66bbc8e-d92e-4e8a-a7ae-878b55b0ff73-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-dlkbw\" (UID: \"d66bbc8e-d92e-4e8a-a7ae-878b55b0ff73\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-dlkbw"
Sep 18 04:14:19.695487 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:14:19.695434    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d66bbc8e-d92e-4e8a-a7ae-878b55b0ff73-home\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-dlkbw\" (UID: \"d66bbc8e-d92e-4e8a-a7ae-878b55b0ff73\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-dlkbw"
Sep 18 04:14:19.697393 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:14:19.697368    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d66bbc8e-d92e-4e8a-a7ae-878b55b0ff73-dshm\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-dlkbw\" (UID: \"d66bbc8e-d92e-4e8a-a7ae-878b55b0ff73\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-dlkbw"
Sep 18 04:14:19.697700 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:14:19.697681    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d66bbc8e-d92e-4e8a-a7ae-878b55b0ff73-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-dlkbw\" (UID: \"d66bbc8e-d92e-4e8a-a7ae-878b55b0ff73\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-dlkbw"
Sep 18 04:14:19.703127 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:14:19.703102    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcjp5\" (UniqueName: \"kubernetes.io/projected/d66bbc8e-d92e-4e8a-a7ae-878b55b0ff73-kube-api-access-lcjp5\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-dlkbw\" (UID: \"d66bbc8e-d92e-4e8a-a7ae-878b55b0ff73\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-dlkbw"
Sep 18 04:14:19.814911 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:14:19.814878    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-dlkbw"
Sep 18 04:14:19.986281 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:14:19.986234    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xcpj4"]
Sep 18 04:14:20.092850 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:14:20.092822    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-dlkbw"]
Sep 18 04:14:20.095189 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:14:20.095147    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd66bbc8e_d92e_4e8a_a7ae_878b55b0ff73.slice/crio-cc7ea2cc63731c2a4c755037bb4fbb97c15bca88e385116e05bdbb76e4efbbbb WatchSource:0}: Error finding container cc7ea2cc63731c2a4c755037bb4fbb97c15bca88e385116e05bdbb76e4efbbbb: Status 404 returned error can't find the container with id cc7ea2cc63731c2a4c755037bb4fbb97c15bca88e385116e05bdbb76e4efbbbb
Sep 18 04:14:20.508546 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:14:20.508451    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-dlkbw" event={"ID":"d66bbc8e-d92e-4e8a-a7ae-878b55b0ff73","Type":"ContainerStarted","Data":"cc7ea2cc63731c2a4c755037bb4fbb97c15bca88e385116e05bdbb76e4efbbbb"}
Sep 18 04:14:21.515922 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:14:21.515859    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-dlkbw" event={"ID":"d66bbc8e-d92e-4e8a-a7ae-878b55b0ff73","Type":"ContainerStarted","Data":"d521cd990d0361f21c61152fad6ee04f22ef0f6650dfe65305f8bc9226790dee"}
Sep 18 04:14:21.534701 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:14:21.534645    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-dlkbw" podStartSLOduration=1.3316776080000001 podStartE2EDuration="2.534630924s" totalImagesPullingTime="1.202953316s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:14:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:14:21.532368052 +0000 UTC m=+495.989811021" watchObservedRunningTime="2026-09-18 04:14:21.534630924 +0000 UTC m=+495.992073893"
Sep 18 04:14:21.815702 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:14:21.815667    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-dlkbw"
Sep 18 04:14:29.815469 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:14:29.815430    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-dlkbw"
Sep 18 04:14:29.827977 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:14:29.827949    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-dlkbw"
Sep 18 04:14:30.573724 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:14:30.573695    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-dlkbw"
Sep 18 04:14:49.474288 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:14:49.474254    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5d57fc946d-fq7cn"]
Sep 18 04:14:49.478931 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:14:49.478911    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-fq7cn"
Sep 18 04:14:49.481352 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:14:49.481330    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 18 04:14:49.485712 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:14:49.485686    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5d57fc946d-fq7cn"]
Sep 18 04:14:49.495972 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:14:49.495946    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:14:49.582655 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:14:49.582618    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8x6k\" (UniqueName: \"kubernetes.io/projected/e5925906-7d4e-459d-a7d3-125bd39eb90e-kube-api-access-p8x6k\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-fq7cn\" (UID: \"e5925906-7d4e-459d-a7d3-125bd39eb90e\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-fq7cn"
Sep 18 04:14:49.582841 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:14:49.582672    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e5925906-7d4e-459d-a7d3-125bd39eb90e-home\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-fq7cn\" (UID: \"e5925906-7d4e-459d-a7d3-125bd39eb90e\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-fq7cn"
Sep 18 04:14:49.582841 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:14:49.582734    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e5925906-7d4e-459d-a7d3-125bd39eb90e-model-cache\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-fq7cn\" (UID: \"e5925906-7d4e-459d-a7d3-125bd39eb90e\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-fq7cn"
Sep 18 04:14:49.582841 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:14:49.582790    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e5925906-7d4e-459d-a7d3-125bd39eb90e-dshm\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-fq7cn\" (UID: \"e5925906-7d4e-459d-a7d3-125bd39eb90e\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-fq7cn"
Sep 18 04:14:49.582841 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:14:49.582806    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5925906-7d4e-459d-a7d3-125bd39eb90e-tls-certs\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-fq7cn\" (UID: \"e5925906-7d4e-459d-a7d3-125bd39eb90e\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-fq7cn"
Sep 18 04:14:49.582841 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:14:49.582830    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5925906-7d4e-459d-a7d3-125bd39eb90e-tmp-dir\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-fq7cn\" (UID: \"e5925906-7d4e-459d-a7d3-125bd39eb90e\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-fq7cn"
Sep 18 04:14:49.683301 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:14:49.683265    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8x6k\" (UniqueName: \"kubernetes.io/projected/e5925906-7d4e-459d-a7d3-125bd39eb90e-kube-api-access-p8x6k\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-fq7cn\" (UID: \"e5925906-7d4e-459d-a7d3-125bd39eb90e\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-fq7cn"
Sep 18 04:14:49.683500 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:14:49.683325    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e5925906-7d4e-459d-a7d3-125bd39eb90e-home\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-fq7cn\" (UID: \"e5925906-7d4e-459d-a7d3-125bd39eb90e\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-fq7cn"
Sep 18 04:14:49.683500 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:14:49.683356    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e5925906-7d4e-459d-a7d3-125bd39eb90e-model-cache\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-fq7cn\" (UID: \"e5925906-7d4e-459d-a7d3-125bd39eb90e\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-fq7cn"
Sep 18 04:14:49.683500 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:14:49.683402    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e5925906-7d4e-459d-a7d3-125bd39eb90e-dshm\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-fq7cn\" (UID: \"e5925906-7d4e-459d-a7d3-125bd39eb90e\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-fq7cn"
Sep 18 04:14:49.683500 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:14:49.683424    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5925906-7d4e-459d-a7d3-125bd39eb90e-tls-certs\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-fq7cn\" (UID: \"e5925906-7d4e-459d-a7d3-125bd39eb90e\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-fq7cn"
Sep 18 04:14:49.683500 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:14:49.683457    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5925906-7d4e-459d-a7d3-125bd39eb90e-tmp-dir\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-fq7cn\" (UID: \"e5925906-7d4e-459d-a7d3-125bd39eb90e\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-fq7cn"
Sep 18 04:14:49.683816 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:14:49.683760    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e5925906-7d4e-459d-a7d3-125bd39eb90e-model-cache\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-fq7cn\" (UID: \"e5925906-7d4e-459d-a7d3-125bd39eb90e\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-fq7cn"
Sep 18 04:14:49.683877 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:14:49.683811    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e5925906-7d4e-459d-a7d3-125bd39eb90e-home\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-fq7cn\" (UID: \"e5925906-7d4e-459d-a7d3-125bd39eb90e\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-fq7cn"
Sep 18 04:14:49.683982 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:14:49.683915    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5925906-7d4e-459d-a7d3-125bd39eb90e-tmp-dir\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-fq7cn\" (UID: \"e5925906-7d4e-459d-a7d3-125bd39eb90e\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-fq7cn"
Sep 18 04:14:49.685682 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:14:49.685658    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e5925906-7d4e-459d-a7d3-125bd39eb90e-dshm\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-fq7cn\" (UID: \"e5925906-7d4e-459d-a7d3-125bd39eb90e\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-fq7cn"
Sep 18 04:14:49.685963 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:14:49.685946    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5925906-7d4e-459d-a7d3-125bd39eb90e-tls-certs\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-fq7cn\" (UID: \"e5925906-7d4e-459d-a7d3-125bd39eb90e\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-fq7cn"
Sep 18 04:14:49.690627 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:14:49.690603    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8x6k\" (UniqueName: \"kubernetes.io/projected/e5925906-7d4e-459d-a7d3-125bd39eb90e-kube-api-access-p8x6k\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-fq7cn\" (UID: \"e5925906-7d4e-459d-a7d3-125bd39eb90e\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-fq7cn"
Sep 18 04:14:49.791686 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:14:49.791650    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-fq7cn"
Sep 18 04:14:50.065554 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:14:50.065525    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5d57fc946d-fq7cn"]
Sep 18 04:14:50.067860 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:14:50.067833    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5925906_7d4e_459d_a7d3_125bd39eb90e.slice/crio-e7f2abd55305ddbe4b19acd8a3a7853d029329557ad1b5e86774e67dc4cede4f WatchSource:0}: Error finding container e7f2abd55305ddbe4b19acd8a3a7853d029329557ad1b5e86774e67dc4cede4f: Status 404 returned error can't find the container with id e7f2abd55305ddbe4b19acd8a3a7853d029329557ad1b5e86774e67dc4cede4f
Sep 18 04:14:50.095728 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:14:50.095693    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xcpj4"]
Sep 18 04:14:50.670568 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:14:50.670530    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-fq7cn" event={"ID":"e5925906-7d4e-459d-a7d3-125bd39eb90e","Type":"ContainerStarted","Data":"598332ab5f94f985ff27900b2d360085e727c6e8ba76abd32db4da2935b410b9"}
Sep 18 04:14:50.670972 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:14:50.670583    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-fq7cn" event={"ID":"e5925906-7d4e-459d-a7d3-125bd39eb90e","Type":"ContainerStarted","Data":"e7f2abd55305ddbe4b19acd8a3a7853d029329557ad1b5e86774e67dc4cede4f"}
Sep 18 04:14:50.792347 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:14:50.792306    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-fq7cn"
Sep 18 04:14:59.792390 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:14:59.792295    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-fq7cn"
Sep 18 04:14:59.805033 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:14:59.804999    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-fq7cn"
Sep 18 04:14:59.824323 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:14:59.824266    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-fq7cn" podStartSLOduration=10.653649632 podStartE2EDuration="10.824250611s" totalImagesPullingTime="170.600979ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:14:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:14:50.687796051 +0000 UTC m=+525.145239040" watchObservedRunningTime="2026-09-18 04:14:59.824250611 +0000 UTC m=+534.281693579"
Sep 18 04:15:00.731727 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:15:00.731695    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-fq7cn"
Sep 18 04:15:14.791455 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:15:14.791421    2585 generic.go:356] "Generic (PLEG): container finished" podID="73b6a921-ab82-44b4-a3fb-c6626a9d94c1" containerID="2c88ff1c4ab961b23cb66d759c6909b4c06ad0d4fc174c73de85ef6dd9e98f36" exitCode=1
Sep 18 04:15:14.791885 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:15:14.791502    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b449b7679-hlvr5" event={"ID":"73b6a921-ab82-44b4-a3fb-c6626a9d94c1","Type":"ContainerDied","Data":"2c88ff1c4ab961b23cb66d759c6909b4c06ad0d4fc174c73de85ef6dd9e98f36"}
Sep 18 04:15:14.791885 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:15:14.791795    2585 scope.go:117] "RemoveContainer" containerID="2c88ff1c4ab961b23cb66d759c6909b4c06ad0d4fc174c73de85ef6dd9e98f36"
Sep 18 04:15:15.016797 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:15:15.016761    2585 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kuadrant-system/dns-operator-controller-manager-7b449b7679-hlvr5"
Sep 18 04:15:15.799489 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:15:15.799454    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b449b7679-hlvr5" event={"ID":"73b6a921-ab82-44b4-a3fb-c6626a9d94c1","Type":"ContainerStarted","Data":"1a048bbda723c2412e8d3ddd7f4ed3d2b03093efd6520dc60eeae6a3d70a1d79"}
Sep 18 04:15:15.799938 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:15:15.799542    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b449b7679-hlvr5"
Sep 18 04:15:18.701633 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:15:18.701598    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:15:20.087165 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:15:20.087129    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xcpj4"]
Sep 18 04:15:24.821215 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:15:24.821177    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:15:26.590249 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:15:26.590210    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xcpj4"]
Sep 18 04:15:26.807772 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:15:26.807740    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b449b7679-hlvr5"
Sep 18 04:15:40.376346 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:15:40.376308    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfkz5zv"]
Sep 18 04:15:40.380580 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:15:40.380556    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfkz5zv"
Sep 18 04:15:40.383467 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:15:40.383443    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Sep 18 04:15:40.390626 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:15:40.390601    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfkz5zv"]
Sep 18 04:15:40.404921 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:15:40.404871    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:15:40.455905 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:15:40.455869    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d603c6b-e567-42d5-aae0-e5e1e8b62d24-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfkz5zv\" (UID: \"2d603c6b-e567-42d5-aae0-e5e1e8b62d24\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfkz5zv"
Sep 18 04:15:40.456074 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:15:40.455942    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2d603c6b-e567-42d5-aae0-e5e1e8b62d24-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfkz5zv\" (UID: \"2d603c6b-e567-42d5-aae0-e5e1e8b62d24\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfkz5zv"
Sep 18 04:15:40.456074 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:15:40.456039    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d603c6b-e567-42d5-aae0-e5e1e8b62d24-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfkz5zv\" (UID: \"2d603c6b-e567-42d5-aae0-e5e1e8b62d24\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfkz5zv"
Sep 18 04:15:40.456156 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:15:40.456079    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rd4w2\" (UniqueName: \"kubernetes.io/projected/2d603c6b-e567-42d5-aae0-e5e1e8b62d24-kube-api-access-rd4w2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfkz5zv\" (UID: \"2d603c6b-e567-42d5-aae0-e5e1e8b62d24\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfkz5zv"
Sep 18 04:15:40.456156 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:15:40.456097    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2d603c6b-e567-42d5-aae0-e5e1e8b62d24-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfkz5zv\" (UID: \"2d603c6b-e567-42d5-aae0-e5e1e8b62d24\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfkz5zv"
Sep 18 04:15:40.456221 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:15:40.456146    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2d603c6b-e567-42d5-aae0-e5e1e8b62d24-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfkz5zv\" (UID: \"2d603c6b-e567-42d5-aae0-e5e1e8b62d24\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfkz5zv"
Sep 18 04:15:40.557116 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:15:40.557073    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d603c6b-e567-42d5-aae0-e5e1e8b62d24-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfkz5zv\" (UID: \"2d603c6b-e567-42d5-aae0-e5e1e8b62d24\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfkz5zv"
Sep 18 04:15:40.557329 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:15:40.557138    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rd4w2\" (UniqueName: \"kubernetes.io/projected/2d603c6b-e567-42d5-aae0-e5e1e8b62d24-kube-api-access-rd4w2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfkz5zv\" (UID: \"2d603c6b-e567-42d5-aae0-e5e1e8b62d24\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfkz5zv"
Sep 18 04:15:40.557329 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:15:40.557167    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2d603c6b-e567-42d5-aae0-e5e1e8b62d24-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfkz5zv\" (UID: \"2d603c6b-e567-42d5-aae0-e5e1e8b62d24\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfkz5zv"
Sep 18 04:15:40.557329 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:15:40.557191    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2d603c6b-e567-42d5-aae0-e5e1e8b62d24-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfkz5zv\" (UID: \"2d603c6b-e567-42d5-aae0-e5e1e8b62d24\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfkz5zv"
Sep 18 04:15:40.557329 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:15:40.557238    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d603c6b-e567-42d5-aae0-e5e1e8b62d24-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfkz5zv\" (UID: \"2d603c6b-e567-42d5-aae0-e5e1e8b62d24\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfkz5zv"
Sep 18 04:15:40.557329 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:15:40.557284    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2d603c6b-e567-42d5-aae0-e5e1e8b62d24-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfkz5zv\" (UID: \"2d603c6b-e567-42d5-aae0-e5e1e8b62d24\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfkz5zv"
Sep 18 04:15:40.557695 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:15:40.557657    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2d603c6b-e567-42d5-aae0-e5e1e8b62d24-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfkz5zv\" (UID: \"2d603c6b-e567-42d5-aae0-e5e1e8b62d24\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfkz5zv"
Sep 18 04:15:40.557808 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:15:40.557671    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d603c6b-e567-42d5-aae0-e5e1e8b62d24-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfkz5zv\" (UID: \"2d603c6b-e567-42d5-aae0-e5e1e8b62d24\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfkz5zv"
Sep 18 04:15:40.557808 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:15:40.557697    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2d603c6b-e567-42d5-aae0-e5e1e8b62d24-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfkz5zv\" (UID: \"2d603c6b-e567-42d5-aae0-e5e1e8b62d24\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfkz5zv"
Sep 18 04:15:40.559513 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:15:40.559491    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2d603c6b-e567-42d5-aae0-e5e1e8b62d24-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfkz5zv\" (UID: \"2d603c6b-e567-42d5-aae0-e5e1e8b62d24\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfkz5zv"
Sep 18 04:15:40.559690 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:15:40.559672    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d603c6b-e567-42d5-aae0-e5e1e8b62d24-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfkz5zv\" (UID: \"2d603c6b-e567-42d5-aae0-e5e1e8b62d24\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfkz5zv"
Sep 18 04:15:40.565312 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:15:40.565287    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rd4w2\" (UniqueName: \"kubernetes.io/projected/2d603c6b-e567-42d5-aae0-e5e1e8b62d24-kube-api-access-rd4w2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfkz5zv\" (UID: \"2d603c6b-e567-42d5-aae0-e5e1e8b62d24\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfkz5zv"
Sep 18 04:15:40.693780 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:15:40.693679    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfkz5zv"
Sep 18 04:15:40.969991 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:15:40.969959    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfkz5zv"]
Sep 18 04:15:40.972605 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:15:40.972560    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d603c6b_e567_42d5_aae0_e5e1e8b62d24.slice/crio-294b6df6832b1d4ff7f8806bc132906edfacb2b3da2c24da188263ad99f3ac4b WatchSource:0}: Error finding container 294b6df6832b1d4ff7f8806bc132906edfacb2b3da2c24da188263ad99f3ac4b: Status 404 returned error can't find the container with id 294b6df6832b1d4ff7f8806bc132906edfacb2b3da2c24da188263ad99f3ac4b
Sep 18 04:15:41.943755 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:15:41.943716    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfkz5zv" event={"ID":"2d603c6b-e567-42d5-aae0-e5e1e8b62d24","Type":"ContainerStarted","Data":"c856f54b8e61a7c8b17274887cbd2124220c53d0a8cb38ccf20bc77be0dbc19e"}
Sep 18 04:15:41.944203 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:15:41.943773    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfkz5zv" event={"ID":"2d603c6b-e567-42d5-aae0-e5e1e8b62d24","Type":"ContainerStarted","Data":"294b6df6832b1d4ff7f8806bc132906edfacb2b3da2c24da188263ad99f3ac4b"}
Sep 18 04:15:41.963745 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:15:41.963685    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfkz5zv" podStartSLOduration=1.7910080929999999 podStartE2EDuration="1.963665051s" totalImagesPullingTime="172.656958ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:15:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:15:41.96048755 +0000 UTC m=+576.417930519" watchObservedRunningTime="2026-09-18 04:15:41.963665051 +0000 UTC m=+576.421108021"
Sep 18 04:15:42.693815 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:15:42.693783    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfkz5zv"
Sep 18 04:15:42.783417 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:15:42.783380    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xcpj4"]
Sep 18 04:15:50.694748 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:15:50.694713    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfkz5zv"
Sep 18 04:15:50.707266 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:15:50.707237    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfkz5zv"
Sep 18 04:15:51.003391 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:15:51.003300    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfkz5zv"
Sep 18 04:16:06.002098 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:16:06.002068    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-jxtk4_6d42c4e4-9bc8-4aa3-8056-c871229383e2/console-operator/1.log"
Sep 18 04:16:06.005141 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:16:06.005114    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-jxtk4_6d42c4e4-9bc8-4aa3-8056-c871229383e2/console-operator/1.log"
Sep 18 04:16:12.303478 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:16:12.303443    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:16:15.288670 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:16:15.288633    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xcpj4"]
Sep 18 04:16:26.806158 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:16:26.806113    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:16:30.503211 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:16:30.503125    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xcpj4"]
Sep 18 04:16:44.100435 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:16:44.100394    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:16:44.155477 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:16:44.155440    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:16:44.219649 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:16:44.219622    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:16:56.736332 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:16:56.736295    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:16:58.041882 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:16:58.041843    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:17:09.851444 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:17:09.851406    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:17:09.918445 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:17:09.918409    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:18:10.759803 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:18:10.759714    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:18:10.827691 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:18:10.827649    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:19:14.334044 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:19:14.334008    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:20:31.173481 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:20:31.173441    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:21:06.038101 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:21:06.038023    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-jxtk4_6d42c4e4-9bc8-4aa3-8056-c871229383e2/console-operator/1.log"
Sep 18 04:21:06.038722 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:21:06.038355    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-jxtk4_6d42c4e4-9bc8-4aa3-8056-c871229383e2/console-operator/1.log"
Sep 18 04:22:18.910384 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:18.910357    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-85cbcd4954-pd9g4_49996cfe-9e97-4e95-98b9-69817e9ba977/manager/0.log"
Sep 18 04:22:19.274555 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:19.274461    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-95b676546-v9qm4_4b555d5a-3f8b-4671-a2bf-4cd002afd0a9/authorino/0.log"
Sep 18 04:22:24.675608 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:24.675578    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-54765d59fd-g2vkd_477814cd-44b9-4c09-82ba-051664f4805c/manager/0.log"
Sep 18 04:22:24.797079 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:24.797042    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-78f7d99c47-4pmfd_8e4fceb9-0054-4238-8fc5-d92f652c89ec/manager/0.log"
Sep 18 04:22:24.924916 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:24.924865    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-85cbcd4954-pd9g4_49996cfe-9e97-4e95-98b9-69817e9ba977/manager/0.log"
Sep 18 04:22:26.503674 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:26.503641    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-95b676546-v9qm4_4b555d5a-3f8b-4671-a2bf-4cd002afd0a9/authorino/0.log"
Sep 18 04:22:26.615773 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:26.615742    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6c7cb5c9cb-jn5j6_fc7a1c0a-8478-4739-b08f-d2eade2bf342/manager/0.log"
Sep 18 04:22:26.723326 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:26.723290    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b449b7679-hlvr5_73b6a921-ab82-44b4-a3fb-c6626a9d94c1/manager/1.log"
Sep 18 04:22:26.953164 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:26.953135    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-54b6d5c989-7l9sz_e78eff66-320f-44f4-8f2f-c554e30b2eb2/manager/0.log"
Sep 18 04:22:27.063549 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:27.063522    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-xcpj4_d32ceddc-f742-4e3b-8e63-df2592e64dc9/limitador/0.log"
Sep 18 04:22:27.177717 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:27.177633    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6d9b9f85cb-qgcj9_68902f18-1762-44b8-b517-bfe372253106/manager/0.log"
Sep 18 04:22:27.967322 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:27.967290    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-qbdbv_3d248c16-db7b-4d6d-ae14-4a321609e0ba/istio-proxy/1.log"
Sep 18 04:22:28.406426 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:28.406386    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-bdc687fb-txxfd_1e106cea-7104-4002-9041-3ee5f7287967/router/0.log"
Sep 18 04:22:28.757361 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:28.757270    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-5fc5ddd44f-dlkbw_d66bbc8e-d92e-4e8a-a7ae-878b55b0ff73/main/0.log"
Sep 18 04:22:28.871161 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:28.871130    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5d57fc946d-fq7cn_e5925906-7d4e-459d-a7d3-125bd39eb90e/main/0.log"
Sep 18 04:22:29.208414 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:29.208386    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfkz5zv_2d603c6b-e567-42d5-aae0-e5e1e8b62d24/main/0.log"
Sep 18 04:22:35.093516 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:35.093479    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:22:36.114524 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:36.114487    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log" limit=1024
Sep 18 04:22:37.919647 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:37.919614    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-j59zp_6dc80677-6f9c-44fd-8d5f-e3c9f4846191/global-pull-secret-syncer/0.log"
Sep 18 04:22:37.968768 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:37.968736    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-prm5t_c4d1f628-59bf-4e95-92d5-84171d5e04e3/konnectivity-agent/0.log"
Sep 18 04:22:38.045951 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:38.045921    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-207.ec2.internal_208db4364c1c40920f745701e77898f0/haproxy/0.log"
Sep 18 04:22:42.516848 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:42.516747    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-95b676546-v9qm4_4b555d5a-3f8b-4671-a2bf-4cd002afd0a9/authorino/0.log"
Sep 18 04:22:42.543950 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:42.543890    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6c7cb5c9cb-jn5j6_fc7a1c0a-8478-4739-b08f-d2eade2bf342/manager/0.log"
Sep 18 04:22:42.571585 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:42.571553    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b449b7679-hlvr5_73b6a921-ab82-44b4-a3fb-c6626a9d94c1/manager/1.log"
Sep 18 04:22:42.571754 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:42.571695    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b449b7679-hlvr5_73b6a921-ab82-44b4-a3fb-c6626a9d94c1/manager/0.log"
Sep 18 04:22:42.632479 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:42.632450    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-54b6d5c989-7l9sz_e78eff66-320f-44f4-8f2f-c554e30b2eb2/manager/0.log"
Sep 18 04:22:42.670477 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:42.670451    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-xcpj4_d32ceddc-f742-4e3b-8e63-df2592e64dc9/limitador/0.log"
Sep 18 04:22:42.715040 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:42.715006    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6d9b9f85cb-qgcj9_68902f18-1762-44b8-b517-bfe372253106/manager/0.log"
Sep 18 04:22:44.354132 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:44.354101    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-mlmq7_debe327d-65f6-4bfc-96db-19c91dd08d9c/kube-state-metrics/0.log"
Sep 18 04:22:44.371044 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:44.371016    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-mlmq7_debe327d-65f6-4bfc-96db-19c91dd08d9c/kube-rbac-proxy-main/0.log"
Sep 18 04:22:44.390841 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:44.390817    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-mlmq7_debe327d-65f6-4bfc-96db-19c91dd08d9c/kube-rbac-proxy-self/0.log"
Sep 18 04:22:44.445276 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:44.445249    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5984459ff8-dm9zq_9e1ae9d8-4154-48d0-a53c-0f09ccf90ede/monitoring-plugin/0.log"
Sep 18 04:22:44.552136 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:44.552108    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-j2pfg_81470b84-4f5e-4a81-bac4-7dd270719538/node-exporter/0.log"
Sep 18 04:22:44.571804 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:44.571731    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-j2pfg_81470b84-4f5e-4a81-bac4-7dd270719538/kube-rbac-proxy/0.log"
Sep 18 04:22:44.610636 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:44.610613    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-j2pfg_81470b84-4f5e-4a81-bac4-7dd270719538/init-textfile/0.log"
Sep 18 04:22:44.847654 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:44.847573    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_62598b60-531e-4ce4-9a1a-258bbed8cd3d/prometheus/0.log"
Sep 18 04:22:44.873373 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:44.873340    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_62598b60-531e-4ce4-9a1a-258bbed8cd3d/config-reloader/0.log"
Sep 18 04:22:44.895726 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:44.895692    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_62598b60-531e-4ce4-9a1a-258bbed8cd3d/thanos-sidecar/0.log"
Sep 18 04:22:44.917137 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:44.917114    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_62598b60-531e-4ce4-9a1a-258bbed8cd3d/kube-rbac-proxy-web/0.log"
Sep 18 04:22:44.945136 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:44.945107    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_62598b60-531e-4ce4-9a1a-258bbed8cd3d/kube-rbac-proxy/0.log"
Sep 18 04:22:44.966034 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:44.966016    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_62598b60-531e-4ce4-9a1a-258bbed8cd3d/kube-rbac-proxy-thanos/0.log"
Sep 18 04:22:44.986838 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:44.986803    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_62598b60-531e-4ce4-9a1a-258bbed8cd3d/init-config-reloader/0.log"
Sep 18 04:22:45.019706 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:45.019686    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-jzhsw_c9950b8d-784a-4f60-a721-fde6c71f76ba/prometheus-operator/0.log"
Sep 18 04:22:45.040481 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:45.040439    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-jzhsw_c9950b8d-784a-4f60-a721-fde6c71f76ba/kube-rbac-proxy/0.log"
Sep 18 04:22:45.073010 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:45.072986    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5c6747dc7b-fbvn9_351504a9-4a92-4c8f-b340-b73af9db8450/prometheus-operator-admission-webhook/0.log"
Sep 18 04:22:45.216579 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:45.216485    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b644748c9-dwgnr_e2c13eaf-b679-43f5-8e3d-5b22a4ac43af/thanos-query/0.log"
Sep 18 04:22:45.259171 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:45.259145    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b644748c9-dwgnr_e2c13eaf-b679-43f5-8e3d-5b22a4ac43af/kube-rbac-proxy-web/0.log"
Sep 18 04:22:45.280444 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:45.280404    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b644748c9-dwgnr_e2c13eaf-b679-43f5-8e3d-5b22a4ac43af/kube-rbac-proxy/0.log"
Sep 18 04:22:45.301624 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:45.301605    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b644748c9-dwgnr_e2c13eaf-b679-43f5-8e3d-5b22a4ac43af/prom-label-proxy/0.log"
Sep 18 04:22:45.324969 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:45.324949    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b644748c9-dwgnr_e2c13eaf-b679-43f5-8e3d-5b22a4ac43af/kube-rbac-proxy-rules/0.log"
Sep 18 04:22:45.345588 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:45.345566    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b644748c9-dwgnr_e2c13eaf-b679-43f5-8e3d-5b22a4ac43af/kube-rbac-proxy-metrics/0.log"
Sep 18 04:22:47.171793 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:47.171760    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-jxtk4_6d42c4e4-9bc8-4aa3-8056-c871229383e2/console-operator/1.log"
Sep 18 04:22:47.180458 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:47.180434    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-jxtk4_6d42c4e4-9bc8-4aa3-8056-c871229383e2/console-operator/2.log"
Sep 18 04:22:47.194522 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:47.194298    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-h5svb/perf-node-gather-daemonset-d6d58"]
Sep 18 04:22:47.198187 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:47.198171    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-h5svb/perf-node-gather-daemonset-d6d58"
Sep 18 04:22:47.200326 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:47.200303    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-h5svb\"/\"kube-root-ca.crt\""
Sep 18 04:22:47.201289 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:47.201272    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-h5svb\"/\"default-dockercfg-6nqjg\""
Sep 18 04:22:47.201352 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:47.201297    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-h5svb\"/\"openshift-service-ca.crt\""
Sep 18 04:22:47.208147 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:47.208122    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-h5svb/perf-node-gather-daemonset-d6d58"]
Sep 18 04:22:47.217485 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:47.217461    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/16334c3d-24c7-4b35-9f1f-5b1f2bae012f-sys\") pod \"perf-node-gather-daemonset-d6d58\" (UID: \"16334c3d-24c7-4b35-9f1f-5b1f2bae012f\") " pod="openshift-must-gather-h5svb/perf-node-gather-daemonset-d6d58"
Sep 18 04:22:47.217586 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:47.217491    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/16334c3d-24c7-4b35-9f1f-5b1f2bae012f-proc\") pod \"perf-node-gather-daemonset-d6d58\" (UID: \"16334c3d-24c7-4b35-9f1f-5b1f2bae012f\") " pod="openshift-must-gather-h5svb/perf-node-gather-daemonset-d6d58"
Sep 18 04:22:47.217586 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:47.217515    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/16334c3d-24c7-4b35-9f1f-5b1f2bae012f-lib-modules\") pod \"perf-node-gather-daemonset-d6d58\" (UID: \"16334c3d-24c7-4b35-9f1f-5b1f2bae012f\") " pod="openshift-must-gather-h5svb/perf-node-gather-daemonset-d6d58"
Sep 18 04:22:47.217586 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:47.217535    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/16334c3d-24c7-4b35-9f1f-5b1f2bae012f-podres\") pod \"perf-node-gather-daemonset-d6d58\" (UID: \"16334c3d-24c7-4b35-9f1f-5b1f2bae012f\") " pod="openshift-must-gather-h5svb/perf-node-gather-daemonset-d6d58"
Sep 18 04:22:47.217586 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:47.217571    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vx8g\" (UniqueName: \"kubernetes.io/projected/16334c3d-24c7-4b35-9f1f-5b1f2bae012f-kube-api-access-8vx8g\") pod \"perf-node-gather-daemonset-d6d58\" (UID: \"16334c3d-24c7-4b35-9f1f-5b1f2bae012f\") " pod="openshift-must-gather-h5svb/perf-node-gather-daemonset-d6d58"
Sep 18 04:22:47.318853 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:47.318817    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/16334c3d-24c7-4b35-9f1f-5b1f2bae012f-lib-modules\") pod \"perf-node-gather-daemonset-d6d58\" (UID: \"16334c3d-24c7-4b35-9f1f-5b1f2bae012f\") " pod="openshift-must-gather-h5svb/perf-node-gather-daemonset-d6d58"
Sep 18 04:22:47.319048 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:47.318870    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/16334c3d-24c7-4b35-9f1f-5b1f2bae012f-podres\") pod \"perf-node-gather-daemonset-d6d58\" (UID: \"16334c3d-24c7-4b35-9f1f-5b1f2bae012f\") " pod="openshift-must-gather-h5svb/perf-node-gather-daemonset-d6d58"
Sep 18 04:22:47.319048 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:47.318939    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vx8g\" (UniqueName: \"kubernetes.io/projected/16334c3d-24c7-4b35-9f1f-5b1f2bae012f-kube-api-access-8vx8g\") pod \"perf-node-gather-daemonset-d6d58\" (UID: \"16334c3d-24c7-4b35-9f1f-5b1f2bae012f\") " pod="openshift-must-gather-h5svb/perf-node-gather-daemonset-d6d58"
Sep 18 04:22:47.319048 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:47.319015    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/16334c3d-24c7-4b35-9f1f-5b1f2bae012f-lib-modules\") pod \"perf-node-gather-daemonset-d6d58\" (UID: \"16334c3d-24c7-4b35-9f1f-5b1f2bae012f\") " pod="openshift-must-gather-h5svb/perf-node-gather-daemonset-d6d58"
Sep 18 04:22:47.319048 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:47.319039    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/16334c3d-24c7-4b35-9f1f-5b1f2bae012f-sys\") pod \"perf-node-gather-daemonset-d6d58\" (UID: \"16334c3d-24c7-4b35-9f1f-5b1f2bae012f\") " pod="openshift-must-gather-h5svb/perf-node-gather-daemonset-d6d58"
Sep 18 04:22:47.319230 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:47.319056    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/16334c3d-24c7-4b35-9f1f-5b1f2bae012f-podres\") pod \"perf-node-gather-daemonset-d6d58\" (UID: \"16334c3d-24c7-4b35-9f1f-5b1f2bae012f\") " pod="openshift-must-gather-h5svb/perf-node-gather-daemonset-d6d58"
Sep 18 04:22:47.319230 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:47.319070    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/16334c3d-24c7-4b35-9f1f-5b1f2bae012f-proc\") pod \"perf-node-gather-daemonset-d6d58\" (UID: \"16334c3d-24c7-4b35-9f1f-5b1f2bae012f\") " pod="openshift-must-gather-h5svb/perf-node-gather-daemonset-d6d58"
Sep 18 04:22:47.319230 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:47.319106    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/16334c3d-24c7-4b35-9f1f-5b1f2bae012f-sys\") pod \"perf-node-gather-daemonset-d6d58\" (UID: \"16334c3d-24c7-4b35-9f1f-5b1f2bae012f\") " pod="openshift-must-gather-h5svb/perf-node-gather-daemonset-d6d58"
Sep 18 04:22:47.319230 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:47.319132    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/16334c3d-24c7-4b35-9f1f-5b1f2bae012f-proc\") pod \"perf-node-gather-daemonset-d6d58\" (UID: \"16334c3d-24c7-4b35-9f1f-5b1f2bae012f\") " pod="openshift-must-gather-h5svb/perf-node-gather-daemonset-d6d58"
Sep 18 04:22:47.326711 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:47.326691    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vx8g\" (UniqueName: \"kubernetes.io/projected/16334c3d-24c7-4b35-9f1f-5b1f2bae012f-kube-api-access-8vx8g\") pod \"perf-node-gather-daemonset-d6d58\" (UID: \"16334c3d-24c7-4b35-9f1f-5b1f2bae012f\") " pod="openshift-must-gather-h5svb/perf-node-gather-daemonset-d6d58"
Sep 18 04:22:47.509406 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:47.509326    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-h5svb/perf-node-gather-daemonset-d6d58"
Sep 18 04:22:47.744020 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:47.743987    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-cff97b4b7-kp8c7_7b4ee9fd-980c-45b2-96a8-5515e3364283/console/0.log"
Sep 18 04:22:47.773783 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:47.773680    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6594f4c75-l5pdv_388bb907-16cf-4b0a-beb8-c3fa40a14153/download-server/0.log"
Sep 18 04:22:47.790142 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:47.790121    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-h5svb/perf-node-gather-daemonset-d6d58"]
Sep 18 04:22:47.792016 ip-10-0-129-207 kubenswrapper[2585]: W0918 04:22:47.791992    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod16334c3d_24c7_4b35_9f1f_5b1f2bae012f.slice/crio-8aee9b74acc6173959315745c3b092eb52b7ca9d111f21f917807b31af564717 WatchSource:0}: Error finding container 8aee9b74acc6173959315745c3b092eb52b7ca9d111f21f917807b31af564717: Status 404 returned error can't find the container with id 8aee9b74acc6173959315745c3b092eb52b7ca9d111f21f917807b31af564717
Sep 18 04:22:48.202443 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:48.202399    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-h5svb/perf-node-gather-daemonset-d6d58" event={"ID":"16334c3d-24c7-4b35-9f1f-5b1f2bae012f","Type":"ContainerStarted","Data":"67bbff89997aae3e3c0205a3a27675373086b48d8577c0be7bc73d21985c162c"}
Sep 18 04:22:48.202858 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:48.202463    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-h5svb/perf-node-gather-daemonset-d6d58" event={"ID":"16334c3d-24c7-4b35-9f1f-5b1f2bae012f","Type":"ContainerStarted","Data":"8aee9b74acc6173959315745c3b092eb52b7ca9d111f21f917807b31af564717"}
Sep 18 04:22:48.202858 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:48.202486    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-h5svb/perf-node-gather-daemonset-d6d58"
Sep 18 04:22:48.217755 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:48.217704    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-h5svb/perf-node-gather-daemonset-d6d58" podStartSLOduration=1.217685352 podStartE2EDuration="1.217685352s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 04:22:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:22:48.21744319 +0000 UTC m=+1002.674886254" watchObservedRunningTime="2026-09-18 04:22:48.217685352 +0000 UTC m=+1002.675128324"
Sep 18 04:22:49.335814 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:49.335787    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5rpl9_1004a663-1296-428b-838a-72dd37ad0e10/dns/0.log"
Sep 18 04:22:49.356104 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:49.356077    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5rpl9_1004a663-1296-428b-838a-72dd37ad0e10/kube-rbac-proxy/0.log"
Sep 18 04:22:49.518562 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:49.518533    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-r47v5_54309f7d-04d4-42f8-8ef3-de8d52091386/dns-node-resolver/0.log"
Sep 18 04:22:50.093800 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:50.093766    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pqmcs_1c08324d-73f3-4f3b-909e-78d4c450e24b/node-ca/0.log"
Sep 18 04:22:51.085319 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:51.085287    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-qbdbv_3d248c16-db7b-4d6d-ae14-4a321609e0ba/istio-proxy/1.log"
Sep 18 04:22:51.086044 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:51.086023    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-qbdbv_3d248c16-db7b-4d6d-ae14-4a321609e0ba/istio-proxy/0.log"
Sep 18 04:22:51.181302 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:51.181276    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-bdc687fb-txxfd_1e106cea-7104-4002-9041-3ee5f7287967/router/0.log"
Sep 18 04:22:51.849825 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:51.849780    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-swf4q_ec3a850b-db56-49b6-a2b7-3dc5b64b9d4f/serve-healthcheck-canary/0.log"
Sep 18 04:22:52.348538 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:52.348507    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-6f9c644dd9-4x6gx_f92ffe18-1282-4f7c-b4f9-824e7e11dc07/insights-operator/0.log"
Sep 18 04:22:52.348538 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:52.348538    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-6f9c644dd9-4x6gx_f92ffe18-1282-4f7c-b4f9-824e7e11dc07/insights-operator/1.log"
Sep 18 04:22:52.369851 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:52.369824    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-26rlw_2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc/kube-rbac-proxy/0.log"
Sep 18 04:22:52.388780 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:52.388758    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-26rlw_2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc/exporter/0.log"
Sep 18 04:22:52.408592 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:52.408570    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-26rlw_2cc64964-e5c8-4a71-b65e-d8a8b1c6d6dc/extractor/0.log"
Sep 18 04:22:54.218444 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:54.218410    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-h5svb/perf-node-gather-daemonset-d6d58"
Sep 18 04:22:54.739794 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:54.739761    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-7c7cdfcfb9-pg58m_a6cf62a7-8702-46ae-90cd-44dd758924a0/manager/0.log"
Sep 18 04:22:54.757640 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:54.757619    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-7c7cdfcfb9-pg58m_a6cf62a7-8702-46ae-90cd-44dd758924a0/copy-manifests/0.log"
Sep 18 04:22:55.983011 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:55.982977    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-operator-56d489b4b8-dgq4q_d44b08a7-089f-4472-a663-99aa9d5d2873/jobset-operator/0.log"
Sep 18 04:22:56.277751 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:56.277719    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-qbdbv_3d248c16-db7b-4d6d-ae14-4a321609e0ba/istio-proxy/1.log"
Sep 18 04:22:56.278633 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:56.278611    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-qbdbv_3d248c16-db7b-4d6d-ae14-4a321609e0ba/istio-proxy/0.log"
Sep 18 04:22:56.351643 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:56.351610    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-bdc687fb-txxfd_1e106cea-7104-4002-9041-3ee5f7287967/router/0.log"
Sep 18 04:22:56.755616 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:56.755588    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-54765d59fd-g2vkd_477814cd-44b9-4c09-82ba-051664f4805c/manager/0.log"
Sep 18 04:22:56.798969 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:56.798931    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-78f7d99c47-4pmfd_8e4fceb9-0054-4238-8fc5-d92f652c89ec/manager/0.log"
Sep 18 04:22:56.839408 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:56.839380    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-85cbcd4954-pd9g4_49996cfe-9e97-4e95-98b9-69817e9ba977/manager/0.log"
Sep 18 04:22:57.648056 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:57.648006    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-qbdbv_3d248c16-db7b-4d6d-ae14-4a321609e0ba/istio-proxy/1.log"
Sep 18 04:22:57.648657 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:57.648564    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-qbdbv_3d248c16-db7b-4d6d-ae14-4a321609e0ba/istio-proxy/0.log"
Sep 18 04:22:57.722480 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:22:57.722449    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-bdc687fb-txxfd_1e106cea-7104-4002-9041-3ee5f7287967/router/0.log"
Sep 18 04:23:03.102713 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:23:03.102682    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-snwbg_dd11bf2c-ca30-45e3-811b-e7f912087184/kube-multus-additional-cni-plugins/0.log"
Sep 18 04:23:03.121035 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:23:03.121011    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-snwbg_dd11bf2c-ca30-45e3-811b-e7f912087184/egress-router-binary-copy/0.log"
Sep 18 04:23:03.139649 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:23:03.139625    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-snwbg_dd11bf2c-ca30-45e3-811b-e7f912087184/cni-plugins/0.log"
Sep 18 04:23:03.158379 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:23:03.158354    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-snwbg_dd11bf2c-ca30-45e3-811b-e7f912087184/bond-cni-plugin/0.log"
Sep 18 04:23:03.176597 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:23:03.176568    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-snwbg_dd11bf2c-ca30-45e3-811b-e7f912087184/routeoverride-cni/0.log"
Sep 18 04:23:03.194396 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:23:03.194367    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-snwbg_dd11bf2c-ca30-45e3-811b-e7f912087184/whereabouts-cni-bincopy/0.log"
Sep 18 04:23:03.212983 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:23:03.212956    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-snwbg_dd11bf2c-ca30-45e3-811b-e7f912087184/whereabouts-cni/0.log"
Sep 18 04:23:03.285196 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:23:03.285165    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-sbmt7_443bf4cf-26a5-47aa-beae-59373c9a9d89/kube-multus/0.log"
Sep 18 04:23:03.419090 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:23:03.419062    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zg942_2d169a38-932c-4d14-8a19-3ce5341fc190/network-metrics-daemon/0.log"
Sep 18 04:23:03.435824 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:23:03.435784    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zg942_2d169a38-932c-4d14-8a19-3ce5341fc190/kube-rbac-proxy/0.log"
Sep 18 04:23:04.259454 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:23:04.259425    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g5hqb_cc11c9df-c3ad-4145-a5b0-a27f7225e599/ovn-controller/0.log"
Sep 18 04:23:04.275753 ip-10-0-129-207 kubenswrapper[2585]: I0918 04:23:04.275729    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g5hqb_cc11c9df-c3ad-4145-a5b0-a27f7225e599/ovn-acl-logging/0.log"