Sep 09 21:07:56.908153 ip-10-0-133-235 systemd[1]: Starting Kubernetes Kubelet...
Sep 09 21:07:57.288328 ip-10-0-133-235 kubenswrapper[2555]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 09 21:07:57.288328 ip-10-0-133-235 kubenswrapper[2555]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 09 21:07:57.288328 ip-10-0-133-235 kubenswrapper[2555]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 09 21:07:57.288328 ip-10-0-133-235 kubenswrapper[2555]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 09 21:07:57.288328 ip-10-0-133-235 kubenswrapper[2555]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 09 21:07:57.289294 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.289204    2555 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 09 21:07:57.292591 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292568    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 21:07:57.292591 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292586    2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 21:07:57.292591 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292592    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 21:07:57.292591 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292596    2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 21:07:57.292850 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292600    2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 21:07:57.292850 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292605    2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 21:07:57.292850 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292609    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 21:07:57.292850 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292613    2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 21:07:57.292850 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292616    2555 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 21:07:57.292850 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292620    2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 21:07:57.292850 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292624    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 21:07:57.292850 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292628    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 21:07:57.292850 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292632    2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 21:07:57.292850 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292635    2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 21:07:57.292850 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292640    2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 21:07:57.292850 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292643    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 21:07:57.292850 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292647    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 21:07:57.292850 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292652    2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 21:07:57.292850 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292656    2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 21:07:57.292850 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292660    2555 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 21:07:57.292850 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292664    2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 21:07:57.292850 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292668    2555 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 21:07:57.292850 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292672    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 21:07:57.293427 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292676    2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 21:07:57.293427 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292679    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 21:07:57.293427 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292683    2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 21:07:57.293427 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292687    2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 21:07:57.293427 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292691    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 21:07:57.293427 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292695    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 21:07:57.293427 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292698    2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 21:07:57.293427 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292705    2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 21:07:57.293427 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292711    2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 21:07:57.293427 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292716    2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 21:07:57.293427 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292720    2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 21:07:57.293427 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292725    2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 21:07:57.293427 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292729    2555 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 21:07:57.293427 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292733    2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 21:07:57.293427 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292738    2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 21:07:57.293427 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292743    2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 21:07:57.293427 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292747    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 21:07:57.293427 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292751    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 21:07:57.293427 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292755    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 21:07:57.293931 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292760    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 21:07:57.293931 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292765    2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 21:07:57.293931 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292769    2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 21:07:57.293931 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292773    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 21:07:57.293931 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292777    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 21:07:57.293931 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292782    2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 21:07:57.293931 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292787    2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 21:07:57.293931 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292791    2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 21:07:57.293931 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292796    2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 21:07:57.293931 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292800    2555 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 21:07:57.293931 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292805    2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 21:07:57.293931 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292809    2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 21:07:57.293931 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292831    2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 21:07:57.293931 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292837    2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 21:07:57.293931 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292842    2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 21:07:57.293931 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292846    2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 21:07:57.293931 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292850    2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 21:07:57.293931 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292854    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 21:07:57.293931 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292858    2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 21:07:57.293931 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292862    2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 21:07:57.294587 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292867    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 21:07:57.294587 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292871    2555 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 21:07:57.294587 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292875    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 21:07:57.294587 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292879    2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 21:07:57.294587 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292883    2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 21:07:57.294587 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292887    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 21:07:57.294587 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292893    2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 21:07:57.294587 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292898    2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 21:07:57.294587 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292903    2555 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 21:07:57.294587 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292908    2555 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 21:07:57.294587 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292913    2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 21:07:57.294587 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292918    2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 21:07:57.294587 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292922    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 21:07:57.294587 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292926    2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 21:07:57.294587 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292930    2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 21:07:57.294587 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292934    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 21:07:57.294587 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292939    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 21:07:57.294587 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292946    2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 21:07:57.294587 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292951    2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 21:07:57.294587 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292956    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 21:07:57.295450 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292961    2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 21:07:57.295450 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292965    2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 21:07:57.295450 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292970    2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 21:07:57.295450 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292974    2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 21:07:57.295450 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292978    2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 21:07:57.295450 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292982    2555 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 21:07:57.295450 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292986    2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 21:07:57.295450 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292991    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 21:07:57.295450 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292995    2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 21:07:57.295450 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.292999    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 21:07:57.295450 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.293003    2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 21:07:57.295450 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.293007    2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 21:07:57.295450 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.293012    2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 21:07:57.295450 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.293019    2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 21:07:57.295450 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.293024    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 21:07:57.295450 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.293029    2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 21:07:57.295450 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.293034    2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 21:07:57.295450 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295313    2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 21:07:57.295450 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295324    2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 21:07:57.296271 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295332    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 21:07:57.296271 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295337    2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 21:07:57.296271 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295342    2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 21:07:57.296271 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295348    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 21:07:57.296271 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295352    2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 21:07:57.296271 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295357    2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 21:07:57.296271 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295364    2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 21:07:57.296271 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295369    2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 21:07:57.296271 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295374    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 21:07:57.296271 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295379    2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 21:07:57.296271 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295384    2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 21:07:57.296271 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295388    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 21:07:57.296271 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295392    2555 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 21:07:57.296271 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295397    2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 21:07:57.296271 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295403    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 21:07:57.296271 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295408    2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 21:07:57.296271 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295414    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 21:07:57.296271 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295419    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 21:07:57.296271 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295423    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 21:07:57.296271 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295428    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 21:07:57.297168 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295432    2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 21:07:57.297168 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295436    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 21:07:57.297168 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295443    2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 21:07:57.297168 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295447    2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 21:07:57.297168 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295452    2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 21:07:57.297168 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295457    2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 21:07:57.297168 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295461    2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 21:07:57.297168 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295464    2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 21:07:57.297168 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295468    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 21:07:57.297168 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295473    2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 21:07:57.297168 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295477    2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 21:07:57.297168 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295483    2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 21:07:57.297168 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295489    2555 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 21:07:57.297168 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295494    2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 21:07:57.297168 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295498    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 21:07:57.297168 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295502    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 21:07:57.297168 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295508    2555 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 21:07:57.297168 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295512    2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 21:07:57.297168 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295516    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 21:07:57.298037 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295521    2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 21:07:57.298037 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295526    2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 21:07:57.298037 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295530    2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 21:07:57.298037 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295534    2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 21:07:57.298037 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295539    2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 21:07:57.298037 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295543    2555 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 21:07:57.298037 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295547    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 21:07:57.298037 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295553    2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 21:07:57.298037 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295557    2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 21:07:57.298037 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295561    2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 21:07:57.298037 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295566    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 21:07:57.298037 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295570    2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 21:07:57.298037 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295575    2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 21:07:57.298037 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295579    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 21:07:57.298037 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295583    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 21:07:57.298037 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295587    2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 21:07:57.298037 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295591    2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 21:07:57.298037 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295596    2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 21:07:57.298037 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295600    2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 21:07:57.298037 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295604    2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 21:07:57.298774 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295608    2555 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 21:07:57.298774 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295611    2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 21:07:57.298774 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295616    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 21:07:57.298774 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295620    2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 21:07:57.298774 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295624    2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 21:07:57.298774 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295628    2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 21:07:57.298774 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295632    2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 21:07:57.298774 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295637    2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 21:07:57.298774 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295641    2555 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 21:07:57.298774 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295645    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 21:07:57.298774 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295650    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 21:07:57.298774 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295654    2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 21:07:57.298774 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295658    2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 21:07:57.298774 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295663    2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 21:07:57.298774 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295667    2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 21:07:57.298774 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295671    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 21:07:57.298774 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295675    2555 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 21:07:57.298774 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295679    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 21:07:57.298774 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295683    2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 21:07:57.298774 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295688    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 21:07:57.299342 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295692    2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 21:07:57.299342 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295696    2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 21:07:57.299342 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295701    2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 21:07:57.299342 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295705    2555 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 21:07:57.299342 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295711    2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 21:07:57.299342 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295715    2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 21:07:57.299342 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295719    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 21:07:57.299342 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295723    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 21:07:57.299342 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295727    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 21:07:57.299342 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295732    2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 21:07:57.299342 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295736    2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 21:07:57.299342 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295740    2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 21:07:57.299342 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295744    2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 21:07:57.299342 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295748    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 21:07:57.299342 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295752    2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 21:07:57.299342 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295757    2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 21:07:57.299342 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295761    2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 21:07:57.299342 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.295765    2555 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 21:07:57.299342 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296342    2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 21:07:57.299342 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296351    2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 21:07:57.299841 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296356    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 21:07:57.299841 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296361    2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 21:07:57.299841 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296366    2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 21:07:57.299841 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296371    2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 21:07:57.299841 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296375    2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 21:07:57.299841 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296379    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 21:07:57.299841 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296384    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 21:07:57.299841 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296388    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 21:07:57.299841 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296392    2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 21:07:57.299841 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296396    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 21:07:57.299841 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296401    2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 21:07:57.299841 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296405    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 21:07:57.299841 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296409    2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 21:07:57.299841 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296414    2555 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 21:07:57.299841 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296418    2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 21:07:57.299841 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296422    2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 21:07:57.299841 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296426    2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 21:07:57.299841 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296430    2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 21:07:57.299841 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296434    2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 21:07:57.299841 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296438    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 21:07:57.300461 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296443    2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 21:07:57.300461 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296447    2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 21:07:57.300461 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296451    2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 21:07:57.300461 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296455    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 21:07:57.300461 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296460    2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 21:07:57.300461 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296464    2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 21:07:57.300461 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296468    2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 21:07:57.300461 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296472    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 21:07:57.300461 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296476    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 21:07:57.300461 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296480    2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 21:07:57.300461 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296485    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 21:07:57.300461 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296489    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 21:07:57.300461 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296494    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 21:07:57.300461 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296498    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 21:07:57.300461 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296502    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 21:07:57.300461 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296507    2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 21:07:57.300461 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296511    2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 21:07:57.300461 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296515    2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 21:07:57.300461 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296519    2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 21:07:57.301045 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296523    2555 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 21:07:57.301045 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296527    2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 21:07:57.301045 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296531    2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 21:07:57.301045 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296536    2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 21:07:57.301045 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296540    2555 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 21:07:57.301045 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296544    2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 21:07:57.301045 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296548    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 21:07:57.301045 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296552    2555 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 21:07:57.301045 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296558    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 21:07:57.301045 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296562    2555 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 21:07:57.301045 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296566    2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 21:07:57.301045 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296571    2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 21:07:57.301045 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296575    2555 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 21:07:57.301045 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296579    2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 21:07:57.301045 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296584    2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 21:07:57.301045 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296588    2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 21:07:57.301045 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296593    2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 21:07:57.301045 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296597    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 21:07:57.301045 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296602    2555 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 21:07:57.301045 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296606    2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 21:07:57.301571 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296610    2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 21:07:57.301571 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296614    2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 21:07:57.301571 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296619    2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 21:07:57.301571 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296623    2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 21:07:57.301571 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296630    2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 21:07:57.301571 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296636    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 21:07:57.301571 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296640    2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 21:07:57.301571 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296645    2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 21:07:57.301571 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296650    2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 21:07:57.301571 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296665    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 21:07:57.301571 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296670    2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 21:07:57.301571 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296674    2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 21:07:57.301571 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296678    2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 21:07:57.301571 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296682    2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 21:07:57.301571 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296687    2555 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 21:07:57.301571 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296691    2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 21:07:57.301571 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296695    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 21:07:57.301571 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296699    2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 21:07:57.301571 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296703    2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 21:07:57.302120 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296707    2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 21:07:57.302120 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296714    2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 21:07:57.302120 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296719    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 21:07:57.302120 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296723    2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 21:07:57.302120 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296728    2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 21:07:57.302120 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296732    2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 21:07:57.302120 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296737    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 21:07:57.302120 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296741    2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 21:07:57.302120 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296745    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 21:07:57.302120 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296749    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 21:07:57.302120 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296753    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 21:07:57.302120 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296758    2555 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 21:07:57.302120 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296763    2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 21:07:57.302120 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296768    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 21:07:57.302120 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296772    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 21:07:57.302120 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296776    2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 21:07:57.302120 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296780    2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 21:07:57.302120 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296784    2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 21:07:57.302120 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.296789    2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 21:07:57.302120 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.296911    2555 flags.go:64] FLAG: --address="0.0.0.0"
Sep 09 21:07:57.302659 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.296963    2555 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 09 21:07:57.302659 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.296978    2555 flags.go:64] FLAG: --anonymous-auth="true"
Sep 09 21:07:57.302659 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.296984    2555 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 09 21:07:57.302659 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297000    2555 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 09 21:07:57.302659 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297006    2555 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 09 21:07:57.302659 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297016    2555 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 09 21:07:57.302659 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297023    2555 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 09 21:07:57.302659 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297028    2555 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 09 21:07:57.302659 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297032    2555 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 09 21:07:57.302659 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297038    2555 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 09 21:07:57.302659 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297043    2555 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 09 21:07:57.302659 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297048    2555 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 09 21:07:57.302659 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297053    2555 flags.go:64] FLAG: --cgroup-root=""
Sep 09 21:07:57.302659 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297057    2555 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 09 21:07:57.302659 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297062    2555 flags.go:64] FLAG: --client-ca-file=""
Sep 09 21:07:57.302659 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297066    2555 flags.go:64] FLAG: --cloud-provider="external"
Sep 09 21:07:57.302659 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297071    2555 flags.go:64] FLAG: --cluster-dns="[]"
Sep 09 21:07:57.302659 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297081    2555 flags.go:64] FLAG: --cluster-domain=""
Sep 09 21:07:57.302659 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297085    2555 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 09 21:07:57.302659 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297090    2555 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 09 21:07:57.302659 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297095    2555 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 09 21:07:57.302659 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297101    2555 flags.go:64] FLAG: --container-log-max-files="5"
Sep 09 21:07:57.302659 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297107    2555 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 09 21:07:57.302659 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297112    2555 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 09 21:07:57.303264 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297117    2555 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 09 21:07:57.303264 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297122    2555 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 09 21:07:57.303264 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297127    2555 flags.go:64] FLAG: --contention-profiling="false"
Sep 09 21:07:57.303264 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297132    2555 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 09 21:07:57.303264 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297136    2555 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 09 21:07:57.303264 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297141    2555 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 09 21:07:57.303264 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297146    2555 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 09 21:07:57.303264 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297153    2555 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 09 21:07:57.303264 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297158    2555 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 09 21:07:57.303264 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297163    2555 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 09 21:07:57.303264 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297167    2555 flags.go:64] FLAG: --enable-load-reader="false"
Sep 09 21:07:57.303264 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297171    2555 flags.go:64] FLAG: --enable-server="true"
Sep 09 21:07:57.303264 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297181    2555 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 09 21:07:57.303264 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297187    2555 flags.go:64] FLAG: --event-burst="100"
Sep 09 21:07:57.303264 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297192    2555 flags.go:64] FLAG: --event-qps="50"
Sep 09 21:07:57.303264 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297197    2555 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 09 21:07:57.303264 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297201    2555 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 09 21:07:57.303264 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297206    2555 flags.go:64] FLAG: --eviction-hard=""
Sep 09 21:07:57.303264 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297213    2555 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 09 21:07:57.303264 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297218    2555 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 09 21:07:57.303264 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297222    2555 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 09 21:07:57.303264 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297227    2555 flags.go:64] FLAG: --eviction-soft=""
Sep 09 21:07:57.303264 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297232    2555 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 09 21:07:57.303264 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297236    2555 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 09 21:07:57.303264 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297241    2555 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 09 21:07:57.303937 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297246    2555 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 09 21:07:57.303937 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297250    2555 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 09 21:07:57.303937 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297255    2555 flags.go:64] FLAG: --fail-swap-on="true"
Sep 09 21:07:57.303937 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297260    2555 flags.go:64] FLAG: --feature-gates=""
Sep 09 21:07:57.303937 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297265    2555 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 09 21:07:57.303937 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297270    2555 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 09 21:07:57.303937 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297274    2555 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 09 21:07:57.303937 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297280    2555 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 09 21:07:57.303937 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297285    2555 flags.go:64] FLAG: --healthz-port="10248"
Sep 09 21:07:57.303937 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297290    2555 flags.go:64] FLAG: --help="false"
Sep 09 21:07:57.303937 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297295    2555 flags.go:64] FLAG: --hostname-override="ip-10-0-133-235.ec2.internal"
Sep 09 21:07:57.303937 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297300    2555 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 09 21:07:57.303937 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297305    2555 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 09 21:07:57.303937 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297310    2555 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 09 21:07:57.303937 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297316    2555 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 09 21:07:57.303937 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297322    2555 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 09 21:07:57.303937 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297326    2555 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 09 21:07:57.303937 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297331    2555 flags.go:64] FLAG: --image-service-endpoint=""
Sep 09 21:07:57.303937 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297335    2555 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 09 21:07:57.303937 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297341    2555 flags.go:64] FLAG: --kube-api-burst="100"
Sep 09 21:07:57.303937 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297354    2555 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 09 21:07:57.303937 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297360    2555 flags.go:64] FLAG: --kube-api-qps="50"
Sep 09 21:07:57.303937 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297364    2555 flags.go:64] FLAG: --kube-reserved=""
Sep 09 21:07:57.303937 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297369    2555 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 09 21:07:57.304614 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297374    2555 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 09 21:07:57.304614 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297379    2555 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 09 21:07:57.304614 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297384    2555 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 09 21:07:57.304614 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297388    2555 flags.go:64] FLAG: --lock-file=""
Sep 09 21:07:57.304614 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297393    2555 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 09 21:07:57.304614 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297397    2555 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 09 21:07:57.304614 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297402    2555 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 09 21:07:57.304614 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297416    2555 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 09 21:07:57.304614 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297421    2555 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 09 21:07:57.304614 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297425    2555 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 09 21:07:57.304614 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297430    2555 flags.go:64] FLAG: --logging-format="text"
Sep 09 21:07:57.304614 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297435    2555 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 09 21:07:57.304614 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297441    2555 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 09 21:07:57.304614 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297446    2555 flags.go:64] FLAG: --manifest-url=""
Sep 09 21:07:57.304614 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297450    2555 flags.go:64] FLAG: --manifest-url-header=""
Sep 09 21:07:57.304614 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297457    2555 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 09 21:07:57.304614 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297462    2555 flags.go:64] FLAG: --max-open-files="1000000"
Sep 09 21:07:57.304614 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297468    2555 flags.go:64] FLAG: --max-pods="110"
Sep 09 21:07:57.304614 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297473    2555 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 09 21:07:57.304614 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297478    2555 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 09 21:07:57.304614 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297483    2555 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 09 21:07:57.304614 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297491    2555 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 09 21:07:57.304614 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297496    2555 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 09 21:07:57.304614 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297500    2555 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 09 21:07:57.304614 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297505    2555 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 09 21:07:57.305265 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297516    2555 flags.go:64] FLAG: --node-status-max-images="50"
Sep 09 21:07:57.305265 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297521    2555 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 09 21:07:57.305265 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297526    2555 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 09 21:07:57.305265 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297530    2555 flags.go:64] FLAG: --pod-cidr=""
Sep 09 21:07:57.305265 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297536    2555 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 09 21:07:57.305265 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297544    2555 flags.go:64] FLAG: --pod-manifest-path=""
Sep 09 21:07:57.305265 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297551    2555 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 09 21:07:57.305265 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297557    2555 flags.go:64] FLAG: --pods-per-core="0"
Sep 09 21:07:57.305265 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297561    2555 flags.go:64] FLAG: --port="10250"
Sep 09 21:07:57.305265 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297566    2555 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 09 21:07:57.305265 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297571    2555 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e9b67a3f5a0459e6"
Sep 09 21:07:57.305265 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297576    2555 flags.go:64] FLAG: --qos-reserved=""
Sep 09 21:07:57.305265 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297581    2555 flags.go:64] FLAG: --read-only-port="10255"
Sep 09 21:07:57.305265 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297586    2555 flags.go:64] FLAG: --register-node="true"
Sep 09 21:07:57.305265 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297591    2555 flags.go:64] FLAG: --register-with-taints=""
Sep 09 21:07:57.305265 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297597    2555 flags.go:64] FLAG: --registry-burst="10"
Sep 09 21:07:57.305265 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297601    2555 flags.go:64] FLAG: --registry-qps="5"
Sep 09 21:07:57.305265 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297606    2555 flags.go:64] FLAG: --reserved-cpus=""
Sep 09 21:07:57.305265 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297611    2555 flags.go:64] FLAG: --reserved-memory=""
Sep 09 21:07:57.305265 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297616    2555 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 09 21:07:57.305265 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297621    2555 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 09 21:07:57.305265 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297626    2555 flags.go:64] FLAG: --rotate-certificates="false"
Sep 09 21:07:57.305265 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297630    2555 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 09 21:07:57.305265 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297635    2555 flags.go:64] FLAG: --runonce="false"
Sep 09 21:07:57.305265 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297640    2555 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 09 21:07:57.305891 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297645    2555 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 09 21:07:57.305891 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297650    2555 flags.go:64] FLAG: --seccomp-default="false"
Sep 09 21:07:57.305891 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297654    2555 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 09 21:07:57.305891 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297659    2555 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 09 21:07:57.305891 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297666    2555 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 09 21:07:57.305891 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297671    2555 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 09 21:07:57.305891 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297676    2555 flags.go:64] FLAG: --storage-driver-password="root"
Sep 09 21:07:57.305891 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297680    2555 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 09 21:07:57.305891 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297686    2555 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 09 21:07:57.305891 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297690    2555 flags.go:64] FLAG: --storage-driver-user="root"
Sep 09 21:07:57.305891 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297695    2555 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 09 21:07:57.305891 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297700    2555 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 09 21:07:57.305891 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297705    2555 flags.go:64] FLAG: --system-cgroups=""
Sep 09 21:07:57.305891 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297712    2555 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 09 21:07:57.305891 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297721    2555 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 09 21:07:57.305891 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297726    2555 flags.go:64] FLAG: --tls-cert-file=""
Sep 09 21:07:57.305891 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297731    2555 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 09 21:07:57.305891 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297736    2555 flags.go:64] FLAG: --tls-min-version=""
Sep 09 21:07:57.305891 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297741    2555 flags.go:64] FLAG: --tls-private-key-file=""
Sep 09 21:07:57.305891 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297746    2555 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 09 21:07:57.305891 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297750    2555 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 09 21:07:57.305891 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297755    2555 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 09 21:07:57.305891 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297760    2555 flags.go:64] FLAG: --v="2"
Sep 09 21:07:57.305891 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297766    2555 flags.go:64] FLAG: --version="false"
Sep 09 21:07:57.305891 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297772    2555 flags.go:64] FLAG: --vmodule=""
Sep 09 21:07:57.306514 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297778    2555 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 09 21:07:57.306514 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.297783    2555 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 09 21:07:57.306514 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.297987    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 21:07:57.306514 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.297996    2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 21:07:57.306514 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298002    2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 21:07:57.306514 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298006    2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 21:07:57.306514 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298010    2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 21:07:57.306514 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298014    2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 21:07:57.306514 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298019    2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 21:07:57.306514 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298023    2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 21:07:57.306514 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298027    2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 21:07:57.306514 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298033    2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 21:07:57.306514 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298036    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 21:07:57.306514 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298040    2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 21:07:57.306514 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298044    2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 21:07:57.306514 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298049    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 21:07:57.306514 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298054    2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 21:07:57.306514 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298061    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 21:07:57.306514 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298065    2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 21:07:57.306514 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298069    2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 21:07:57.307039 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298076    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 21:07:57.307039 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298081    2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 21:07:57.307039 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298085    2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 21:07:57.307039 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298089    2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 21:07:57.307039 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298093    2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 21:07:57.307039 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298097    2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 21:07:57.307039 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298102    2555 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 21:07:57.307039 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298106    2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 21:07:57.307039 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298110    2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 21:07:57.307039 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298114    2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 21:07:57.307039 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298118    2555 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 21:07:57.307039 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298123    2555 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 21:07:57.307039 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298127    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 21:07:57.307039 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298131    2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 21:07:57.307039 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298135    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 21:07:57.307039 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298140    2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 21:07:57.307039 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298144    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 21:07:57.307039 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298148    2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 21:07:57.307039 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298152    2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 21:07:57.307039 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298156    2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 21:07:57.307647 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298161    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 21:07:57.307647 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298165    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 21:07:57.307647 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298169    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 21:07:57.307647 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298174    2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 21:07:57.307647 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298179    2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 21:07:57.307647 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298186    2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 21:07:57.307647 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298191    2555 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 21:07:57.307647 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298196    2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 21:07:57.307647 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298200    2555 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 21:07:57.307647 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298205    2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 21:07:57.307647 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298209    2555 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 21:07:57.307647 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298213    2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 21:07:57.307647 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298220    2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 21:07:57.307647 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298225    2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 21:07:57.307647 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298229    2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 21:07:57.307647 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298234    2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 21:07:57.307647 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298238    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 21:07:57.307647 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298242    2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 21:07:57.307647 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298246    2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 21:07:57.308209 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298250    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 21:07:57.308209 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298255    2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 21:07:57.308209 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298259    2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 21:07:57.308209 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298263    2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 21:07:57.308209 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298269    2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 21:07:57.308209 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298275    2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 21:07:57.308209 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298279    2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 21:07:57.308209 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298283    2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 21:07:57.308209 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298287    2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 21:07:57.308209 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298291    2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 21:07:57.308209 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298296    2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 21:07:57.308209 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298300    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 21:07:57.308209 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298305    2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 21:07:57.308209 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298309    2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 21:07:57.308209 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298313    2555 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 21:07:57.308209 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298317    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 21:07:57.308209 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298323    2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 21:07:57.308209 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298327    2555 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 21:07:57.308209 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298331    2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 21:07:57.308667 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298335    2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 21:07:57.308667 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298339    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 21:07:57.308667 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298343    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 21:07:57.308667 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298348    2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 21:07:57.308667 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298352    2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 21:07:57.308667 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298356    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 21:07:57.308667 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298361    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 21:07:57.308667 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298365    2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 21:07:57.308667 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298370    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 21:07:57.308667 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298374    2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 21:07:57.308667 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298378    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 21:07:57.308667 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298383    2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 21:07:57.308667 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298387    2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 21:07:57.308667 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298391    2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 21:07:57.308667 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298396    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 21:07:57.308667 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298400    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 21:07:57.308667 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298404    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 21:07:57.308667 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298408    2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 21:07:57.308667 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298412    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 21:07:57.308667 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298416    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 21:07:57.309176 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298420    2555 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 21:07:57.309176 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298424    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 21:07:57.309176 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.298429    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 21:07:57.309176 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.298437    2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 09 21:07:57.309176 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.306153    2555 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 09 21:07:57.309176 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.306172    2555 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 09 21:07:57.309176 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.306928    2555 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 09 21:07:57.309176 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.306935    2555 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 09 21:07:57.309176 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.306997    2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 21:07:57.309176 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307002    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 21:07:57.309176 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307005    2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 21:07:57.309176 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307008    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 21:07:57.309176 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307011    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 21:07:57.309176 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307014    2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 21:07:57.309176 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307017    2555 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 21:07:57.309552 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307020    2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 21:07:57.309552 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307024    2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 21:07:57.309552 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307027    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 21:07:57.309552 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307029    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 21:07:57.309552 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307032    2555 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 21:07:57.309552 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307035    2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 21:07:57.309552 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307038    2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 21:07:57.309552 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307040    2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 21:07:57.309552 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307043    2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 21:07:57.309552 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307046    2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 21:07:57.309552 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307048    2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 21:07:57.309552 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307051    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 21:07:57.309552 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307054    2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 21:07:57.309552 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307057    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 21:07:57.309552 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307059    2555 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 21:07:57.309552 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307062    2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 21:07:57.309552 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307065    2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 21:07:57.309552 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307067    2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 21:07:57.309552 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307070    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 21:07:57.310041 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307072    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 21:07:57.310041 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307075    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 21:07:57.310041 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307077    2555 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 21:07:57.310041 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307086    2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 21:07:57.310041 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307089    2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 21:07:57.310041 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307092    2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 21:07:57.310041 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307094    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 21:07:57.310041 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307097    2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 21:07:57.310041 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307099    2555 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 21:07:57.310041 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307102    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 21:07:57.310041 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307105    2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 21:07:57.310041 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307108    2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 21:07:57.310041 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307110    2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 21:07:57.310041 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307113    2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 21:07:57.310041 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307115    2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 21:07:57.310041 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307118    2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 21:07:57.310041 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307120    2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 21:07:57.310041 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307123    2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 21:07:57.310041 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307126    2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 21:07:57.310041 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307128    2555 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 21:07:57.310535 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307131    2555 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 21:07:57.310535 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307133    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 21:07:57.310535 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307136    2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 21:07:57.310535 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307139    2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 21:07:57.310535 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307141    2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 21:07:57.310535 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307144    2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 21:07:57.310535 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307146    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 21:07:57.310535 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307149    2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 21:07:57.310535 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307151    2555 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 21:07:57.310535 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307164    2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 21:07:57.310535 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307169    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 21:07:57.310535 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307173    2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 21:07:57.310535 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307175    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 21:07:57.310535 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307178    2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 21:07:57.310535 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307181    2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 21:07:57.310535 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307185    2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 21:07:57.310535 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307193    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 21:07:57.310535 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307196    2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 21:07:57.310535 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307198    2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 21:07:57.311045 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307201    2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 21:07:57.311045 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307204    2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 21:07:57.311045 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307206    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 21:07:57.311045 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307209    2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 21:07:57.311045 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307211    2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 21:07:57.311045 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307214    2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 21:07:57.311045 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307217    2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 21:07:57.311045 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307219    2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 21:07:57.311045 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307222    2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 21:07:57.311045 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307224    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 21:07:57.311045 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307227    2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 21:07:57.311045 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307229    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 21:07:57.311045 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307232    2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 21:07:57.311045 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307234    2555 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 21:07:57.311045 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307237    2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 21:07:57.311045 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307241    2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 21:07:57.311045 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307245    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 21:07:57.311045 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307247    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 21:07:57.311045 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307250    2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 21:07:57.311520 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307252    2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 21:07:57.311520 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307255    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 21:07:57.311520 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307258    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 21:07:57.311520 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307260    2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 21:07:57.311520 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307263    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 21:07:57.311520 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307266    2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 21:07:57.311520 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307270    2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 21:07:57.311520 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307274    2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 21:07:57.311520 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307277    2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 21:07:57.311520 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307280    2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 21:07:57.311520 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307283    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 21:07:57.311520 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307291    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 21:07:57.311520 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307294    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 21:07:57.311520 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307296    2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 21:07:57.311520 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307299    2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 21:07:57.311918 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.307305    2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 09 21:07:57.311918 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307444    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 21:07:57.311918 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307449    2555 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 21:07:57.311918 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307451    2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 21:07:57.311918 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307454    2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 21:07:57.311918 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307458    2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 21:07:57.311918 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307463    2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 21:07:57.311918 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307466    2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 21:07:57.311918 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307469    2555 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 21:07:57.311918 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307471    2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 21:07:57.311918 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307475    2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 21:07:57.311918 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307477    2555 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 21:07:57.311918 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307480    2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 21:07:57.311918 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307483    2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 21:07:57.312264 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307486    2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 21:07:57.312264 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307488    2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 21:07:57.312264 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307490    2555 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 21:07:57.312264 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307493    2555 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 21:07:57.312264 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307496    2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 21:07:57.312264 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307499    2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 21:07:57.312264 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307501    2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 21:07:57.312264 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307504    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 21:07:57.312264 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307507    2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 21:07:57.312264 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307510    2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 21:07:57.312264 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307512    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 21:07:57.312264 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307515    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 21:07:57.312264 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307517    2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 21:07:57.312264 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307520    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 21:07:57.312264 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307522    2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 21:07:57.312264 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307530    2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 21:07:57.312264 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307533    2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 21:07:57.312264 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307536    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 21:07:57.312264 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307538    2555 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 21:07:57.312264 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307541    2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 21:07:57.312742 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307543    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 21:07:57.312742 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307546    2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 21:07:57.312742 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307548    2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 21:07:57.312742 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307551    2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 21:07:57.312742 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307554    2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 21:07:57.312742 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307556    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 21:07:57.312742 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307559    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 21:07:57.312742 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307567    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 21:07:57.312742 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307570    2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 21:07:57.312742 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307573    2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 21:07:57.312742 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307575    2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 21:07:57.312742 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307578    2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 21:07:57.312742 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307580    2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 21:07:57.312742 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307583    2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 21:07:57.312742 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307586    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 21:07:57.312742 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307588    2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 21:07:57.312742 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307591    2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 21:07:57.312742 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307593    2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 21:07:57.312742 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307596    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 21:07:57.313224 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307598    2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 21:07:57.313224 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307601    2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 21:07:57.313224 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307604    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 21:07:57.313224 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307607    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 21:07:57.313224 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307609    2555 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 21:07:57.313224 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307612    2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 21:07:57.313224 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307614    2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 21:07:57.313224 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307617    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 21:07:57.313224 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307619    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 21:07:57.313224 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307627    2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 21:07:57.313224 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307630    2555 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 21:07:57.313224 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307633    2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 21:07:57.313224 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307635    2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 21:07:57.313224 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307638    2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 21:07:57.313224 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307641    2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 21:07:57.313224 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307645    2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 21:07:57.313224 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307647    2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 21:07:57.313224 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307650    2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 21:07:57.313224 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307653    2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 21:07:57.313224 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307655    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 21:07:57.313700 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307658    2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 21:07:57.313700 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307661    2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 21:07:57.313700 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307664    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 21:07:57.313700 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307666    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 21:07:57.313700 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307669    2555 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 21:07:57.313700 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307672    2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 21:07:57.313700 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307674    2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 21:07:57.313700 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307677    2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 21:07:57.313700 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307680    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 21:07:57.313700 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307682    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 21:07:57.313700 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307685    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 21:07:57.313700 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307687    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 21:07:57.313700 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307690    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 21:07:57.313700 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307692    2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 21:07:57.313700 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307695    2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 21:07:57.313700 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307699    2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 21:07:57.313700 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307702    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 21:07:57.313700 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307705    2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 21:07:57.313700 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307708    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 21:07:57.314190 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307711    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 21:07:57.314190 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307714    2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 21:07:57.314190 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307716    2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 21:07:57.314190 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307726    2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 21:07:57.314190 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307729    2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 21:07:57.314190 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307732    2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 21:07:57.314190 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307735    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 21:07:57.314190 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:57.307738    2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 21:07:57.314190 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.307742    2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 09 21:07:57.314190 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.307855    2555 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 09 21:07:57.314190 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.309847    2555 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 09 21:07:57.314190 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.310617    2555 server.go:1019] "Starting client certificate rotation"
Sep 09 21:07:57.314190 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.310718    2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 09 21:07:57.314190 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.310760    2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 09 21:07:57.314544 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.313577    2555 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 09 21:07:57.321109 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.321086    2555 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 09 21:07:57.328063 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.328046    2555 log.go:25] "Validated CRI v1 runtime API"
Sep 09 21:07:57.331985 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.331970    2555 log.go:25] "Validated CRI v1 image API"
Sep 09 21:07:57.332782 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.332767    2555 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 09 21:07:57.335319 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.335301    2555 fs.go:135] Filesystem UUIDs: map[0650567e-cc32-4316-8a62-4e02ac14d451:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 be464fc3-b715-4faa-9677-5f8c2add0a03:/dev/nvme0n1p4]
Sep 09 21:07:57.335390 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.335318    2555 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 09 21:07:57.340286 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.340176    2555 manager.go:216] Machine: {Timestamp:2026-09-09 21:07:57.338939312 +0000 UTC m=+0.318257416 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100138 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec29346ebefd2f30717dbe791077ceac SystemUUID:ec29346e-befd-2f30-717d-be791077ceac BootID:40409ae8-74eb-47bf-aca9-d98e462917fd Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:7f:4f:dc:a5:05 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:7f:4f:dc:a5:05 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2a:37:7c:75:fc:7a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 09 21:07:57.340286 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.340284    2555 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 09 21:07:57.340399 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.340387    2555 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 09 21:07:57.343540 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.343513    2555 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 09 21:07:57.343672 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.343542    2555 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-235.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 09 21:07:57.344562 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.344551    2555 topology_manager.go:138] "Creating topology manager with none policy"
Sep 09 21:07:57.344595 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.344563    2555 container_manager_linux.go:309] "Creating device plugin manager"
Sep 09 21:07:57.344595 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.344571    2555 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 09 21:07:57.345266 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.345256    2555 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 09 21:07:57.346343 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.346332    2555 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 09 21:07:57.349068 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.349053    2555 state_mem.go:36] "Initialized new in-memory state store"
Sep 09 21:07:57.349165 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.349148    2555 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 09 21:07:57.349213 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.349178    2555 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 09 21:07:57.349213 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.349200    2555 kubelet.go:486] "Attempting to sync node with API server"
Sep 09 21:07:57.349276 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.349218    2555 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 09 21:07:57.349276 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.349232    2555 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 09 21:07:57.349276 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.349241    2555 kubelet.go:398] "Adding apiserver pod source"
Sep 09 21:07:57.349276 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.349249    2555 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 09 21:07:57.349642 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.349630    2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 09 21:07:57.349691 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.349653    2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 09 21:07:57.351696 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.351659    2555 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 09 21:07:57.354112 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.354097    2555 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 09 21:07:57.354190 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.354135    2555 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 09 21:07:57.354322 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.354309    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 09 21:07:57.354381 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.354329    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 09 21:07:57.354381 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.354337    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 09 21:07:57.354381 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.354347    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 09 21:07:57.354381 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.354360    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 09 21:07:57.354381 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.354369    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 09 21:07:57.354898 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.354888    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 09 21:07:57.354956 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.354901    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 09 21:07:57.354956 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.354914    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 09 21:07:57.354956 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.354923    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 09 21:07:57.354956 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.354936    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 09 21:07:57.354956 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.354948    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 09 21:07:57.356223 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.356206    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 09 21:07:57.356223 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.356227    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 09 21:07:57.359968 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.359955    2555 server.go:1268] "Started kubelet"
Sep 09 21:07:57.360080 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.360023    2555 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 09 21:07:57.360143 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.360089    2555 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 09 21:07:57.360193 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.360160    2555 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 09 21:07:57.360712 ip-10-0-133-235 systemd[1]: Started Kubernetes Kubelet.
Sep 09 21:07:57.361212 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.361192    2555 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 09 21:07:57.365405 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.365384    2555 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-235.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 09 21:07:57.366401 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:07:57.366355    2555 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 09 21:07:57.366508 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:07:57.366394    2555 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-235.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 09 21:07:57.366803 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.366785    2555 server.go:310] "Adding debug handlers to kubelet server"
Sep 09 21:07:57.367267 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:07:57.367222    2555 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 09 21:07:57.368756 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.368733    2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 09 21:07:57.369352 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.369338    2555 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 09 21:07:57.369840 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:07:57.369697    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-235.ec2.internal\" not found"
Sep 09 21:07:57.369920 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.369903    2555 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 09 21:07:57.369974 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.369925    2555 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 09 21:07:57.369974 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.369940    2555 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 09 21:07:57.370058 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.370043    2555 reconstruct.go:97] "Volume reconstruction finished"
Sep 09 21:07:57.370058 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.370049    2555 reconciler.go:29] "Reconciler: start to sync state"
Sep 09 21:07:57.370131 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.370107    2555 factory.go:55] Registering systemd factory
Sep 09 21:07:57.370131 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.370124    2555 factory.go:223] Registration of the systemd container factory successfully
Sep 09 21:07:57.370313 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.370303    2555 factory.go:153] Registering CRI-O factory
Sep 09 21:07:57.370313 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.370313    2555 factory.go:223] Registration of the crio container factory successfully
Sep 09 21:07:57.370412 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.370373    2555 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 09 21:07:57.370412 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.370391    2555 factory.go:103] Registering Raw factory
Sep 09 21:07:57.370412 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.370402    2555 manager.go:1196] Started watching for new ooms in manager
Sep 09 21:07:57.370806 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.370795    2555 manager.go:349] Starting recovery of all containers
Sep 09 21:07:57.370902 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:07:57.369870    2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-235.ec2.internal.18d3c32d8a72a16b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-235.ec2.internal,UID:ip-10-0-133-235.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-235.ec2.internal,},FirstTimestamp:2026-09-09 21:07:57.359931755 +0000 UTC m=+0.339249859,LastTimestamp:2026-09-09 21:07:57.359931755 +0000 UTC m=+0.339249859,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-235.ec2.internal,}"
Sep 09 21:07:57.371595 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:07:57.371569    2555 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 09 21:07:57.371694 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:07:57.371672    2555 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-235.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 09 21:07:57.382067 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.382052    2555 manager.go:354] Recovery completed
Sep 09 21:07:57.386455 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.386439    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 21:07:57.388230 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.388201    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-235.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 21:07:57.388307 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.388239    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-235.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 21:07:57.388307 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.388249    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-235.ec2.internal" event="NodeHasSufficientPID"
Sep 09 21:07:57.388769 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.388756    2555 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 09 21:07:57.388769 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.388764    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 21:07:57.388936 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.388766    2555 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 09 21:07:57.388936 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.388853    2555 state_mem.go:36] "Initialized new in-memory state store"
Sep 09 21:07:57.389432 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.389417    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-235.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 21:07:57.389504 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.389441    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-235.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 21:07:57.389504 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.389451    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-235.ec2.internal" event="NodeHasSufficientPID"
Sep 09 21:07:57.390023 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.390012    2555 policy_none.go:49] "None policy: Start"
Sep 09 21:07:57.390076 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.390028    2555 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 09 21:07:57.390076 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.390037    2555 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 09 21:07:57.390998 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.390983    2555 policy_none.go:47] "Start"
Sep 09 21:07:57.391069 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:07:57.390951    2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-235.ec2.internal.18d3c32d8c225ff6  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-235.ec2.internal,UID:ip-10-0-133-235.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-235.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-235.ec2.internal,},FirstTimestamp:2026-09-09 21:07:57.38822655 +0000 UTC m=+0.367544653,LastTimestamp:2026-09-09 21:07:57.38822655 +0000 UTC m=+0.367544653,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-235.ec2.internal,}"
Sep 09 21:07:57.399995 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:07:57.399920    2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-235.ec2.internal.18d3c32d8c22a227  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-235.ec2.internal,UID:ip-10-0-133-235.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-133-235.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-133-235.ec2.internal,},FirstTimestamp:2026-09-09 21:07:57.388243495 +0000 UTC m=+0.367561601,LastTimestamp:2026-09-09 21:07:57.388243495 +0000 UTC m=+0.367561601,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-235.ec2.internal,}"
Sep 09 21:07:57.406577 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:07:57.405993    2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-235.ec2.internal.18d3c32d8c22c673  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-235.ec2.internal,UID:ip-10-0-133-235.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-133-235.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-133-235.ec2.internal,},FirstTimestamp:2026-09-09 21:07:57.388252787 +0000 UTC m=+0.367570892,LastTimestamp:2026-09-09 21:07:57.388252787 +0000 UTC m=+0.367570892,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-235.ec2.internal,}"
Sep 09 21:07:57.413158 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:07:57.413071    2555 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-133-235.ec2.internal.18d3c32d8c225ff6\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-235.ec2.internal.18d3c32d8c225ff6  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-235.ec2.internal,UID:ip-10-0-133-235.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-235.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-235.ec2.internal,},FirstTimestamp:2026-09-09 21:07:57.38822655 +0000 UTC m=+0.367544653,LastTimestamp:2026-09-09 21:07:57.389429989 +0000 UTC m=+0.368748093,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-235.ec2.internal,}"
Sep 09 21:07:57.429111 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:07:57.419021    2555 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-133-235.ec2.internal.18d3c32d8c22a227\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-235.ec2.internal.18d3c32d8c22a227  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-235.ec2.internal,UID:ip-10-0-133-235.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-133-235.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-133-235.ec2.internal,},FirstTimestamp:2026-09-09 21:07:57.388243495 +0000 UTC m=+0.367561601,LastTimestamp:2026-09-09 21:07:57.389445905 +0000 UTC m=+0.368764009,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-235.ec2.internal,}"
Sep 09 21:07:57.429111 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.419464    2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hkpmt"
Sep 09 21:07:57.429111 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.427465    2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hkpmt"
Sep 09 21:07:57.429111 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:07:57.427958    2555 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-133-235.ec2.internal.18d3c32d8c22c673\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-235.ec2.internal.18d3c32d8c22c673  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-235.ec2.internal,UID:ip-10-0-133-235.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-133-235.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-133-235.ec2.internal,},FirstTimestamp:2026-09-09 21:07:57.388252787 +0000 UTC m=+0.367570892,LastTimestamp:2026-09-09 21:07:57.389455865 +0000 UTC m=+0.368773969,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-235.ec2.internal,}"
Sep 09 21:07:57.429482 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.429467    2555 manager.go:337] "Starting Device Plugin manager"
Sep 09 21:07:57.429538 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:07:57.429510    2555 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 09 21:07:57.429538 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.429523    2555 server.go:87] "Starting device plugin registration server"
Sep 09 21:07:57.429787 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.429771    2555 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 09 21:07:57.429910 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.429786    2555 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 09 21:07:57.429910 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.429874    2555 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 09 21:07:57.430016 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.429959    2555 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 09 21:07:57.430016 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.429968    2555 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 09 21:07:57.430503 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:07:57.430484    2555 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 09 21:07:57.430589 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:07:57.430536    2555 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-235.ec2.internal\" not found"
Sep 09 21:07:57.458882 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.458848    2555 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 09 21:07:57.460064 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.460046    2555 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 09 21:07:57.460151 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.460100    2555 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 09 21:07:57.460151 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.460124    2555 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 09 21:07:57.460259 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:07:57.460169    2555 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 09 21:07:57.463038 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.463017    2555 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 21:07:57.530650 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.530629    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 21:07:57.531490 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.531471    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-235.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 21:07:57.531559 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.531503    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-235.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 21:07:57.531559 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.531517    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-235.ec2.internal" event="NodeHasSufficientPID"
Sep 09 21:07:57.531559 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.531538    2555 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-235.ec2.internal"
Sep 09 21:07:57.543785 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.543727    2555 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-235.ec2.internal"
Sep 09 21:07:57.543785 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:07:57.543758    2555 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-235.ec2.internal\": node \"ip-10-0-133-235.ec2.internal\" not found"
Sep 09 21:07:57.560485 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.560467    2555 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-235.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-235.ec2.internal"]
Sep 09 21:07:57.560558 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.560529    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 21:07:57.561768 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.561746    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-235.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 21:07:57.561855 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.561773    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-235.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 21:07:57.561855 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.561784    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-235.ec2.internal" event="NodeHasSufficientPID"
Sep 09 21:07:57.562958 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.562945    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 21:07:57.563060 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.563045    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-235.ec2.internal"
Sep 09 21:07:57.563102 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.563084    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 21:07:57.563628 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.563606    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-235.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 21:07:57.563628 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.563626    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-235.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 21:07:57.563757 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.563635    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-235.ec2.internal" event="NodeHasSufficientPID"
Sep 09 21:07:57.563757 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.563638    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-235.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 21:07:57.563757 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.563655    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-235.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 21:07:57.563757 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.563664    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-235.ec2.internal" event="NodeHasSufficientPID"
Sep 09 21:07:57.564701 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.564688    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-235.ec2.internal"
Sep 09 21:07:57.564760 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.564713    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 21:07:57.565340 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.565325    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-235.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 21:07:57.565415 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.565345    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-235.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 21:07:57.565415 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.565358    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-235.ec2.internal" event="NodeHasSufficientPID"
Sep 09 21:07:57.571484 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.571465    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f778c97992e131b077853819dd25ede0-config\") pod \"kube-apiserver-proxy-ip-10-0-133-235.ec2.internal\" (UID: \"f778c97992e131b077853819dd25ede0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-235.ec2.internal"
Sep 09 21:07:57.571565 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.571489    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/80431ef9b40002b355f9a5fc07e0031e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-235.ec2.internal\" (UID: \"80431ef9b40002b355f9a5fc07e0031e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-235.ec2.internal"
Sep 09 21:07:57.571565 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.571508    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/80431ef9b40002b355f9a5fc07e0031e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-235.ec2.internal\" (UID: \"80431ef9b40002b355f9a5fc07e0031e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-235.ec2.internal"
Sep 09 21:07:57.591480 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:07:57.591461    2555 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-235.ec2.internal\" not found" node="ip-10-0-133-235.ec2.internal"
Sep 09 21:07:57.595857 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:07:57.595841    2555 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-235.ec2.internal\" not found" node="ip-10-0-133-235.ec2.internal"
Sep 09 21:07:57.612157 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:07:57.612139    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-235.ec2.internal\" not found"
Sep 09 21:07:57.672058 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.672026    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/80431ef9b40002b355f9a5fc07e0031e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-235.ec2.internal\" (UID: \"80431ef9b40002b355f9a5fc07e0031e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-235.ec2.internal"
Sep 09 21:07:57.672156 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.672062    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f778c97992e131b077853819dd25ede0-config\") pod \"kube-apiserver-proxy-ip-10-0-133-235.ec2.internal\" (UID: \"f778c97992e131b077853819dd25ede0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-235.ec2.internal"
Sep 09 21:07:57.672156 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.672078    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/80431ef9b40002b355f9a5fc07e0031e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-235.ec2.internal\" (UID: \"80431ef9b40002b355f9a5fc07e0031e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-235.ec2.internal"
Sep 09 21:07:57.672156 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.672129    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/80431ef9b40002b355f9a5fc07e0031e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-235.ec2.internal\" (UID: \"80431ef9b40002b355f9a5fc07e0031e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-235.ec2.internal"
Sep 09 21:07:57.672156 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.672133    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/80431ef9b40002b355f9a5fc07e0031e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-235.ec2.internal\" (UID: \"80431ef9b40002b355f9a5fc07e0031e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-235.ec2.internal"
Sep 09 21:07:57.672156 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.672134    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f778c97992e131b077853819dd25ede0-config\") pod \"kube-apiserver-proxy-ip-10-0-133-235.ec2.internal\" (UID: \"f778c97992e131b077853819dd25ede0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-235.ec2.internal"
Sep 09 21:07:57.712222 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:07:57.712198    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-235.ec2.internal\" not found"
Sep 09 21:07:57.812614 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:07:57.812560    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-235.ec2.internal\" not found"
Sep 09 21:07:57.894218 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.894199    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-235.ec2.internal"
Sep 09 21:07:57.898965 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:57.898586    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-235.ec2.internal"
Sep 09 21:07:57.913131 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:07:57.913109    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-235.ec2.internal\" not found"
Sep 09 21:07:58.013622 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:07:58.013589    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-235.ec2.internal\" not found"
Sep 09 21:07:58.114246 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:07:58.114158    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-235.ec2.internal\" not found"
Sep 09 21:07:58.217649 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:07:58.217606    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-235.ec2.internal\" not found"
Sep 09 21:07:58.312361 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:58.312323    2555 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 09 21:07:58.312797 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:58.312486    2555 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 09 21:07:58.318073 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:07:58.318051    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-235.ec2.internal\" not found"
Sep 09 21:07:58.418631 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:07:58.418524    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-235.ec2.internal\" not found"
Sep 09 21:07:58.429497 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:58.429453    2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-08 21:02:58 +0000 UTC" deadline="2028-05-06 13:44:09.205690236 +0000 UTC"
Sep 09 21:07:58.429497 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:58.429495    2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14512h36m10.776198949s"
Sep 09 21:07:58.519203 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:07:58.519156    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-235.ec2.internal\" not found"
Sep 09 21:07:58.582191 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:58.582152    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 21:07:58.583858 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:58.583823    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-235.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 21:07:58.583977 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:58.583866    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-235.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 21:07:58.583977 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:58.583876    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-235.ec2.internal" event="NodeHasSufficientPID"
Sep 09 21:07:58.613731 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:58.613694    2555 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 21:07:58.619486 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:07:58.619453    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-235.ec2.internal\" not found"
Sep 09 21:07:58.651084 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:58.651049    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80431ef9b40002b355f9a5fc07e0031e.slice/crio-50b05e4a0b21645392ef03783e44ffbac7bd53c802811dd82ee30143dd6eca6f WatchSource:0}: Error finding container 50b05e4a0b21645392ef03783e44ffbac7bd53c802811dd82ee30143dd6eca6f: Status 404 returned error can't find the container with id 50b05e4a0b21645392ef03783e44ffbac7bd53c802811dd82ee30143dd6eca6f
Sep 09 21:07:58.651811 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:58.651785    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf778c97992e131b077853819dd25ede0.slice/crio-e66da2ce847cb0e3a62efd4096a5539c5ab9ba1a862e50c9c16110bbc9b3576b WatchSource:0}: Error finding container e66da2ce847cb0e3a62efd4096a5539c5ab9ba1a862e50c9c16110bbc9b3576b: Status 404 returned error can't find the container with id e66da2ce847cb0e3a62efd4096a5539c5ab9ba1a862e50c9c16110bbc9b3576b
Sep 09 21:07:58.658320 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:58.658302    2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 21:07:58.722680 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:07:58.722584    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-235.ec2.internal\" not found"
Sep 09 21:07:58.760731 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:58.760700    2555 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 21:07:58.766360 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:58.766335    2555 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 21:07:58.769771 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:58.769757    2555 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-235.ec2.internal"
Sep 09 21:07:58.785306 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:58.785289    2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 09 21:07:58.786342 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:58.786330    2555 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-235.ec2.internal"
Sep 09 21:07:58.797153 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:58.797133    2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 09 21:07:59.351334 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.351298    2555 apiserver.go:52] "Watching apiserver"
Sep 09 21:07:59.361929 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.361891    2555 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 09 21:07:59.362290 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.362264    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-fjp57","kube-system/kube-apiserver-proxy-ip-10-0-133-235.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9jhg","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-235.ec2.internal","openshift-network-operator/iptables-alerter-vhmqh","openshift-ovn-kubernetes/ovnkube-node-wzzsp","openshift-cluster-node-tuning-operator/tuned-hssdd","openshift-dns/node-resolver-zln8j","openshift-image-registry/node-ca-z8swp","openshift-multus/multus-additional-cni-plugins-dm8mh","openshift-multus/multus-q7sjb","openshift-multus/network-metrics-daemon-zd7mb","openshift-network-diagnostics/network-check-target-787zm","kube-system/global-pull-secret-syncer-5px25"]
Sep 09 21:07:59.363891 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.363865    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dm8mh"
Sep 09 21:07:59.365430 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.365406    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-787zm"
Sep 09 21:07:59.365538 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:07:59.365513    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-787zm" podUID="f22a4fe6-1a57-40fe-a1c7-ea0662c99601"
Sep 09 21:07:59.366832 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.366733    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9jhg"
Sep 09 21:07:59.367004 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.366982    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 09 21:07:59.367004 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.366996    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 09 21:07:59.367212 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.367191    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 09 21:07:59.367341 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.367231    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-zvl99\""
Sep 09 21:07:59.367431 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.367412    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 09 21:07:59.367570 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.367535    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 09 21:07:59.368550 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.368523    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5px25"
Sep 09 21:07:59.368652 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:07:59.368600    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5px25" podUID="1d5bd2bb-63bd-4425-ae59-2177722354f5"
Sep 09 21:07:59.369454 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.369281    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 09 21:07:59.369618 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.369598    2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 09 21:07:59.370036 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.370014    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 09 21:07:59.370477 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.370459    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-p8grp\""
Sep 09 21:07:59.371015 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.370671    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vhmqh"
Sep 09 21:07:59.371015 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.370700    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 09 21:07:59.371883 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.371861    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp"
Sep 09 21:07:59.373671 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.373349    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-z8swp"
Sep 09 21:07:59.374120 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.373763    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 09 21:07:59.374120 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.373863    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 09 21:07:59.374712 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.374687    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-h9gdr\""
Sep 09 21:07:59.374803 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.374733    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 09 21:07:59.374862 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.374798    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 09 21:07:59.374946 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.374877    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 09 21:07:59.374946 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.374940    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 09 21:07:59.375242 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.375223    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hssdd"
Sep 09 21:07:59.375349 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.375304    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 09 21:07:59.375489 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.375471    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-llmdx\""
Sep 09 21:07:59.375759 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.375226    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 09 21:07:59.376596 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.376019    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 09 21:07:59.376596 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.376411    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 09 21:07:59.376596 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.376420    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 09 21:07:59.376596 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.376456    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 09 21:07:59.376596 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.376416    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-jfv6q\""
Sep 09 21:07:59.377973 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.377952    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zln8j"
Sep 09 21:07:59.379447 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.379428    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fjp57"
Sep 09 21:07:59.379911 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.379893    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-s74b4\""
Sep 09 21:07:59.380022 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.379971    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 09 21:07:59.380237 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.380218    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 09 21:07:59.380576 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.380552    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 09 21:07:59.380801 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.380781    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 09 21:07:59.381441 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.381402    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-kpqkf\""
Sep 09 21:07:59.383190 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.383111    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 09 21:07:59.383460 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.383437    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-26d4k\""
Sep 09 21:07:59.384620 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.384596    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zd7mb"
Sep 09 21:07:59.384728 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:07:59.384703    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zd7mb" podUID="325461e6-e654-481d-9458-feb1bb597455"
Sep 09 21:07:59.384796 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.384517    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-q7sjb"
Sep 09 21:07:59.384796 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.384359    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 09 21:07:59.385130 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.384494    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bd496f3d-f208-431d-8171-5868156304f6-cnibin\") pod \"multus-additional-cni-plugins-dm8mh\" (UID: \"bd496f3d-f208-431d-8171-5868156304f6\") " pod="openshift-multus/multus-additional-cni-plugins-dm8mh"
Sep 09 21:07:59.385334 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.385300    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bd496f3d-f208-431d-8171-5868156304f6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dm8mh\" (UID: \"bd496f3d-f208-431d-8171-5868156304f6\") " pod="openshift-multus/multus-additional-cni-plugins-dm8mh"
Sep 09 21:07:59.385477 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.385440    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/928443e9-b49f-4f2a-acd4-fc3525edc7ee-registration-dir\") pod \"aws-ebs-csi-driver-node-m9jhg\" (UID: \"928443e9-b49f-4f2a-acd4-fc3525edc7ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9jhg"
Sep 09 21:07:59.385577 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.385492    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bltct\" (UniqueName: \"kubernetes.io/projected/928443e9-b49f-4f2a-acd4-fc3525edc7ee-kube-api-access-bltct\") pod \"aws-ebs-csi-driver-node-m9jhg\" (UID: \"928443e9-b49f-4f2a-acd4-fc3525edc7ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9jhg"
Sep 09 21:07:59.385577 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.385523    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/63f30c56-37ce-46c3-b443-9b2afdb432b1-systemd-units\") pod \"ovnkube-node-wzzsp\" (UID: \"63f30c56-37ce-46c3-b443-9b2afdb432b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp"
Sep 09 21:07:59.385577 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.385556    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63f30c56-37ce-46c3-b443-9b2afdb432b1-host-run-ovn-kubernetes\") pod \"ovnkube-node-wzzsp\" (UID: \"63f30c56-37ce-46c3-b443-9b2afdb432b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp"
Sep 09 21:07:59.385734 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.385587    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bd496f3d-f208-431d-8171-5868156304f6-cni-binary-copy\") pod \"multus-additional-cni-plugins-dm8mh\" (UID: \"bd496f3d-f208-431d-8171-5868156304f6\") " pod="openshift-multus/multus-additional-cni-plugins-dm8mh"
Sep 09 21:07:59.385734 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.385620    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1d5bd2bb-63bd-4425-ae59-2177722354f5-kubelet-config\") pod \"global-pull-secret-syncer-5px25\" (UID: \"1d5bd2bb-63bd-4425-ae59-2177722354f5\") " pod="kube-system/global-pull-secret-syncer-5px25"
Sep 09 21:07:59.385734 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.385646    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bd496f3d-f208-431d-8171-5868156304f6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dm8mh\" (UID: \"bd496f3d-f208-431d-8171-5868156304f6\") " pod="openshift-multus/multus-additional-cni-plugins-dm8mh"
Sep 09 21:07:59.385734 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.385703    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/928443e9-b49f-4f2a-acd4-fc3525edc7ee-etc-selinux\") pod \"aws-ebs-csi-driver-node-m9jhg\" (UID: \"928443e9-b49f-4f2a-acd4-fc3525edc7ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9jhg"
Sep 09 21:07:59.385957 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.385733    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/63f30c56-37ce-46c3-b443-9b2afdb432b1-node-log\") pod \"ovnkube-node-wzzsp\" (UID: \"63f30c56-37ce-46c3-b443-9b2afdb432b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp"
Sep 09 21:07:59.385957 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.385764    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/63f30c56-37ce-46c3-b443-9b2afdb432b1-ovn-node-metrics-cert\") pod \"ovnkube-node-wzzsp\" (UID: \"63f30c56-37ce-46c3-b443-9b2afdb432b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp"
Sep 09 21:07:59.385957 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.385812    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q58qv\" (UniqueName: \"kubernetes.io/projected/63f30c56-37ce-46c3-b443-9b2afdb432b1-kube-api-access-q58qv\") pod \"ovnkube-node-wzzsp\" (UID: \"63f30c56-37ce-46c3-b443-9b2afdb432b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp"
Sep 09 21:07:59.385957 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.385885    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqnl5\" (UniqueName: \"kubernetes.io/projected/140804ca-8508-4fe3-bfb1-1726c619701e-kube-api-access-dqnl5\") pod \"iptables-alerter-vhmqh\" (UID: \"140804ca-8508-4fe3-bfb1-1726c619701e\") " pod="openshift-network-operator/iptables-alerter-vhmqh"
Sep 09 21:07:59.385957 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.385936    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/63f30c56-37ce-46c3-b443-9b2afdb432b1-host-slash\") pod \"ovnkube-node-wzzsp\" (UID: \"63f30c56-37ce-46c3-b443-9b2afdb432b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp"
Sep 09 21:07:59.386203 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.385968    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/63f30c56-37ce-46c3-b443-9b2afdb432b1-run-systemd\") pod \"ovnkube-node-wzzsp\" (UID: \"63f30c56-37ce-46c3-b443-9b2afdb432b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp"
Sep 09 21:07:59.386203 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.385995    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63f30c56-37ce-46c3-b443-9b2afdb432b1-var-lib-openvswitch\") pod \"ovnkube-node-wzzsp\" (UID: \"63f30c56-37ce-46c3-b443-9b2afdb432b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp"
Sep 09 21:07:59.386203 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.386034    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63f30c56-37ce-46c3-b443-9b2afdb432b1-run-openvswitch\") pod \"ovnkube-node-wzzsp\" (UID: \"63f30c56-37ce-46c3-b443-9b2afdb432b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp"
Sep 09 21:07:59.386203 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.386078    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/63f30c56-37ce-46c3-b443-9b2afdb432b1-host-cni-bin\") pod \"ovnkube-node-wzzsp\" (UID: \"63f30c56-37ce-46c3-b443-9b2afdb432b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp"
Sep 09 21:07:59.386203 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.386118    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/63f30c56-37ce-46c3-b443-9b2afdb432b1-env-overrides\") pod \"ovnkube-node-wzzsp\" (UID: \"63f30c56-37ce-46c3-b443-9b2afdb432b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp"
Sep 09 21:07:59.386203 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.386151    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/63f30c56-37ce-46c3-b443-9b2afdb432b1-host-kubelet\") pod \"ovnkube-node-wzzsp\" (UID: \"63f30c56-37ce-46c3-b443-9b2afdb432b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp"
Sep 09 21:07:59.386499 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.386215    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/63f30c56-37ce-46c3-b443-9b2afdb432b1-run-ovn\") pod \"ovnkube-node-wzzsp\" (UID: \"63f30c56-37ce-46c3-b443-9b2afdb432b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp"
Sep 09 21:07:59.386499 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.386246    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bd496f3d-f208-431d-8171-5868156304f6-system-cni-dir\") pod \"multus-additional-cni-plugins-dm8mh\" (UID: \"bd496f3d-f208-431d-8171-5868156304f6\") " pod="openshift-multus/multus-additional-cni-plugins-dm8mh"
Sep 09 21:07:59.386499 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.386280    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/928443e9-b49f-4f2a-acd4-fc3525edc7ee-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m9jhg\" (UID: \"928443e9-b49f-4f2a-acd4-fc3525edc7ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9jhg"
Sep 09 21:07:59.386499 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.386317    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/928443e9-b49f-4f2a-acd4-fc3525edc7ee-socket-dir\") pod \"aws-ebs-csi-driver-node-m9jhg\" (UID: \"928443e9-b49f-4f2a-acd4-fc3525edc7ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9jhg"
Sep 09 21:07:59.386499 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.386347    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/928443e9-b49f-4f2a-acd4-fc3525edc7ee-device-dir\") pod \"aws-ebs-csi-driver-node-m9jhg\" (UID: \"928443e9-b49f-4f2a-acd4-fc3525edc7ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9jhg"
Sep 09 21:07:59.386499 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.386386    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1d5bd2bb-63bd-4425-ae59-2177722354f5-dbus\") pod \"global-pull-secret-syncer-5px25\" (UID: \"1d5bd2bb-63bd-4425-ae59-2177722354f5\") " pod="kube-system/global-pull-secret-syncer-5px25"
Sep 09 21:07:59.386499 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.386418    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/63f30c56-37ce-46c3-b443-9b2afdb432b1-log-socket\") pod \"ovnkube-node-wzzsp\" (UID: \"63f30c56-37ce-46c3-b443-9b2afdb432b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp"
Sep 09 21:07:59.386499 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.386451    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bd496f3d-f208-431d-8171-5868156304f6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dm8mh\" (UID: \"bd496f3d-f208-431d-8171-5868156304f6\") " pod="openshift-multus/multus-additional-cni-plugins-dm8mh"
Sep 09 21:07:59.386499 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.386476    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/928443e9-b49f-4f2a-acd4-fc3525edc7ee-sys-fs\") pod \"aws-ebs-csi-driver-node-m9jhg\" (UID: \"928443e9-b49f-4f2a-acd4-fc3525edc7ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9jhg"
Sep 09 21:07:59.386985 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.386505    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1d5bd2bb-63bd-4425-ae59-2177722354f5-original-pull-secret\") pod \"global-pull-secret-syncer-5px25\" (UID: \"1d5bd2bb-63bd-4425-ae59-2177722354f5\") " pod="kube-system/global-pull-secret-syncer-5px25"
Sep 09 21:07:59.386985 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.386542    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/140804ca-8508-4fe3-bfb1-1726c619701e-iptables-alerter-script\") pod \"iptables-alerter-vhmqh\" (UID: \"140804ca-8508-4fe3-bfb1-1726c619701e\") " pod="openshift-network-operator/iptables-alerter-vhmqh"
Sep 09 21:07:59.386985 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.386572    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/63f30c56-37ce-46c3-b443-9b2afdb432b1-host-run-netns\") pod \"ovnkube-node-wzzsp\" (UID: \"63f30c56-37ce-46c3-b443-9b2afdb432b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp"
Sep 09 21:07:59.386985 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.386599    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63f30c56-37ce-46c3-b443-9b2afdb432b1-etc-openvswitch\") pod \"ovnkube-node-wzzsp\" (UID: \"63f30c56-37ce-46c3-b443-9b2afdb432b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp"
Sep 09 21:07:59.386985 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.386669    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/63f30c56-37ce-46c3-b443-9b2afdb432b1-ovnkube-config\") pod \"ovnkube-node-wzzsp\" (UID: \"63f30c56-37ce-46c3-b443-9b2afdb432b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp"
Sep 09 21:07:59.386985 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.386709    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/63f30c56-37ce-46c3-b443-9b2afdb432b1-ovnkube-script-lib\") pod \"ovnkube-node-wzzsp\" (UID: \"63f30c56-37ce-46c3-b443-9b2afdb432b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp"
Sep 09 21:07:59.386985 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.386746    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4x9n\" (UniqueName: \"kubernetes.io/projected/bd496f3d-f208-431d-8171-5868156304f6-kube-api-access-q4x9n\") pod \"multus-additional-cni-plugins-dm8mh\" (UID: \"bd496f3d-f208-431d-8171-5868156304f6\") " pod="openshift-multus/multus-additional-cni-plugins-dm8mh"
Sep 09 21:07:59.386985 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.386822    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rj4lj\" (UniqueName: \"kubernetes.io/projected/f22a4fe6-1a57-40fe-a1c7-ea0662c99601-kube-api-access-rj4lj\") pod \"network-check-target-787zm\" (UID: \"f22a4fe6-1a57-40fe-a1c7-ea0662c99601\") " pod="openshift-network-diagnostics/network-check-target-787zm"
Sep 09 21:07:59.386985 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.386867    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/140804ca-8508-4fe3-bfb1-1726c619701e-host-slash\") pod \"iptables-alerter-vhmqh\" (UID: \"140804ca-8508-4fe3-bfb1-1726c619701e\") " pod="openshift-network-operator/iptables-alerter-vhmqh"
Sep 09 21:07:59.387429 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.386931    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/63f30c56-37ce-46c3-b443-9b2afdb432b1-host-cni-netd\") pod \"ovnkube-node-wzzsp\" (UID: \"63f30c56-37ce-46c3-b443-9b2afdb432b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp"
Sep 09 21:07:59.387429 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.387179    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63f30c56-37ce-46c3-b443-9b2afdb432b1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wzzsp\" (UID: \"63f30c56-37ce-46c3-b443-9b2afdb432b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp"
Sep 09 21:07:59.387890 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.387867    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-9cc4x\""
Sep 09 21:07:59.388154 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.388136    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 09 21:07:59.390635 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.390612    2555 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 09 21:07:59.422674 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.422484    2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-vzftb"
Sep 09 21:07:59.434150 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.434122    2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-vzftb"
Sep 09 21:07:59.466823 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.466732    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-235.ec2.internal" event={"ID":"80431ef9b40002b355f9a5fc07e0031e","Type":"ContainerStarted","Data":"50b05e4a0b21645392ef03783e44ffbac7bd53c802811dd82ee30143dd6eca6f"}
Sep 09 21:07:59.468368 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.468306    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-235.ec2.internal" event={"ID":"f778c97992e131b077853819dd25ede0","Type":"ContainerStarted","Data":"e66da2ce847cb0e3a62efd4096a5539c5ab9ba1a862e50c9c16110bbc9b3576b"}
Sep 09 21:07:59.471120 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.471085    2555 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 09 21:07:59.488007 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.487968    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/85bff06c-41a6-4cd8-8196-aca41c4b9a50-host-run-multus-certs\") pod \"multus-q7sjb\" (UID: \"85bff06c-41a6-4cd8-8196-aca41c4b9a50\") " pod="openshift-multus/multus-q7sjb"
Sep 09 21:07:59.488141 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.488014    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/63f30c56-37ce-46c3-b443-9b2afdb432b1-ovn-node-metrics-cert\") pod \"ovnkube-node-wzzsp\" (UID: \"63f30c56-37ce-46c3-b443-9b2afdb432b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp"
Sep 09 21:07:59.488141 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.488046    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q58qv\" (UniqueName: \"kubernetes.io/projected/63f30c56-37ce-46c3-b443-9b2afdb432b1-kube-api-access-q58qv\") pod \"ovnkube-node-wzzsp\" (UID: \"63f30c56-37ce-46c3-b443-9b2afdb432b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp"
Sep 09 21:07:59.488141 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.488073    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8db7296c-f0fc-4706-b8a2-1a189e9e4fea-etc-systemd\") pod \"tuned-hssdd\" (UID: \"8db7296c-f0fc-4706-b8a2-1a189e9e4fea\") " pod="openshift-cluster-node-tuning-operator/tuned-hssdd"
Sep 09 21:07:59.488141 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.488100    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8db7296c-f0fc-4706-b8a2-1a189e9e4fea-var-lib-kubelet\") pod \"tuned-hssdd\" (UID: \"8db7296c-f0fc-4706-b8a2-1a189e9e4fea\") " pod="openshift-cluster-node-tuning-operator/tuned-hssdd"
Sep 09 21:07:59.488141 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.488124    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8db7296c-f0fc-4706-b8a2-1a189e9e4fea-host\") pod \"tuned-hssdd\" (UID: \"8db7296c-f0fc-4706-b8a2-1a189e9e4fea\") " pod="openshift-cluster-node-tuning-operator/tuned-hssdd"
Sep 09 21:07:59.488407 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.488149    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/85bff06c-41a6-4cd8-8196-aca41c4b9a50-host-run-netns\") pod \"multus-q7sjb\" (UID: \"85bff06c-41a6-4cd8-8196-aca41c4b9a50\") " pod="openshift-multus/multus-q7sjb"
Sep 09 21:07:59.488407 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.488175    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63f30c56-37ce-46c3-b443-9b2afdb432b1-run-openvswitch\") pod \"ovnkube-node-wzzsp\" (UID: \"63f30c56-37ce-46c3-b443-9b2afdb432b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp"
Sep 09 21:07:59.488407 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.488200    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eb3f4d24-4a06-4b75-a0ea-c6e8fba9e5f6-host\") pod \"node-ca-z8swp\" (UID: \"eb3f4d24-4a06-4b75-a0ea-c6e8fba9e5f6\") " pod="openshift-image-registry/node-ca-z8swp"
Sep 09 21:07:59.488407 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.488227    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8db7296c-f0fc-4706-b8a2-1a189e9e4fea-etc-sysctl-conf\") pod \"tuned-hssdd\" (UID: \"8db7296c-f0fc-4706-b8a2-1a189e9e4fea\") " pod="openshift-cluster-node-tuning-operator/tuned-hssdd"
Sep 09 21:07:59.488407 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.488253    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/63f30c56-37ce-46c3-b443-9b2afdb432b1-run-ovn\") pod \"ovnkube-node-wzzsp\" (UID: \"63f30c56-37ce-46c3-b443-9b2afdb432b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp"
Sep 09 21:07:59.488407 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.488278    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bd496f3d-f208-431d-8171-5868156304f6-system-cni-dir\") pod \"multus-additional-cni-plugins-dm8mh\" (UID: \"bd496f3d-f208-431d-8171-5868156304f6\") " pod="openshift-multus/multus-additional-cni-plugins-dm8mh"
Sep 09 21:07:59.488407 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.488298    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/928443e9-b49f-4f2a-acd4-fc3525edc7ee-socket-dir\") pod \"aws-ebs-csi-driver-node-m9jhg\" (UID: \"928443e9-b49f-4f2a-acd4-fc3525edc7ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9jhg"
Sep 09 21:07:59.488407 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.488319    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/928443e9-b49f-4f2a-acd4-fc3525edc7ee-device-dir\") pod \"aws-ebs-csi-driver-node-m9jhg\" (UID: \"928443e9-b49f-4f2a-acd4-fc3525edc7ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9jhg"
Sep 09 21:07:59.488407 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.488355    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/63f30c56-37ce-46c3-b443-9b2afdb432b1-log-socket\") pod \"ovnkube-node-wzzsp\" (UID: \"63f30c56-37ce-46c3-b443-9b2afdb432b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp"
Sep 09 21:07:59.488407 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.488380    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/df53dce4-0da4-4e78-8e7d-e77e0734a8d9-agent-certs\") pod \"konnectivity-agent-fjp57\" (UID: \"df53dce4-0da4-4e78-8e7d-e77e0734a8d9\") " pod="kube-system/konnectivity-agent-fjp57"
Sep 09 21:07:59.488984 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.488411    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/85bff06c-41a6-4cd8-8196-aca41c4b9a50-hostroot\") pod \"multus-q7sjb\" (UID: \"85bff06c-41a6-4cd8-8196-aca41c4b9a50\") " pod="openshift-multus/multus-q7sjb"
Sep 09 21:07:59.488984 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.488440    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1d5bd2bb-63bd-4425-ae59-2177722354f5-original-pull-secret\") pod \"global-pull-secret-syncer-5px25\" (UID: \"1d5bd2bb-63bd-4425-ae59-2177722354f5\") " pod="kube-system/global-pull-secret-syncer-5px25"
Sep 09 21:07:59.488984 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.488469    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/140804ca-8508-4fe3-bfb1-1726c619701e-iptables-alerter-script\") pod \"iptables-alerter-vhmqh\" (UID: \"140804ca-8508-4fe3-bfb1-1726c619701e\") " pod="openshift-network-operator/iptables-alerter-vhmqh"
Sep 09 21:07:59.488984 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.488499    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63f30c56-37ce-46c3-b443-9b2afdb432b1-etc-openvswitch\") pod \"ovnkube-node-wzzsp\" (UID: \"63f30c56-37ce-46c3-b443-9b2afdb432b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp"
Sep 09 21:07:59.488984 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.488524    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/63f30c56-37ce-46c3-b443-9b2afdb432b1-ovnkube-config\") pod \"ovnkube-node-wzzsp\" (UID: \"63f30c56-37ce-46c3-b443-9b2afdb432b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp"
Sep 09 21:07:59.488984 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.488549    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/63f30c56-37ce-46c3-b443-9b2afdb432b1-ovnkube-script-lib\") pod \"ovnkube-node-wzzsp\" (UID: \"63f30c56-37ce-46c3-b443-9b2afdb432b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp"
Sep 09 21:07:59.488984 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.488577    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4x9n\" (UniqueName: \"kubernetes.io/projected/bd496f3d-f208-431d-8171-5868156304f6-kube-api-access-q4x9n\") pod \"multus-additional-cni-plugins-dm8mh\" (UID: \"bd496f3d-f208-431d-8171-5868156304f6\") " pod="openshift-multus/multus-additional-cni-plugins-dm8mh"
Sep 09 21:07:59.488984 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.488602    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/928443e9-b49f-4f2a-acd4-fc3525edc7ee-registration-dir\") pod \"aws-ebs-csi-driver-node-m9jhg\" (UID: \"928443e9-b49f-4f2a-acd4-fc3525edc7ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9jhg"
Sep 09 21:07:59.488984 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.488633    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8db7296c-f0fc-4706-b8a2-1a189e9e4fea-etc-modprobe-d\") pod \"tuned-hssdd\" (UID: \"8db7296c-f0fc-4706-b8a2-1a189e9e4fea\") " pod="openshift-cluster-node-tuning-operator/tuned-hssdd"
Sep 09 21:07:59.488984 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.488665    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bd496f3d-f208-431d-8171-5868156304f6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dm8mh\" (UID: \"bd496f3d-f208-431d-8171-5868156304f6\") " pod="openshift-multus/multus-additional-cni-plugins-dm8mh"
Sep 09 21:07:59.488984 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.488690    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8db7296c-f0fc-4706-b8a2-1a189e9e4fea-lib-modules\") pod \"tuned-hssdd\" (UID: \"8db7296c-f0fc-4706-b8a2-1a189e9e4fea\") " pod="openshift-cluster-node-tuning-operator/tuned-hssdd"
Sep 09 21:07:59.488984 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.488715    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/22210233-a1fa-4335-a652-6b89192b07ec-tmp-dir\") pod \"node-resolver-zln8j\" (UID: \"22210233-a1fa-4335-a652-6b89192b07ec\") " pod="openshift-dns/node-resolver-zln8j"
Sep 09 21:07:59.488984 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.488739    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/85bff06c-41a6-4cd8-8196-aca41c4b9a50-system-cni-dir\") pod \"multus-q7sjb\" (UID: \"85bff06c-41a6-4cd8-8196-aca41c4b9a50\") " pod="openshift-multus/multus-q7sjb"
Sep 09 21:07:59.488984 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.488764    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/85bff06c-41a6-4cd8-8196-aca41c4b9a50-host-run-k8s-cni-cncf-io\") pod \"multus-q7sjb\" (UID: \"85bff06c-41a6-4cd8-8196-aca41c4b9a50\") " pod="openshift-multus/multus-q7sjb"
Sep 09 21:07:59.488984 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.488809    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/85bff06c-41a6-4cd8-8196-aca41c4b9a50-host-var-lib-cni-multus\") pod \"multus-q7sjb\" (UID: \"85bff06c-41a6-4cd8-8196-aca41c4b9a50\") " pod="openshift-multus/multus-q7sjb"
Sep 09 21:07:59.488984 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.488839    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/85bff06c-41a6-4cd8-8196-aca41c4b9a50-multus-daemon-config\") pod \"multus-q7sjb\" (UID: \"85bff06c-41a6-4cd8-8196-aca41c4b9a50\") " pod="openshift-multus/multus-q7sjb"
Sep 09 21:07:59.488984 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.488884    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/85bff06c-41a6-4cd8-8196-aca41c4b9a50-etc-kubernetes\") pod \"multus-q7sjb\" (UID: \"85bff06c-41a6-4cd8-8196-aca41c4b9a50\") " pod="openshift-multus/multus-q7sjb"
Sep 09 21:07:59.489831 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.488927    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/63f30c56-37ce-46c3-b443-9b2afdb432b1-systemd-units\") pod \"ovnkube-node-wzzsp\" (UID: \"63f30c56-37ce-46c3-b443-9b2afdb432b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp"
Sep 09 21:07:59.489831 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.488958    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2c46p\" (UniqueName: \"kubernetes.io/projected/325461e6-e654-481d-9458-feb1bb597455-kube-api-access-2c46p\") pod \"network-metrics-daemon-zd7mb\" (UID: \"325461e6-e654-481d-9458-feb1bb597455\") " pod="openshift-multus/network-metrics-daemon-zd7mb"
Sep 09 21:07:59.489831 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.488984    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8db7296c-f0fc-4706-b8a2-1a189e9e4fea-tmp\") pod \"tuned-hssdd\" (UID: \"8db7296c-f0fc-4706-b8a2-1a189e9e4fea\") " pod="openshift-cluster-node-tuning-operator/tuned-hssdd"
Sep 09 21:07:59.489831 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.489010    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/85bff06c-41a6-4cd8-8196-aca41c4b9a50-host-var-lib-kubelet\") pod \"multus-q7sjb\" (UID: \"85bff06c-41a6-4cd8-8196-aca41c4b9a50\") " pod="openshift-multus/multus-q7sjb"
Sep 09 21:07:59.489831 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.489052    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1d5bd2bb-63bd-4425-ae59-2177722354f5-kubelet-config\") pod \"global-pull-secret-syncer-5px25\" (UID: \"1d5bd2bb-63bd-4425-ae59-2177722354f5\") " pod="kube-system/global-pull-secret-syncer-5px25"
Sep 09 21:07:59.489831 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.489079    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/63f30c56-37ce-46c3-b443-9b2afdb432b1-node-log\") pod \"ovnkube-node-wzzsp\" (UID: \"63f30c56-37ce-46c3-b443-9b2afdb432b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp"
Sep 09 21:07:59.489831 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.489102    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8db7296c-f0fc-4706-b8a2-1a189e9e4fea-sys\") pod \"tuned-hssdd\" (UID: \"8db7296c-f0fc-4706-b8a2-1a189e9e4fea\") " pod="openshift-cluster-node-tuning-operator/tuned-hssdd"
Sep 09 21:07:59.489831 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.489127    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/85bff06c-41a6-4cd8-8196-aca41c4b9a50-cni-binary-copy\") pod \"multus-q7sjb\" (UID: \"85bff06c-41a6-4cd8-8196-aca41c4b9a50\") " pod="openshift-multus/multus-q7sjb"
Sep 09 21:07:59.489831 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.489152    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/85bff06c-41a6-4cd8-8196-aca41c4b9a50-multus-conf-dir\") pod \"multus-q7sjb\" (UID: \"85bff06c-41a6-4cd8-8196-aca41c4b9a50\") " pod="openshift-multus/multus-q7sjb"
Sep 09 21:07:59.489831 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.489181    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqnl5\" (UniqueName: \"kubernetes.io/projected/140804ca-8508-4fe3-bfb1-1726c619701e-kube-api-access-dqnl5\") pod \"iptables-alerter-vhmqh\" (UID: \"140804ca-8508-4fe3-bfb1-1726c619701e\") " pod="openshift-network-operator/iptables-alerter-vhmqh"
Sep 09 21:07:59.489831 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.489212    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/63f30c56-37ce-46c3-b443-9b2afdb432b1-host-slash\") pod \"ovnkube-node-wzzsp\" (UID: \"63f30c56-37ce-46c3-b443-9b2afdb432b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp"
Sep 09 21:07:59.489831 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.489268    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/63f30c56-37ce-46c3-b443-9b2afdb432b1-run-systemd\") pod \"ovnkube-node-wzzsp\" (UID: \"63f30c56-37ce-46c3-b443-9b2afdb432b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp"
Sep 09 21:07:59.489831 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.489295    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63f30c56-37ce-46c3-b443-9b2afdb432b1-var-lib-openvswitch\") pod \"ovnkube-node-wzzsp\" (UID: \"63f30c56-37ce-46c3-b443-9b2afdb432b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp"
Sep 09 21:07:59.489831 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.489329    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/63f30c56-37ce-46c3-b443-9b2afdb432b1-host-cni-bin\") pod \"ovnkube-node-wzzsp\" (UID: \"63f30c56-37ce-46c3-b443-9b2afdb432b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp"
Sep 09 21:07:59.489831 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.489355    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/63f30c56-37ce-46c3-b443-9b2afdb432b1-env-overrides\") pod \"ovnkube-node-wzzsp\" (UID: \"63f30c56-37ce-46c3-b443-9b2afdb432b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp"
Sep 09 21:07:59.489831 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.489385    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/928443e9-b49f-4f2a-acd4-fc3525edc7ee-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m9jhg\" (UID: \"928443e9-b49f-4f2a-acd4-fc3525edc7ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9jhg"
Sep 09 21:07:59.489831 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.489415    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/63f30c56-37ce-46c3-b443-9b2afdb432b1-host-kubelet\") pod \"ovnkube-node-wzzsp\" (UID: \"63f30c56-37ce-46c3-b443-9b2afdb432b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp"
Sep 09 21:07:59.490719 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.489440    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8db7296c-f0fc-4706-b8a2-1a189e9e4fea-etc-sysctl-d\") pod \"tuned-hssdd\" (UID: \"8db7296c-f0fc-4706-b8a2-1a189e9e4fea\") " pod="openshift-cluster-node-tuning-operator/tuned-hssdd"
Sep 09 21:07:59.490719 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.489466    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/22210233-a1fa-4335-a652-6b89192b07ec-hosts-file\") pod \"node-resolver-zln8j\" (UID: \"22210233-a1fa-4335-a652-6b89192b07ec\") " pod="openshift-dns/node-resolver-zln8j"
Sep 09 21:07:59.490719 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.489492    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbtb9\" (UniqueName: \"kubernetes.io/projected/22210233-a1fa-4335-a652-6b89192b07ec-kube-api-access-zbtb9\") pod \"node-resolver-zln8j\" (UID: \"22210233-a1fa-4335-a652-6b89192b07ec\") " pod="openshift-dns/node-resolver-zln8j"
Sep 09 21:07:59.490719 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.489519    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/85bff06c-41a6-4cd8-8196-aca41c4b9a50-cnibin\") pod \"multus-q7sjb\" (UID: \"85bff06c-41a6-4cd8-8196-aca41c4b9a50\") " pod="openshift-multus/multus-q7sjb"
Sep 09 21:07:59.490719 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.489545    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1d5bd2bb-63bd-4425-ae59-2177722354f5-dbus\") pod \"global-pull-secret-syncer-5px25\" (UID: \"1d5bd2bb-63bd-4425-ae59-2177722354f5\") " pod="kube-system/global-pull-secret-syncer-5px25"
Sep 09 21:07:59.490719 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.489572    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bd496f3d-f208-431d-8171-5868156304f6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dm8mh\" (UID: \"bd496f3d-f208-431d-8171-5868156304f6\") " pod="openshift-multus/multus-additional-cni-plugins-dm8mh"
Sep 09 21:07:59.490719 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.489600    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/928443e9-b49f-4f2a-acd4-fc3525edc7ee-sys-fs\") pod \"aws-ebs-csi-driver-node-m9jhg\" (UID: \"928443e9-b49f-4f2a-acd4-fc3525edc7ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9jhg"
Sep 09 21:07:59.490719 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.489662    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/df53dce4-0da4-4e78-8e7d-e77e0734a8d9-konnectivity-ca\") pod \"konnectivity-agent-fjp57\" (UID: \"df53dce4-0da4-4e78-8e7d-e77e0734a8d9\") " pod="kube-system/konnectivity-agent-fjp57"
Sep 09 21:07:59.490719 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.489727    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8db7296c-f0fc-4706-b8a2-1a189e9e4fea-etc-tuned\") pod \"tuned-hssdd\" (UID: \"8db7296c-f0fc-4706-b8a2-1a189e9e4fea\") " pod="openshift-cluster-node-tuning-operator/tuned-hssdd"
Sep 09 21:07:59.490719 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.490328    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/63f30c56-37ce-46c3-b443-9b2afdb432b1-log-socket\") pod \"ovnkube-node-wzzsp\" (UID: \"63f30c56-37ce-46c3-b443-9b2afdb432b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp"
Sep 09 21:07:59.490719 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.490389    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/85bff06c-41a6-4cd8-8196-aca41c4b9a50-multus-socket-dir-parent\") pod \"multus-q7sjb\" (UID: \"85bff06c-41a6-4cd8-8196-aca41c4b9a50\") " pod="openshift-multus/multus-q7sjb"
Sep 09 21:07:59.490719 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.490395    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63f30c56-37ce-46c3-b443-9b2afdb432b1-var-lib-openvswitch\") pod \"ovnkube-node-wzzsp\" (UID: \"63f30c56-37ce-46c3-b443-9b2afdb432b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp"
Sep 09 21:07:59.490719 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.490437    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/63f30c56-37ce-46c3-b443-9b2afdb432b1-systemd-units\") pod \"ovnkube-node-wzzsp\" (UID: \"63f30c56-37ce-46c3-b443-9b2afdb432b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp"
Sep 09 21:07:59.490719 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.490448    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/63f30c56-37ce-46c3-b443-9b2afdb432b1-host-cni-bin\") pod \"ovnkube-node-wzzsp\" (UID: \"63f30c56-37ce-46c3-b443-9b2afdb432b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp"
Sep 09 21:07:59.490719 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.490464    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/85bff06c-41a6-4cd8-8196-aca41c4b9a50-host-var-lib-cni-bin\") pod \"multus-q7sjb\" (UID: \"85bff06c-41a6-4cd8-8196-aca41c4b9a50\") " pod="openshift-multus/multus-q7sjb"
Sep 09 21:07:59.490719 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.490533    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1d5bd2bb-63bd-4425-ae59-2177722354f5-kubelet-config\") pod \"global-pull-secret-syncer-5px25\" (UID: \"1d5bd2bb-63bd-4425-ae59-2177722354f5\") " pod="kube-system/global-pull-secret-syncer-5px25"
Sep 09 21:07:59.490719 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.490585    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/63f30c56-37ce-46c3-b443-9b2afdb432b1-node-log\") pod \"ovnkube-node-wzzsp\" (UID: \"63f30c56-37ce-46c3-b443-9b2afdb432b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp"
Sep 09 21:07:59.491643 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.490967    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/63f30c56-37ce-46c3-b443-9b2afdb432b1-env-overrides\") pod \"ovnkube-node-wzzsp\" (UID: \"63f30c56-37ce-46c3-b443-9b2afdb432b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp"
Sep 09 21:07:59.491643 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.491034    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sx5jp\" (UniqueName: \"kubernetes.io/projected/85bff06c-41a6-4cd8-8196-aca41c4b9a50-kube-api-access-sx5jp\") pod \"multus-q7sjb\" (UID: \"85bff06c-41a6-4cd8-8196-aca41c4b9a50\") " pod="openshift-multus/multus-q7sjb"
Sep 09 21:07:59.491643 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.491066    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/63f30c56-37ce-46c3-b443-9b2afdb432b1-host-run-netns\") pod \"ovnkube-node-wzzsp\" (UID: \"63f30c56-37ce-46c3-b443-9b2afdb432b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp"
Sep 09 21:07:59.491643 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.491092    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rj4lj\" (UniqueName: \"kubernetes.io/projected/f22a4fe6-1a57-40fe-a1c7-ea0662c99601-kube-api-access-rj4lj\") pod \"network-check-target-787zm\" (UID: \"f22a4fe6-1a57-40fe-a1c7-ea0662c99601\") " pod="openshift-network-diagnostics/network-check-target-787zm"
Sep 09 21:07:59.491643 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.491116    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8db7296c-f0fc-4706-b8a2-1a189e9e4fea-run\") pod \"tuned-hssdd\" (UID: \"8db7296c-f0fc-4706-b8a2-1a189e9e4fea\") " pod="openshift-cluster-node-tuning-operator/tuned-hssdd"
Sep 09 21:07:59.491643 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.491141    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/140804ca-8508-4fe3-bfb1-1726c619701e-host-slash\") pod \"iptables-alerter-vhmqh\" (UID: \"140804ca-8508-4fe3-bfb1-1726c619701e\") " pod="openshift-network-operator/iptables-alerter-vhmqh"
Sep 09 21:07:59.491643 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.491168    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/63f30c56-37ce-46c3-b443-9b2afdb432b1-host-cni-netd\") pod \"ovnkube-node-wzzsp\" (UID: \"63f30c56-37ce-46c3-b443-9b2afdb432b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp"
Sep 09 21:07:59.491643 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.491196    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63f30c56-37ce-46c3-b443-9b2afdb432b1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wzzsp\" (UID: \"63f30c56-37ce-46c3-b443-9b2afdb432b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp"
Sep 09 21:07:59.491643 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.491234    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bd496f3d-f208-431d-8171-5868156304f6-cnibin\") pod \"multus-additional-cni-plugins-dm8mh\" (UID: \"bd496f3d-f208-431d-8171-5868156304f6\") " pod="openshift-multus/multus-additional-cni-plugins-dm8mh"
Sep 09 21:07:59.491643 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.491264    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bltct\" (UniqueName: \"kubernetes.io/projected/928443e9-b49f-4f2a-acd4-fc3525edc7ee-kube-api-access-bltct\") pod \"aws-ebs-csi-driver-node-m9jhg\" (UID: \"928443e9-b49f-4f2a-acd4-fc3525edc7ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9jhg"
Sep 09 21:07:59.491643 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.491293    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/325461e6-e654-481d-9458-feb1bb597455-metrics-certs\") pod \"network-metrics-daemon-zd7mb\" (UID: \"325461e6-e654-481d-9458-feb1bb597455\") " pod="openshift-multus/network-metrics-daemon-zd7mb"
Sep 09 21:07:59.491643 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.491324    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hjbj\" (UniqueName: \"kubernetes.io/projected/8db7296c-f0fc-4706-b8a2-1a189e9e4fea-kube-api-access-5hjbj\") pod \"tuned-hssdd\" (UID: \"8db7296c-f0fc-4706-b8a2-1a189e9e4fea\") " pod="openshift-cluster-node-tuning-operator/tuned-hssdd"
Sep 09 21:07:59.491643 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.491324    2555 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 09 21:07:59.491643 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.491353    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63f30c56-37ce-46c3-b443-9b2afdb432b1-host-run-ovn-kubernetes\") pod \"ovnkube-node-wzzsp\" (UID: \"63f30c56-37ce-46c3-b443-9b2afdb432b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp"
Sep 09 21:07:59.491643 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.491402    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bd496f3d-f208-431d-8171-5868156304f6-cni-binary-copy\") pod \"multus-additional-cni-plugins-dm8mh\" (UID: \"bd496f3d-f208-431d-8171-5868156304f6\") " pod="openshift-multus/multus-additional-cni-plugins-dm8mh"
Sep 09 21:07:59.491643 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.491428    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eb3f4d24-4a06-4b75-a0ea-c6e8fba9e5f6-serviceca\") pod \"node-ca-z8swp\" (UID: \"eb3f4d24-4a06-4b75-a0ea-c6e8fba9e5f6\") " pod="openshift-image-registry/node-ca-z8swp"
Sep 09 21:07:59.491643 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.491450    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8db7296c-f0fc-4706-b8a2-1a189e9e4fea-etc-sysconfig\") pod \"tuned-hssdd\" (UID: \"8db7296c-f0fc-4706-b8a2-1a189e9e4fea\") " pod="openshift-cluster-node-tuning-operator/tuned-hssdd"
Sep 09 21:07:59.492486 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.491472    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8db7296c-f0fc-4706-b8a2-1a189e9e4fea-etc-kubernetes\") pod \"tuned-hssdd\" (UID: \"8db7296c-f0fc-4706-b8a2-1a189e9e4fea\") " pod="openshift-cluster-node-tuning-operator/tuned-hssdd"
Sep 09 21:07:59.492486 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.491495    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/85bff06c-41a6-4cd8-8196-aca41c4b9a50-multus-cni-dir\") pod \"multus-q7sjb\" (UID: \"85bff06c-41a6-4cd8-8196-aca41c4b9a50\") " pod="openshift-multus/multus-q7sjb"
Sep 09 21:07:59.492486 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.491523    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bd496f3d-f208-431d-8171-5868156304f6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dm8mh\" (UID: \"bd496f3d-f208-431d-8171-5868156304f6\") " pod="openshift-multus/multus-additional-cni-plugins-dm8mh"
Sep 09 21:07:59.492486 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.491551    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/928443e9-b49f-4f2a-acd4-fc3525edc7ee-etc-selinux\") pod \"aws-ebs-csi-driver-node-m9jhg\" (UID: \"928443e9-b49f-4f2a-acd4-fc3525edc7ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9jhg"
Sep 09 21:07:59.492486 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.491577    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6s252\" (UniqueName: \"kubernetes.io/projected/eb3f4d24-4a06-4b75-a0ea-c6e8fba9e5f6-kube-api-access-6s252\") pod \"node-ca-z8swp\" (UID: \"eb3f4d24-4a06-4b75-a0ea-c6e8fba9e5f6\") " pod="openshift-image-registry/node-ca-z8swp"
Sep 09 21:07:59.492486 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.491662    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/63f30c56-37ce-46c3-b443-9b2afdb432b1-run-ovn\") pod \"ovnkube-node-wzzsp\" (UID: \"63f30c56-37ce-46c3-b443-9b2afdb432b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp"
Sep 09 21:07:59.492486 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.491705    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/928443e9-b49f-4f2a-acd4-fc3525edc7ee-registration-dir\") pod \"aws-ebs-csi-driver-node-m9jhg\" (UID: \"928443e9-b49f-4f2a-acd4-fc3525edc7ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9jhg"
Sep 09 21:07:59.492486 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.491710    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/63f30c56-37ce-46c3-b443-9b2afdb432b1-host-run-netns\") pod \"ovnkube-node-wzzsp\" (UID: \"63f30c56-37ce-46c3-b443-9b2afdb432b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp"
Sep 09 21:07:59.492486 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:07:59.491770    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 21:07:59.492486 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.491833    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bd496f3d-f208-431d-8171-5868156304f6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dm8mh\" (UID: \"bd496f3d-f208-431d-8171-5868156304f6\") " pod="openshift-multus/multus-additional-cni-plugins-dm8mh"
Sep 09 21:07:59.492486 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.491897    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/63f30c56-37ce-46c3-b443-9b2afdb432b1-run-systemd\") pod \"ovnkube-node-wzzsp\" (UID: \"63f30c56-37ce-46c3-b443-9b2afdb432b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp"
Sep 09 21:07:59.492486 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.491964    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/928443e9-b49f-4f2a-acd4-fc3525edc7ee-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m9jhg\" (UID: \"928443e9-b49f-4f2a-acd4-fc3525edc7ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9jhg"
Sep 09 21:07:59.492486 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.492014    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bd496f3d-f208-431d-8171-5868156304f6-system-cni-dir\") pod \"multus-additional-cni-plugins-dm8mh\" (UID: \"bd496f3d-f208-431d-8171-5868156304f6\") " pod="openshift-multus/multus-additional-cni-plugins-dm8mh"
Sep 09 21:07:59.492486 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.492017    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/140804ca-8508-4fe3-bfb1-1726c619701e-host-slash\") pod \"iptables-alerter-vhmqh\" (UID: \"140804ca-8508-4fe3-bfb1-1726c619701e\") " pod="openshift-network-operator/iptables-alerter-vhmqh"
Sep 09 21:07:59.492486 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.492055    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/63f30c56-37ce-46c3-b443-9b2afdb432b1-host-cni-netd\") pod \"ovnkube-node-wzzsp\" (UID: \"63f30c56-37ce-46c3-b443-9b2afdb432b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp"
Sep 09 21:07:59.492486 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.492060    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/63f30c56-37ce-46c3-b443-9b2afdb432b1-host-kubelet\") pod \"ovnkube-node-wzzsp\" (UID: \"63f30c56-37ce-46c3-b443-9b2afdb432b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp"
Sep 09 21:07:59.492486 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.492100    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63f30c56-37ce-46c3-b443-9b2afdb432b1-run-openvswitch\") pod \"ovnkube-node-wzzsp\" (UID: \"63f30c56-37ce-46c3-b443-9b2afdb432b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp"
Sep 09 21:07:59.493460 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.492106    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63f30c56-37ce-46c3-b443-9b2afdb432b1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wzzsp\" (UID: \"63f30c56-37ce-46c3-b443-9b2afdb432b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp"
Sep 09 21:07:59.493460 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.492154    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/928443e9-b49f-4f2a-acd4-fc3525edc7ee-socket-dir\") pod \"aws-ebs-csi-driver-node-m9jhg\" (UID: \"928443e9-b49f-4f2a-acd4-fc3525edc7ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9jhg"
Sep 09 21:07:59.493460 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.492158    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bd496f3d-f208-431d-8171-5868156304f6-cnibin\") pod \"multus-additional-cni-plugins-dm8mh\" (UID: \"bd496f3d-f208-431d-8171-5868156304f6\") " pod="openshift-multus/multus-additional-cni-plugins-dm8mh"
Sep 09 21:07:59.493460 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.492204    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/928443e9-b49f-4f2a-acd4-fc3525edc7ee-sys-fs\") pod \"aws-ebs-csi-driver-node-m9jhg\" (UID: \"928443e9-b49f-4f2a-acd4-fc3525edc7ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9jhg"
Sep 09 21:07:59.493460 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.492222    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bd496f3d-f208-431d-8171-5868156304f6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dm8mh\" (UID: \"bd496f3d-f208-431d-8171-5868156304f6\") " pod="openshift-multus/multus-additional-cni-plugins-dm8mh"
Sep 09 21:07:59.493460 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:07:59.492287    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d5bd2bb-63bd-4425-ae59-2177722354f5-original-pull-secret podName:1d5bd2bb-63bd-4425-ae59-2177722354f5 nodeName:}" failed. No retries permitted until 2026-09-09 21:07:59.992264368 +0000 UTC m=+2.971582479 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1d5bd2bb-63bd-4425-ae59-2177722354f5-original-pull-secret") pod "global-pull-secret-syncer-5px25" (UID: "1d5bd2bb-63bd-4425-ae59-2177722354f5") : object "kube-system"/"original-pull-secret" not registered
Sep 09 21:07:59.493460 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.492311    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/140804ca-8508-4fe3-bfb1-1726c619701e-iptables-alerter-script\") pod \"iptables-alerter-vhmqh\" (UID: \"140804ca-8508-4fe3-bfb1-1726c619701e\") " pod="openshift-network-operator/iptables-alerter-vhmqh"
Sep 09 21:07:59.493460 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.492161    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/63f30c56-37ce-46c3-b443-9b2afdb432b1-host-slash\") pod \"ovnkube-node-wzzsp\" (UID: \"63f30c56-37ce-46c3-b443-9b2afdb432b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp"
Sep 09 21:07:59.493460 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.492494    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1d5bd2bb-63bd-4425-ae59-2177722354f5-dbus\") pod \"global-pull-secret-syncer-5px25\" (UID: \"1d5bd2bb-63bd-4425-ae59-2177722354f5\") " pod="kube-system/global-pull-secret-syncer-5px25"
Sep 09 21:07:59.493460 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.492514    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63f30c56-37ce-46c3-b443-9b2afdb432b1-etc-openvswitch\") pod \"ovnkube-node-wzzsp\" (UID: \"63f30c56-37ce-46c3-b443-9b2afdb432b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp"
Sep 09 21:07:59.493460 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.492528    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63f30c56-37ce-46c3-b443-9b2afdb432b1-host-run-ovn-kubernetes\") pod \"ovnkube-node-wzzsp\" (UID: \"63f30c56-37ce-46c3-b443-9b2afdb432b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp"
Sep 09 21:07:59.493460 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.492548    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/928443e9-b49f-4f2a-acd4-fc3525edc7ee-device-dir\") pod \"aws-ebs-csi-driver-node-m9jhg\" (UID: \"928443e9-b49f-4f2a-acd4-fc3525edc7ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9jhg"
Sep 09 21:07:59.493460 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.492661    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/928443e9-b49f-4f2a-acd4-fc3525edc7ee-etc-selinux\") pod \"aws-ebs-csi-driver-node-m9jhg\" (UID: \"928443e9-b49f-4f2a-acd4-fc3525edc7ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9jhg"
Sep 09 21:07:59.493460 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.492754    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/63f30c56-37ce-46c3-b443-9b2afdb432b1-ovnkube-script-lib\") pod \"ovnkube-node-wzzsp\" (UID: \"63f30c56-37ce-46c3-b443-9b2afdb432b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp"
Sep 09 21:07:59.493460 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.492975    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/63f30c56-37ce-46c3-b443-9b2afdb432b1-ovnkube-config\") pod \"ovnkube-node-wzzsp\" (UID: \"63f30c56-37ce-46c3-b443-9b2afdb432b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp"
Sep 09 21:07:59.494265 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.493529    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bd496f3d-f208-431d-8171-5868156304f6-cni-binary-copy\") pod \"multus-additional-cni-plugins-dm8mh\" (UID: \"bd496f3d-f208-431d-8171-5868156304f6\") " pod="openshift-multus/multus-additional-cni-plugins-dm8mh"
Sep 09 21:07:59.494265 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.493595    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bd496f3d-f208-431d-8171-5868156304f6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dm8mh\" (UID: \"bd496f3d-f208-431d-8171-5868156304f6\") " pod="openshift-multus/multus-additional-cni-plugins-dm8mh"
Sep 09 21:07:59.496275 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.496251    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/63f30c56-37ce-46c3-b443-9b2afdb432b1-ovn-node-metrics-cert\") pod \"ovnkube-node-wzzsp\" (UID: \"63f30c56-37ce-46c3-b443-9b2afdb432b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp"
Sep 09 21:07:59.500661 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:07:59.500639    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 21:07:59.500661 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:07:59.500666    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 21:07:59.500828 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:07:59.500679    2555 projected.go:196] Error preparing data for projected volume kube-api-access-rj4lj for pod openshift-network-diagnostics/network-check-target-787zm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 21:07:59.500828 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:07:59.500744    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f22a4fe6-1a57-40fe-a1c7-ea0662c99601-kube-api-access-rj4lj podName:f22a4fe6-1a57-40fe-a1c7-ea0662c99601 nodeName:}" failed. No retries permitted until 2026-09-09 21:08:00.000726435 +0000 UTC m=+2.980044544 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-rj4lj" (UniqueName: "kubernetes.io/projected/f22a4fe6-1a57-40fe-a1c7-ea0662c99601-kube-api-access-rj4lj") pod "network-check-target-787zm" (UID: "f22a4fe6-1a57-40fe-a1c7-ea0662c99601") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 21:07:59.505838 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.505800    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4x9n\" (UniqueName: \"kubernetes.io/projected/bd496f3d-f208-431d-8171-5868156304f6-kube-api-access-q4x9n\") pod \"multus-additional-cni-plugins-dm8mh\" (UID: \"bd496f3d-f208-431d-8171-5868156304f6\") " pod="openshift-multus/multus-additional-cni-plugins-dm8mh"
Sep 09 21:07:59.507158 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.507109    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqnl5\" (UniqueName: \"kubernetes.io/projected/140804ca-8508-4fe3-bfb1-1726c619701e-kube-api-access-dqnl5\") pod \"iptables-alerter-vhmqh\" (UID: \"140804ca-8508-4fe3-bfb1-1726c619701e\") " pod="openshift-network-operator/iptables-alerter-vhmqh"
Sep 09 21:07:59.509581 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.509551    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q58qv\" (UniqueName: \"kubernetes.io/projected/63f30c56-37ce-46c3-b443-9b2afdb432b1-kube-api-access-q58qv\") pod \"ovnkube-node-wzzsp\" (UID: \"63f30c56-37ce-46c3-b443-9b2afdb432b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp"
Sep 09 21:07:59.509872 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.509848    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bltct\" (UniqueName: \"kubernetes.io/projected/928443e9-b49f-4f2a-acd4-fc3525edc7ee-kube-api-access-bltct\") pod \"aws-ebs-csi-driver-node-m9jhg\" (UID: \"928443e9-b49f-4f2a-acd4-fc3525edc7ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9jhg"
Sep 09 21:07:59.592328 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.592290    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8db7296c-f0fc-4706-b8a2-1a189e9e4fea-sys\") pod \"tuned-hssdd\" (UID: \"8db7296c-f0fc-4706-b8a2-1a189e9e4fea\") " pod="openshift-cluster-node-tuning-operator/tuned-hssdd"
Sep 09 21:07:59.592328 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.592330    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/85bff06c-41a6-4cd8-8196-aca41c4b9a50-cni-binary-copy\") pod \"multus-q7sjb\" (UID: \"85bff06c-41a6-4cd8-8196-aca41c4b9a50\") " pod="openshift-multus/multus-q7sjb"
Sep 09 21:07:59.592543 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.592351    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/85bff06c-41a6-4cd8-8196-aca41c4b9a50-multus-conf-dir\") pod \"multus-q7sjb\" (UID: \"85bff06c-41a6-4cd8-8196-aca41c4b9a50\") " pod="openshift-multus/multus-q7sjb"
Sep 09 21:07:59.592543 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.592437    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8db7296c-f0fc-4706-b8a2-1a189e9e4fea-etc-sysctl-d\") pod \"tuned-hssdd\" (UID: \"8db7296c-f0fc-4706-b8a2-1a189e9e4fea\") " pod="openshift-cluster-node-tuning-operator/tuned-hssdd"
Sep 09 21:07:59.592543 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.592457    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/22210233-a1fa-4335-a652-6b89192b07ec-hosts-file\") pod \"node-resolver-zln8j\" (UID: \"22210233-a1fa-4335-a652-6b89192b07ec\") " pod="openshift-dns/node-resolver-zln8j"
Sep 09 21:07:59.592543 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.592476    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbtb9\" (UniqueName: \"kubernetes.io/projected/22210233-a1fa-4335-a652-6b89192b07ec-kube-api-access-zbtb9\") pod \"node-resolver-zln8j\" (UID: \"22210233-a1fa-4335-a652-6b89192b07ec\") " pod="openshift-dns/node-resolver-zln8j"
Sep 09 21:07:59.592543 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.592497    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/85bff06c-41a6-4cd8-8196-aca41c4b9a50-cnibin\") pod \"multus-q7sjb\" (UID: \"85bff06c-41a6-4cd8-8196-aca41c4b9a50\") " pod="openshift-multus/multus-q7sjb"
Sep 09 21:07:59.592543 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.592516    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/df53dce4-0da4-4e78-8e7d-e77e0734a8d9-konnectivity-ca\") pod \"konnectivity-agent-fjp57\" (UID: \"df53dce4-0da4-4e78-8e7d-e77e0734a8d9\") " pod="kube-system/konnectivity-agent-fjp57"
Sep 09 21:07:59.592543 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.592531    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8db7296c-f0fc-4706-b8a2-1a189e9e4fea-etc-tuned\") pod \"tuned-hssdd\" (UID: \"8db7296c-f0fc-4706-b8a2-1a189e9e4fea\") " pod="openshift-cluster-node-tuning-operator/tuned-hssdd"
Sep 09 21:07:59.592852 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.592557    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/85bff06c-41a6-4cd8-8196-aca41c4b9a50-multus-socket-dir-parent\") pod \"multus-q7sjb\" (UID: \"85bff06c-41a6-4cd8-8196-aca41c4b9a50\") " pod="openshift-multus/multus-q7sjb"
Sep 09 21:07:59.592852 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.592583    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/85bff06c-41a6-4cd8-8196-aca41c4b9a50-host-var-lib-cni-bin\") pod \"multus-q7sjb\" (UID: \"85bff06c-41a6-4cd8-8196-aca41c4b9a50\") " pod="openshift-multus/multus-q7sjb"
Sep 09 21:07:59.592852 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.592608    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sx5jp\" (UniqueName: \"kubernetes.io/projected/85bff06c-41a6-4cd8-8196-aca41c4b9a50-kube-api-access-sx5jp\") pod \"multus-q7sjb\" (UID: \"85bff06c-41a6-4cd8-8196-aca41c4b9a50\") " pod="openshift-multus/multus-q7sjb"
Sep 09 21:07:59.592852 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.592641    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8db7296c-f0fc-4706-b8a2-1a189e9e4fea-run\") pod \"tuned-hssdd\" (UID: \"8db7296c-f0fc-4706-b8a2-1a189e9e4fea\") " pod="openshift-cluster-node-tuning-operator/tuned-hssdd"
Sep 09 21:07:59.592852 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.592664    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/325461e6-e654-481d-9458-feb1bb597455-metrics-certs\") pod \"network-metrics-daemon-zd7mb\" (UID: \"325461e6-e654-481d-9458-feb1bb597455\") " pod="openshift-multus/network-metrics-daemon-zd7mb"
Sep 09 21:07:59.592852 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.592692    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hjbj\" (UniqueName: \"kubernetes.io/projected/8db7296c-f0fc-4706-b8a2-1a189e9e4fea-kube-api-access-5hjbj\") pod \"tuned-hssdd\" (UID: \"8db7296c-f0fc-4706-b8a2-1a189e9e4fea\") " pod="openshift-cluster-node-tuning-operator/tuned-hssdd"
Sep 09 21:07:59.592852 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.592709    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eb3f4d24-4a06-4b75-a0ea-c6e8fba9e5f6-serviceca\") pod \"node-ca-z8swp\" (UID: \"eb3f4d24-4a06-4b75-a0ea-c6e8fba9e5f6\") " pod="openshift-image-registry/node-ca-z8swp"
Sep 09 21:07:59.592852 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.592723    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8db7296c-f0fc-4706-b8a2-1a189e9e4fea-etc-sysconfig\") pod \"tuned-hssdd\" (UID: \"8db7296c-f0fc-4706-b8a2-1a189e9e4fea\") " pod="openshift-cluster-node-tuning-operator/tuned-hssdd"
Sep 09 21:07:59.592852 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.592738    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8db7296c-f0fc-4706-b8a2-1a189e9e4fea-etc-kubernetes\") pod \"tuned-hssdd\" (UID: \"8db7296c-f0fc-4706-b8a2-1a189e9e4fea\") " pod="openshift-cluster-node-tuning-operator/tuned-hssdd"
Sep 09 21:07:59.592852 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.592758    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/85bff06c-41a6-4cd8-8196-aca41c4b9a50-multus-cni-dir\") pod \"multus-q7sjb\" (UID: \"85bff06c-41a6-4cd8-8196-aca41c4b9a50\") " pod="openshift-multus/multus-q7sjb"
Sep 09 21:07:59.592852 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.592786    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s252\" (UniqueName: \"kubernetes.io/projected/eb3f4d24-4a06-4b75-a0ea-c6e8fba9e5f6-kube-api-access-6s252\") pod \"node-ca-z8swp\" (UID: \"eb3f4d24-4a06-4b75-a0ea-c6e8fba9e5f6\") " pod="openshift-image-registry/node-ca-z8swp"
Sep 09 21:07:59.592852 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.592812    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/85bff06c-41a6-4cd8-8196-aca41c4b9a50-host-run-multus-certs\") pod \"multus-q7sjb\" (UID: \"85bff06c-41a6-4cd8-8196-aca41c4b9a50\") " pod="openshift-multus/multus-q7sjb"
Sep 09 21:07:59.592852 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.592830    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8db7296c-f0fc-4706-b8a2-1a189e9e4fea-etc-systemd\") pod \"tuned-hssdd\" (UID: \"8db7296c-f0fc-4706-b8a2-1a189e9e4fea\") " pod="openshift-cluster-node-tuning-operator/tuned-hssdd"
Sep 09 21:07:59.592852 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.592855    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8db7296c-f0fc-4706-b8a2-1a189e9e4fea-var-lib-kubelet\") pod \"tuned-hssdd\" (UID: \"8db7296c-f0fc-4706-b8a2-1a189e9e4fea\") " pod="openshift-cluster-node-tuning-operator/tuned-hssdd"
Sep 09 21:07:59.593453 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.592892    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8db7296c-f0fc-4706-b8a2-1a189e9e4fea-host\") pod \"tuned-hssdd\" (UID: \"8db7296c-f0fc-4706-b8a2-1a189e9e4fea\") " pod="openshift-cluster-node-tuning-operator/tuned-hssdd"
Sep 09 21:07:59.593453 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.592918    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/85bff06c-41a6-4cd8-8196-aca41c4b9a50-host-run-netns\") pod \"multus-q7sjb\" (UID: \"85bff06c-41a6-4cd8-8196-aca41c4b9a50\") " pod="openshift-multus/multus-q7sjb"
Sep 09 21:07:59.593453 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.592944    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eb3f4d24-4a06-4b75-a0ea-c6e8fba9e5f6-host\") pod \"node-ca-z8swp\" (UID: \"eb3f4d24-4a06-4b75-a0ea-c6e8fba9e5f6\") " pod="openshift-image-registry/node-ca-z8swp"
Sep 09 21:07:59.593453 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.592972    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8db7296c-f0fc-4706-b8a2-1a189e9e4fea-etc-sysctl-conf\") pod \"tuned-hssdd\" (UID: \"8db7296c-f0fc-4706-b8a2-1a189e9e4fea\") " pod="openshift-cluster-node-tuning-operator/tuned-hssdd"
Sep 09 21:07:59.593453 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.593004    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/df53dce4-0da4-4e78-8e7d-e77e0734a8d9-agent-certs\") pod \"konnectivity-agent-fjp57\" (UID: \"df53dce4-0da4-4e78-8e7d-e77e0734a8d9\") " pod="kube-system/konnectivity-agent-fjp57"
Sep 09 21:07:59.593453 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.593006    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8db7296c-f0fc-4706-b8a2-1a189e9e4fea-sys\") pod \"tuned-hssdd\" (UID: \"8db7296c-f0fc-4706-b8a2-1a189e9e4fea\") " pod="openshift-cluster-node-tuning-operator/tuned-hssdd"
Sep 09 21:07:59.593453 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.593030    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/85bff06c-41a6-4cd8-8196-aca41c4b9a50-hostroot\") pod \"multus-q7sjb\" (UID: \"85bff06c-41a6-4cd8-8196-aca41c4b9a50\") " pod="openshift-multus/multus-q7sjb"
Sep 09 21:07:59.593453 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.593095    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8db7296c-f0fc-4706-b8a2-1a189e9e4fea-etc-modprobe-d\") pod \"tuned-hssdd\" (UID: \"8db7296c-f0fc-4706-b8a2-1a189e9e4fea\") " pod="openshift-cluster-node-tuning-operator/tuned-hssdd"
Sep 09 21:07:59.593453 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.593127    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8db7296c-f0fc-4706-b8a2-1a189e9e4fea-lib-modules\") pod \"tuned-hssdd\" (UID: \"8db7296c-f0fc-4706-b8a2-1a189e9e4fea\") " pod="openshift-cluster-node-tuning-operator/tuned-hssdd"
Sep 09 21:07:59.593453 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:07:59.593137    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 21:07:59.593453 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.593152    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/22210233-a1fa-4335-a652-6b89192b07ec-tmp-dir\") pod \"node-resolver-zln8j\" (UID: \"22210233-a1fa-4335-a652-6b89192b07ec\") " pod="openshift-dns/node-resolver-zln8j"
Sep 09 21:07:59.593453 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.593178    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/85bff06c-41a6-4cd8-8196-aca41c4b9a50-system-cni-dir\") pod \"multus-q7sjb\" (UID: \"85bff06c-41a6-4cd8-8196-aca41c4b9a50\") " pod="openshift-multus/multus-q7sjb"
Sep 09 21:07:59.593453 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:07:59.593221    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/325461e6-e654-481d-9458-feb1bb597455-metrics-certs podName:325461e6-e654-481d-9458-feb1bb597455 nodeName:}" failed. No retries permitted until 2026-09-09 21:08:00.093200886 +0000 UTC m=+3.072518983 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/325461e6-e654-481d-9458-feb1bb597455-metrics-certs") pod "network-metrics-daemon-zd7mb" (UID: "325461e6-e654-481d-9458-feb1bb597455") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 21:07:59.593453 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.593226    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/85bff06c-41a6-4cd8-8196-aca41c4b9a50-cnibin\") pod \"multus-q7sjb\" (UID: \"85bff06c-41a6-4cd8-8196-aca41c4b9a50\") " pod="openshift-multus/multus-q7sjb"
Sep 09 21:07:59.593453 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.593249    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/85bff06c-41a6-4cd8-8196-aca41c4b9a50-host-run-k8s-cni-cncf-io\") pod \"multus-q7sjb\" (UID: \"85bff06c-41a6-4cd8-8196-aca41c4b9a50\") " pod="openshift-multus/multus-q7sjb"
Sep 09 21:07:59.593453 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.593297    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/85bff06c-41a6-4cd8-8196-aca41c4b9a50-host-var-lib-cni-multus\") pod \"multus-q7sjb\" (UID: \"85bff06c-41a6-4cd8-8196-aca41c4b9a50\") " pod="openshift-multus/multus-q7sjb"
Sep 09 21:07:59.593453 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.593305    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/85bff06c-41a6-4cd8-8196-aca41c4b9a50-system-cni-dir\") pod \"multus-q7sjb\" (UID: \"85bff06c-41a6-4cd8-8196-aca41c4b9a50\") " pod="openshift-multus/multus-q7sjb"
Sep 09 21:07:59.593453 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.593324    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/85bff06c-41a6-4cd8-8196-aca41c4b9a50-multus-daemon-config\") pod \"multus-q7sjb\" (UID: \"85bff06c-41a6-4cd8-8196-aca41c4b9a50\") " pod="openshift-multus/multus-q7sjb"
Sep 09 21:07:59.594365 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.593351    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8db7296c-f0fc-4706-b8a2-1a189e9e4fea-run\") pod \"tuned-hssdd\" (UID: \"8db7296c-f0fc-4706-b8a2-1a189e9e4fea\") " pod="openshift-cluster-node-tuning-operator/tuned-hssdd"
Sep 09 21:07:59.594365 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.593356    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/85bff06c-41a6-4cd8-8196-aca41c4b9a50-etc-kubernetes\") pod \"multus-q7sjb\" (UID: \"85bff06c-41a6-4cd8-8196-aca41c4b9a50\") " pod="openshift-multus/multus-q7sjb"
Sep 09 21:07:59.594365 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.593387    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/85bff06c-41a6-4cd8-8196-aca41c4b9a50-multus-conf-dir\") pod \"multus-q7sjb\" (UID: \"85bff06c-41a6-4cd8-8196-aca41c4b9a50\") " pod="openshift-multus/multus-q7sjb"
Sep 09 21:07:59.594365 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.593390    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2c46p\" (UniqueName: \"kubernetes.io/projected/325461e6-e654-481d-9458-feb1bb597455-kube-api-access-2c46p\") pod \"network-metrics-daemon-zd7mb\" (UID: \"325461e6-e654-481d-9458-feb1bb597455\") " pod="openshift-multus/network-metrics-daemon-zd7mb"
Sep 09 21:07:59.594365 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.593427    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8db7296c-f0fc-4706-b8a2-1a189e9e4fea-tmp\") pod \"tuned-hssdd\" (UID: \"8db7296c-f0fc-4706-b8a2-1a189e9e4fea\") " pod="openshift-cluster-node-tuning-operator/tuned-hssdd"
Sep 09 21:07:59.594365 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.593454    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/85bff06c-41a6-4cd8-8196-aca41c4b9a50-host-var-lib-kubelet\") pod \"multus-q7sjb\" (UID: \"85bff06c-41a6-4cd8-8196-aca41c4b9a50\") " pod="openshift-multus/multus-q7sjb"
Sep 09 21:07:59.594365 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.593526    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/85bff06c-41a6-4cd8-8196-aca41c4b9a50-host-var-lib-kubelet\") pod \"multus-q7sjb\" (UID: \"85bff06c-41a6-4cd8-8196-aca41c4b9a50\") " pod="openshift-multus/multus-q7sjb"
Sep 09 21:07:59.594365 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.593642    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/85bff06c-41a6-4cd8-8196-aca41c4b9a50-cni-binary-copy\") pod \"multus-q7sjb\" (UID: \"85bff06c-41a6-4cd8-8196-aca41c4b9a50\") " pod="openshift-multus/multus-q7sjb"
Sep 09 21:07:59.594365 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.593671    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8db7296c-f0fc-4706-b8a2-1a189e9e4fea-etc-sysctl-d\") pod \"tuned-hssdd\" (UID: \"8db7296c-f0fc-4706-b8a2-1a189e9e4fea\") " pod="openshift-cluster-node-tuning-operator/tuned-hssdd"
Sep 09 21:07:59.594365 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.593742    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/df53dce4-0da4-4e78-8e7d-e77e0734a8d9-konnectivity-ca\") pod \"konnectivity-agent-fjp57\" (UID: \"df53dce4-0da4-4e78-8e7d-e77e0734a8d9\") " pod="kube-system/konnectivity-agent-fjp57"
Sep 09 21:07:59.594365 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.593759    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/85bff06c-41a6-4cd8-8196-aca41c4b9a50-hostroot\") pod \"multus-q7sjb\" (UID: \"85bff06c-41a6-4cd8-8196-aca41c4b9a50\") " pod="openshift-multus/multus-q7sjb"
Sep 09 21:07:59.594365 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.593767    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8db7296c-f0fc-4706-b8a2-1a189e9e4fea-host\") pod \"tuned-hssdd\" (UID: \"8db7296c-f0fc-4706-b8a2-1a189e9e4fea\") " pod="openshift-cluster-node-tuning-operator/tuned-hssdd"
Sep 09 21:07:59.594365 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.593803    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/85bff06c-41a6-4cd8-8196-aca41c4b9a50-etc-kubernetes\") pod \"multus-q7sjb\" (UID: \"85bff06c-41a6-4cd8-8196-aca41c4b9a50\") " pod="openshift-multus/multus-q7sjb"
Sep 09 21:07:59.594365 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.593955    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/22210233-a1fa-4335-a652-6b89192b07ec-hosts-file\") pod \"node-resolver-zln8j\" (UID: \"22210233-a1fa-4335-a652-6b89192b07ec\") " pod="openshift-dns/node-resolver-zln8j"
Sep 09 21:07:59.594365 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.594003    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/85bff06c-41a6-4cd8-8196-aca41c4b9a50-host-var-lib-cni-bin\") pod \"multus-q7sjb\" (UID: \"85bff06c-41a6-4cd8-8196-aca41c4b9a50\") " pod="openshift-multus/multus-q7sjb"
Sep 09 21:07:59.594365 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.594118    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8db7296c-f0fc-4706-b8a2-1a189e9e4fea-lib-modules\") pod \"tuned-hssdd\" (UID: \"8db7296c-f0fc-4706-b8a2-1a189e9e4fea\") " pod="openshift-cluster-node-tuning-operator/tuned-hssdd"
Sep 09 21:07:59.594365 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.594164    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8db7296c-f0fc-4706-b8a2-1a189e9e4fea-etc-modprobe-d\") pod \"tuned-hssdd\" (UID: \"8db7296c-f0fc-4706-b8a2-1a189e9e4fea\") " pod="openshift-cluster-node-tuning-operator/tuned-hssdd"
Sep 09 21:07:59.594365 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.594217    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8db7296c-f0fc-4706-b8a2-1a189e9e4fea-etc-sysctl-conf\") pod \"tuned-hssdd\" (UID: \"8db7296c-f0fc-4706-b8a2-1a189e9e4fea\") " pod="openshift-cluster-node-tuning-operator/tuned-hssdd"
Sep 09 21:07:59.595305 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.594298    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/85bff06c-41a6-4cd8-8196-aca41c4b9a50-multus-daemon-config\") pod \"multus-q7sjb\" (UID: \"85bff06c-41a6-4cd8-8196-aca41c4b9a50\") " pod="openshift-multus/multus-q7sjb"
Sep 09 21:07:59.595305 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.594352    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/85bff06c-41a6-4cd8-8196-aca41c4b9a50-host-run-netns\") pod \"multus-q7sjb\" (UID: \"85bff06c-41a6-4cd8-8196-aca41c4b9a50\") " pod="openshift-multus/multus-q7sjb"
Sep 09 21:07:59.595305 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.594369    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/85bff06c-41a6-4cd8-8196-aca41c4b9a50-multus-socket-dir-parent\") pod \"multus-q7sjb\" (UID: \"85bff06c-41a6-4cd8-8196-aca41c4b9a50\") " pod="openshift-multus/multus-q7sjb"
Sep 09 21:07:59.595305 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.594465    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8db7296c-f0fc-4706-b8a2-1a189e9e4fea-etc-sysconfig\") pod \"tuned-hssdd\" (UID: \"8db7296c-f0fc-4706-b8a2-1a189e9e4fea\") " pod="openshift-cluster-node-tuning-operator/tuned-hssdd"
Sep 09 21:07:59.595305 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.594508    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/22210233-a1fa-4335-a652-6b89192b07ec-tmp-dir\") pod \"node-resolver-zln8j\" (UID: \"22210233-a1fa-4335-a652-6b89192b07ec\") " pod="openshift-dns/node-resolver-zln8j"
Sep 09 21:07:59.595305 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.594514    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8db7296c-f0fc-4706-b8a2-1a189e9e4fea-etc-kubernetes\") pod \"tuned-hssdd\" (UID: \"8db7296c-f0fc-4706-b8a2-1a189e9e4fea\") " pod="openshift-cluster-node-tuning-operator/tuned-hssdd"
Sep 09 21:07:59.595305 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.594599    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/85bff06c-41a6-4cd8-8196-aca41c4b9a50-multus-cni-dir\") pod \"multus-q7sjb\" (UID: \"85bff06c-41a6-4cd8-8196-aca41c4b9a50\") " pod="openshift-multus/multus-q7sjb"
Sep 09 21:07:59.595305 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.594715    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eb3f4d24-4a06-4b75-a0ea-c6e8fba9e5f6-host\") pod \"node-ca-z8swp\" (UID: \"eb3f4d24-4a06-4b75-a0ea-c6e8fba9e5f6\") " pod="openshift-image-registry/node-ca-z8swp"
Sep 09 21:07:59.595305 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.594757    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/85bff06c-41a6-4cd8-8196-aca41c4b9a50-host-run-multus-certs\") pod \"multus-q7sjb\" (UID: \"85bff06c-41a6-4cd8-8196-aca41c4b9a50\") " pod="openshift-multus/multus-q7sjb"
Sep 09 21:07:59.595305 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.594826    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eb3f4d24-4a06-4b75-a0ea-c6e8fba9e5f6-serviceca\") pod \"node-ca-z8swp\" (UID: \"eb3f4d24-4a06-4b75-a0ea-c6e8fba9e5f6\") " pod="openshift-image-registry/node-ca-z8swp"
Sep 09 21:07:59.595305 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.594863    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8db7296c-f0fc-4706-b8a2-1a189e9e4fea-var-lib-kubelet\") pod \"tuned-hssdd\" (UID: \"8db7296c-f0fc-4706-b8a2-1a189e9e4fea\") " pod="openshift-cluster-node-tuning-operator/tuned-hssdd"
Sep 09 21:07:59.595305 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.594897    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8db7296c-f0fc-4706-b8a2-1a189e9e4fea-etc-systemd\") pod \"tuned-hssdd\" (UID: \"8db7296c-f0fc-4706-b8a2-1a189e9e4fea\") " pod="openshift-cluster-node-tuning-operator/tuned-hssdd"
Sep 09 21:07:59.595305 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.594923    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/85bff06c-41a6-4cd8-8196-aca41c4b9a50-host-run-k8s-cni-cncf-io\") pod \"multus-q7sjb\" (UID: \"85bff06c-41a6-4cd8-8196-aca41c4b9a50\") " pod="openshift-multus/multus-q7sjb"
Sep 09 21:07:59.595305 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.595157    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/85bff06c-41a6-4cd8-8196-aca41c4b9a50-host-var-lib-cni-multus\") pod \"multus-q7sjb\" (UID: \"85bff06c-41a6-4cd8-8196-aca41c4b9a50\") " pod="openshift-multus/multus-q7sjb"
Sep 09 21:07:59.597485 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.597458    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8db7296c-f0fc-4706-b8a2-1a189e9e4fea-tmp\") pod \"tuned-hssdd\" (UID: \"8db7296c-f0fc-4706-b8a2-1a189e9e4fea\") " pod="openshift-cluster-node-tuning-operator/tuned-hssdd"
Sep 09 21:07:59.597738 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.597705    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8db7296c-f0fc-4706-b8a2-1a189e9e4fea-etc-tuned\") pod \"tuned-hssdd\" (UID: \"8db7296c-f0fc-4706-b8a2-1a189e9e4fea\") " pod="openshift-cluster-node-tuning-operator/tuned-hssdd"
Sep 09 21:07:59.598475 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.598429    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/df53dce4-0da4-4e78-8e7d-e77e0734a8d9-agent-certs\") pod \"konnectivity-agent-fjp57\" (UID: \"df53dce4-0da4-4e78-8e7d-e77e0734a8d9\") " pod="kube-system/konnectivity-agent-fjp57"
Sep 09 21:07:59.604467 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.604400    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbtb9\" (UniqueName: \"kubernetes.io/projected/22210233-a1fa-4335-a652-6b89192b07ec-kube-api-access-zbtb9\") pod \"node-resolver-zln8j\" (UID: \"22210233-a1fa-4335-a652-6b89192b07ec\") " pod="openshift-dns/node-resolver-zln8j"
Sep 09 21:07:59.604601 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.604576    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sx5jp\" (UniqueName: \"kubernetes.io/projected/85bff06c-41a6-4cd8-8196-aca41c4b9a50-kube-api-access-sx5jp\") pod \"multus-q7sjb\" (UID: \"85bff06c-41a6-4cd8-8196-aca41c4b9a50\") " pod="openshift-multus/multus-q7sjb"
Sep 09 21:07:59.606481 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.606432    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hjbj\" (UniqueName: \"kubernetes.io/projected/8db7296c-f0fc-4706-b8a2-1a189e9e4fea-kube-api-access-5hjbj\") pod \"tuned-hssdd\" (UID: \"8db7296c-f0fc-4706-b8a2-1a189e9e4fea\") " pod="openshift-cluster-node-tuning-operator/tuned-hssdd"
Sep 09 21:07:59.607020 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.606997    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6s252\" (UniqueName: \"kubernetes.io/projected/eb3f4d24-4a06-4b75-a0ea-c6e8fba9e5f6-kube-api-access-6s252\") pod \"node-ca-z8swp\" (UID: \"eb3f4d24-4a06-4b75-a0ea-c6e8fba9e5f6\") " pod="openshift-image-registry/node-ca-z8swp"
Sep 09 21:07:59.607737 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.607712    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2c46p\" (UniqueName: \"kubernetes.io/projected/325461e6-e654-481d-9458-feb1bb597455-kube-api-access-2c46p\") pod \"network-metrics-daemon-zd7mb\" (UID: \"325461e6-e654-481d-9458-feb1bb597455\") " pod="openshift-multus/network-metrics-daemon-zd7mb"
Sep 09 21:07:59.613179 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.613152    2555 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 21:07:59.677638 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.677604    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dm8mh"
Sep 09 21:07:59.687671 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.687646    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9jhg"
Sep 09 21:07:59.690887 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:59.690854    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd496f3d_f208_431d_8171_5868156304f6.slice/crio-0ff2e548b5f17136236c81a9cb86d60464ac61bb76d59fdcba35083aa159f9b0 WatchSource:0}: Error finding container 0ff2e548b5f17136236c81a9cb86d60464ac61bb76d59fdcba35083aa159f9b0: Status 404 returned error can't find the container with id 0ff2e548b5f17136236c81a9cb86d60464ac61bb76d59fdcba35083aa159f9b0
Sep 09 21:07:59.698104 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:59.698080    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod928443e9_b49f_4f2a_acd4_fc3525edc7ee.slice/crio-88c852c71b6745a22404a1cf2958b881eeb9d42b6b8fe39241296d853fca1745 WatchSource:0}: Error finding container 88c852c71b6745a22404a1cf2958b881eeb9d42b6b8fe39241296d853fca1745: Status 404 returned error can't find the container with id 88c852c71b6745a22404a1cf2958b881eeb9d42b6b8fe39241296d853fca1745
Sep 09 21:07:59.701335 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.701154    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vhmqh"
Sep 09 21:07:59.710129 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.709006    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp"
Sep 09 21:07:59.711400 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:59.711351    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod140804ca_8508_4fe3_bfb1_1726c619701e.slice/crio-b8cbbafaac0df2c812d3849a93efe8934d4545d7dce17e2acfb47de8dad3e0b6 WatchSource:0}: Error finding container b8cbbafaac0df2c812d3849a93efe8934d4545d7dce17e2acfb47de8dad3e0b6: Status 404 returned error can't find the container with id b8cbbafaac0df2c812d3849a93efe8934d4545d7dce17e2acfb47de8dad3e0b6
Sep 09 21:07:59.717856 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.717681    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-z8swp"
Sep 09 21:07:59.719157 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:59.719131    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63f30c56_37ce_46c3_b443_9b2afdb432b1.slice/crio-8272f02c6298192a6a61cf6112d4d5ff6af90d90950753ca0af7ea5d0e895a58 WatchSource:0}: Error finding container 8272f02c6298192a6a61cf6112d4d5ff6af90d90950753ca0af7ea5d0e895a58: Status 404 returned error can't find the container with id 8272f02c6298192a6a61cf6112d4d5ff6af90d90950753ca0af7ea5d0e895a58
Sep 09 21:07:59.727171 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.727139    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hssdd"
Sep 09 21:07:59.728231 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:59.728189    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb3f4d24_4a06_4b75_a0ea_c6e8fba9e5f6.slice/crio-640cdc737f70ca2631652cfab369c8b73268ed528a6dd551b6fdf7ae4cce0362 WatchSource:0}: Error finding container 640cdc737f70ca2631652cfab369c8b73268ed528a6dd551b6fdf7ae4cce0362: Status 404 returned error can't find the container with id 640cdc737f70ca2631652cfab369c8b73268ed528a6dd551b6fdf7ae4cce0362
Sep 09 21:07:59.736859 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.736836    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zln8j"
Sep 09 21:07:59.745915 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.745735    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fjp57"
Sep 09 21:07:59.748448 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:59.748425    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22210233_a1fa_4335_a652_6b89192b07ec.slice/crio-bb3f9d21d420aea6399caa30d054760cbc21120e4a63210d59492cb164ac2b15 WatchSource:0}: Error finding container bb3f9d21d420aea6399caa30d054760cbc21120e4a63210d59492cb164ac2b15: Status 404 returned error can't find the container with id bb3f9d21d420aea6399caa30d054760cbc21120e4a63210d59492cb164ac2b15
Sep 09 21:07:59.753594 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.753417    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-q7sjb"
Sep 09 21:07:59.756562 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:59.756535    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf53dce4_0da4_4e78_8e7d_e77e0734a8d9.slice/crio-19451405d95f943c2d55742a181b6186be0b38a2790dafcaac1a2b60594d977a WatchSource:0}: Error finding container 19451405d95f943c2d55742a181b6186be0b38a2790dafcaac1a2b60594d977a: Status 404 returned error can't find the container with id 19451405d95f943c2d55742a181b6186be0b38a2790dafcaac1a2b60594d977a
Sep 09 21:07:59.763669 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:07:59.763643    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85bff06c_41a6_4cd8_8196_aca41c4b9a50.slice/crio-683226558fde6fec1977003004bc6b8f47ef86c0ad1937131b9720c15bb7b339 WatchSource:0}: Error finding container 683226558fde6fec1977003004bc6b8f47ef86c0ad1937131b9720c15bb7b339: Status 404 returned error can't find the container with id 683226558fde6fec1977003004bc6b8f47ef86c0ad1937131b9720c15bb7b339
Sep 09 21:07:59.997401 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:07:59.997308    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1d5bd2bb-63bd-4425-ae59-2177722354f5-original-pull-secret\") pod \"global-pull-secret-syncer-5px25\" (UID: \"1d5bd2bb-63bd-4425-ae59-2177722354f5\") " pod="kube-system/global-pull-secret-syncer-5px25"
Sep 09 21:07:59.997572 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:07:59.997494    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 21:07:59.997642 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:07:59.997583    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d5bd2bb-63bd-4425-ae59-2177722354f5-original-pull-secret podName:1d5bd2bb-63bd-4425-ae59-2177722354f5 nodeName:}" failed. No retries permitted until 2026-09-09 21:08:00.997559976 +0000 UTC m=+3.976878086 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1d5bd2bb-63bd-4425-ae59-2177722354f5-original-pull-secret") pod "global-pull-secret-syncer-5px25" (UID: "1d5bd2bb-63bd-4425-ae59-2177722354f5") : object "kube-system"/"original-pull-secret" not registered
Sep 09 21:08:00.098123 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:00.098090    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rj4lj\" (UniqueName: \"kubernetes.io/projected/f22a4fe6-1a57-40fe-a1c7-ea0662c99601-kube-api-access-rj4lj\") pod \"network-check-target-787zm\" (UID: \"f22a4fe6-1a57-40fe-a1c7-ea0662c99601\") " pod="openshift-network-diagnostics/network-check-target-787zm"
Sep 09 21:08:00.098123 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:00.098131    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/325461e6-e654-481d-9458-feb1bb597455-metrics-certs\") pod \"network-metrics-daemon-zd7mb\" (UID: \"325461e6-e654-481d-9458-feb1bb597455\") " pod="openshift-multus/network-metrics-daemon-zd7mb"
Sep 09 21:08:00.098387 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:00.098251    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 21:08:00.098387 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:00.098286    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 21:08:00.098387 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:00.098311    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 21:08:00.098387 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:00.098316    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/325461e6-e654-481d-9458-feb1bb597455-metrics-certs podName:325461e6-e654-481d-9458-feb1bb597455 nodeName:}" failed. No retries permitted until 2026-09-09 21:08:01.098301737 +0000 UTC m=+4.077619834 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/325461e6-e654-481d-9458-feb1bb597455-metrics-certs") pod "network-metrics-daemon-zd7mb" (UID: "325461e6-e654-481d-9458-feb1bb597455") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 21:08:00.098387 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:00.098325    2555 projected.go:196] Error preparing data for projected volume kube-api-access-rj4lj for pod openshift-network-diagnostics/network-check-target-787zm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 21:08:00.098387 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:00.098385    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f22a4fe6-1a57-40fe-a1c7-ea0662c99601-kube-api-access-rj4lj podName:f22a4fe6-1a57-40fe-a1c7-ea0662c99601 nodeName:}" failed. No retries permitted until 2026-09-09 21:08:01.098365792 +0000 UTC m=+4.077683901 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-rj4lj" (UniqueName: "kubernetes.io/projected/f22a4fe6-1a57-40fe-a1c7-ea0662c99601-kube-api-access-rj4lj") pod "network-check-target-787zm" (UID: "f22a4fe6-1a57-40fe-a1c7-ea0662c99601") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 21:08:00.436624 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:00.436522    2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 21:03:00 +0000 UTC" deadline="2028-06-06 19:09:39.433425584 +0000 UTC"
Sep 09 21:08:00.436624 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:00.436571    2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15262h1m38.99686003s"
Sep 09 21:08:00.460747 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:00.460572    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5px25"
Sep 09 21:08:00.460747 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:00.460703    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5px25" podUID="1d5bd2bb-63bd-4425-ae59-2177722354f5"
Sep 09 21:08:00.472889 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:00.472793    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fjp57" event={"ID":"df53dce4-0da4-4e78-8e7d-e77e0734a8d9","Type":"ContainerStarted","Data":"19451405d95f943c2d55742a181b6186be0b38a2790dafcaac1a2b60594d977a"}
Sep 09 21:08:00.476915 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:00.476880    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hssdd" event={"ID":"8db7296c-f0fc-4706-b8a2-1a189e9e4fea","Type":"ContainerStarted","Data":"1f0d27ea09496ce1c1c658be091a62d49c49fa3b553ee6c6df735d5190b200f5"}
Sep 09 21:08:00.479030 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:00.478999    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp" event={"ID":"63f30c56-37ce-46c3-b443-9b2afdb432b1","Type":"ContainerStarted","Data":"8272f02c6298192a6a61cf6112d4d5ff6af90d90950753ca0af7ea5d0e895a58"}
Sep 09 21:08:00.481177 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:00.481099    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vhmqh" event={"ID":"140804ca-8508-4fe3-bfb1-1726c619701e","Type":"ContainerStarted","Data":"b8cbbafaac0df2c812d3849a93efe8934d4545d7dce17e2acfb47de8dad3e0b6"}
Sep 09 21:08:00.483806 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:00.483733    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9jhg" event={"ID":"928443e9-b49f-4f2a-acd4-fc3525edc7ee","Type":"ContainerStarted","Data":"88c852c71b6745a22404a1cf2958b881eeb9d42b6b8fe39241296d853fca1745"}
Sep 09 21:08:00.485371 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:00.485304    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-q7sjb" event={"ID":"85bff06c-41a6-4cd8-8196-aca41c4b9a50","Type":"ContainerStarted","Data":"683226558fde6fec1977003004bc6b8f47ef86c0ad1937131b9720c15bb7b339"}
Sep 09 21:08:00.486971 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:00.486922    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zln8j" event={"ID":"22210233-a1fa-4335-a652-6b89192b07ec","Type":"ContainerStarted","Data":"bb3f9d21d420aea6399caa30d054760cbc21120e4a63210d59492cb164ac2b15"}
Sep 09 21:08:00.489023 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:00.488997    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-z8swp" event={"ID":"eb3f4d24-4a06-4b75-a0ea-c6e8fba9e5f6","Type":"ContainerStarted","Data":"640cdc737f70ca2631652cfab369c8b73268ed528a6dd551b6fdf7ae4cce0362"}
Sep 09 21:08:00.490400 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:00.490373    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dm8mh" event={"ID":"bd496f3d-f208-431d-8171-5868156304f6","Type":"ContainerStarted","Data":"0ff2e548b5f17136236c81a9cb86d60464ac61bb76d59fdcba35083aa159f9b0"}
Sep 09 21:08:01.007331 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:01.007288    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1d5bd2bb-63bd-4425-ae59-2177722354f5-original-pull-secret\") pod \"global-pull-secret-syncer-5px25\" (UID: \"1d5bd2bb-63bd-4425-ae59-2177722354f5\") " pod="kube-system/global-pull-secret-syncer-5px25"
Sep 09 21:08:01.007523 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:01.007451    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 21:08:01.007588 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:01.007527    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d5bd2bb-63bd-4425-ae59-2177722354f5-original-pull-secret podName:1d5bd2bb-63bd-4425-ae59-2177722354f5 nodeName:}" failed. No retries permitted until 2026-09-09 21:08:03.007505704 +0000 UTC m=+5.986823821 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1d5bd2bb-63bd-4425-ae59-2177722354f5-original-pull-secret") pod "global-pull-secret-syncer-5px25" (UID: "1d5bd2bb-63bd-4425-ae59-2177722354f5") : object "kube-system"/"original-pull-secret" not registered
Sep 09 21:08:01.108475 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:01.108434    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rj4lj\" (UniqueName: \"kubernetes.io/projected/f22a4fe6-1a57-40fe-a1c7-ea0662c99601-kube-api-access-rj4lj\") pod \"network-check-target-787zm\" (UID: \"f22a4fe6-1a57-40fe-a1c7-ea0662c99601\") " pod="openshift-network-diagnostics/network-check-target-787zm"
Sep 09 21:08:01.108660 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:01.108491    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/325461e6-e654-481d-9458-feb1bb597455-metrics-certs\") pod \"network-metrics-daemon-zd7mb\" (UID: \"325461e6-e654-481d-9458-feb1bb597455\") " pod="openshift-multus/network-metrics-daemon-zd7mb"
Sep 09 21:08:01.108660 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:01.108605    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 21:08:01.108775 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:01.108682    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/325461e6-e654-481d-9458-feb1bb597455-metrics-certs podName:325461e6-e654-481d-9458-feb1bb597455 nodeName:}" failed. No retries permitted until 2026-09-09 21:08:03.108661838 +0000 UTC m=+6.087979987 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/325461e6-e654-481d-9458-feb1bb597455-metrics-certs") pod "network-metrics-daemon-zd7mb" (UID: "325461e6-e654-481d-9458-feb1bb597455") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 21:08:01.108775 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:01.108678    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 21:08:01.108775 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:01.108712    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 21:08:01.108775 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:01.108726    2555 projected.go:196] Error preparing data for projected volume kube-api-access-rj4lj for pod openshift-network-diagnostics/network-check-target-787zm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 21:08:01.108775 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:01.108760    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f22a4fe6-1a57-40fe-a1c7-ea0662c99601-kube-api-access-rj4lj podName:f22a4fe6-1a57-40fe-a1c7-ea0662c99601 nodeName:}" failed. No retries permitted until 2026-09-09 21:08:03.108750507 +0000 UTC m=+6.088068614 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-rj4lj" (UniqueName: "kubernetes.io/projected/f22a4fe6-1a57-40fe-a1c7-ea0662c99601-kube-api-access-rj4lj") pod "network-check-target-787zm" (UID: "f22a4fe6-1a57-40fe-a1c7-ea0662c99601") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 21:08:01.437850 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:01.437693    2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 21:03:00 +0000 UTC" deadline="2028-04-18 20:32:13.963233475 +0000 UTC"
Sep 09 21:08:01.437850 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:01.437758    2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14087h24m12.525481744s"
Sep 09 21:08:01.463414 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:01.461955    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zd7mb"
Sep 09 21:08:01.463414 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:01.462104    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zd7mb" podUID="325461e6-e654-481d-9458-feb1bb597455"
Sep 09 21:08:01.463414 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:01.462536    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-787zm"
Sep 09 21:08:01.463414 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:01.462635    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-787zm" podUID="f22a4fe6-1a57-40fe-a1c7-ea0662c99601"
Sep 09 21:08:02.461496 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:02.461098    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5px25"
Sep 09 21:08:02.461496 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:02.461451    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5px25" podUID="1d5bd2bb-63bd-4425-ae59-2177722354f5"
Sep 09 21:08:02.505294 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:02.505202    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-235.ec2.internal" event={"ID":"f778c97992e131b077853819dd25ede0","Type":"ContainerStarted","Data":"ca4a3e05315858f4a2e9601238d97d2de477ec7fd0cc30ada7980921eb987013"}
Sep 09 21:08:02.509171 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:02.509138    2555 generic.go:356] "Generic (PLEG): container finished" podID="80431ef9b40002b355f9a5fc07e0031e" containerID="9c2c12aa5f09dfaa6957bb23fe8a86e057e029c21fa856837d2aa730b34fc137" exitCode=0
Sep 09 21:08:02.509287 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:02.509188    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-235.ec2.internal" event={"ID":"80431ef9b40002b355f9a5fc07e0031e","Type":"ContainerDied","Data":"9c2c12aa5f09dfaa6957bb23fe8a86e057e029c21fa856837d2aa730b34fc137"}
Sep 09 21:08:02.525838 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:02.525779    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-235.ec2.internal" podStartSLOduration=3.52575978 podStartE2EDuration="3.52575978s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 21:07:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:08:02.525163622 +0000 UTC m=+5.504481741" watchObservedRunningTime="2026-09-09 21:08:02.52575978 +0000 UTC m=+5.505077901"
Sep 09 21:08:03.023940 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:03.023897    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1d5bd2bb-63bd-4425-ae59-2177722354f5-original-pull-secret\") pod \"global-pull-secret-syncer-5px25\" (UID: \"1d5bd2bb-63bd-4425-ae59-2177722354f5\") " pod="kube-system/global-pull-secret-syncer-5px25"
Sep 09 21:08:03.024146 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:03.024114    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 21:08:03.024213 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:03.024181    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d5bd2bb-63bd-4425-ae59-2177722354f5-original-pull-secret podName:1d5bd2bb-63bd-4425-ae59-2177722354f5 nodeName:}" failed. No retries permitted until 2026-09-09 21:08:07.024161551 +0000 UTC m=+10.003479657 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1d5bd2bb-63bd-4425-ae59-2177722354f5-original-pull-secret") pod "global-pull-secret-syncer-5px25" (UID: "1d5bd2bb-63bd-4425-ae59-2177722354f5") : object "kube-system"/"original-pull-secret" not registered
Sep 09 21:08:03.125825 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:03.124964    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rj4lj\" (UniqueName: \"kubernetes.io/projected/f22a4fe6-1a57-40fe-a1c7-ea0662c99601-kube-api-access-rj4lj\") pod \"network-check-target-787zm\" (UID: \"f22a4fe6-1a57-40fe-a1c7-ea0662c99601\") " pod="openshift-network-diagnostics/network-check-target-787zm"
Sep 09 21:08:03.125825 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:03.125019    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/325461e6-e654-481d-9458-feb1bb597455-metrics-certs\") pod \"network-metrics-daemon-zd7mb\" (UID: \"325461e6-e654-481d-9458-feb1bb597455\") " pod="openshift-multus/network-metrics-daemon-zd7mb"
Sep 09 21:08:03.125825 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:03.125169    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 21:08:03.125825 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:03.125239    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/325461e6-e654-481d-9458-feb1bb597455-metrics-certs podName:325461e6-e654-481d-9458-feb1bb597455 nodeName:}" failed. No retries permitted until 2026-09-09 21:08:07.125217968 +0000 UTC m=+10.104536067 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/325461e6-e654-481d-9458-feb1bb597455-metrics-certs") pod "network-metrics-daemon-zd7mb" (UID: "325461e6-e654-481d-9458-feb1bb597455") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 21:08:03.125825 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:03.125679    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 21:08:03.125825 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:03.125698    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 21:08:03.125825 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:03.125711    2555 projected.go:196] Error preparing data for projected volume kube-api-access-rj4lj for pod openshift-network-diagnostics/network-check-target-787zm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 21:08:03.125825 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:03.125759    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f22a4fe6-1a57-40fe-a1c7-ea0662c99601-kube-api-access-rj4lj podName:f22a4fe6-1a57-40fe-a1c7-ea0662c99601 nodeName:}" failed. No retries permitted until 2026-09-09 21:08:07.125742598 +0000 UTC m=+10.105060696 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-rj4lj" (UniqueName: "kubernetes.io/projected/f22a4fe6-1a57-40fe-a1c7-ea0662c99601-kube-api-access-rj4lj") pod "network-check-target-787zm" (UID: "f22a4fe6-1a57-40fe-a1c7-ea0662c99601") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 21:08:03.462070 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:03.461985    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zd7mb"
Sep 09 21:08:03.462567 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:03.462154    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zd7mb" podUID="325461e6-e654-481d-9458-feb1bb597455"
Sep 09 21:08:03.462567 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:03.462206    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-787zm"
Sep 09 21:08:03.462567 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:03.462327    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-787zm" podUID="f22a4fe6-1a57-40fe-a1c7-ea0662c99601"
Sep 09 21:08:04.460668 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:04.460631    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5px25"
Sep 09 21:08:04.460887 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:04.460788    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5px25" podUID="1d5bd2bb-63bd-4425-ae59-2177722354f5"
Sep 09 21:08:05.461673 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:05.461072    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zd7mb"
Sep 09 21:08:05.461673 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:05.461133    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-787zm"
Sep 09 21:08:05.461673 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:05.461248    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zd7mb" podUID="325461e6-e654-481d-9458-feb1bb597455"
Sep 09 21:08:05.461673 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:05.461426    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-787zm" podUID="f22a4fe6-1a57-40fe-a1c7-ea0662c99601"
Sep 09 21:08:06.461234 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:06.461147    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5px25"
Sep 09 21:08:06.461398 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:06.461314    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5px25" podUID="1d5bd2bb-63bd-4425-ae59-2177722354f5"
Sep 09 21:08:07.057359 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:07.057309    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1d5bd2bb-63bd-4425-ae59-2177722354f5-original-pull-secret\") pod \"global-pull-secret-syncer-5px25\" (UID: \"1d5bd2bb-63bd-4425-ae59-2177722354f5\") " pod="kube-system/global-pull-secret-syncer-5px25"
Sep 09 21:08:07.057851 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:07.057504    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 21:08:07.057851 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:07.057595    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d5bd2bb-63bd-4425-ae59-2177722354f5-original-pull-secret podName:1d5bd2bb-63bd-4425-ae59-2177722354f5 nodeName:}" failed. No retries permitted until 2026-09-09 21:08:15.057571777 +0000 UTC m=+18.036889872 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1d5bd2bb-63bd-4425-ae59-2177722354f5-original-pull-secret") pod "global-pull-secret-syncer-5px25" (UID: "1d5bd2bb-63bd-4425-ae59-2177722354f5") : object "kube-system"/"original-pull-secret" not registered
Sep 09 21:08:07.159236 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:07.158464    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rj4lj\" (UniqueName: \"kubernetes.io/projected/f22a4fe6-1a57-40fe-a1c7-ea0662c99601-kube-api-access-rj4lj\") pod \"network-check-target-787zm\" (UID: \"f22a4fe6-1a57-40fe-a1c7-ea0662c99601\") " pod="openshift-network-diagnostics/network-check-target-787zm"
Sep 09 21:08:07.159236 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:07.158519    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/325461e6-e654-481d-9458-feb1bb597455-metrics-certs\") pod \"network-metrics-daemon-zd7mb\" (UID: \"325461e6-e654-481d-9458-feb1bb597455\") " pod="openshift-multus/network-metrics-daemon-zd7mb"
Sep 09 21:08:07.159236 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:07.158658    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 21:08:07.159236 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:07.158718    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/325461e6-e654-481d-9458-feb1bb597455-metrics-certs podName:325461e6-e654-481d-9458-feb1bb597455 nodeName:}" failed. No retries permitted until 2026-09-09 21:08:15.158702324 +0000 UTC m=+18.138020431 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/325461e6-e654-481d-9458-feb1bb597455-metrics-certs") pod "network-metrics-daemon-zd7mb" (UID: "325461e6-e654-481d-9458-feb1bb597455") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 21:08:07.159236 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:07.158803    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 21:08:07.159236 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:07.158814    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 21:08:07.159236 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:07.158825    2555 projected.go:196] Error preparing data for projected volume kube-api-access-rj4lj for pod openshift-network-diagnostics/network-check-target-787zm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 21:08:07.159236 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:07.158858    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f22a4fe6-1a57-40fe-a1c7-ea0662c99601-kube-api-access-rj4lj podName:f22a4fe6-1a57-40fe-a1c7-ea0662c99601 nodeName:}" failed. No retries permitted until 2026-09-09 21:08:15.158849472 +0000 UTC m=+18.138167564 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-rj4lj" (UniqueName: "kubernetes.io/projected/f22a4fe6-1a57-40fe-a1c7-ea0662c99601-kube-api-access-rj4lj") pod "network-check-target-787zm" (UID: "f22a4fe6-1a57-40fe-a1c7-ea0662c99601") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 21:08:07.462401 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:07.462302    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zd7mb"
Sep 09 21:08:07.462568 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:07.462420    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-787zm"
Sep 09 21:08:07.462568 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:07.462502    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-787zm" podUID="f22a4fe6-1a57-40fe-a1c7-ea0662c99601"
Sep 09 21:08:07.462568 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:07.462472    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zd7mb" podUID="325461e6-e654-481d-9458-feb1bb597455"
Sep 09 21:08:08.461034 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:08.460995    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5px25"
Sep 09 21:08:08.461657 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:08.461153    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5px25" podUID="1d5bd2bb-63bd-4425-ae59-2177722354f5"
Sep 09 21:08:09.460663 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:09.460630    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-787zm"
Sep 09 21:08:09.460873 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:09.460772    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-787zm" podUID="f22a4fe6-1a57-40fe-a1c7-ea0662c99601"
Sep 09 21:08:09.461249 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:09.460630    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zd7mb"
Sep 09 21:08:09.461249 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:09.461202    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zd7mb" podUID="325461e6-e654-481d-9458-feb1bb597455"
Sep 09 21:08:10.461109 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:10.461079    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5px25"
Sep 09 21:08:10.461274 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:10.461186    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5px25" podUID="1d5bd2bb-63bd-4425-ae59-2177722354f5"
Sep 09 21:08:11.460887 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:11.460852    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zd7mb"
Sep 09 21:08:11.460887 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:11.460875    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-787zm"
Sep 09 21:08:11.461050 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:11.460966    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zd7mb" podUID="325461e6-e654-481d-9458-feb1bb597455"
Sep 09 21:08:11.461091 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:11.461074    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-787zm" podUID="f22a4fe6-1a57-40fe-a1c7-ea0662c99601"
Sep 09 21:08:11.532502 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:11.532461    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-235.ec2.internal" event={"ID":"80431ef9b40002b355f9a5fc07e0031e","Type":"ContainerStarted","Data":"61c4b01c01269f007aab2574af88cd6c0617e31a7ce0f260124b792cb43b75ea"}
Sep 09 21:08:11.534199 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:11.534172    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zln8j" event={"ID":"22210233-a1fa-4335-a652-6b89192b07ec","Type":"ContainerStarted","Data":"35cfa3ad061353873a662ad582943b88ee1e26cf3b21d9a5514c07720e3af7ed"}
Sep 09 21:08:11.535699 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:11.535665    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-z8swp" event={"ID":"eb3f4d24-4a06-4b75-a0ea-c6e8fba9e5f6","Type":"ContainerStarted","Data":"89b59e23fae88e5a4869527da1d5cc303377e3067d0380ab3bfc07b96f9bf874"}
Sep 09 21:08:11.537320 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:11.537296    2555 generic.go:356] "Generic (PLEG): container finished" podID="bd496f3d-f208-431d-8171-5868156304f6" containerID="4d95d7cab9cd511e55fd5868d624ebcb3e354cd3edd4574150a702ea33b96e71" exitCode=0
Sep 09 21:08:11.537425 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:11.537383    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dm8mh" event={"ID":"bd496f3d-f208-431d-8171-5868156304f6","Type":"ContainerDied","Data":"4d95d7cab9cd511e55fd5868d624ebcb3e354cd3edd4574150a702ea33b96e71"}
Sep 09 21:08:11.539096 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:11.539046    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fjp57" event={"ID":"df53dce4-0da4-4e78-8e7d-e77e0734a8d9","Type":"ContainerStarted","Data":"e07126a29abe2a4f7845c0ee7dbd397bc41c8f7d8a114dbf8d52809a1b2b19d6"}
Sep 09 21:08:11.540733 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:11.540705    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hssdd" event={"ID":"8db7296c-f0fc-4706-b8a2-1a189e9e4fea","Type":"ContainerStarted","Data":"94ce6ddf1b6e4547ceef2eb839b8fb2fb7f7caf71be2606ee9d15656daac91ab"}
Sep 09 21:08:11.542301 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:11.542279    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9jhg" event={"ID":"928443e9-b49f-4f2a-acd4-fc3525edc7ee","Type":"ContainerStarted","Data":"37db2d9fa2ba02d02f90fef2f478134a04c43333c9a91f561498344a11b5dcbb"}
Sep 09 21:08:11.551079 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:11.551024    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-235.ec2.internal" podStartSLOduration=12.551005415 podStartE2EDuration="12.551005415s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 21:07:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:08:11.550530022 +0000 UTC m=+14.529848136" watchObservedRunningTime="2026-09-09 21:08:11.551005415 +0000 UTC m=+14.530323529"
Sep 09 21:08:11.571640 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:11.571588    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-z8swp" podStartSLOduration=2.571343395 podStartE2EDuration="13.571570798s" totalImagesPullingTime="11.000227403s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 21:07:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:08:11.57134515 +0000 UTC m=+14.550663263" watchObservedRunningTime="2026-09-09 21:08:11.571570798 +0000 UTC m=+14.550888910"
Sep 09 21:08:11.587949 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:11.587893    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-zln8j" podStartSLOduration=2.676131222 podStartE2EDuration="13.587875348s" totalImagesPullingTime="10.911744126s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 21:07:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:08:11.587536606 +0000 UTC m=+14.566854719" watchObservedRunningTime="2026-09-09 21:08:11.587875348 +0000 UTC m=+14.567193460"
Sep 09 21:08:11.626692 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:11.626643    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-hssdd" podStartSLOduration=2.5866891279999997 podStartE2EDuration="13.626625864s" totalImagesPullingTime="11.039936736s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 21:07:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:08:11.609685866 +0000 UTC m=+14.589003995" watchObservedRunningTime="2026-09-09 21:08:11.626625864 +0000 UTC m=+14.605943977"
Sep 09 21:08:11.627114 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:11.627077    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-fjp57" podStartSLOduration=2.6573470009999998 podStartE2EDuration="13.62706607s" totalImagesPullingTime="10.969719069s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:07:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:08:11.62648895 +0000 UTC m=+14.605807064" watchObservedRunningTime="2026-09-09 21:08:11.62706607 +0000 UTC m=+14.606384184"
Sep 09 21:08:12.461275 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:12.461046    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5px25"
Sep 09 21:08:12.461440 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:12.461375    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5px25" podUID="1d5bd2bb-63bd-4425-ae59-2177722354f5"
Sep 09 21:08:12.545934 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:12.545851    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vhmqh" event={"ID":"140804ca-8508-4fe3-bfb1-1726c619701e","Type":"ContainerStarted","Data":"e0e399b026dff39b27d82b866f4bdde9eca0ac1484ff09ae37e28e58b2989eb7"}
Sep 09 21:08:12.567810 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:12.567754    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-vhmqh" podStartSLOduration=3.57492215 podStartE2EDuration="14.567735514s" totalImagesPullingTime="10.992813364s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 21:07:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:08:12.567041347 +0000 UTC m=+15.546359465" watchObservedRunningTime="2026-09-09 21:08:12.567735514 +0000 UTC m=+15.547053628"
Sep 09 21:08:13.461373 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:13.461274    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zd7mb"
Sep 09 21:08:13.461373 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:13.461322    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-787zm"
Sep 09 21:08:13.461612 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:13.461434    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zd7mb" podUID="325461e6-e654-481d-9458-feb1bb597455"
Sep 09 21:08:13.461612 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:13.461562    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-787zm" podUID="f22a4fe6-1a57-40fe-a1c7-ea0662c99601"
Sep 09 21:08:13.860962 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:13.860879    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-fjp57"
Sep 09 21:08:13.861600 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:13.861575    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-fjp57"
Sep 09 21:08:14.460809 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:14.460775    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5px25"
Sep 09 21:08:14.461024 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:14.460912    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5px25" podUID="1d5bd2bb-63bd-4425-ae59-2177722354f5"
Sep 09 21:08:14.550726 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:14.550695    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-fjp57"
Sep 09 21:08:14.551206 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:14.551188    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-fjp57"
Sep 09 21:08:15.118852 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:15.118812    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1d5bd2bb-63bd-4425-ae59-2177722354f5-original-pull-secret\") pod \"global-pull-secret-syncer-5px25\" (UID: \"1d5bd2bb-63bd-4425-ae59-2177722354f5\") " pod="kube-system/global-pull-secret-syncer-5px25"
Sep 09 21:08:15.119480 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:15.118927    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 21:08:15.119480 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:15.118982    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d5bd2bb-63bd-4425-ae59-2177722354f5-original-pull-secret podName:1d5bd2bb-63bd-4425-ae59-2177722354f5 nodeName:}" failed. No retries permitted until 2026-09-09 21:08:31.118968442 +0000 UTC m=+34.098286546 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1d5bd2bb-63bd-4425-ae59-2177722354f5-original-pull-secret") pod "global-pull-secret-syncer-5px25" (UID: "1d5bd2bb-63bd-4425-ae59-2177722354f5") : object "kube-system"/"original-pull-secret" not registered
Sep 09 21:08:15.219462 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:15.219435    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rj4lj\" (UniqueName: \"kubernetes.io/projected/f22a4fe6-1a57-40fe-a1c7-ea0662c99601-kube-api-access-rj4lj\") pod \"network-check-target-787zm\" (UID: \"f22a4fe6-1a57-40fe-a1c7-ea0662c99601\") " pod="openshift-network-diagnostics/network-check-target-787zm"
Sep 09 21:08:15.219462 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:15.219468    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/325461e6-e654-481d-9458-feb1bb597455-metrics-certs\") pod \"network-metrics-daemon-zd7mb\" (UID: \"325461e6-e654-481d-9458-feb1bb597455\") " pod="openshift-multus/network-metrics-daemon-zd7mb"
Sep 09 21:08:15.219639 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:15.219578    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 21:08:15.219639 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:15.219587    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 21:08:15.219639 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:15.219603    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 21:08:15.219639 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:15.219614    2555 projected.go:196] Error preparing data for projected volume kube-api-access-rj4lj for pod openshift-network-diagnostics/network-check-target-787zm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 21:08:15.219639 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:15.219629    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/325461e6-e654-481d-9458-feb1bb597455-metrics-certs podName:325461e6-e654-481d-9458-feb1bb597455 nodeName:}" failed. No retries permitted until 2026-09-09 21:08:31.219612453 +0000 UTC m=+34.198930559 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/325461e6-e654-481d-9458-feb1bb597455-metrics-certs") pod "network-metrics-daemon-zd7mb" (UID: "325461e6-e654-481d-9458-feb1bb597455") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 21:08:15.219844 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:15.219653    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f22a4fe6-1a57-40fe-a1c7-ea0662c99601-kube-api-access-rj4lj podName:f22a4fe6-1a57-40fe-a1c7-ea0662c99601 nodeName:}" failed. No retries permitted until 2026-09-09 21:08:31.219641481 +0000 UTC m=+34.198959576 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-rj4lj" (UniqueName: "kubernetes.io/projected/f22a4fe6-1a57-40fe-a1c7-ea0662c99601-kube-api-access-rj4lj") pod "network-check-target-787zm" (UID: "f22a4fe6-1a57-40fe-a1c7-ea0662c99601") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 21:08:15.461013 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:15.460923    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zd7mb"
Sep 09 21:08:15.461189 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:15.460923    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-787zm"
Sep 09 21:08:15.461189 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:15.461070    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zd7mb" podUID="325461e6-e654-481d-9458-feb1bb597455"
Sep 09 21:08:15.461189 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:15.461125    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-787zm" podUID="f22a4fe6-1a57-40fe-a1c7-ea0662c99601"
Sep 09 21:08:16.460700 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:16.460662    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5px25"
Sep 09 21:08:16.461296 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:16.460794    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5px25" podUID="1d5bd2bb-63bd-4425-ae59-2177722354f5"
Sep 09 21:08:17.461468 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:17.461434    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zd7mb"
Sep 09 21:08:17.461924 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:17.461517    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-787zm"
Sep 09 21:08:17.461924 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:17.461527    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zd7mb" podUID="325461e6-e654-481d-9458-feb1bb597455"
Sep 09 21:08:17.461924 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:17.461622    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-787zm" podUID="f22a4fe6-1a57-40fe-a1c7-ea0662c99601"
Sep 09 21:08:18.460552 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:18.460518    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5px25"
Sep 09 21:08:18.460737 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:18.460645    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5px25" podUID="1d5bd2bb-63bd-4425-ae59-2177722354f5"
Sep 09 21:08:19.460768 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:19.460731    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zd7mb"
Sep 09 21:08:19.461228 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:19.460891    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zd7mb" podUID="325461e6-e654-481d-9458-feb1bb597455"
Sep 09 21:08:19.461228 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:19.460950    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-787zm"
Sep 09 21:08:19.461228 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:19.461025    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-787zm" podUID="f22a4fe6-1a57-40fe-a1c7-ea0662c99601"
Sep 09 21:08:20.460938 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:20.460903    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5px25"
Sep 09 21:08:20.461395 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:20.461041    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5px25" podUID="1d5bd2bb-63bd-4425-ae59-2177722354f5"
Sep 09 21:08:20.935084 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:20.934906    2555 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 09 21:08:21.441739 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:21.441608    2555 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-09T21:08:20.935075127Z","UUID":"1b403077-25d0-46f4-995f-66761be77077","Handler":null,"Name":"","Endpoint":""}
Sep 09 21:08:21.443029 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:21.443014    2555 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 09 21:08:21.443108 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:21.443041    2555 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 09 21:08:21.460439 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:21.460417    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-787zm"
Sep 09 21:08:21.460525 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:21.460426    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zd7mb"
Sep 09 21:08:21.460525 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:21.460515    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-787zm" podUID="f22a4fe6-1a57-40fe-a1c7-ea0662c99601"
Sep 09 21:08:21.460640 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:21.460620    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zd7mb" podUID="325461e6-e654-481d-9458-feb1bb597455"
Sep 09 21:08:21.566180 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:21.565954    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-q7sjb" event={"ID":"85bff06c-41a6-4cd8-8196-aca41c4b9a50","Type":"ContainerStarted","Data":"14fbe360bcde5c0756d1568fc1212cdca56750126ef29e260cfd63ae08eb590a"}
Sep 09 21:08:21.568153 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:21.568127    2555 generic.go:356] "Generic (PLEG): container finished" podID="bd496f3d-f208-431d-8171-5868156304f6" containerID="9e4d5b55ec607282343e8550c870669f68781c1d322937f0360305943b6cede1" exitCode=0
Sep 09 21:08:21.568310 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:21.568217    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dm8mh" event={"ID":"bd496f3d-f208-431d-8171-5868156304f6","Type":"ContainerDied","Data":"9e4d5b55ec607282343e8550c870669f68781c1d322937f0360305943b6cede1"}
Sep 09 21:08:21.572041 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:21.572017    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp" event={"ID":"63f30c56-37ce-46c3-b443-9b2afdb432b1","Type":"ContainerStarted","Data":"470353278cca3b45522be1a500b23a219b4196a709c33a6b98e23a03cfadacd5"}
Sep 09 21:08:21.572311 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:21.572104    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp" event={"ID":"63f30c56-37ce-46c3-b443-9b2afdb432b1","Type":"ContainerStarted","Data":"c3a69b9492500bbe83e8ebf97a2fbd3ac37c889777755a272bdb54016d1c781a"}
Sep 09 21:08:21.572311 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:21.572152    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp" event={"ID":"63f30c56-37ce-46c3-b443-9b2afdb432b1","Type":"ContainerStarted","Data":"fa39e64a3da7890b2c04b913e9f3edca76f4ef1c36605043e257466b4d93b596"}
Sep 09 21:08:21.572311 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:21.572194    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp" event={"ID":"63f30c56-37ce-46c3-b443-9b2afdb432b1","Type":"ContainerStarted","Data":"719092c37a6bba052490b1f0c342310e60f682ed64d50bebe749c5a3011f9328"}
Sep 09 21:08:21.572311 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:21.572223    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp" event={"ID":"63f30c56-37ce-46c3-b443-9b2afdb432b1","Type":"ContainerStarted","Data":"a953f9d914b8d36a48e3557e825e3b88544e1549765e0271c01bc84f2c6a7b2f"}
Sep 09 21:08:21.572311 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:21.572261    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp" event={"ID":"63f30c56-37ce-46c3-b443-9b2afdb432b1","Type":"ContainerStarted","Data":"86ecf2591b7a0a46d99b750096b4de7f473a4ff8d92dce9041a9a34a0bf34712"}
Sep 09 21:08:21.573977 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:21.573954    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9jhg" event={"ID":"928443e9-b49f-4f2a-acd4-fc3525edc7ee","Type":"ContainerStarted","Data":"00f3951e4e9051d08bb676f7a366a29fe73334d92f3e2dced75050fa433c91c9"}
Sep 09 21:08:21.591859 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:21.591791    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-q7sjb" podStartSLOduration=2.539380534 podStartE2EDuration="23.591775745s" totalImagesPullingTime="21.052395211s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 21:07:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:08:21.591323852 +0000 UTC m=+24.570641964" watchObservedRunningTime="2026-09-09 21:08:21.591775745 +0000 UTC m=+24.571093860"
Sep 09 21:08:22.461279 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:22.461248    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5px25"
Sep 09 21:08:22.461390 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:22.461366    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5px25" podUID="1d5bd2bb-63bd-4425-ae59-2177722354f5"
Sep 09 21:08:22.578430 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:22.578388    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9jhg" event={"ID":"928443e9-b49f-4f2a-acd4-fc3525edc7ee","Type":"ContainerStarted","Data":"aecf636a97014566d3c62cc8ae83520815d1daa6e15ccab3eac7df3963872af8"}
Sep 09 21:08:22.601453 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:22.601333    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9jhg" podStartSLOduration=2.45002636 podStartE2EDuration="24.601312584s" totalImagesPullingTime="22.151286224s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 21:07:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:08:22.600633876 +0000 UTC m=+25.579951991" watchObservedRunningTime="2026-09-09 21:08:22.601312584 +0000 UTC m=+25.580630696"
Sep 09 21:08:23.461400 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:23.461322    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-787zm"
Sep 09 21:08:23.461400 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:23.461357    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zd7mb"
Sep 09 21:08:23.461598 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:23.461430    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-787zm" podUID="f22a4fe6-1a57-40fe-a1c7-ea0662c99601"
Sep 09 21:08:23.461598 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:23.461572    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zd7mb" podUID="325461e6-e654-481d-9458-feb1bb597455"
Sep 09 21:08:23.582098 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:23.582065    2555 generic.go:356] "Generic (PLEG): container finished" podID="bd496f3d-f208-431d-8171-5868156304f6" containerID="c3accc7cab6c59002dc2caaa3b78aac624c8bf9b6abdc1edcd69c694d7c244c5" exitCode=0
Sep 09 21:08:23.582557 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:23.582142    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dm8mh" event={"ID":"bd496f3d-f208-431d-8171-5868156304f6","Type":"ContainerDied","Data":"c3accc7cab6c59002dc2caaa3b78aac624c8bf9b6abdc1edcd69c694d7c244c5"}
Sep 09 21:08:24.460942 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:24.460916    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5px25"
Sep 09 21:08:24.461122 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:24.461013    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5px25" podUID="1d5bd2bb-63bd-4425-ae59-2177722354f5"
Sep 09 21:08:24.588122 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:24.588086    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp" event={"ID":"63f30c56-37ce-46c3-b443-9b2afdb432b1","Type":"ContainerStarted","Data":"1eaae774837f4b42dda0c6fc85e443549c4d54dcccf97e1f52cdce7cacbfaa1d"}
Sep 09 21:08:25.460463 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:25.460415    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zd7mb"
Sep 09 21:08:25.460658 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:25.460529    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zd7mb" podUID="325461e6-e654-481d-9458-feb1bb597455"
Sep 09 21:08:25.460658 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:25.460583    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-787zm"
Sep 09 21:08:25.460784 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:25.460663    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-787zm" podUID="f22a4fe6-1a57-40fe-a1c7-ea0662c99601"
Sep 09 21:08:25.592508 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:25.592472    2555 generic.go:356] "Generic (PLEG): container finished" podID="bd496f3d-f208-431d-8171-5868156304f6" containerID="a1761d9c5f66ac33b54eb9ffdac8b04ff15eb2b1789b49324c7200259e9acd0a" exitCode=0
Sep 09 21:08:25.592950 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:25.592517    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dm8mh" event={"ID":"bd496f3d-f208-431d-8171-5868156304f6","Type":"ContainerDied","Data":"a1761d9c5f66ac33b54eb9ffdac8b04ff15eb2b1789b49324c7200259e9acd0a"}
Sep 09 21:08:26.460872 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:26.460600    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5px25"
Sep 09 21:08:26.461023 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:26.460926    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5px25" podUID="1d5bd2bb-63bd-4425-ae59-2177722354f5"
Sep 09 21:08:26.599427 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:26.599392    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp" event={"ID":"63f30c56-37ce-46c3-b443-9b2afdb432b1","Type":"ContainerStarted","Data":"8431ad6d8d54c6d503a4983e2d769f527112b90d2f8942b0a50af43b48b5691e"}
Sep 09 21:08:26.600160 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:26.599707    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp"
Sep 09 21:08:26.600160 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:26.599780    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp"
Sep 09 21:08:26.617809 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:26.617784    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp"
Sep 09 21:08:26.630423 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:26.630371    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp" podStartSLOduration=7.535483085 podStartE2EDuration="28.63035767s" totalImagesPullingTime="21.094874585s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 21:07:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:08:26.629881991 +0000 UTC m=+29.609200105" watchObservedRunningTime="2026-09-09 21:08:26.63035767 +0000 UTC m=+29.609675783"
Sep 09 21:08:27.461500 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:27.461427    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zd7mb"
Sep 09 21:08:27.461656 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:27.461563    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zd7mb" podUID="325461e6-e654-481d-9458-feb1bb597455"
Sep 09 21:08:27.461656 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:27.461580    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-787zm"
Sep 09 21:08:27.461733 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:27.461673    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-787zm" podUID="f22a4fe6-1a57-40fe-a1c7-ea0662c99601"
Sep 09 21:08:27.601571 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:27.601537    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp"
Sep 09 21:08:27.616230 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:27.616208    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp"
Sep 09 21:08:27.654948 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:27.654916    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-787zm"]
Sep 09 21:08:27.655099 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:27.655024    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-787zm"
Sep 09 21:08:27.655147 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:27.655131    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-787zm" podUID="f22a4fe6-1a57-40fe-a1c7-ea0662c99601"
Sep 09 21:08:27.658398 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:27.658371    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5px25"]
Sep 09 21:08:27.658524 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:27.658479    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5px25"
Sep 09 21:08:27.658601 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:27.658574    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5px25" podUID="1d5bd2bb-63bd-4425-ae59-2177722354f5"
Sep 09 21:08:27.659191 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:27.659170    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zd7mb"]
Sep 09 21:08:27.659300 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:27.659260    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zd7mb"
Sep 09 21:08:27.659404 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:27.659370    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zd7mb" podUID="325461e6-e654-481d-9458-feb1bb597455"
Sep 09 21:08:29.460893 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:29.460854    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5px25"
Sep 09 21:08:29.461353 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:29.460867    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zd7mb"
Sep 09 21:08:29.461353 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:29.460996    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5px25" podUID="1d5bd2bb-63bd-4425-ae59-2177722354f5"
Sep 09 21:08:29.461353 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:29.460868    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-787zm"
Sep 09 21:08:29.461353 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:29.461111    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zd7mb" podUID="325461e6-e654-481d-9458-feb1bb597455"
Sep 09 21:08:29.461353 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:29.461156    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-787zm" podUID="f22a4fe6-1a57-40fe-a1c7-ea0662c99601"
Sep 09 21:08:30.611684 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:30.611603    2555 generic.go:356] "Generic (PLEG): container finished" podID="bd496f3d-f208-431d-8171-5868156304f6" containerID="748d91b1e8e4f284b3c19dd0e5d9a44ebc04ee98d3e6b95380c2388f373a0994" exitCode=0
Sep 09 21:08:30.611684 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:30.611660    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dm8mh" event={"ID":"bd496f3d-f208-431d-8171-5868156304f6","Type":"ContainerDied","Data":"748d91b1e8e4f284b3c19dd0e5d9a44ebc04ee98d3e6b95380c2388f373a0994"}
Sep 09 21:08:31.135735 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:31.135706    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1d5bd2bb-63bd-4425-ae59-2177722354f5-original-pull-secret\") pod \"global-pull-secret-syncer-5px25\" (UID: \"1d5bd2bb-63bd-4425-ae59-2177722354f5\") " pod="kube-system/global-pull-secret-syncer-5px25"
Sep 09 21:08:31.135883 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:31.135860    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 21:08:31.135936 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:31.135925    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d5bd2bb-63bd-4425-ae59-2177722354f5-original-pull-secret podName:1d5bd2bb-63bd-4425-ae59-2177722354f5 nodeName:}" failed. No retries permitted until 2026-09-09 21:09:03.135908452 +0000 UTC m=+66.115226547 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1d5bd2bb-63bd-4425-ae59-2177722354f5-original-pull-secret") pod "global-pull-secret-syncer-5px25" (UID: "1d5bd2bb-63bd-4425-ae59-2177722354f5") : object "kube-system"/"original-pull-secret" not registered
Sep 09 21:08:31.236497 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:31.236464    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rj4lj\" (UniqueName: \"kubernetes.io/projected/f22a4fe6-1a57-40fe-a1c7-ea0662c99601-kube-api-access-rj4lj\") pod \"network-check-target-787zm\" (UID: \"f22a4fe6-1a57-40fe-a1c7-ea0662c99601\") " pod="openshift-network-diagnostics/network-check-target-787zm"
Sep 09 21:08:31.236497 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:31.236502    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/325461e6-e654-481d-9458-feb1bb597455-metrics-certs\") pod \"network-metrics-daemon-zd7mb\" (UID: \"325461e6-e654-481d-9458-feb1bb597455\") " pod="openshift-multus/network-metrics-daemon-zd7mb"
Sep 09 21:08:31.236696 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:31.236611    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 21:08:31.236696 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:31.236616    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 21:08:31.236696 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:31.236638    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 21:08:31.236696 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:31.236648    2555 projected.go:196] Error preparing data for projected volume kube-api-access-rj4lj for pod openshift-network-diagnostics/network-check-target-787zm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 21:08:31.236696 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:31.236673    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/325461e6-e654-481d-9458-feb1bb597455-metrics-certs podName:325461e6-e654-481d-9458-feb1bb597455 nodeName:}" failed. No retries permitted until 2026-09-09 21:09:03.236653993 +0000 UTC m=+66.215972105 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/325461e6-e654-481d-9458-feb1bb597455-metrics-certs") pod "network-metrics-daemon-zd7mb" (UID: "325461e6-e654-481d-9458-feb1bb597455") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 21:08:31.236696 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:31.236694    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f22a4fe6-1a57-40fe-a1c7-ea0662c99601-kube-api-access-rj4lj podName:f22a4fe6-1a57-40fe-a1c7-ea0662c99601 nodeName:}" failed. No retries permitted until 2026-09-09 21:09:03.236682597 +0000 UTC m=+66.216000695 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-rj4lj" (UniqueName: "kubernetes.io/projected/f22a4fe6-1a57-40fe-a1c7-ea0662c99601-kube-api-access-rj4lj") pod "network-check-target-787zm" (UID: "f22a4fe6-1a57-40fe-a1c7-ea0662c99601") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 21:08:31.461363 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:31.461279    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5px25"
Sep 09 21:08:31.461363 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:31.461303    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-787zm"
Sep 09 21:08:31.461567 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:31.461371    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5px25" podUID="1d5bd2bb-63bd-4425-ae59-2177722354f5"
Sep 09 21:08:31.461567 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:31.461282    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zd7mb"
Sep 09 21:08:31.461567 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:31.461454    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-787zm" podUID="f22a4fe6-1a57-40fe-a1c7-ea0662c99601"
Sep 09 21:08:31.461567 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:31.461512    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zd7mb" podUID="325461e6-e654-481d-9458-feb1bb597455"
Sep 09 21:08:31.617232 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:31.617203    2555 generic.go:356] "Generic (PLEG): container finished" podID="bd496f3d-f208-431d-8171-5868156304f6" containerID="274ccad8dfd91553b21d926c052d1d12fd59f183f2825006084649d3f869b8ae" exitCode=0
Sep 09 21:08:31.617232 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:31.617238    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dm8mh" event={"ID":"bd496f3d-f208-431d-8171-5868156304f6","Type":"ContainerDied","Data":"274ccad8dfd91553b21d926c052d1d12fd59f183f2825006084649d3f869b8ae"}
Sep 09 21:08:32.622202 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:32.621981    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dm8mh" event={"ID":"bd496f3d-f208-431d-8171-5868156304f6","Type":"ContainerStarted","Data":"284020287a2efe6cbc7daab99f32a87aa06f3d46670017ea124a3b00c8e44e7c"}
Sep 09 21:08:32.651389 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:32.651342    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-dm8mh" podStartSLOduration=6.646871978 podStartE2EDuration="34.651327799s" totalImagesPullingTime="28.004455821s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 21:07:58 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:08:32.650895153 +0000 UTC m=+35.630213268" watchObservedRunningTime="2026-09-09 21:08:32.651327799 +0000 UTC m=+35.630645911"
Sep 09 21:08:33.460460 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:33.460430    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5px25"
Sep 09 21:08:33.460704 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:33.460435    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zd7mb"
Sep 09 21:08:33.460704 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:33.460537    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5px25" podUID="1d5bd2bb-63bd-4425-ae59-2177722354f5"
Sep 09 21:08:33.460704 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:33.460614    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zd7mb" podUID="325461e6-e654-481d-9458-feb1bb597455"
Sep 09 21:08:33.460704 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:33.460659    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-787zm"
Sep 09 21:08:33.460704 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:33.460705    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-787zm" podUID="f22a4fe6-1a57-40fe-a1c7-ea0662c99601"
Sep 09 21:08:34.297171 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:34.297150    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-235.ec2.internal" event="NodeReady"
Sep 09 21:08:34.297579 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:34.297255    2555 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 09 21:08:34.341700 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:34.341678    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-588b6c65d4-jnmhd"]
Sep 09 21:08:34.360904 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:34.360886    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd"
Sep 09 21:08:34.363602 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:34.363555    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-588b6c65d4-jnmhd"]
Sep 09 21:08:34.364031 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:34.364009    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 09 21:08:34.364341 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:34.364324    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 09 21:08:34.364341 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:34.364334    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-9q5q4\""
Sep 09 21:08:34.364499 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:34.364336    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 09 21:08:34.367325 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:34.367219    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-rfxqx"]
Sep 09 21:08:34.373310 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:34.373293    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 09 21:08:34.385479 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:34.385460    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-2888n"]
Sep 09 21:08:34.385573 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:34.385559    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rfxqx"
Sep 09 21:08:34.388802 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:34.388774    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 09 21:08:34.388977 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:34.388942    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 09 21:08:34.389341 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:34.389323    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6rdjz\""
Sep 09 21:08:34.403608 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:34.403591    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2888n"
Sep 09 21:08:34.403697 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:34.403590    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2888n"]
Sep 09 21:08:34.403697 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:34.403645    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rfxqx"]
Sep 09 21:08:34.408257 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:34.408239    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 09 21:08:34.408353 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:34.408242    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 09 21:08:34.408353 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:34.408243    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 09 21:08:34.408353 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:34.408243    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-xc5lb\""
Sep 09 21:08:34.459038 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:34.459015    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f0356f0a-0671-452b-a4d6-a845c9e79079-ca-trust-extracted\") pod \"image-registry-588b6c65d4-jnmhd\" (UID: \"f0356f0a-0671-452b-a4d6-a845c9e79079\") " pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd"
Sep 09 21:08:34.459140 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:34.459042    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f0356f0a-0671-452b-a4d6-a845c9e79079-installation-pull-secrets\") pod \"image-registry-588b6c65d4-jnmhd\" (UID: \"f0356f0a-0671-452b-a4d6-a845c9e79079\") " pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd"
Sep 09 21:08:34.459140 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:34.459061    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtnjl\" (UniqueName: \"kubernetes.io/projected/f0356f0a-0671-452b-a4d6-a845c9e79079-kube-api-access-jtnjl\") pod \"image-registry-588b6c65d4-jnmhd\" (UID: \"f0356f0a-0671-452b-a4d6-a845c9e79079\") " pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd"
Sep 09 21:08:34.459140 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:34.459084    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f0356f0a-0671-452b-a4d6-a845c9e79079-registry-tls\") pod \"image-registry-588b6c65d4-jnmhd\" (UID: \"f0356f0a-0671-452b-a4d6-a845c9e79079\") " pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd"
Sep 09 21:08:34.459140 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:34.459100    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f0356f0a-0671-452b-a4d6-a845c9e79079-registry-certificates\") pod \"image-registry-588b6c65d4-jnmhd\" (UID: \"f0356f0a-0671-452b-a4d6-a845c9e79079\") " pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd"
Sep 09 21:08:34.459458 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:34.459174    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f0356f0a-0671-452b-a4d6-a845c9e79079-trusted-ca\") pod \"image-registry-588b6c65d4-jnmhd\" (UID: \"f0356f0a-0671-452b-a4d6-a845c9e79079\") " pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd"
Sep 09 21:08:34.459458 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:34.459222    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f0356f0a-0671-452b-a4d6-a845c9e79079-image-registry-private-configuration\") pod \"image-registry-588b6c65d4-jnmhd\" (UID: \"f0356f0a-0671-452b-a4d6-a845c9e79079\") " pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd"
Sep 09 21:08:34.459458 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:34.459262    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f0356f0a-0671-452b-a4d6-a845c9e79079-bound-sa-token\") pod \"image-registry-588b6c65d4-jnmhd\" (UID: \"f0356f0a-0671-452b-a4d6-a845c9e79079\") " pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd"
Sep 09 21:08:34.560538 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:34.560478    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f0356f0a-0671-452b-a4d6-a845c9e79079-ca-trust-extracted\") pod \"image-registry-588b6c65d4-jnmhd\" (UID: \"f0356f0a-0671-452b-a4d6-a845c9e79079\") " pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd"
Sep 09 21:08:34.560538 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:34.560511    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f0356f0a-0671-452b-a4d6-a845c9e79079-installation-pull-secrets\") pod \"image-registry-588b6c65d4-jnmhd\" (UID: \"f0356f0a-0671-452b-a4d6-a845c9e79079\") " pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd"
Sep 09 21:08:34.560684 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:34.560537    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtnjl\" (UniqueName: \"kubernetes.io/projected/f0356f0a-0671-452b-a4d6-a845c9e79079-kube-api-access-jtnjl\") pod \"image-registry-588b6c65d4-jnmhd\" (UID: \"f0356f0a-0671-452b-a4d6-a845c9e79079\") " pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd"
Sep 09 21:08:34.560684 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:34.560563    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0e8de06-c61e-40f5-a07e-8a5a426c236a-tmp-dir\") pod \"dns-default-rfxqx\" (UID: \"a0e8de06-c61e-40f5-a07e-8a5a426c236a\") " pod="openshift-dns/dns-default-rfxqx"
Sep 09 21:08:34.560684 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:34.560585    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a0e8de06-c61e-40f5-a07e-8a5a426c236a-config-volume\") pod \"dns-default-rfxqx\" (UID: \"a0e8de06-c61e-40f5-a07e-8a5a426c236a\") " pod="openshift-dns/dns-default-rfxqx"
Sep 09 21:08:34.560684 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:34.560605    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/09f5e589-c6ad-44a0-a60e-8243559b2b65-cert\") pod \"ingress-canary-2888n\" (UID: \"09f5e589-c6ad-44a0-a60e-8243559b2b65\") " pod="openshift-ingress-canary/ingress-canary-2888n"
Sep 09 21:08:34.560684 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:34.560628    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjhf9\" (UniqueName: \"kubernetes.io/projected/09f5e589-c6ad-44a0-a60e-8243559b2b65-kube-api-access-xjhf9\") pod \"ingress-canary-2888n\" (UID: \"09f5e589-c6ad-44a0-a60e-8243559b2b65\") " pod="openshift-ingress-canary/ingress-canary-2888n"
Sep 09 21:08:34.560684 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:34.560667    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f0356f0a-0671-452b-a4d6-a845c9e79079-registry-tls\") pod \"image-registry-588b6c65d4-jnmhd\" (UID: \"f0356f0a-0671-452b-a4d6-a845c9e79079\") " pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd"
Sep 09 21:08:34.560994 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:34.560691    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f0356f0a-0671-452b-a4d6-a845c9e79079-registry-certificates\") pod \"image-registry-588b6c65d4-jnmhd\" (UID: \"f0356f0a-0671-452b-a4d6-a845c9e79079\") " pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd"
Sep 09 21:08:34.560994 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:34.560734    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f0356f0a-0671-452b-a4d6-a845c9e79079-trusted-ca\") pod \"image-registry-588b6c65d4-jnmhd\" (UID: \"f0356f0a-0671-452b-a4d6-a845c9e79079\") " pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd"
Sep 09 21:08:34.560994 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:34.560773    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f0356f0a-0671-452b-a4d6-a845c9e79079-image-registry-private-configuration\") pod \"image-registry-588b6c65d4-jnmhd\" (UID: \"f0356f0a-0671-452b-a4d6-a845c9e79079\") " pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd"
Sep 09 21:08:34.560994 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:34.560787    2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 21:08:34.560994 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:34.560808    2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-588b6c65d4-jnmhd: secret "image-registry-tls" not found
Sep 09 21:08:34.560994 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:34.560811    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f0356f0a-0671-452b-a4d6-a845c9e79079-bound-sa-token\") pod \"image-registry-588b6c65d4-jnmhd\" (UID: \"f0356f0a-0671-452b-a4d6-a845c9e79079\") " pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd"
Sep 09 21:08:34.560994 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:34.560874    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0e8de06-c61e-40f5-a07e-8a5a426c236a-metrics-tls\") pod \"dns-default-rfxqx\" (UID: \"a0e8de06-c61e-40f5-a07e-8a5a426c236a\") " pod="openshift-dns/dns-default-rfxqx"
Sep 09 21:08:34.560994 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:34.560873    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f0356f0a-0671-452b-a4d6-a845c9e79079-ca-trust-extracted\") pod \"image-registry-588b6c65d4-jnmhd\" (UID: \"f0356f0a-0671-452b-a4d6-a845c9e79079\") " pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd"
Sep 09 21:08:34.560994 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:34.560904    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f0356f0a-0671-452b-a4d6-a845c9e79079-registry-tls podName:f0356f0a-0671-452b-a4d6-a845c9e79079 nodeName:}" failed. No retries permitted until 2026-09-09 21:08:35.060881274 +0000 UTC m=+38.040199382 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f0356f0a-0671-452b-a4d6-a845c9e79079-registry-tls") pod "image-registry-588b6c65d4-jnmhd" (UID: "f0356f0a-0671-452b-a4d6-a845c9e79079") : secret "image-registry-tls" not found
Sep 09 21:08:34.560994 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:34.560944    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dc8bs\" (UniqueName: \"kubernetes.io/projected/a0e8de06-c61e-40f5-a07e-8a5a426c236a-kube-api-access-dc8bs\") pod \"dns-default-rfxqx\" (UID: \"a0e8de06-c61e-40f5-a07e-8a5a426c236a\") " pod="openshift-dns/dns-default-rfxqx"
Sep 09 21:08:34.561495 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:34.561464    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f0356f0a-0671-452b-a4d6-a845c9e79079-registry-certificates\") pod \"image-registry-588b6c65d4-jnmhd\" (UID: \"f0356f0a-0671-452b-a4d6-a845c9e79079\") " pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd"
Sep 09 21:08:34.562012 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:34.561992    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f0356f0a-0671-452b-a4d6-a845c9e79079-trusted-ca\") pod \"image-registry-588b6c65d4-jnmhd\" (UID: \"f0356f0a-0671-452b-a4d6-a845c9e79079\") " pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd"
Sep 09 21:08:34.564541 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:34.564513    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f0356f0a-0671-452b-a4d6-a845c9e79079-image-registry-private-configuration\") pod \"image-registry-588b6c65d4-jnmhd\" (UID: \"f0356f0a-0671-452b-a4d6-a845c9e79079\") " pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd"
Sep 09 21:08:34.564610 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:34.564548    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f0356f0a-0671-452b-a4d6-a845c9e79079-installation-pull-secrets\") pod \"image-registry-588b6c65d4-jnmhd\" (UID: \"f0356f0a-0671-452b-a4d6-a845c9e79079\") " pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd"
Sep 09 21:08:34.574477 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:34.574454    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f0356f0a-0671-452b-a4d6-a845c9e79079-bound-sa-token\") pod \"image-registry-588b6c65d4-jnmhd\" (UID: \"f0356f0a-0671-452b-a4d6-a845c9e79079\") " pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd"
Sep 09 21:08:34.574829 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:34.574795    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtnjl\" (UniqueName: \"kubernetes.io/projected/f0356f0a-0671-452b-a4d6-a845c9e79079-kube-api-access-jtnjl\") pod \"image-registry-588b6c65d4-jnmhd\" (UID: \"f0356f0a-0671-452b-a4d6-a845c9e79079\") " pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd"
Sep 09 21:08:34.661873 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:34.661850    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0e8de06-c61e-40f5-a07e-8a5a426c236a-metrics-tls\") pod \"dns-default-rfxqx\" (UID: \"a0e8de06-c61e-40f5-a07e-8a5a426c236a\") " pod="openshift-dns/dns-default-rfxqx"
Sep 09 21:08:34.662007 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:34.661885    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dc8bs\" (UniqueName: \"kubernetes.io/projected/a0e8de06-c61e-40f5-a07e-8a5a426c236a-kube-api-access-dc8bs\") pod \"dns-default-rfxqx\" (UID: \"a0e8de06-c61e-40f5-a07e-8a5a426c236a\") " pod="openshift-dns/dns-default-rfxqx"
Sep 09 21:08:34.662007 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:34.661934    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0e8de06-c61e-40f5-a07e-8a5a426c236a-tmp-dir\") pod \"dns-default-rfxqx\" (UID: \"a0e8de06-c61e-40f5-a07e-8a5a426c236a\") " pod="openshift-dns/dns-default-rfxqx"
Sep 09 21:08:34.662007 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:34.661959    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a0e8de06-c61e-40f5-a07e-8a5a426c236a-config-volume\") pod \"dns-default-rfxqx\" (UID: \"a0e8de06-c61e-40f5-a07e-8a5a426c236a\") " pod="openshift-dns/dns-default-rfxqx"
Sep 09 21:08:34.662007 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:34.661981    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/09f5e589-c6ad-44a0-a60e-8243559b2b65-cert\") pod \"ingress-canary-2888n\" (UID: \"09f5e589-c6ad-44a0-a60e-8243559b2b65\") " pod="openshift-ingress-canary/ingress-canary-2888n"
Sep 09 21:08:34.662007 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:34.662004    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjhf9\" (UniqueName: \"kubernetes.io/projected/09f5e589-c6ad-44a0-a60e-8243559b2b65-kube-api-access-xjhf9\") pod \"ingress-canary-2888n\" (UID: \"09f5e589-c6ad-44a0-a60e-8243559b2b65\") " pod="openshift-ingress-canary/ingress-canary-2888n"
Sep 09 21:08:34.662216 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:34.661982    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 21:08:34.662216 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:34.662111    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0e8de06-c61e-40f5-a07e-8a5a426c236a-metrics-tls podName:a0e8de06-c61e-40f5-a07e-8a5a426c236a nodeName:}" failed. No retries permitted until 2026-09-09 21:08:35.162088713 +0000 UTC m=+38.141406826 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a0e8de06-c61e-40f5-a07e-8a5a426c236a-metrics-tls") pod "dns-default-rfxqx" (UID: "a0e8de06-c61e-40f5-a07e-8a5a426c236a") : secret "dns-default-metrics-tls" not found
Sep 09 21:08:34.662351 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:34.662334    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0e8de06-c61e-40f5-a07e-8a5a426c236a-tmp-dir\") pod \"dns-default-rfxqx\" (UID: \"a0e8de06-c61e-40f5-a07e-8a5a426c236a\") " pod="openshift-dns/dns-default-rfxqx"
Sep 09 21:08:34.662549 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:34.662527    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a0e8de06-c61e-40f5-a07e-8a5a426c236a-config-volume\") pod \"dns-default-rfxqx\" (UID: \"a0e8de06-c61e-40f5-a07e-8a5a426c236a\") " pod="openshift-dns/dns-default-rfxqx"
Sep 09 21:08:34.664179 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:34.664161    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/09f5e589-c6ad-44a0-a60e-8243559b2b65-cert\") pod \"ingress-canary-2888n\" (UID: \"09f5e589-c6ad-44a0-a60e-8243559b2b65\") " pod="openshift-ingress-canary/ingress-canary-2888n"
Sep 09 21:08:34.673660 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:34.673634    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dc8bs\" (UniqueName: \"kubernetes.io/projected/a0e8de06-c61e-40f5-a07e-8a5a426c236a-kube-api-access-dc8bs\") pod \"dns-default-rfxqx\" (UID: \"a0e8de06-c61e-40f5-a07e-8a5a426c236a\") " pod="openshift-dns/dns-default-rfxqx"
Sep 09 21:08:34.674020 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:34.674002    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjhf9\" (UniqueName: \"kubernetes.io/projected/09f5e589-c6ad-44a0-a60e-8243559b2b65-kube-api-access-xjhf9\") pod \"ingress-canary-2888n\" (UID: \"09f5e589-c6ad-44a0-a60e-8243559b2b65\") " pod="openshift-ingress-canary/ingress-canary-2888n"
Sep 09 21:08:34.711091 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:34.711065    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2888n"
Sep 09 21:08:35.018357 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:35.018324    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:08:35.065431 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:35.065398    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f0356f0a-0671-452b-a4d6-a845c9e79079-registry-tls\") pod \"image-registry-588b6c65d4-jnmhd\" (UID: \"f0356f0a-0671-452b-a4d6-a845c9e79079\") " pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd"
Sep 09 21:08:35.065558 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:35.065542    2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 21:08:35.065597 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:35.065562    2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-588b6c65d4-jnmhd: secret "image-registry-tls" not found
Sep 09 21:08:35.065630 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:35.065613    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f0356f0a-0671-452b-a4d6-a845c9e79079-registry-tls podName:f0356f0a-0671-452b-a4d6-a845c9e79079 nodeName:}" failed. No retries permitted until 2026-09-09 21:08:36.065598632 +0000 UTC m=+39.044916724 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f0356f0a-0671-452b-a4d6-a845c9e79079-registry-tls") pod "image-registry-588b6c65d4-jnmhd" (UID: "f0356f0a-0671-452b-a4d6-a845c9e79079") : secret "image-registry-tls" not found
Sep 09 21:08:35.111224 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:35.111182    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2888n"]
Sep 09 21:08:35.115463 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:08:35.115436    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09f5e589_c6ad_44a0_a60e_8243559b2b65.slice/crio-9da9df5099911f5a269b23bdde2ee74700a4a1fe6cf4e87aee192867a4b7a4ae WatchSource:0}: Error finding container 9da9df5099911f5a269b23bdde2ee74700a4a1fe6cf4e87aee192867a4b7a4ae: Status 404 returned error can't find the container with id 9da9df5099911f5a269b23bdde2ee74700a4a1fe6cf4e87aee192867a4b7a4ae
Sep 09 21:08:35.143016 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:35.142956    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:08:35.166051 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:35.166029    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0e8de06-c61e-40f5-a07e-8a5a426c236a-metrics-tls\") pod \"dns-default-rfxqx\" (UID: \"a0e8de06-c61e-40f5-a07e-8a5a426c236a\") " pod="openshift-dns/dns-default-rfxqx"
Sep 09 21:08:35.166156 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:35.166144    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 21:08:35.166205 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:35.166196    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0e8de06-c61e-40f5-a07e-8a5a426c236a-metrics-tls podName:a0e8de06-c61e-40f5-a07e-8a5a426c236a nodeName:}" failed. No retries permitted until 2026-09-09 21:08:36.166182441 +0000 UTC m=+39.145500550 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a0e8de06-c61e-40f5-a07e-8a5a426c236a-metrics-tls") pod "dns-default-rfxqx" (UID: "a0e8de06-c61e-40f5-a07e-8a5a426c236a") : secret "dns-default-metrics-tls" not found
Sep 09 21:08:35.460742 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:35.460655    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-787zm"
Sep 09 21:08:35.461482 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:35.460655    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5px25"
Sep 09 21:08:35.461482 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:35.460656    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zd7mb"
Sep 09 21:08:35.464735 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:35.464694    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 09 21:08:35.464894 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:35.464738    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 09 21:08:35.464894 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:35.464781    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 09 21:08:35.464894 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:35.464785    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xv4rm\""
Sep 09 21:08:35.464894 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:35.464741    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gdn8f\""
Sep 09 21:08:35.464894 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:35.464794    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 09 21:08:35.630254 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:35.630218    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2888n" event={"ID":"09f5e589-c6ad-44a0-a60e-8243559b2b65","Type":"ContainerStarted","Data":"9da9df5099911f5a269b23bdde2ee74700a4a1fe6cf4e87aee192867a4b7a4ae"}
Sep 09 21:08:35.734696 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:35.734608    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:08:35.814460 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:35.814425    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:08:35.938492 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:35.938461    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:08:36.048794 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:36.048707    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:08:36.073929 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:36.073897    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f0356f0a-0671-452b-a4d6-a845c9e79079-registry-tls\") pod \"image-registry-588b6c65d4-jnmhd\" (UID: \"f0356f0a-0671-452b-a4d6-a845c9e79079\") " pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd"
Sep 09 21:08:36.074087 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:36.074016    2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 21:08:36.074087 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:36.074032    2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-588b6c65d4-jnmhd: secret "image-registry-tls" not found
Sep 09 21:08:36.074087 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:36.074086    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f0356f0a-0671-452b-a4d6-a845c9e79079-registry-tls podName:f0356f0a-0671-452b-a4d6-a845c9e79079 nodeName:}" failed. No retries permitted until 2026-09-09 21:08:38.074070013 +0000 UTC m=+41.053388108 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f0356f0a-0671-452b-a4d6-a845c9e79079-registry-tls") pod "image-registry-588b6c65d4-jnmhd" (UID: "f0356f0a-0671-452b-a4d6-a845c9e79079") : secret "image-registry-tls" not found
Sep 09 21:08:36.149419 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:36.149363    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:08:36.174693 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:36.174668    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0e8de06-c61e-40f5-a07e-8a5a426c236a-metrics-tls\") pod \"dns-default-rfxqx\" (UID: \"a0e8de06-c61e-40f5-a07e-8a5a426c236a\") " pod="openshift-dns/dns-default-rfxqx"
Sep 09 21:08:36.174872 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:36.174792    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 21:08:36.174872 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:36.174866    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0e8de06-c61e-40f5-a07e-8a5a426c236a-metrics-tls podName:a0e8de06-c61e-40f5-a07e-8a5a426c236a nodeName:}" failed. No retries permitted until 2026-09-09 21:08:38.174846962 +0000 UTC m=+41.154165054 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a0e8de06-c61e-40f5-a07e-8a5a426c236a-metrics-tls") pod "dns-default-rfxqx" (UID: "a0e8de06-c61e-40f5-a07e-8a5a426c236a") : secret "dns-default-metrics-tls" not found
Sep 09 21:08:38.087909 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:38.087698    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f0356f0a-0671-452b-a4d6-a845c9e79079-registry-tls\") pod \"image-registry-588b6c65d4-jnmhd\" (UID: \"f0356f0a-0671-452b-a4d6-a845c9e79079\") " pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd"
Sep 09 21:08:38.087909 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:38.087871    2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 21:08:38.087909 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:38.087888    2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-588b6c65d4-jnmhd: secret "image-registry-tls" not found
Sep 09 21:08:38.088299 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:38.087947    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f0356f0a-0671-452b-a4d6-a845c9e79079-registry-tls podName:f0356f0a-0671-452b-a4d6-a845c9e79079 nodeName:}" failed. No retries permitted until 2026-09-09 21:08:42.087928478 +0000 UTC m=+45.067246588 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f0356f0a-0671-452b-a4d6-a845c9e79079-registry-tls") pod "image-registry-588b6c65d4-jnmhd" (UID: "f0356f0a-0671-452b-a4d6-a845c9e79079") : secret "image-registry-tls" not found
Sep 09 21:08:38.188589 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:38.188557    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0e8de06-c61e-40f5-a07e-8a5a426c236a-metrics-tls\") pod \"dns-default-rfxqx\" (UID: \"a0e8de06-c61e-40f5-a07e-8a5a426c236a\") " pod="openshift-dns/dns-default-rfxqx"
Sep 09 21:08:38.188729 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:38.188704    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 21:08:38.188783 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:38.188761    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0e8de06-c61e-40f5-a07e-8a5a426c236a-metrics-tls podName:a0e8de06-c61e-40f5-a07e-8a5a426c236a nodeName:}" failed. No retries permitted until 2026-09-09 21:08:42.188746393 +0000 UTC m=+45.168064491 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a0e8de06-c61e-40f5-a07e-8a5a426c236a-metrics-tls") pod "dns-default-rfxqx" (UID: "a0e8de06-c61e-40f5-a07e-8a5a426c236a") : secret "dns-default-metrics-tls" not found
Sep 09 21:08:38.535207 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:38.535107    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:08:38.639315 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:38.639279    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2888n" event={"ID":"09f5e589-c6ad-44a0-a60e-8243559b2b65","Type":"ContainerStarted","Data":"14b80d09e5008fb0ba9a644dff94f16728ecd003388c4c900dc819a6471a0f33"}
Sep 09 21:08:38.651422 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:38.651397    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:08:38.665557 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:38.665508    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-2888n" podStartSLOduration=1.7472338029999999 podStartE2EDuration="4.665492921s" totalImagesPullingTime="2.918259118s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:08:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:08:38.664912911 +0000 UTC m=+41.644231025" watchObservedRunningTime="2026-09-09 21:08:38.665492921 +0000 UTC m=+41.644811031"
Sep 09 21:08:39.508721 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:39.508684    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:08:39.577270 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:39.577231    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:08:39.875060 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:39.874973    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:08:40.434126 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:40.434091    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:08:42.117557 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:42.117528    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f0356f0a-0671-452b-a4d6-a845c9e79079-registry-tls\") pod \"image-registry-588b6c65d4-jnmhd\" (UID: \"f0356f0a-0671-452b-a4d6-a845c9e79079\") " pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd"
Sep 09 21:08:42.117888 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:42.117688    2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 21:08:42.117888 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:42.117700    2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-588b6c65d4-jnmhd: secret "image-registry-tls" not found
Sep 09 21:08:42.117888 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:42.117755    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f0356f0a-0671-452b-a4d6-a845c9e79079-registry-tls podName:f0356f0a-0671-452b-a4d6-a845c9e79079 nodeName:}" failed. No retries permitted until 2026-09-09 21:08:50.117738063 +0000 UTC m=+53.097056165 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f0356f0a-0671-452b-a4d6-a845c9e79079-registry-tls") pod "image-registry-588b6c65d4-jnmhd" (UID: "f0356f0a-0671-452b-a4d6-a845c9e79079") : secret "image-registry-tls" not found
Sep 09 21:08:42.218790 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:42.218702    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0e8de06-c61e-40f5-a07e-8a5a426c236a-metrics-tls\") pod \"dns-default-rfxqx\" (UID: \"a0e8de06-c61e-40f5-a07e-8a5a426c236a\") " pod="openshift-dns/dns-default-rfxqx"
Sep 09 21:08:42.218933 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:42.218885    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 21:08:42.218967 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:42.218952    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0e8de06-c61e-40f5-a07e-8a5a426c236a-metrics-tls podName:a0e8de06-c61e-40f5-a07e-8a5a426c236a nodeName:}" failed. No retries permitted until 2026-09-09 21:08:50.218935852 +0000 UTC m=+53.198253948 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a0e8de06-c61e-40f5-a07e-8a5a426c236a-metrics-tls") pod "dns-default-rfxqx" (UID: "a0e8de06-c61e-40f5-a07e-8a5a426c236a") : secret "dns-default-metrics-tls" not found
Sep 09 21:08:44.418322 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:44.418294    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:08:44.486451 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:44.486417    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:08:50.178440 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:50.178398    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f0356f0a-0671-452b-a4d6-a845c9e79079-registry-tls\") pod \"image-registry-588b6c65d4-jnmhd\" (UID: \"f0356f0a-0671-452b-a4d6-a845c9e79079\") " pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd"
Sep 09 21:08:50.178960 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:50.178573    2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 21:08:50.178960 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:50.178596    2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-588b6c65d4-jnmhd: secret "image-registry-tls" not found
Sep 09 21:08:50.178960 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:50.178657    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f0356f0a-0671-452b-a4d6-a845c9e79079-registry-tls podName:f0356f0a-0671-452b-a4d6-a845c9e79079 nodeName:}" failed. No retries permitted until 2026-09-09 21:09:06.178641154 +0000 UTC m=+69.157959245 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f0356f0a-0671-452b-a4d6-a845c9e79079-registry-tls") pod "image-registry-588b6c65d4-jnmhd" (UID: "f0356f0a-0671-452b-a4d6-a845c9e79079") : secret "image-registry-tls" not found
Sep 09 21:08:50.279045 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:50.279000    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0e8de06-c61e-40f5-a07e-8a5a426c236a-metrics-tls\") pod \"dns-default-rfxqx\" (UID: \"a0e8de06-c61e-40f5-a07e-8a5a426c236a\") " pod="openshift-dns/dns-default-rfxqx"
Sep 09 21:08:50.279162 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:50.279144    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 21:08:50.279227 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:08:50.279217    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0e8de06-c61e-40f5-a07e-8a5a426c236a-metrics-tls podName:a0e8de06-c61e-40f5-a07e-8a5a426c236a nodeName:}" failed. No retries permitted until 2026-09-09 21:09:06.279201343 +0000 UTC m=+69.258519433 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a0e8de06-c61e-40f5-a07e-8a5a426c236a-metrics-tls") pod "dns-default-rfxqx" (UID: "a0e8de06-c61e-40f5-a07e-8a5a426c236a") : secret "dns-default-metrics-tls" not found
Sep 09 21:08:50.640627 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:50.640558    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77cfc8d95f-9hbst"]
Sep 09 21:08:50.642196 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:50.642182    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77cfc8d95f-9hbst"
Sep 09 21:08:50.652176 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:50.652157    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 09 21:08:50.653176 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:50.653157    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 09 21:08:50.653258 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:50.653216    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 09 21:08:50.653352 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:50.653310    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 09 21:08:50.653352 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:50.653324    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 09 21:08:50.653466 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:50.653381    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 09 21:08:50.653571 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:50.653558    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 09 21:08:50.656940 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:50.656920    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77cfc8d95f-9hbst"]
Sep 09 21:08:50.681709 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:50.681671    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aa258edd-0396-4977-b686-9c535921f2fa-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-77cfc8d95f-9hbst\" (UID: \"aa258edd-0396-4977-b686-9c535921f2fa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77cfc8d95f-9hbst"
Sep 09 21:08:50.681709 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:50.681712    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvpg9\" (UniqueName: \"kubernetes.io/projected/aa258edd-0396-4977-b686-9c535921f2fa-kube-api-access-hvpg9\") pod \"cluster-proxy-proxy-agent-77cfc8d95f-9hbst\" (UID: \"aa258edd-0396-4977-b686-9c535921f2fa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77cfc8d95f-9hbst"
Sep 09 21:08:50.681896 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:50.681788    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa258edd-0396-4977-b686-9c535921f2fa-additional-service-ca\") pod \"cluster-proxy-proxy-agent-77cfc8d95f-9hbst\" (UID: \"aa258edd-0396-4977-b686-9c535921f2fa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77cfc8d95f-9hbst"
Sep 09 21:08:50.681896 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:50.681808    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/aa258edd-0396-4977-b686-9c535921f2fa-ca\") pod \"cluster-proxy-proxy-agent-77cfc8d95f-9hbst\" (UID: \"aa258edd-0396-4977-b686-9c535921f2fa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77cfc8d95f-9hbst"
Sep 09 21:08:50.681970 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:50.681901    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/aa258edd-0396-4977-b686-9c535921f2fa-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-77cfc8d95f-9hbst\" (UID: \"aa258edd-0396-4977-b686-9c535921f2fa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77cfc8d95f-9hbst"
Sep 09 21:08:50.681970 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:50.681929    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/aa258edd-0396-4977-b686-9c535921f2fa-hub\") pod \"cluster-proxy-proxy-agent-77cfc8d95f-9hbst\" (UID: \"aa258edd-0396-4977-b686-9c535921f2fa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77cfc8d95f-9hbst"
Sep 09 21:08:50.782969 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:50.782936    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/aa258edd-0396-4977-b686-9c535921f2fa-ca\") pod \"cluster-proxy-proxy-agent-77cfc8d95f-9hbst\" (UID: \"aa258edd-0396-4977-b686-9c535921f2fa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77cfc8d95f-9hbst"
Sep 09 21:08:50.783075 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:50.782993    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/aa258edd-0396-4977-b686-9c535921f2fa-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-77cfc8d95f-9hbst\" (UID: \"aa258edd-0396-4977-b686-9c535921f2fa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77cfc8d95f-9hbst"
Sep 09 21:08:50.783075 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:50.783011    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/aa258edd-0396-4977-b686-9c535921f2fa-hub\") pod \"cluster-proxy-proxy-agent-77cfc8d95f-9hbst\" (UID: \"aa258edd-0396-4977-b686-9c535921f2fa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77cfc8d95f-9hbst"
Sep 09 21:08:50.783075 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:50.783048    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aa258edd-0396-4977-b686-9c535921f2fa-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-77cfc8d95f-9hbst\" (UID: \"aa258edd-0396-4977-b686-9c535921f2fa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77cfc8d95f-9hbst"
Sep 09 21:08:50.783075 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:50.783066    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvpg9\" (UniqueName: \"kubernetes.io/projected/aa258edd-0396-4977-b686-9c535921f2fa-kube-api-access-hvpg9\") pod \"cluster-proxy-proxy-agent-77cfc8d95f-9hbst\" (UID: \"aa258edd-0396-4977-b686-9c535921f2fa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77cfc8d95f-9hbst"
Sep 09 21:08:50.783270 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:50.783102    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa258edd-0396-4977-b686-9c535921f2fa-additional-service-ca\") pod \"cluster-proxy-proxy-agent-77cfc8d95f-9hbst\" (UID: \"aa258edd-0396-4977-b686-9c535921f2fa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77cfc8d95f-9hbst"
Sep 09 21:08:50.783795 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:50.783772    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa258edd-0396-4977-b686-9c535921f2fa-additional-service-ca\") pod \"cluster-proxy-proxy-agent-77cfc8d95f-9hbst\" (UID: \"aa258edd-0396-4977-b686-9c535921f2fa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77cfc8d95f-9hbst"
Sep 09 21:08:50.786506 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:50.786475    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/aa258edd-0396-4977-b686-9c535921f2fa-ca\") pod \"cluster-proxy-proxy-agent-77cfc8d95f-9hbst\" (UID: \"aa258edd-0396-4977-b686-9c535921f2fa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77cfc8d95f-9hbst"
Sep 09 21:08:50.786595 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:50.786490    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/aa258edd-0396-4977-b686-9c535921f2fa-hub\") pod \"cluster-proxy-proxy-agent-77cfc8d95f-9hbst\" (UID: \"aa258edd-0396-4977-b686-9c535921f2fa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77cfc8d95f-9hbst"
Sep 09 21:08:50.786690 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:50.786667    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aa258edd-0396-4977-b686-9c535921f2fa-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-77cfc8d95f-9hbst\" (UID: \"aa258edd-0396-4977-b686-9c535921f2fa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77cfc8d95f-9hbst"
Sep 09 21:08:50.786734 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:50.786690    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/aa258edd-0396-4977-b686-9c535921f2fa-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-77cfc8d95f-9hbst\" (UID: \"aa258edd-0396-4977-b686-9c535921f2fa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77cfc8d95f-9hbst"
Sep 09 21:08:50.792876 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:50.792844    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvpg9\" (UniqueName: \"kubernetes.io/projected/aa258edd-0396-4977-b686-9c535921f2fa-kube-api-access-hvpg9\") pod \"cluster-proxy-proxy-agent-77cfc8d95f-9hbst\" (UID: \"aa258edd-0396-4977-b686-9c535921f2fa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77cfc8d95f-9hbst"
Sep 09 21:08:50.966437 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:50.966396    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77cfc8d95f-9hbst"
Sep 09 21:08:51.240335 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:51.240253    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77cfc8d95f-9hbst"]
Sep 09 21:08:51.243356 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:08:51.243323    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaa258edd_0396_4977_b686_9c535921f2fa.slice/crio-6b5e4ef1384018efdea81bc8fe5fda49e0e95b9f6fd6f7ecf212f2c2f93bdf7c WatchSource:0}: Error finding container 6b5e4ef1384018efdea81bc8fe5fda49e0e95b9f6fd6f7ecf212f2c2f93bdf7c: Status 404 returned error can't find the container with id 6b5e4ef1384018efdea81bc8fe5fda49e0e95b9f6fd6f7ecf212f2c2f93bdf7c
Sep 09 21:08:51.668075 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:51.668044    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77cfc8d95f-9hbst" event={"ID":"aa258edd-0396-4977-b686-9c535921f2fa","Type":"ContainerStarted","Data":"6b5e4ef1384018efdea81bc8fe5fda49e0e95b9f6fd6f7ecf212f2c2f93bdf7c"}
Sep 09 21:08:52.815168 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:52.815080    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:08:52.882423 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:52.882382    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:08:52.998891 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:52.998856    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:08:53.075222 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:53.075135    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:08:54.052424 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:54.052337    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:08:56.397240 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:56.397208    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:08:56.498060 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:56.498029    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:08:56.606255 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:56.606221    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:08:56.672828 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:56.672799    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:08:56.685475 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:56.685443    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77cfc8d95f-9hbst" event={"ID":"aa258edd-0396-4977-b686-9c535921f2fa","Type":"ContainerStarted","Data":"1ac67780e3c0aba6f41d241f3f93cd7dec1f172a1ee94ac00cedd105d87ca0a8"}
Sep 09 21:08:56.685615 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:56.685484    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77cfc8d95f-9hbst" event={"ID":"aa258edd-0396-4977-b686-9c535921f2fa","Type":"ContainerStarted","Data":"27a4e18bead55b0356106dd7b43a5247f923bd53fadaf01fb943e53e7d5f6099"}
Sep 09 21:08:56.685615 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:56.685497    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77cfc8d95f-9hbst" event={"ID":"aa258edd-0396-4977-b686-9c535921f2fa","Type":"ContainerStarted","Data":"a6edc4898d3d4a5dfc5c40cf4b1ee416af262c7e417708fbf9b0cea199cdd854"}
Sep 09 21:08:56.705742 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:56.705691    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77cfc8d95f-9hbst" podStartSLOduration=2.345462922 podStartE2EDuration="6.705676026s" totalImagesPullingTime="4.360213104s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:08:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:08:56.703870358 +0000 UTC m=+59.683188470" watchObservedRunningTime="2026-09-09 21:08:56.705676026 +0000 UTC m=+59.684994139"
Sep 09 21:08:59.617247 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:59.617219    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wzzsp"
Sep 09 21:08:59.777289 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:59.777255    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:08:59.877845 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:08:59.877756    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:09:03.176748 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:09:03.176709    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1d5bd2bb-63bd-4425-ae59-2177722354f5-original-pull-secret\") pod \"global-pull-secret-syncer-5px25\" (UID: \"1d5bd2bb-63bd-4425-ae59-2177722354f5\") " pod="kube-system/global-pull-secret-syncer-5px25"
Sep 09 21:09:03.179757 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:09:03.179736    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 09 21:09:03.189359 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:09:03.189338    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1d5bd2bb-63bd-4425-ae59-2177722354f5-original-pull-secret\") pod \"global-pull-secret-syncer-5px25\" (UID: \"1d5bd2bb-63bd-4425-ae59-2177722354f5\") " pod="kube-system/global-pull-secret-syncer-5px25"
Sep 09 21:09:03.277758 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:09:03.277698    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rj4lj\" (UniqueName: \"kubernetes.io/projected/f22a4fe6-1a57-40fe-a1c7-ea0662c99601-kube-api-access-rj4lj\") pod \"network-check-target-787zm\" (UID: \"f22a4fe6-1a57-40fe-a1c7-ea0662c99601\") " pod="openshift-network-diagnostics/network-check-target-787zm"
Sep 09 21:09:03.277758 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:09:03.277761    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/325461e6-e654-481d-9458-feb1bb597455-metrics-certs\") pod \"network-metrics-daemon-zd7mb\" (UID: \"325461e6-e654-481d-9458-feb1bb597455\") " pod="openshift-multus/network-metrics-daemon-zd7mb"
Sep 09 21:09:03.280812 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:09:03.280791    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 09 21:09:03.280921 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:09:03.280842    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 09 21:09:03.288897 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:09:03.288877    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 09 21:09:03.288966 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:09:03.288944    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/325461e6-e654-481d-9458-feb1bb597455-metrics-certs podName:325461e6-e654-481d-9458-feb1bb597455 nodeName:}" failed. No retries permitted until 2026-09-09 21:10:07.288928061 +0000 UTC m=+130.268246165 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/325461e6-e654-481d-9458-feb1bb597455-metrics-certs") pod "network-metrics-daemon-zd7mb" (UID: "325461e6-e654-481d-9458-feb1bb597455") : secret "metrics-daemon-secret" not found
Sep 09 21:09:03.291447 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:09:03.291430    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 09 21:09:03.302123 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:09:03.302103    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rj4lj\" (UniqueName: \"kubernetes.io/projected/f22a4fe6-1a57-40fe-a1c7-ea0662c99601-kube-api-access-rj4lj\") pod \"network-check-target-787zm\" (UID: \"f22a4fe6-1a57-40fe-a1c7-ea0662c99601\") " pod="openshift-network-diagnostics/network-check-target-787zm"
Sep 09 21:09:03.375667 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:09:03.375640    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xv4rm\""
Sep 09 21:09:03.377757 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:09:03.377740    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5px25"
Sep 09 21:09:03.383305 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:09:03.383288    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-787zm"
Sep 09 21:09:03.651636 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:09:03.651600    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5px25"]
Sep 09 21:09:03.655421 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:09:03.655374    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d5bd2bb_63bd_4425_ae59_2177722354f5.slice/crio-9c552b39d12159a5e8e311e1bdb382c5038f22c28f26d6cbdf12ea443eff2ab6 WatchSource:0}: Error finding container 9c552b39d12159a5e8e311e1bdb382c5038f22c28f26d6cbdf12ea443eff2ab6: Status 404 returned error can't find the container with id 9c552b39d12159a5e8e311e1bdb382c5038f22c28f26d6cbdf12ea443eff2ab6
Sep 09 21:09:03.656264 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:09:03.656240    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-787zm"]
Sep 09 21:09:03.659591 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:09:03.659552    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf22a4fe6_1a57_40fe_a1c7_ea0662c99601.slice/crio-5143bca9275679beb1a46c24b077acf6c69b868dc54254f4fbffd99cd39f3f99 WatchSource:0}: Error finding container 5143bca9275679beb1a46c24b077acf6c69b868dc54254f4fbffd99cd39f3f99: Status 404 returned error can't find the container with id 5143bca9275679beb1a46c24b077acf6c69b868dc54254f4fbffd99cd39f3f99
Sep 09 21:09:03.701924 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:09:03.701831    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-787zm" event={"ID":"f22a4fe6-1a57-40fe-a1c7-ea0662c99601","Type":"ContainerStarted","Data":"5143bca9275679beb1a46c24b077acf6c69b868dc54254f4fbffd99cd39f3f99"}
Sep 09 21:09:03.702900 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:09:03.702881    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5px25" event={"ID":"1d5bd2bb-63bd-4425-ae59-2177722354f5","Type":"ContainerStarted","Data":"9c552b39d12159a5e8e311e1bdb382c5038f22c28f26d6cbdf12ea443eff2ab6"}
Sep 09 21:09:06.196603 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:09:06.196557    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f0356f0a-0671-452b-a4d6-a845c9e79079-registry-tls\") pod \"image-registry-588b6c65d4-jnmhd\" (UID: \"f0356f0a-0671-452b-a4d6-a845c9e79079\") " pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd"
Sep 09 21:09:06.197099 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:09:06.196758    2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 21:09:06.197099 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:09:06.196782    2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-588b6c65d4-jnmhd: secret "image-registry-tls" not found
Sep 09 21:09:06.197099 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:09:06.196874    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f0356f0a-0671-452b-a4d6-a845c9e79079-registry-tls podName:f0356f0a-0671-452b-a4d6-a845c9e79079 nodeName:}" failed. No retries permitted until 2026-09-09 21:09:38.196851553 +0000 UTC m=+101.176169657 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f0356f0a-0671-452b-a4d6-a845c9e79079-registry-tls") pod "image-registry-588b6c65d4-jnmhd" (UID: "f0356f0a-0671-452b-a4d6-a845c9e79079") : secret "image-registry-tls" not found
Sep 09 21:09:06.297691 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:09:06.297650    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0e8de06-c61e-40f5-a07e-8a5a426c236a-metrics-tls\") pod \"dns-default-rfxqx\" (UID: \"a0e8de06-c61e-40f5-a07e-8a5a426c236a\") " pod="openshift-dns/dns-default-rfxqx"
Sep 09 21:09:06.297886 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:09:06.297851    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 21:09:06.297952 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:09:06.297942    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0e8de06-c61e-40f5-a07e-8a5a426c236a-metrics-tls podName:a0e8de06-c61e-40f5-a07e-8a5a426c236a nodeName:}" failed. No retries permitted until 2026-09-09 21:09:38.297920504 +0000 UTC m=+101.277238601 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a0e8de06-c61e-40f5-a07e-8a5a426c236a-metrics-tls") pod "dns-default-rfxqx" (UID: "a0e8de06-c61e-40f5-a07e-8a5a426c236a") : secret "dns-default-metrics-tls" not found
Sep 09 21:09:07.717492 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:09:07.717448    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-787zm" event={"ID":"f22a4fe6-1a57-40fe-a1c7-ea0662c99601","Type":"ContainerStarted","Data":"21f69c7b3941d30c118ab752d4c6f0067820d322daf32df4f12009aa864980e8"}
Sep 09 21:09:07.717946 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:09:07.717770    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-787zm"
Sep 09 21:09:07.740214 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:09:07.740154    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-787zm" podStartSLOduration=66.432615685 podStartE2EDuration="1m9.740132671s" totalImagesPullingTime="3.307516986s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:07:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:09:07.739411289 +0000 UTC m=+70.718729403" watchObservedRunningTime="2026-09-09 21:09:07.740132671 +0000 UTC m=+70.719450787"
Sep 09 21:09:08.723185 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:09:08.723136    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5px25" event={"ID":"1d5bd2bb-63bd-4425-ae59-2177722354f5","Type":"ContainerStarted","Data":"b35d371ddef17657b13c938b4f3f273a402cea3dadad68ae5ea78e3c2594b6ed"}
Sep 09 21:09:08.742216 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:09:08.742003    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5px25" podStartSLOduration=65.839095613 podStartE2EDuration="1m10.741984144s" totalImagesPullingTime="4.902888531s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 21:07:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:09:08.741582638 +0000 UTC m=+71.720900752" watchObservedRunningTime="2026-09-09 21:09:08.741984144 +0000 UTC m=+71.721302256"
Sep 09 21:09:14.003497 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:09:14.003461    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:09:14.073086 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:09:14.073055    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:09:17.522282 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:09:17.522243    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:09:17.603855 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:09:17.603807    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:09:17.671439 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:09:17.671404    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:09:38.223565 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:09:38.223524    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f0356f0a-0671-452b-a4d6-a845c9e79079-registry-tls\") pod \"image-registry-588b6c65d4-jnmhd\" (UID: \"f0356f0a-0671-452b-a4d6-a845c9e79079\") " pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd"
Sep 09 21:09:38.223999 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:09:38.223634    2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 21:09:38.223999 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:09:38.223646    2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-588b6c65d4-jnmhd: secret "image-registry-tls" not found
Sep 09 21:09:38.223999 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:09:38.223703    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f0356f0a-0671-452b-a4d6-a845c9e79079-registry-tls podName:f0356f0a-0671-452b-a4d6-a845c9e79079 nodeName:}" failed. No retries permitted until 2026-09-09 21:10:42.223688397 +0000 UTC m=+165.203006488 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f0356f0a-0671-452b-a4d6-a845c9e79079-registry-tls") pod "image-registry-588b6c65d4-jnmhd" (UID: "f0356f0a-0671-452b-a4d6-a845c9e79079") : secret "image-registry-tls" not found
Sep 09 21:09:38.324641 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:09:38.324606    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0e8de06-c61e-40f5-a07e-8a5a426c236a-metrics-tls\") pod \"dns-default-rfxqx\" (UID: \"a0e8de06-c61e-40f5-a07e-8a5a426c236a\") " pod="openshift-dns/dns-default-rfxqx"
Sep 09 21:09:38.324777 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:09:38.324726    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 21:09:38.324842 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:09:38.324799    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0e8de06-c61e-40f5-a07e-8a5a426c236a-metrics-tls podName:a0e8de06-c61e-40f5-a07e-8a5a426c236a nodeName:}" failed. No retries permitted until 2026-09-09 21:10:42.324782148 +0000 UTC m=+165.304100242 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a0e8de06-c61e-40f5-a07e-8a5a426c236a-metrics-tls") pod "dns-default-rfxqx" (UID: "a0e8de06-c61e-40f5-a07e-8a5a426c236a") : secret "dns-default-metrics-tls" not found
Sep 09 21:09:38.726223 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:09:38.726196    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-787zm"
Sep 09 21:10:07.319675 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:10:07.319638    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/325461e6-e654-481d-9458-feb1bb597455-metrics-certs\") pod \"network-metrics-daemon-zd7mb\" (UID: \"325461e6-e654-481d-9458-feb1bb597455\") " pod="openshift-multus/network-metrics-daemon-zd7mb"
Sep 09 21:10:07.320088 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:10:07.319780    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 09 21:10:07.320088 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:10:07.319873    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/325461e6-e654-481d-9458-feb1bb597455-metrics-certs podName:325461e6-e654-481d-9458-feb1bb597455 nodeName:}" failed. No retries permitted until 2026-09-09 21:12:09.319854593 +0000 UTC m=+252.299172686 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/325461e6-e654-481d-9458-feb1bb597455-metrics-certs") pod "network-metrics-daemon-zd7mb" (UID: "325461e6-e654-481d-9458-feb1bb597455") : secret "metrics-daemon-secret" not found
Sep 09 21:10:37.372907 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:10:37.372867    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079"
Sep 09 21:10:37.394028 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:10:37.393987    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-rfxqx" podUID="a0e8de06-c61e-40f5-a07e-8a5a426c236a"
Sep 09 21:10:37.969397 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:10:37.969363    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rfxqx"
Sep 09 21:10:37.969568 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:10:37.969363    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd"
Sep 09 21:10:38.482187 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:10:38.482154    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-zd7mb" podUID="325461e6-e654-481d-9458-feb1bb597455"
Sep 09 21:10:42.265927 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:10:42.265886    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f0356f0a-0671-452b-a4d6-a845c9e79079-registry-tls\") pod \"image-registry-588b6c65d4-jnmhd\" (UID: \"f0356f0a-0671-452b-a4d6-a845c9e79079\") " pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd"
Sep 09 21:10:42.266295 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:10:42.266026    2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 21:10:42.266295 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:10:42.266044    2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-588b6c65d4-jnmhd: secret "image-registry-tls" not found
Sep 09 21:10:42.266295 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:10:42.266120    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f0356f0a-0671-452b-a4d6-a845c9e79079-registry-tls podName:f0356f0a-0671-452b-a4d6-a845c9e79079 nodeName:}" failed. No retries permitted until 2026-09-09 21:12:44.266105474 +0000 UTC m=+287.245423570 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f0356f0a-0671-452b-a4d6-a845c9e79079-registry-tls") pod "image-registry-588b6c65d4-jnmhd" (UID: "f0356f0a-0671-452b-a4d6-a845c9e79079") : secret "image-registry-tls" not found
Sep 09 21:10:42.366461 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:10:42.366425    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0e8de06-c61e-40f5-a07e-8a5a426c236a-metrics-tls\") pod \"dns-default-rfxqx\" (UID: \"a0e8de06-c61e-40f5-a07e-8a5a426c236a\") " pod="openshift-dns/dns-default-rfxqx"
Sep 09 21:10:42.366611 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:10:42.366558    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 21:10:42.366659 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:10:42.366624    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0e8de06-c61e-40f5-a07e-8a5a426c236a-metrics-tls podName:a0e8de06-c61e-40f5-a07e-8a5a426c236a nodeName:}" failed. No retries permitted until 2026-09-09 21:12:44.366609898 +0000 UTC m=+287.345927988 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a0e8de06-c61e-40f5-a07e-8a5a426c236a-metrics-tls") pod "dns-default-rfxqx" (UID: "a0e8de06-c61e-40f5-a07e-8a5a426c236a") : secret "dns-default-metrics-tls" not found
Sep 09 21:10:53.460796 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:10:53.460713    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zd7mb"
Sep 09 21:11:16.994770 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:11:16.994741    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:11:32.377198 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:11:32.377154    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:12:09.367473 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:09.367431    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/325461e6-e654-481d-9458-feb1bb597455-metrics-certs\") pod \"network-metrics-daemon-zd7mb\" (UID: \"325461e6-e654-481d-9458-feb1bb597455\") " pod="openshift-multus/network-metrics-daemon-zd7mb"
Sep 09 21:12:09.367985 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:12:09.367595    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 09 21:12:09.367985 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:12:09.367669    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/325461e6-e654-481d-9458-feb1bb597455-metrics-certs podName:325461e6-e654-481d-9458-feb1bb597455 nodeName:}" failed. No retries permitted until 2026-09-09 21:14:11.367653016 +0000 UTC m=+374.346971111 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/325461e6-e654-481d-9458-feb1bb597455-metrics-certs") pod "network-metrics-daemon-zd7mb" (UID: "325461e6-e654-481d-9458-feb1bb597455") : secret "metrics-daemon-secret" not found
Sep 09 21:12:10.397971 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:10.397935    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:12:10.452801 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:10.452772    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:12:13.698727 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:13.698691    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:12:28.906724 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:28.906651    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:12:29.005860 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:29.005806    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:12:31.088662 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:31.088630    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:12:31.189543 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:31.189512    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:12:32.514796 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:32.514759    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-cnv44"]
Sep 09 21:12:32.516667 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:32.516653    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cnv44"
Sep 09 21:12:32.521021 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:32.520991    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 09 21:12:32.521021 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:32.521016    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 09 21:12:32.521198 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:32.521023    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6hr85\""
Sep 09 21:12:32.521198 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:32.521019    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 09 21:12:32.522061 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:32.522029    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 09 21:12:32.525000 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:32.524984    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:12:32.531762 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:32.531742    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cnv44"]
Sep 09 21:12:32.604933 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:32.604911    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:12:32.631058 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:32.631032    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/52bf3dba-5c47-4e6e-a863-2a656c4d7661-data-volume\") pod \"insights-runtime-extractor-cnv44\" (UID: \"52bf3dba-5c47-4e6e-a863-2a656c4d7661\") " pod="openshift-insights/insights-runtime-extractor-cnv44"
Sep 09 21:12:32.631140 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:32.631122    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/52bf3dba-5c47-4e6e-a863-2a656c4d7661-crio-socket\") pod \"insights-runtime-extractor-cnv44\" (UID: \"52bf3dba-5c47-4e6e-a863-2a656c4d7661\") " pod="openshift-insights/insights-runtime-extractor-cnv44"
Sep 09 21:12:32.631188 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:32.631145    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/52bf3dba-5c47-4e6e-a863-2a656c4d7661-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cnv44\" (UID: \"52bf3dba-5c47-4e6e-a863-2a656c4d7661\") " pod="openshift-insights/insights-runtime-extractor-cnv44"
Sep 09 21:12:32.631235 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:32.631192    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/52bf3dba-5c47-4e6e-a863-2a656c4d7661-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cnv44\" (UID: \"52bf3dba-5c47-4e6e-a863-2a656c4d7661\") " pod="openshift-insights/insights-runtime-extractor-cnv44"
Sep 09 21:12:32.631235 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:32.631210    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnmt8\" (UniqueName: \"kubernetes.io/projected/52bf3dba-5c47-4e6e-a863-2a656c4d7661-kube-api-access-lnmt8\") pod \"insights-runtime-extractor-cnv44\" (UID: \"52bf3dba-5c47-4e6e-a863-2a656c4d7661\") " pod="openshift-insights/insights-runtime-extractor-cnv44"
Sep 09 21:12:32.731729 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:32.731698    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/52bf3dba-5c47-4e6e-a863-2a656c4d7661-crio-socket\") pod \"insights-runtime-extractor-cnv44\" (UID: \"52bf3dba-5c47-4e6e-a863-2a656c4d7661\") " pod="openshift-insights/insights-runtime-extractor-cnv44"
Sep 09 21:12:32.731729 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:32.731731    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/52bf3dba-5c47-4e6e-a863-2a656c4d7661-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cnv44\" (UID: \"52bf3dba-5c47-4e6e-a863-2a656c4d7661\") " pod="openshift-insights/insights-runtime-extractor-cnv44"
Sep 09 21:12:32.731890 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:32.731758    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/52bf3dba-5c47-4e6e-a863-2a656c4d7661-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cnv44\" (UID: \"52bf3dba-5c47-4e6e-a863-2a656c4d7661\") " pod="openshift-insights/insights-runtime-extractor-cnv44"
Sep 09 21:12:32.731890 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:32.731773    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnmt8\" (UniqueName: \"kubernetes.io/projected/52bf3dba-5c47-4e6e-a863-2a656c4d7661-kube-api-access-lnmt8\") pod \"insights-runtime-extractor-cnv44\" (UID: \"52bf3dba-5c47-4e6e-a863-2a656c4d7661\") " pod="openshift-insights/insights-runtime-extractor-cnv44"
Sep 09 21:12:32.731890 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:32.731800    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/52bf3dba-5c47-4e6e-a863-2a656c4d7661-data-volume\") pod \"insights-runtime-extractor-cnv44\" (UID: \"52bf3dba-5c47-4e6e-a863-2a656c4d7661\") " pod="openshift-insights/insights-runtime-extractor-cnv44"
Sep 09 21:12:32.731890 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:32.731840    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/52bf3dba-5c47-4e6e-a863-2a656c4d7661-crio-socket\") pod \"insights-runtime-extractor-cnv44\" (UID: \"52bf3dba-5c47-4e6e-a863-2a656c4d7661\") " pod="openshift-insights/insights-runtime-extractor-cnv44"
Sep 09 21:12:32.731890 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:12:32.731846    2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 21:12:32.731890 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:12:32.731875    2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 21:12:32.732177 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:12:32.731931    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/52bf3dba-5c47-4e6e-a863-2a656c4d7661-kube-rbac-proxy-cm podName:52bf3dba-5c47-4e6e-a863-2a656c4d7661 nodeName:}" failed. No retries permitted until 2026-09-09 21:12:33.231910008 +0000 UTC m=+276.211228118 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/52bf3dba-5c47-4e6e-a863-2a656c4d7661-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cnv44" (UID: "52bf3dba-5c47-4e6e-a863-2a656c4d7661") : configmap "kube-rbac-proxy" not found
Sep 09 21:12:32.732177 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:12:32.731950    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52bf3dba-5c47-4e6e-a863-2a656c4d7661-insights-runtime-extractor-tls podName:52bf3dba-5c47-4e6e-a863-2a656c4d7661 nodeName:}" failed. No retries permitted until 2026-09-09 21:12:33.231939828 +0000 UTC m=+276.211257919 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/52bf3dba-5c47-4e6e-a863-2a656c4d7661-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cnv44" (UID: "52bf3dba-5c47-4e6e-a863-2a656c4d7661") : secret "insights-runtime-extractor-tls" not found
Sep 09 21:12:32.732177 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:32.732087    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/52bf3dba-5c47-4e6e-a863-2a656c4d7661-data-volume\") pod \"insights-runtime-extractor-cnv44\" (UID: \"52bf3dba-5c47-4e6e-a863-2a656c4d7661\") " pod="openshift-insights/insights-runtime-extractor-cnv44"
Sep 09 21:12:32.743770 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:32.741079    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnmt8\" (UniqueName: \"kubernetes.io/projected/52bf3dba-5c47-4e6e-a863-2a656c4d7661-kube-api-access-lnmt8\") pod \"insights-runtime-extractor-cnv44\" (UID: \"52bf3dba-5c47-4e6e-a863-2a656c4d7661\") " pod="openshift-insights/insights-runtime-extractor-cnv44"
Sep 09 21:12:33.235852 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:33.235804    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/52bf3dba-5c47-4e6e-a863-2a656c4d7661-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cnv44\" (UID: \"52bf3dba-5c47-4e6e-a863-2a656c4d7661\") " pod="openshift-insights/insights-runtime-extractor-cnv44"
Sep 09 21:12:33.236024 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:33.235863    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/52bf3dba-5c47-4e6e-a863-2a656c4d7661-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cnv44\" (UID: \"52bf3dba-5c47-4e6e-a863-2a656c4d7661\") " pod="openshift-insights/insights-runtime-extractor-cnv44"
Sep 09 21:12:33.236024 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:12:33.235935    2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 21:12:33.236024 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:12:33.235960    2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 21:12:33.236024 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:12:33.236007    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/52bf3dba-5c47-4e6e-a863-2a656c4d7661-kube-rbac-proxy-cm podName:52bf3dba-5c47-4e6e-a863-2a656c4d7661 nodeName:}" failed. No retries permitted until 2026-09-09 21:12:34.235992368 +0000 UTC m=+277.215310462 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/52bf3dba-5c47-4e6e-a863-2a656c4d7661-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cnv44" (UID: "52bf3dba-5c47-4e6e-a863-2a656c4d7661") : configmap "kube-rbac-proxy" not found
Sep 09 21:12:33.236024 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:12:33.236021    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52bf3dba-5c47-4e6e-a863-2a656c4d7661-insights-runtime-extractor-tls podName:52bf3dba-5c47-4e6e-a863-2a656c4d7661 nodeName:}" failed. No retries permitted until 2026-09-09 21:12:34.236015212 +0000 UTC m=+277.215333303 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/52bf3dba-5c47-4e6e-a863-2a656c4d7661-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cnv44" (UID: "52bf3dba-5c47-4e6e-a863-2a656c4d7661") : secret "insights-runtime-extractor-tls" not found
Sep 09 21:12:33.430970 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:33.430937    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:12:33.530994 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:33.530915    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:12:33.630477 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:33.630451    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:12:33.730687 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:33.730665    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:12:34.138937 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:34.138906    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:12:34.242346 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:34.242316    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:12:34.244347 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:34.244328    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/52bf3dba-5c47-4e6e-a863-2a656c4d7661-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cnv44\" (UID: \"52bf3dba-5c47-4e6e-a863-2a656c4d7661\") " pod="openshift-insights/insights-runtime-extractor-cnv44"
Sep 09 21:12:34.244403 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:34.244366    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/52bf3dba-5c47-4e6e-a863-2a656c4d7661-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cnv44\" (UID: \"52bf3dba-5c47-4e6e-a863-2a656c4d7661\") " pod="openshift-insights/insights-runtime-extractor-cnv44"
Sep 09 21:12:34.244473 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:12:34.244461    2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 21:12:34.244528 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:12:34.244519    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52bf3dba-5c47-4e6e-a863-2a656c4d7661-insights-runtime-extractor-tls podName:52bf3dba-5c47-4e6e-a863-2a656c4d7661 nodeName:}" failed. No retries permitted until 2026-09-09 21:12:36.244507119 +0000 UTC m=+279.223825209 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/52bf3dba-5c47-4e6e-a863-2a656c4d7661-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cnv44" (UID: "52bf3dba-5c47-4e6e-a863-2a656c4d7661") : secret "insights-runtime-extractor-tls" not found
Sep 09 21:12:34.244854 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:34.244838    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/52bf3dba-5c47-4e6e-a863-2a656c4d7661-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cnv44\" (UID: \"52bf3dba-5c47-4e6e-a863-2a656c4d7661\") " pod="openshift-insights/insights-runtime-extractor-cnv44"
Sep 09 21:12:34.659005 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:34.658979    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zln8j_22210233-a1fa-4335-a652-6b89192b07ec/dns-node-resolver/0.log"
Sep 09 21:12:35.634197 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:35.634171    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:12:35.659080 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:35.659060    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-z8swp_eb3f4d24-4a06-4b75-a0ea-c6e8fba9e5f6/node-ca/0.log"
Sep 09 21:12:35.736614 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:35.736590    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:12:35.805745 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:35.805712    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:12:36.059574 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:36.059551    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2888n_09f5e589-c6ad-44a0-a60e-8243559b2b65/serve-healthcheck-canary/0.log"
Sep 09 21:12:36.259376 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:36.259346    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/52bf3dba-5c47-4e6e-a863-2a656c4d7661-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cnv44\" (UID: \"52bf3dba-5c47-4e6e-a863-2a656c4d7661\") " pod="openshift-insights/insights-runtime-extractor-cnv44"
Sep 09 21:12:36.259523 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:12:36.259506    2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 21:12:36.259576 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:12:36.259567    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52bf3dba-5c47-4e6e-a863-2a656c4d7661-insights-runtime-extractor-tls podName:52bf3dba-5c47-4e6e-a863-2a656c4d7661 nodeName:}" failed. No retries permitted until 2026-09-09 21:12:40.259553899 +0000 UTC m=+283.238871995 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/52bf3dba-5c47-4e6e-a863-2a656c4d7661-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cnv44" (UID: "52bf3dba-5c47-4e6e-a863-2a656c4d7661") : secret "insights-runtime-extractor-tls" not found
Sep 09 21:12:36.669679 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:36.669651    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:12:38.158299 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:38.158269    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:12:38.365662 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:38.365635    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:12:38.469722 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:38.469694    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:12:38.566564 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:38.566533    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:12:38.682372 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:38.682343    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:12:38.838657 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:38.838586    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:12:39.573881 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:39.573853    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:12:39.674730 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:39.674702    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:12:40.028608 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:40.028577    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:12:40.227671 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:40.227642    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:12:40.286530 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:40.286475    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/52bf3dba-5c47-4e6e-a863-2a656c4d7661-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cnv44\" (UID: \"52bf3dba-5c47-4e6e-a863-2a656c4d7661\") " pod="openshift-insights/insights-runtime-extractor-cnv44"
Sep 09 21:12:40.286617 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:12:40.286581    2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 21:12:40.286658 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:12:40.286627    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52bf3dba-5c47-4e6e-a863-2a656c4d7661-insights-runtime-extractor-tls podName:52bf3dba-5c47-4e6e-a863-2a656c4d7661 nodeName:}" failed. No retries permitted until 2026-09-09 21:12:48.286614267 +0000 UTC m=+291.265932358 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/52bf3dba-5c47-4e6e-a863-2a656c4d7661-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cnv44" (UID: "52bf3dba-5c47-4e6e-a863-2a656c4d7661") : secret "insights-runtime-extractor-tls" not found
Sep 09 21:12:40.431705 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:40.431672    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:12:40.629988 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:40.629923    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:12:40.825186 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:40.825163    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:12:40.968378 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:40.968345    2555 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77cfc8d95f-9hbst" podUID="aa258edd-0396-4977-b686-9c535921f2fa" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Sep 09 21:12:40.970587 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:12:40.970569    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-rfxqx" podUID="a0e8de06-c61e-40f5-a07e-8a5a426c236a"
Sep 09 21:12:40.970641 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:12:40.970569    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079"
Sep 09 21:12:41.302471 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:41.302397    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rfxqx"
Sep 09 21:12:41.302603 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:41.302397    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd"
Sep 09 21:12:41.845139 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:41.845108    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:12:41.945254 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:41.945221    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:12:42.047412 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:42.047383    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:12:42.251643 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:42.251610    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:12:42.445269 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:42.445234    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:12:42.660665 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:42.660584    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:12:43.111387 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:43.111358    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:12:43.823544 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:43.823508    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:12:44.032154 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:44.032128    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:12:44.236099 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:44.236066    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:12:44.320921 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:44.320896    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f0356f0a-0671-452b-a4d6-a845c9e79079-registry-tls\") pod \"image-registry-588b6c65d4-jnmhd\" (UID: \"f0356f0a-0671-452b-a4d6-a845c9e79079\") " pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd"
Sep 09 21:12:44.323289 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:44.323267    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f0356f0a-0671-452b-a4d6-a845c9e79079-registry-tls\") pod \"image-registry-588b6c65d4-jnmhd\" (UID: \"f0356f0a-0671-452b-a4d6-a845c9e79079\") " pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd"
Sep 09 21:12:44.422264 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:44.422231    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0e8de06-c61e-40f5-a07e-8a5a426c236a-metrics-tls\") pod \"dns-default-rfxqx\" (UID: \"a0e8de06-c61e-40f5-a07e-8a5a426c236a\") " pod="openshift-dns/dns-default-rfxqx"
Sep 09 21:12:44.424425 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:44.424407    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0e8de06-c61e-40f5-a07e-8a5a426c236a-metrics-tls\") pod \"dns-default-rfxqx\" (UID: \"a0e8de06-c61e-40f5-a07e-8a5a426c236a\") " pod="openshift-dns/dns-default-rfxqx"
Sep 09 21:12:44.608034 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:44.607954    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-9q5q4\""
Sep 09 21:12:44.608034 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:44.607992    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6rdjz\""
Sep 09 21:12:44.613230 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:44.613214    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd"
Sep 09 21:12:44.613325 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:44.613309    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rfxqx"
Sep 09 21:12:44.627369 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:44.627345    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:12:44.729343 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:44.729312    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:12:44.891964 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:44.891942    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rfxqx"]
Sep 09 21:12:44.894250 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:12:44.894226    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0e8de06_c61e_40f5_a07e_8a5a426c236a.slice/crio-44e7377b678e14847ffab3959c4867d6488a9abdeb72fddb7f6dadc8fcb35042 WatchSource:0}: Error finding container 44e7377b678e14847ffab3959c4867d6488a9abdeb72fddb7f6dadc8fcb35042: Status 404 returned error can't find the container with id 44e7377b678e14847ffab3959c4867d6488a9abdeb72fddb7f6dadc8fcb35042
Sep 09 21:12:44.896707 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:44.896685    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-588b6c65d4-jnmhd"]
Sep 09 21:12:44.899696 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:12:44.899677    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0356f0a_0671_452b_a4d6_a845c9e79079.slice/crio-d18e53c2929b134d3d1b0addd6acc14375a99ed1489deef15f54c2e59ac06ce1 WatchSource:0}: Error finding container d18e53c2929b134d3d1b0addd6acc14375a99ed1489deef15f54c2e59ac06ce1: Status 404 returned error can't find the container with id d18e53c2929b134d3d1b0addd6acc14375a99ed1489deef15f54c2e59ac06ce1
Sep 09 21:12:45.039259 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:45.039221    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:12:45.315952 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:45.315917    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" event={"ID":"f0356f0a-0671-452b-a4d6-a845c9e79079","Type":"ContainerStarted","Data":"259d7585b870d15a27978bfb5b0a47bf3ac5b83cd8ebea701193d94c2d7be77f"}
Sep 09 21:12:45.316381 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:45.315962    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" event={"ID":"f0356f0a-0671-452b-a4d6-a845c9e79079","Type":"ContainerStarted","Data":"d18e53c2929b134d3d1b0addd6acc14375a99ed1489deef15f54c2e59ac06ce1"}
Sep 09 21:12:45.316381 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:45.316038    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd"
Sep 09 21:12:45.317096 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:45.317078    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rfxqx" event={"ID":"a0e8de06-c61e-40f5-a07e-8a5a426c236a","Type":"ContainerStarted","Data":"44e7377b678e14847ffab3959c4867d6488a9abdeb72fddb7f6dadc8fcb35042"}
Sep 09 21:12:45.345195 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:45.345155    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" podStartSLOduration=287.345142266 podStartE2EDuration="4m47.345142266s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:07:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:12:45.344174593 +0000 UTC m=+288.323492706" watchObservedRunningTime="2026-09-09 21:12:45.345142266 +0000 UTC m=+288.324460379"
Sep 09 21:12:45.624774 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:45.624697    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:12:46.279094 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:46.279048    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:12:46.429954 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:46.429928    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:12:46.638258 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:46.638226    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:12:47.029361 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:47.029326    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:12:47.325152 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:47.325062    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rfxqx" event={"ID":"a0e8de06-c61e-40f5-a07e-8a5a426c236a","Type":"ContainerStarted","Data":"827cff798a885eff62f0990dad5a933fa14492675a67be1882063ea3224c9052"}
Sep 09 21:12:47.325152 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:47.325139    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rfxqx" event={"ID":"a0e8de06-c61e-40f5-a07e-8a5a426c236a","Type":"ContainerStarted","Data":"63d2b6b589e10c9b8a9fa3375bbef804294e2499e3b9e3dfea79c1807191d91a"}
Sep 09 21:12:47.325370 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:47.325213    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-rfxqx"
Sep 09 21:12:47.346648 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:47.346607    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-rfxqx" podStartSLOduration=251.799390033 podStartE2EDuration="4m13.346594632s" totalImagesPullingTime="1.547204599s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:08:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:12:47.346033569 +0000 UTC m=+290.325351683" watchObservedRunningTime="2026-09-09 21:12:47.346594632 +0000 UTC m=+290.325912745"
Sep 09 21:12:47.429995 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:47.429967    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:12:48.040681 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:48.040649    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:12:48.356880 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:48.356789    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/52bf3dba-5c47-4e6e-a863-2a656c4d7661-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cnv44\" (UID: \"52bf3dba-5c47-4e6e-a863-2a656c4d7661\") " pod="openshift-insights/insights-runtime-extractor-cnv44"
Sep 09 21:12:48.358970 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:48.358952    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/52bf3dba-5c47-4e6e-a863-2a656c4d7661-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cnv44\" (UID: \"52bf3dba-5c47-4e6e-a863-2a656c4d7661\") " pod="openshift-insights/insights-runtime-extractor-cnv44"
Sep 09 21:12:48.425682 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:48.425645    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cnv44"
Sep 09 21:12:48.440929 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:48.440904    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:12:48.631738 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:48.631664    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:12:48.695660 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:48.695629    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cnv44"]
Sep 09 21:12:48.698360 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:12:48.698336    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52bf3dba_5c47_4e6e_a863_2a656c4d7661.slice/crio-26005b76c4118bfd148a0af64a99c29a716db65d8b49f220c6dd63b84151bf18 WatchSource:0}: Error finding container 26005b76c4118bfd148a0af64a99c29a716db65d8b49f220c6dd63b84151bf18: Status 404 returned error can't find the container with id 26005b76c4118bfd148a0af64a99c29a716db65d8b49f220c6dd63b84151bf18
Sep 09 21:12:48.824403 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:48.824373    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:12:49.333368 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:49.333335    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:12:49.335303 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:49.335279    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cnv44" event={"ID":"52bf3dba-5c47-4e6e-a863-2a656c4d7661","Type":"ContainerStarted","Data":"da718e03a7415aa155005651eadd56ce93c0f981fa16a6fb5f708a8cbbcbcff4"}
Sep 09 21:12:49.335427 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:49.335326    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cnv44" event={"ID":"52bf3dba-5c47-4e6e-a863-2a656c4d7661","Type":"ContainerStarted","Data":"26005b76c4118bfd148a0af64a99c29a716db65d8b49f220c6dd63b84151bf18"}
Sep 09 21:12:50.342301 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:50.342262    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cnv44" event={"ID":"52bf3dba-5c47-4e6e-a863-2a656c4d7661","Type":"ContainerStarted","Data":"450b26895b5cc466a239c79271db136951755f017346fe38783ee6a203f84b13"}
Sep 09 21:12:50.968218 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:50.968188    2555 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77cfc8d95f-9hbst" podUID="aa258edd-0396-4977-b686-9c535921f2fa" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Sep 09 21:12:51.347501 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:51.347396    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cnv44" event={"ID":"52bf3dba-5c47-4e6e-a863-2a656c4d7661","Type":"ContainerStarted","Data":"cf12866e766687c258a7df47b5f2472f3f38ebcba44e8741a7ae1507f56ab471"}
Sep 09 21:12:54.576766 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:54.576727    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:12:54.645255 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:54.645225    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:12:56.461255 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:12:56.461209    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-zd7mb" podUID="325461e6-e654-481d-9458-feb1bb597455"
Sep 09 21:12:57.330716 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:57.330688    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-rfxqx"
Sep 09 21:12:57.351401 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:57.351357    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-cnv44" podStartSLOduration=23.197368195 podStartE2EDuration="25.351341866s" totalImagesPullingTime="2.153973671s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 21:12:32 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:12:51.371291298 +0000 UTC m=+294.350609411" watchObservedRunningTime="2026-09-09 21:12:57.351341866 +0000 UTC m=+300.330659979"
Sep 09 21:12:57.386931 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:12:57.386896    2555 kubelet.go:1648] "Image garbage collection succeeded"
Sep 09 21:13:00.967686 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:13:00.967649    2555 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77cfc8d95f-9hbst" podUID="aa258edd-0396-4977-b686-9c535921f2fa" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Sep 09 21:13:00.969609 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:13:00.967716    2555 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77cfc8d95f-9hbst"
Sep 09 21:13:00.969609 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:13:00.968149    2555 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"27a4e18bead55b0356106dd7b43a5247f923bd53fadaf01fb943e53e7d5f6099"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77cfc8d95f-9hbst" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Sep 09 21:13:00.969609 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:13:00.968197    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77cfc8d95f-9hbst" podUID="aa258edd-0396-4977-b686-9c535921f2fa" containerName="service-proxy" containerID="cri-o://27a4e18bead55b0356106dd7b43a5247f923bd53fadaf01fb943e53e7d5f6099" gracePeriod=30
Sep 09 21:13:01.379722 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:13:01.379640    2555 generic.go:356] "Generic (PLEG): container finished" podID="aa258edd-0396-4977-b686-9c535921f2fa" containerID="27a4e18bead55b0356106dd7b43a5247f923bd53fadaf01fb943e53e7d5f6099" exitCode=2
Sep 09 21:13:01.379872 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:13:01.379715    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77cfc8d95f-9hbst" event={"ID":"aa258edd-0396-4977-b686-9c535921f2fa","Type":"ContainerDied","Data":"27a4e18bead55b0356106dd7b43a5247f923bd53fadaf01fb943e53e7d5f6099"}
Sep 09 21:13:01.379872 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:13:01.379760    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77cfc8d95f-9hbst" event={"ID":"aa258edd-0396-4977-b686-9c535921f2fa","Type":"ContainerStarted","Data":"749996ad9787ad47e811fa456bc861bb3eb9bc8327a184e99ae27b5b9ddf9ebf"}
Sep 09 21:13:03.548233 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:13:03.548200    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:13:04.617336 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:13:04.617299    2555 patch_prober.go:28] interesting pod/image-registry-588b6c65d4-jnmhd container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:13:04.617708 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:13:04.617351    2555 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:13:04.912774 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:13:04.912746    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:13:06.324179 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:13:06.324147    2555 patch_prober.go:28] interesting pod/image-registry-588b6c65d4-jnmhd container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:13:06.324632 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:13:06.324198    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:13:11.460978 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:13:11.460941    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zd7mb"
Sep 09 21:13:14.617238 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:13:14.617205    2555 patch_prober.go:28] interesting pod/image-registry-588b6c65d4-jnmhd container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:13:14.617594 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:13:14.617264    2555 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:13:16.324125 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:13:16.324095    2555 patch_prober.go:28] interesting pod/image-registry-588b6c65d4-jnmhd container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:13:16.324570 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:13:16.324144    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:13:24.617087 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:13:24.617046    2555 patch_prober.go:28] interesting pod/image-registry-588b6c65d4-jnmhd container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:13:24.617561 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:13:24.617098    2555 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:13:24.617561 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:13:24.617136    2555 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd"
Sep 09 21:13:24.617561 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:13:24.617556    2555 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"259d7585b870d15a27978bfb5b0a47bf3ac5b83cd8ebea701193d94c2d7be77f"} pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" containerMessage="Container registry failed liveness probe, will be restarted"
Sep 09 21:13:24.620974 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:13:24.620945    2555 patch_prober.go:28] interesting pod/image-registry-588b6c65d4-jnmhd container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:13:24.621123 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:13:24.620994    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:13:25.092109 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:13:25.092079    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:13:25.186104 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:13:25.186077    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:13:25.284984 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:13:25.284948    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:13:25.386293 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:13:25.386222    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:13:25.506324 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:13:25.506295    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:13:25.682863 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:13:25.682832    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:13:25.873606 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:13:25.873572    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:13:25.975071 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:13:25.975011    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:13:26.485033 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:13:26.485003    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:13:26.884343 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:13:26.884267    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:13:27.077148 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:13:27.077112    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:13:27.305213 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:13:27.305182    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:13:27.367089 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:13:27.367061    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:13:34.622025 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:13:34.621989    2555 patch_prober.go:28] interesting pod/image-registry-588b6c65d4-jnmhd container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:13:34.622473 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:13:34.622050    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:13:38.713770 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:13:38.713739    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:13:38.774786 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:13:38.774751    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:13:41.905412 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:13:41.905379    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:13:41.985564 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:13:41.985530    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:13:44.621952 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:13:44.621917    2555 patch_prober.go:28] interesting pod/image-registry-588b6c65d4-jnmhd container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:13:44.622311 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:13:44.621966    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:13:46.386230 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:13:46.386198    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:13:49.635850 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:13:49.635803    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerName="registry" containerID="cri-o://259d7585b870d15a27978bfb5b0a47bf3ac5b83cd8ebea701193d94c2d7be77f" gracePeriod=30
Sep 09 21:13:50.519450 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:13:50.519420    2555 generic.go:356] "Generic (PLEG): container finished" podID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerID="259d7585b870d15a27978bfb5b0a47bf3ac5b83cd8ebea701193d94c2d7be77f" exitCode=0
Sep 09 21:13:50.519622 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:13:50.519477    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" event={"ID":"f0356f0a-0671-452b-a4d6-a845c9e79079","Type":"ContainerDied","Data":"259d7585b870d15a27978bfb5b0a47bf3ac5b83cd8ebea701193d94c2d7be77f"}
Sep 09 21:13:50.519622 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:13:50.519517    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" event={"ID":"f0356f0a-0671-452b-a4d6-a845c9e79079","Type":"ContainerStarted","Data":"f2079e6cb74d5e52e01eae1404c7eca232e892738865ab4664afe2f704bff627"}
Sep 09 21:13:50.519704 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:13:50.519663    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd"
Sep 09 21:13:51.641804 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:13:51.641773    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:13:51.723030 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:13:51.723006    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:13:56.739613 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:13:56.739584    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rfxqx_a0e8de06-c61e-40f5-a07e-8a5a426c236a/dns/0.log"
Sep 09 21:13:56.939240 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:13:56.939216    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rfxqx_a0e8de06-c61e-40f5-a07e-8a5a426c236a/kube-rbac-proxy/0.log"
Sep 09 21:13:57.542018 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:13:57.538581    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zln8j_22210233-a1fa-4335-a652-6b89192b07ec/dns-node-resolver/0.log"
Sep 09 21:13:58.141308 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:13:58.141281    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-588b6c65d4-jnmhd_f0356f0a-0671-452b-a4d6-a845c9e79079/registry/0.log"
Sep 09 21:13:58.339322 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:13:58.339294    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-588b6c65d4-jnmhd_f0356f0a-0671-452b-a4d6-a845c9e79079/registry/1.log"
Sep 09 21:13:58.940840 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:13:58.940800    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-z8swp_eb3f4d24-4a06-4b75-a0ea-c6e8fba9e5f6/node-ca/0.log"
Sep 09 21:13:59.338722 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:13:59.338630    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2888n_09f5e589-c6ad-44a0-a60e-8243559b2b65/serve-healthcheck-canary/0.log"
Sep 09 21:14:01.090701 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:14:01.090667    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:14:01.190932 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:14:01.190905    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:14:04.621065 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:14:04.621030    2555 patch_prober.go:28] interesting pod/image-registry-588b6c65d4-jnmhd container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:14:04.621490 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:14:04.621089    2555 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:14:10.608009 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:14:10.607977    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:14:10.665416 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:14:10.665388    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:14:11.418668 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:14:11.418621    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/325461e6-e654-481d-9458-feb1bb597455-metrics-certs\") pod \"network-metrics-daemon-zd7mb\" (UID: \"325461e6-e654-481d-9458-feb1bb597455\") " pod="openshift-multus/network-metrics-daemon-zd7mb"
Sep 09 21:14:11.420917 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:14:11.420885    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/325461e6-e654-481d-9458-feb1bb597455-metrics-certs\") pod \"network-metrics-daemon-zd7mb\" (UID: \"325461e6-e654-481d-9458-feb1bb597455\") " pod="openshift-multus/network-metrics-daemon-zd7mb"
Sep 09 21:14:11.464697 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:14:11.464666    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gdn8f\""
Sep 09 21:14:11.472924 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:14:11.472906    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zd7mb"
Sep 09 21:14:11.527550 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:14:11.527225    2555 patch_prober.go:28] interesting pod/image-registry-588b6c65d4-jnmhd container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:14:11.527550 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:14:11.527299    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:14:11.741842 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:14:11.741739    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zd7mb"]
Sep 09 21:14:11.745622 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:14:11.745591    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod325461e6_e654_481d_9458_feb1bb597455.slice/crio-23b7ecefb94e6b437fece9a813920fe2e7a07e4f2459b3d44f34f8cf9f31a163 WatchSource:0}: Error finding container 23b7ecefb94e6b437fece9a813920fe2e7a07e4f2459b3d44f34f8cf9f31a163: Status 404 returned error can't find the container with id 23b7ecefb94e6b437fece9a813920fe2e7a07e4f2459b3d44f34f8cf9f31a163
Sep 09 21:14:11.747487 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:14:11.747470    2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 21:14:12.588053 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:14:12.588020    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zd7mb" event={"ID":"325461e6-e654-481d-9458-feb1bb597455","Type":"ContainerStarted","Data":"23b7ecefb94e6b437fece9a813920fe2e7a07e4f2459b3d44f34f8cf9f31a163"}
Sep 09 21:14:13.592416 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:14:13.592379    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zd7mb" event={"ID":"325461e6-e654-481d-9458-feb1bb597455","Type":"ContainerStarted","Data":"a76051fb6513051bcbf15540eb0bac6f198175857141a832561014db4e59c9c4"}
Sep 09 21:14:13.592793 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:14:13.592438    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zd7mb" event={"ID":"325461e6-e654-481d-9458-feb1bb597455","Type":"ContainerStarted","Data":"b5afa7b0aead9253a0966bb471e3e9c6d9e07afc186cfbd92712e285ae1a022a"}
Sep 09 21:14:13.609698 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:14:13.609644    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-zd7mb" podStartSLOduration=374.411614327 podStartE2EDuration="6m15.609625328s" totalImagesPullingTime="1.198011001s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:07:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:14:13.609013538 +0000 UTC m=+376.588331651" watchObservedRunningTime="2026-09-09 21:14:13.609625328 +0000 UTC m=+376.588943442"
Sep 09 21:14:14.618488 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:14:14.618458    2555 patch_prober.go:28] interesting pod/image-registry-588b6c65d4-jnmhd container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:14:14.618868 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:14:14.618511    2555 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:14:20.215713 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:14:20.215685    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:14:20.285188 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:14:20.285164    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:14:21.526606 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:14:21.526571    2555 patch_prober.go:28] interesting pod/image-registry-588b6c65d4-jnmhd container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:14:21.526982 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:14:21.526632    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:14:24.617226 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:14:24.617192    2555 patch_prober.go:28] interesting pod/image-registry-588b6c65d4-jnmhd container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:14:24.617577 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:14:24.617250    2555 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:14:24.617577 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:14:24.617290    2555 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd"
Sep 09 21:14:24.617700 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:14:24.617682    2555 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"f2079e6cb74d5e52e01eae1404c7eca232e892738865ab4664afe2f704bff627"} pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" containerMessage="Container registry failed liveness probe, will be restarted"
Sep 09 21:14:24.621371 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:14:24.621340    2555 patch_prober.go:28] interesting pod/image-registry-588b6c65d4-jnmhd container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:14:24.621485 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:14:24.621390    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:14:29.825161 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:14:29.825123    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:14:34.621665 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:14:34.621629    2555 patch_prober.go:28] interesting pod/image-registry-588b6c65d4-jnmhd container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:14:34.622048 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:14:34.621676    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:14:39.433019 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:14:39.432975    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:14:39.505479 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:14:39.505453    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:14:44.621432 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:14:44.621398    2555 patch_prober.go:28] interesting pod/image-registry-588b6c65d4-jnmhd container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:14:44.621875 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:14:44.621457    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:14:49.002313 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:14:49.002251    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:14:49.070654 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:14:49.070626    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:14:49.636794 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:14:49.636763    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerName="registry" containerID="cri-o://f2079e6cb74d5e52e01eae1404c7eca232e892738865ab4664afe2f704bff627" gracePeriod=30
Sep 09 21:14:50.705781 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:14:50.705748    2555 generic.go:356] "Generic (PLEG): container finished" podID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerID="f2079e6cb74d5e52e01eae1404c7eca232e892738865ab4664afe2f704bff627" exitCode=0
Sep 09 21:14:50.706243 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:14:50.705796    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" event={"ID":"f0356f0a-0671-452b-a4d6-a845c9e79079","Type":"ContainerDied","Data":"f2079e6cb74d5e52e01eae1404c7eca232e892738865ab4664afe2f704bff627"}
Sep 09 21:14:50.706243 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:14:50.705864    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" event={"ID":"f0356f0a-0671-452b-a4d6-a845c9e79079","Type":"ContainerStarted","Data":"999a778931a0c84916fb1920ddb43c3bfe600a02a9399f3f585674ea9becdefb"}
Sep 09 21:14:50.706243 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:14:50.706019    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd"
Sep 09 21:14:50.706941 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:14:50.706924    2555 scope.go:117] "RemoveContainer" containerID="259d7585b870d15a27978bfb5b0a47bf3ac5b83cd8ebea701193d94c2d7be77f"
Sep 09 21:14:58.506409 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:14:58.506381    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:14:58.579885 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:14:58.579851    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:15:04.617479 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:15:04.617446    2555 patch_prober.go:28] interesting pod/image-registry-588b6c65d4-jnmhd container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:15:04.617851 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:15:04.617502    2555 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:15:08.050698 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:15:08.050666    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:15:11.714872 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:15:11.714807    2555 patch_prober.go:28] interesting pod/image-registry-588b6c65d4-jnmhd container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:15:11.715222 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:15:11.714894    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:15:14.617007 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:15:14.616974    2555 patch_prober.go:28] interesting pod/image-registry-588b6c65d4-jnmhd container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:15:14.617436 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:15:14.617027    2555 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:15:17.567839 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:15:17.567793    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:15:17.626604 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:15:17.626581    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:15:21.714442 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:15:21.714364    2555 patch_prober.go:28] interesting pod/image-registry-588b6c65d4-jnmhd container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:15:21.714442 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:15:21.714411    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:15:24.617764 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:15:24.617722    2555 patch_prober.go:28] interesting pod/image-registry-588b6c65d4-jnmhd container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:15:24.618131 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:15:24.617783    2555 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:15:24.618131 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:15:24.617835    2555 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd"
Sep 09 21:15:24.618272 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:15:24.618255    2555 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"999a778931a0c84916fb1920ddb43c3bfe600a02a9399f3f585674ea9becdefb"} pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" containerMessage="Container registry failed liveness probe, will be restarted"
Sep 09 21:15:24.621654 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:15:24.621630    2555 patch_prober.go:28] interesting pod/image-registry-588b6c65d4-jnmhd container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:15:24.621785 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:15:24.621666    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:15:25.011403 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:15:25.011377    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:15:25.083592 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:15:25.083566    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:15:26.930738 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:15:26.930709    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:15:27.014737 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:15:27.014701    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:15:34.622983 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:15:34.622943    2555 patch_prober.go:28] interesting pod/image-registry-588b6c65d4-jnmhd container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:15:34.623340 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:15:34.623006    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:15:36.430586 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:15:36.430557    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:15:44.622638 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:15:44.622606    2555 patch_prober.go:28] interesting pod/image-registry-588b6c65d4-jnmhd container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:15:44.623030 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:15:44.622654    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:15:45.986753 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:15:45.986722    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:15:46.087764 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:15:46.087741    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:15:47.350882 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:15:47.350841    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:15:49.636307 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:15:49.636257    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerName="registry" containerID="cri-o://999a778931a0c84916fb1920ddb43c3bfe600a02a9399f3f585674ea9becdefb" gracePeriod=30
Sep 09 21:15:49.883148 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:15:49.883115    2555 generic.go:356] "Generic (PLEG): container finished" podID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerID="999a778931a0c84916fb1920ddb43c3bfe600a02a9399f3f585674ea9becdefb" exitCode=0
Sep 09 21:15:49.883324 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:15:49.883155    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" event={"ID":"f0356f0a-0671-452b-a4d6-a845c9e79079","Type":"ContainerDied","Data":"999a778931a0c84916fb1920ddb43c3bfe600a02a9399f3f585674ea9becdefb"}
Sep 09 21:15:49.883324 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:15:49.883195    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" event={"ID":"f0356f0a-0671-452b-a4d6-a845c9e79079","Type":"ContainerStarted","Data":"21f38fb9fe6218ce3fff942a424969fc3e82b3fd95c5157c4006ae86fff34e81"}
Sep 09 21:15:49.883324 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:15:49.883218    2555 scope.go:117] "RemoveContainer" containerID="f2079e6cb74d5e52e01eae1404c7eca232e892738865ab4664afe2f704bff627"
Sep 09 21:15:49.883510 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:15:49.883420    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd"
Sep 09 21:15:53.568391 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:15:53.568355    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:15:55.646814 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:15:55.646775    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:15:55.712940 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:15:55.712916    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:16:04.617715 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:16:04.617683    2555 patch_prober.go:28] interesting pod/image-registry-588b6c65d4-jnmhd container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:16:04.618104 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:16:04.617735    2555 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:16:05.046215 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:16:05.046177    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:16:10.892790 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:16:10.892753    2555 patch_prober.go:28] interesting pod/image-registry-588b6c65d4-jnmhd container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:16:10.893242 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:16:10.892807    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:16:14.617469 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:16:14.617433    2555 patch_prober.go:28] interesting pod/image-registry-588b6c65d4-jnmhd container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:16:14.617813 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:16:14.617485    2555 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:16:14.689585 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:16:14.689554    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:16:14.792003 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:16:14.791966    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:16:20.892731 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:16:20.892700    2555 patch_prober.go:28] interesting pod/image-registry-588b6c65d4-jnmhd container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:16:20.893241 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:16:20.892755    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:16:24.319571 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:16:24.319541    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:16:24.378442 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:16:24.378414    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:16:24.617295 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:16:24.617223    2555 patch_prober.go:28] interesting pod/image-registry-588b6c65d4-jnmhd container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:16:24.617295 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:16:24.617269    2555 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:16:24.617464 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:16:24.617302    2555 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd"
Sep 09 21:16:24.617704 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:16:24.617678    2555 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"21f38fb9fe6218ce3fff942a424969fc3e82b3fd95c5157c4006ae86fff34e81"} pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" containerMessage="Container registry failed liveness probe, will be restarted"
Sep 09 21:16:24.621192 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:16:24.621162    2555 patch_prober.go:28] interesting pod/image-registry-588b6c65d4-jnmhd container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:16:24.621296 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:16:24.621205    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:16:34.016140 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:16:34.016101    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:16:34.073551 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:16:34.073522    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:16:34.621485 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:16:34.621448    2555 patch_prober.go:28] interesting pod/image-registry-588b6c65d4-jnmhd container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:16:34.621637 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:16:34.621498    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:16:43.687578 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:16:43.687541    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:16:43.757509 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:16:43.757482    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:16:44.621970 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:16:44.621940    2555 patch_prober.go:28] interesting pod/image-registry-588b6c65d4-jnmhd container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:16:44.622143 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:16:44.621987    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:16:49.635811 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:16:49.635769    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerName="registry" containerID="cri-o://21f38fb9fe6218ce3fff942a424969fc3e82b3fd95c5157c4006ae86fff34e81" gracePeriod=30
Sep 09 21:16:50.068632 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:16:50.068599    2555 generic.go:356] "Generic (PLEG): container finished" podID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerID="21f38fb9fe6218ce3fff942a424969fc3e82b3fd95c5157c4006ae86fff34e81" exitCode=0
Sep 09 21:16:50.068831 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:16:50.068670    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" event={"ID":"f0356f0a-0671-452b-a4d6-a845c9e79079","Type":"ContainerDied","Data":"21f38fb9fe6218ce3fff942a424969fc3e82b3fd95c5157c4006ae86fff34e81"}
Sep 09 21:16:50.068831 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:16:50.068720    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" event={"ID":"f0356f0a-0671-452b-a4d6-a845c9e79079","Type":"ContainerStarted","Data":"85abef064f98e0e689953c6c14245396e9509363da5af4ddec90d8e46a7ebc68"}
Sep 09 21:16:50.068831 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:16:50.068741    2555 scope.go:117] "RemoveContainer" containerID="999a778931a0c84916fb1920ddb43c3bfe600a02a9399f3f585674ea9becdefb"
Sep 09 21:16:50.069003 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:16:50.068945    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd"
Sep 09 21:16:53.236100 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:16:53.236072    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:16:53.298797 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:16:53.298778    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:17:02.814808 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:17:02.814773    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:17:02.872876 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:17:02.872847    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:17:04.617423 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:17:04.617391    2555 patch_prober.go:28] interesting pod/image-registry-588b6c65d4-jnmhd container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:17:04.617885 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:17:04.617447    2555 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:17:07.986634 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:17:07.986597    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:17:11.078387 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:17:11.078349    2555 patch_prober.go:28] interesting pod/image-registry-588b6c65d4-jnmhd container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:17:11.078741 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:17:11.078411    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:17:12.181412 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:17:12.181378    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:17:12.273355 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:17:12.273315    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:17:14.617085 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:17:14.617053    2555 patch_prober.go:28] interesting pod/image-registry-588b6c65d4-jnmhd container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:17:14.617511 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:17:14.617113    2555 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:17:21.078389 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:17:21.078346    2555 patch_prober.go:28] interesting pod/image-registry-588b6c65d4-jnmhd container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:17:21.078765 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:17:21.078404    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:17:21.748970 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:17:21.748939    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:17:21.816772 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:17:21.816735    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:17:24.617664 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:17:24.617633    2555 patch_prober.go:28] interesting pod/image-registry-588b6c65d4-jnmhd container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:17:24.618135 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:17:24.617681    2555 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:17:24.618135 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:17:24.617721    2555 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd"
Sep 09 21:17:24.618212 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:17:24.618154    2555 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"85abef064f98e0e689953c6c14245396e9509363da5af4ddec90d8e46a7ebc68"} pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" containerMessage="Container registry failed liveness probe, will be restarted"
Sep 09 21:17:24.621537 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:17:24.621509    2555 patch_prober.go:28] interesting pod/image-registry-588b6c65d4-jnmhd container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:17:24.621681 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:17:24.621555    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:17:31.374099 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:17:31.374056    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:17:31.432406 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:17:31.432372    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:17:34.621753 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:17:34.621723    2555 patch_prober.go:28] interesting pod/image-registry-588b6c65d4-jnmhd container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:17:34.622138 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:17:34.621780    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:17:34.810032 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:17:34.810001    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:17:40.786036 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:17:40.786002    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:17:40.845328 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:17:40.845289    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:17:43.934159 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:17:43.934126    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:17:44.033887 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:17:44.033862    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:17:44.096385 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:17:44.096348    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:17:44.622084 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:17:44.622047    2555 patch_prober.go:28] interesting pod/image-registry-588b6c65d4-jnmhd container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:17:44.622240 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:17:44.622097    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:17:49.636345 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:17:49.636306    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerName="registry" containerID="cri-o://85abef064f98e0e689953c6c14245396e9509363da5af4ddec90d8e46a7ebc68" gracePeriod=30
Sep 09 21:17:49.940158 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:17:49.940129    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:17:50.018380 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:17:50.018349    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:17:50.257999 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:17:50.257918    2555 generic.go:356] "Generic (PLEG): container finished" podID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerID="85abef064f98e0e689953c6c14245396e9509363da5af4ddec90d8e46a7ebc68" exitCode=0
Sep 09 21:17:50.257999 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:17:50.257984    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" event={"ID":"f0356f0a-0671-452b-a4d6-a845c9e79079","Type":"ContainerDied","Data":"85abef064f98e0e689953c6c14245396e9509363da5af4ddec90d8e46a7ebc68"}
Sep 09 21:17:50.258197 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:17:50.258030    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" event={"ID":"f0356f0a-0671-452b-a4d6-a845c9e79079","Type":"ContainerStarted","Data":"0da6f543a0893afd813c8283dbc84f46309cb37f3bebb61dc906c995ffb8be38"}
Sep 09 21:17:50.258197 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:17:50.258050    2555 scope.go:117] "RemoveContainer" containerID="21f38fb9fe6218ce3fff942a424969fc3e82b3fd95c5157c4006ae86fff34e81"
Sep 09 21:17:50.258197 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:17:50.258155    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd"
Sep 09 21:17:50.345149 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:17:50.345121    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:17:56.036370 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:17:56.036333    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:17:56.134167 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:17:56.134138    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:17:59.931360 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:17:59.931320    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:17:59.998398 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:17:59.998371    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:18:04.618140 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:18:04.618101    2555 patch_prober.go:28] interesting pod/image-registry-588b6c65d4-jnmhd container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:18:04.620430 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:18:04.618151    2555 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:18:09.445022 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:18:09.444985    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:18:10.632528 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:18:10.632499    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:18:11.266927 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:18:11.266891    2555 patch_prober.go:28] interesting pod/image-registry-588b6c65d4-jnmhd container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:18:11.267084 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:18:11.266954    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:18:14.617212 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:18:14.617179    2555 patch_prober.go:28] interesting pod/image-registry-588b6c65d4-jnmhd container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:18:14.617648 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:18:14.617231    2555 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:18:19.080340 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:18:19.080306    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:18:19.182010 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:18:19.181982    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:18:21.267294 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:18:21.267216    2555 patch_prober.go:28] interesting pod/image-registry-588b6c65d4-jnmhd container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:18:21.267294 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:18:21.267265    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:18:24.617736 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:18:24.617704    2555 patch_prober.go:28] interesting pod/image-registry-588b6c65d4-jnmhd container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:18:24.618199 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:18:24.617752    2555 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:18:24.618199 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:18:24.617786    2555 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd"
Sep 09 21:18:24.618199 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:18:24.618194    2555 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"0da6f543a0893afd813c8283dbc84f46309cb37f3bebb61dc906c995ffb8be38"} pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" containerMessage="Container registry failed liveness probe, will be restarted"
Sep 09 21:18:24.621496 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:18:24.621468    2555 patch_prober.go:28] interesting pod/image-registry-588b6c65d4-jnmhd container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:18:24.621653 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:18:24.621507    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:18:28.763389 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:18:28.763358    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:18:28.833145 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:18:28.833101    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:18:34.164336 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:18:34.164289    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:18:34.621803 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:18:34.621727    2555 patch_prober.go:28] interesting pod/image-registry-588b6c65d4-jnmhd container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:18:34.621803 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:18:34.621772    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:18:38.377877 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:18:38.377845    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:18:38.454557 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:18:38.454511    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:18:43.960211 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:18:43.960175    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:18:44.058981 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:18:44.058952    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:18:44.148896 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:18:44.148866    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:18:44.622257 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:18:44.622226    2555 patch_prober.go:28] interesting pod/image-registry-588b6c65d4-jnmhd container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:18:44.622425 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:18:44.622277    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:18:47.955614 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:18:47.955581    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:18:48.045142 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:18:48.045112    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:18:49.636217 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:18:49.636181    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerName="registry" containerID="cri-o://0da6f543a0893afd813c8283dbc84f46309cb37f3bebb61dc906c995ffb8be38" gracePeriod=30
Sep 09 21:18:49.752328 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:18:49.752301    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"registry\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=registry pod=image-registry-588b6c65d4-jnmhd_openshift-image-registry(f0356f0a-0671-452b-a4d6-a845c9e79079)\"" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079"
Sep 09 21:18:50.439063 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:18:50.439030    2555 generic.go:356] "Generic (PLEG): container finished" podID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerID="0da6f543a0893afd813c8283dbc84f46309cb37f3bebb61dc906c995ffb8be38" exitCode=0
Sep 09 21:18:50.439225 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:18:50.439104    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" event={"ID":"f0356f0a-0671-452b-a4d6-a845c9e79079","Type":"ContainerDied","Data":"0da6f543a0893afd813c8283dbc84f46309cb37f3bebb61dc906c995ffb8be38"}
Sep 09 21:18:50.439225 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:18:50.439158    2555 scope.go:117] "RemoveContainer" containerID="85abef064f98e0e689953c6c14245396e9509363da5af4ddec90d8e46a7ebc68"
Sep 09 21:18:50.439472 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:18:50.439452    2555 scope.go:117] "RemoveContainer" containerID="0da6f543a0893afd813c8283dbc84f46309cb37f3bebb61dc906c995ffb8be38"
Sep 09 21:18:50.439628 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:18:50.439609    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"registry\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=registry pod=image-registry-588b6c65d4-jnmhd_openshift-image-registry(f0356f0a-0671-452b-a4d6-a845c9e79079)\"" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079"
Sep 09 21:18:52.652109 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:18:52.652078    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:18:57.559085 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:18:57.559058    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:18:57.619063 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:18:57.619042    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:19:05.461145 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:05.461112    2555 scope.go:117] "RemoveContainer" containerID="0da6f543a0893afd813c8283dbc84f46309cb37f3bebb61dc906c995ffb8be38"
Sep 09 21:19:05.461651 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:19:05.461276    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"registry\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=registry pod=image-registry-588b6c65d4-jnmhd_openshift-image-registry(f0356f0a-0671-452b-a4d6-a845c9e79079)\"" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079"
Sep 09 21:19:06.963111 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:06.963078    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:19:07.037237 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:07.037209    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:19:10.331184 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:10.331150    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:19:10.364126 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:10.364096    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-8sthh"]
Sep 09 21:19:10.366893 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:10.366879    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-8sthh"
Sep 09 21:19:10.376718 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:10.376696    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 09 21:19:10.376718 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:10.376708    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-vprbf\""
Sep 09 21:19:10.393036 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:10.393013    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-8sthh"]
Sep 09 21:19:10.442255 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:10.442230    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/936229c4-18f4-4a45-bdf8-b01a1cf30347-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-8sthh\" (UID: \"936229c4-18f4-4a45-bdf8-b01a1cf30347\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-8sthh"
Sep 09 21:19:10.497705 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:10.497685    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:19:10.543018 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:10.542996    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/936229c4-18f4-4a45-bdf8-b01a1cf30347-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-8sthh\" (UID: \"936229c4-18f4-4a45-bdf8-b01a1cf30347\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-8sthh"
Sep 09 21:19:10.545353 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:10.545333    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/936229c4-18f4-4a45-bdf8-b01a1cf30347-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-8sthh\" (UID: \"936229c4-18f4-4a45-bdf8-b01a1cf30347\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-8sthh"
Sep 09 21:19:10.671536 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:10.671511    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:19:10.674784 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:10.674764    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-8sthh"
Sep 09 21:19:10.825002 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:10.824972    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:19:10.969896 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:10.969807    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-8sthh"]
Sep 09 21:19:10.974123 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:19:10.974101    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod936229c4_18f4_4a45_bdf8_b01a1cf30347.slice/crio-766c2180f00676c6a5ef791b89eead0526ae85b39df66b1b238fe40e70429dad WatchSource:0}: Error finding container 766c2180f00676c6a5ef791b89eead0526ae85b39df66b1b238fe40e70429dad: Status 404 returned error can't find the container with id 766c2180f00676c6a5ef791b89eead0526ae85b39df66b1b238fe40e70429dad
Sep 09 21:19:11.503777 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:11.503738    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-8sthh" event={"ID":"936229c4-18f4-4a45-bdf8-b01a1cf30347","Type":"ContainerStarted","Data":"766c2180f00676c6a5ef791b89eead0526ae85b39df66b1b238fe40e70429dad"}
Sep 09 21:19:12.508006 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:12.507972    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-8sthh" event={"ID":"936229c4-18f4-4a45-bdf8-b01a1cf30347","Type":"ContainerStarted","Data":"3148a9ed651c11904118eafe86dc421836aaea26b77f0239d4c4f6ed3e571742"}
Sep 09 21:19:12.508431 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:12.508259    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-8sthh"
Sep 09 21:19:12.512919 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:12.512897    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-8sthh"
Sep 09 21:19:12.568880 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:12.568807    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-8sthh" podStartSLOduration=1.61157844 podStartE2EDuration="2.568790069s" totalImagesPullingTime="957.211629ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:19:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:19:12.539013048 +0000 UTC m=+675.518331183" watchObservedRunningTime="2026-09-09 21:19:12.568790069 +0000 UTC m=+675.548108183"
Sep 09 21:19:12.872262 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:12.872155    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:19:13.062867 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:13.062788    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:19:15.725206 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:15.725144    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:19:16.513267 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:16.513234    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:19:16.612727 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:16.612696    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:19:18.189401 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:18.189364    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:19:18.476325 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:18.476246    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:19:18.598955 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:18.598921    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-kql4x"]
Sep 09 21:19:18.601989 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:18.601974    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-kql4x"
Sep 09 21:19:18.611863 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:19:18.611839    2555 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"kube-state-metrics-kube-rbac-proxy-config\" is forbidden: User \"system:node:ip-10-0-133-235.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-133-235.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" type="*v1.Secret"
Sep 09 21:19:18.612072 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:19:18.612054    2555 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"metrics-client-ca\" is forbidden: User \"system:node:ip-10-0-133-235.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-133-235.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" type="*v1.ConfigMap"
Sep 09 21:19:18.615289 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:19:18.615271    2555 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"kube-state-metrics-dockercfg-m9d7p\" is forbidden: User \"system:node:ip-10-0-133-235.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-133-235.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-m9d7p\"" type="*v1.Secret"
Sep 09 21:19:18.624920 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:19:18.624896    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kube-state-metrics-74cb57df7-kql4x\" is forbidden: User \"system:node:ip-10-0-133-235.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-133-235.ec2.internal' and this object" podUID="e5282c61-9537-4d25-80df-e47bac0afa15" pod="openshift-monitoring/kube-state-metrics-74cb57df7-kql4x"
Sep 09 21:19:18.625236 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:19:18.625206    2555 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-state-metrics-custom-resource-state-configmap\" is forbidden: User \"system:node:ip-10-0-133-235.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-133-235.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" type="*v1.ConfigMap"
Sep 09 21:19:18.625437 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:19:18.625420    2555 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"kube-state-metrics-tls\" is forbidden: User \"system:node:ip-10-0-133-235.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-133-235.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" type="*v1.Secret"
Sep 09 21:19:18.625735 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:19:18.625715    2555 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-133-235.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-133-235.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
Sep 09 21:19:18.625813 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:19:18.625772    2555 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-133-235.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-133-235.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
Sep 09 21:19:18.644099 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:18.644074    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-kql4x"]
Sep 09 21:19:18.681071 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:18.681042    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-6p65g"]
Sep 09 21:19:18.684180 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:18.684161    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6p65g"
Sep 09 21:19:18.690104 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:18.689896    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 09 21:19:18.690104 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:18.689964    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 09 21:19:18.690214 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:18.690114    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-llcr5\""
Sep 09 21:19:18.690264 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:18.690236    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 09 21:19:18.698642 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:18.698621    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e5282c61-9537-4d25-80df-e47bac0afa15-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-kql4x\" (UID: \"e5282c61-9537-4d25-80df-e47bac0afa15\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-kql4x"
Sep 09 21:19:18.698739 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:18.698650    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e5282c61-9537-4d25-80df-e47bac0afa15-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-kql4x\" (UID: \"e5282c61-9537-4d25-80df-e47bac0afa15\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-kql4x"
Sep 09 21:19:18.698739 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:18.698671    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e5282c61-9537-4d25-80df-e47bac0afa15-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-kql4x\" (UID: \"e5282c61-9537-4d25-80df-e47bac0afa15\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-kql4x"
Sep 09 21:19:18.698811 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:18.698763    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74k5d\" (UniqueName: \"kubernetes.io/projected/e5282c61-9537-4d25-80df-e47bac0afa15-kube-api-access-74k5d\") pod \"kube-state-metrics-74cb57df7-kql4x\" (UID: \"e5282c61-9537-4d25-80df-e47bac0afa15\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-kql4x"
Sep 09 21:19:18.698811 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:18.698802    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5282c61-9537-4d25-80df-e47bac0afa15-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-kql4x\" (UID: \"e5282c61-9537-4d25-80df-e47bac0afa15\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-kql4x"
Sep 09 21:19:18.698910 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:18.698850    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e5282c61-9537-4d25-80df-e47bac0afa15-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-kql4x\" (UID: \"e5282c61-9537-4d25-80df-e47bac0afa15\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-kql4x"
Sep 09 21:19:18.717002 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:18.716966    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:19:18.799302 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:18.799240    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/86500301-64db-4e6f-b8eb-11d791d85f36-node-exporter-tls\") pod \"node-exporter-6p65g\" (UID: \"86500301-64db-4e6f-b8eb-11d791d85f36\") " pod="openshift-monitoring/node-exporter-6p65g"
Sep 09 21:19:18.799302 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:18.799276    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74k5d\" (UniqueName: \"kubernetes.io/projected/e5282c61-9537-4d25-80df-e47bac0afa15-kube-api-access-74k5d\") pod \"kube-state-metrics-74cb57df7-kql4x\" (UID: \"e5282c61-9537-4d25-80df-e47bac0afa15\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-kql4x"
Sep 09 21:19:18.799302 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:18.799297    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/86500301-64db-4e6f-b8eb-11d791d85f36-node-exporter-wtmp\") pod \"node-exporter-6p65g\" (UID: \"86500301-64db-4e6f-b8eb-11d791d85f36\") " pod="openshift-monitoring/node-exporter-6p65g"
Sep 09 21:19:18.799477 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:18.799367    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/86500301-64db-4e6f-b8eb-11d791d85f36-metrics-client-ca\") pod \"node-exporter-6p65g\" (UID: \"86500301-64db-4e6f-b8eb-11d791d85f36\") " pod="openshift-monitoring/node-exporter-6p65g"
Sep 09 21:19:18.799477 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:18.799428    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5282c61-9537-4d25-80df-e47bac0afa15-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-kql4x\" (UID: \"e5282c61-9537-4d25-80df-e47bac0afa15\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-kql4x"
Sep 09 21:19:18.799477 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:18.799453    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e5282c61-9537-4d25-80df-e47bac0afa15-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-kql4x\" (UID: \"e5282c61-9537-4d25-80df-e47bac0afa15\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-kql4x"
Sep 09 21:19:18.799570 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:18.799477    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/86500301-64db-4e6f-b8eb-11d791d85f36-sys\") pod \"node-exporter-6p65g\" (UID: \"86500301-64db-4e6f-b8eb-11d791d85f36\") " pod="openshift-monitoring/node-exporter-6p65g"
Sep 09 21:19:18.799570 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:18.799505    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpfmk\" (UniqueName: \"kubernetes.io/projected/86500301-64db-4e6f-b8eb-11d791d85f36-kube-api-access-zpfmk\") pod \"node-exporter-6p65g\" (UID: \"86500301-64db-4e6f-b8eb-11d791d85f36\") " pod="openshift-monitoring/node-exporter-6p65g"
Sep 09 21:19:18.799570 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:18.799535    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e5282c61-9537-4d25-80df-e47bac0afa15-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-kql4x\" (UID: \"e5282c61-9537-4d25-80df-e47bac0afa15\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-kql4x"
Sep 09 21:19:18.799570 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:18.799557    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/86500301-64db-4e6f-b8eb-11d791d85f36-root\") pod \"node-exporter-6p65g\" (UID: \"86500301-64db-4e6f-b8eb-11d791d85f36\") " pod="openshift-monitoring/node-exporter-6p65g"
Sep 09 21:19:18.799689 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:18.799574    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e5282c61-9537-4d25-80df-e47bac0afa15-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-kql4x\" (UID: \"e5282c61-9537-4d25-80df-e47bac0afa15\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-kql4x"
Sep 09 21:19:18.799689 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:18.799597    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/86500301-64db-4e6f-b8eb-11d791d85f36-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6p65g\" (UID: \"86500301-64db-4e6f-b8eb-11d791d85f36\") " pod="openshift-monitoring/node-exporter-6p65g"
Sep 09 21:19:18.799689 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:18.799628    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e5282c61-9537-4d25-80df-e47bac0afa15-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-kql4x\" (UID: \"e5282c61-9537-4d25-80df-e47bac0afa15\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-kql4x"
Sep 09 21:19:18.799689 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:18.799654    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/86500301-64db-4e6f-b8eb-11d791d85f36-node-exporter-accelerators-collector-config\") pod \"node-exporter-6p65g\" (UID: \"86500301-64db-4e6f-b8eb-11d791d85f36\") " pod="openshift-monitoring/node-exporter-6p65g"
Sep 09 21:19:18.799689 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:18.799685    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/86500301-64db-4e6f-b8eb-11d791d85f36-node-exporter-textfile\") pod \"node-exporter-6p65g\" (UID: \"86500301-64db-4e6f-b8eb-11d791d85f36\") " pod="openshift-monitoring/node-exporter-6p65g"
Sep 09 21:19:18.799881 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:18.799834    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e5282c61-9537-4d25-80df-e47bac0afa15-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-kql4x\" (UID: \"e5282c61-9537-4d25-80df-e47bac0afa15\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-kql4x"
Sep 09 21:19:18.815873 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:18.815853    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:19:18.899966 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:18.899944    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/86500301-64db-4e6f-b8eb-11d791d85f36-node-exporter-accelerators-collector-config\") pod \"node-exporter-6p65g\" (UID: \"86500301-64db-4e6f-b8eb-11d791d85f36\") " pod="openshift-monitoring/node-exporter-6p65g"
Sep 09 21:19:18.900081 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:18.899976    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/86500301-64db-4e6f-b8eb-11d791d85f36-node-exporter-textfile\") pod \"node-exporter-6p65g\" (UID: \"86500301-64db-4e6f-b8eb-11d791d85f36\") " pod="openshift-monitoring/node-exporter-6p65g"
Sep 09 21:19:18.900081 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:18.900002    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/86500301-64db-4e6f-b8eb-11d791d85f36-node-exporter-tls\") pod \"node-exporter-6p65g\" (UID: \"86500301-64db-4e6f-b8eb-11d791d85f36\") " pod="openshift-monitoring/node-exporter-6p65g"
Sep 09 21:19:18.900160 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:19:18.900092    2555 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 09 21:19:18.900160 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:18.900130    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/86500301-64db-4e6f-b8eb-11d791d85f36-node-exporter-wtmp\") pod \"node-exporter-6p65g\" (UID: \"86500301-64db-4e6f-b8eb-11d791d85f36\") " pod="openshift-monitoring/node-exporter-6p65g"
Sep 09 21:19:18.900160 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:19:18.900156    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86500301-64db-4e6f-b8eb-11d791d85f36-node-exporter-tls podName:86500301-64db-4e6f-b8eb-11d791d85f36 nodeName:}" failed. No retries permitted until 2026-09-09 21:19:19.400136979 +0000 UTC m=+682.379455077 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/86500301-64db-4e6f-b8eb-11d791d85f36-node-exporter-tls") pod "node-exporter-6p65g" (UID: "86500301-64db-4e6f-b8eb-11d791d85f36") : secret "node-exporter-tls" not found
Sep 09 21:19:18.900274 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:18.900191    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/86500301-64db-4e6f-b8eb-11d791d85f36-metrics-client-ca\") pod \"node-exporter-6p65g\" (UID: \"86500301-64db-4e6f-b8eb-11d791d85f36\") " pod="openshift-monitoring/node-exporter-6p65g"
Sep 09 21:19:18.900274 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:18.900232    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/86500301-64db-4e6f-b8eb-11d791d85f36-sys\") pod \"node-exporter-6p65g\" (UID: \"86500301-64db-4e6f-b8eb-11d791d85f36\") " pod="openshift-monitoring/node-exporter-6p65g"
Sep 09 21:19:18.900274 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:18.900253    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/86500301-64db-4e6f-b8eb-11d791d85f36-node-exporter-wtmp\") pod \"node-exporter-6p65g\" (UID: \"86500301-64db-4e6f-b8eb-11d791d85f36\") " pod="openshift-monitoring/node-exporter-6p65g"
Sep 09 21:19:18.900274 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:18.900261    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpfmk\" (UniqueName: \"kubernetes.io/projected/86500301-64db-4e6f-b8eb-11d791d85f36-kube-api-access-zpfmk\") pod \"node-exporter-6p65g\" (UID: \"86500301-64db-4e6f-b8eb-11d791d85f36\") " pod="openshift-monitoring/node-exporter-6p65g"
Sep 09 21:19:18.900461 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:18.900329    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/86500301-64db-4e6f-b8eb-11d791d85f36-node-exporter-textfile\") pod \"node-exporter-6p65g\" (UID: \"86500301-64db-4e6f-b8eb-11d791d85f36\") " pod="openshift-monitoring/node-exporter-6p65g"
Sep 09 21:19:18.900461 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:18.900332    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/86500301-64db-4e6f-b8eb-11d791d85f36-sys\") pod \"node-exporter-6p65g\" (UID: \"86500301-64db-4e6f-b8eb-11d791d85f36\") " pod="openshift-monitoring/node-exporter-6p65g"
Sep 09 21:19:18.900461 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:18.900372    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/86500301-64db-4e6f-b8eb-11d791d85f36-root\") pod \"node-exporter-6p65g\" (UID: \"86500301-64db-4e6f-b8eb-11d791d85f36\") " pod="openshift-monitoring/node-exporter-6p65g"
Sep 09 21:19:18.900461 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:18.900436    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/86500301-64db-4e6f-b8eb-11d791d85f36-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6p65g\" (UID: \"86500301-64db-4e6f-b8eb-11d791d85f36\") " pod="openshift-monitoring/node-exporter-6p65g"
Sep 09 21:19:18.900599 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:18.900437    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/86500301-64db-4e6f-b8eb-11d791d85f36-root\") pod \"node-exporter-6p65g\" (UID: \"86500301-64db-4e6f-b8eb-11d791d85f36\") " pod="openshift-monitoring/node-exporter-6p65g"
Sep 09 21:19:18.900599 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:18.900523    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/86500301-64db-4e6f-b8eb-11d791d85f36-node-exporter-accelerators-collector-config\") pod \"node-exporter-6p65g\" (UID: \"86500301-64db-4e6f-b8eb-11d791d85f36\") " pod="openshift-monitoring/node-exporter-6p65g"
Sep 09 21:19:18.902517 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:18.902499    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/86500301-64db-4e6f-b8eb-11d791d85f36-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6p65g\" (UID: \"86500301-64db-4e6f-b8eb-11d791d85f36\") " pod="openshift-monitoring/node-exporter-6p65g"
Sep 09 21:19:18.914687 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:18.914663    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:19:19.080134 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:19.080053    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:19:19.326380 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:19.326346    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:19:19.405850 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:19.405766    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/86500301-64db-4e6f-b8eb-11d791d85f36-node-exporter-tls\") pod \"node-exporter-6p65g\" (UID: \"86500301-64db-4e6f-b8eb-11d791d85f36\") " pod="openshift-monitoring/node-exporter-6p65g"
Sep 09 21:19:19.408064 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:19.408035    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/86500301-64db-4e6f-b8eb-11d791d85f36-node-exporter-tls\") pod \"node-exporter-6p65g\" (UID: \"86500301-64db-4e6f-b8eb-11d791d85f36\") " pod="openshift-monitoring/node-exporter-6p65g"
Sep 09 21:19:19.645073 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:19.645048    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:19:19.689139 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:19.689120    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 09 21:19:19.692335 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:19.692311    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e5282c61-9537-4d25-80df-e47bac0afa15-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-kql4x\" (UID: \"e5282c61-9537-4d25-80df-e47bac0afa15\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-kql4x"
Sep 09 21:19:19.745088 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:19.745062    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:19:19.797911 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:19.797882    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 09 21:19:19.799884 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:19:19.799863    2555 configmap.go:193] Couldn't get configMap openshift-monitoring/kube-state-metrics-custom-resource-state-configmap: failed to sync configmap cache: timed out waiting for the condition
Sep 09 21:19:19.799968 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:19:19.799898    2555 configmap.go:193] Couldn't get configMap openshift-monitoring/metrics-client-ca: failed to sync configmap cache: timed out waiting for the condition
Sep 09 21:19:19.799968 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:19:19.799931    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e5282c61-9537-4d25-80df-e47bac0afa15-kube-state-metrics-custom-resource-state-configmap podName:e5282c61-9537-4d25-80df-e47bac0afa15 nodeName:}" failed. No retries permitted until 2026-09-09 21:19:20.299911782 +0000 UTC m=+683.279229879 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-custom-resource-state-configmap" (UniqueName: "kubernetes.io/configmap/e5282c61-9537-4d25-80df-e47bac0afa15-kube-state-metrics-custom-resource-state-configmap") pod "kube-state-metrics-74cb57df7-kql4x" (UID: "e5282c61-9537-4d25-80df-e47bac0afa15") : failed to sync configmap cache: timed out waiting for the condition
Sep 09 21:19:19.799968 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:19:19.799952    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e5282c61-9537-4d25-80df-e47bac0afa15-metrics-client-ca podName:e5282c61-9537-4d25-80df-e47bac0afa15 nodeName:}" failed. No retries permitted until 2026-09-09 21:19:20.299942766 +0000 UTC m=+683.279260862 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-client-ca" (UniqueName: "kubernetes.io/configmap/e5282c61-9537-4d25-80df-e47bac0afa15-metrics-client-ca") pod "kube-state-metrics-74cb57df7-kql4x" (UID: "e5282c61-9537-4d25-80df-e47bac0afa15") : failed to sync configmap cache: timed out waiting for the condition
Sep 09 21:19:19.800126 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:19:19.799975    2555 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: failed to sync secret cache: timed out waiting for the condition
Sep 09 21:19:19.800126 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:19:19.800020    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5282c61-9537-4d25-80df-e47bac0afa15-kube-state-metrics-tls podName:e5282c61-9537-4d25-80df-e47bac0afa15 nodeName:}" failed. No retries permitted until 2026-09-09 21:19:20.300003265 +0000 UTC m=+683.279321373 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/e5282c61-9537-4d25-80df-e47bac0afa15-kube-state-metrics-tls") pod "kube-state-metrics-74cb57df7-kql4x" (UID: "e5282c61-9537-4d25-80df-e47bac0afa15") : failed to sync secret cache: timed out waiting for the condition
Sep 09 21:19:19.802348 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:19.802330    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 09 21:19:19.807173 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:19:19.807156    2555 projected.go:291] Couldn't get configMap openshift-monitoring/kube-root-ca.crt: failed to sync configmap cache: timed out waiting for the condition
Sep 09 21:19:19.829813 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:19.829789    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 09 21:19:19.829813 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:19.829789    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 09 21:19:19.829953 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:19.829798    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 09 21:19:19.829953 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:19.829814    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 09 21:19:19.830234 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:19.830221    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-hg2hf\""
Sep 09 21:19:19.830315 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:19.830299    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 09 21:19:19.830486 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:19.830474    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 09 21:19:19.830608 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:19.830588    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 09 21:19:19.830640 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:19.830613    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 09 21:19:19.839076 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:19.839061    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 09 21:19:19.846025 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:19.846005    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 09 21:19:19.900455 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:19:19.900435    2555 configmap.go:193] Couldn't get configMap openshift-monitoring/metrics-client-ca: failed to sync configmap cache: timed out waiting for the condition
Sep 09 21:19:19.900575 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:19:19.900503    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/86500301-64db-4e6f-b8eb-11d791d85f36-metrics-client-ca podName:86500301-64db-4e6f-b8eb-11d791d85f36 nodeName:}" failed. No retries permitted until 2026-09-09 21:19:20.400488155 +0000 UTC m=+683.379806250 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-client-ca" (UniqueName: "kubernetes.io/configmap/86500301-64db-4e6f-b8eb-11d791d85f36-metrics-client-ca") pod "node-exporter-6p65g" (UID: "86500301-64db-4e6f-b8eb-11d791d85f36") : failed to sync configmap cache: timed out waiting for the condition
Sep 09 21:19:19.907555 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:19.907534    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:19:19.909607 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:19:19.909592    2555 projected.go:291] Couldn't get configMap openshift-monitoring/kube-root-ca.crt: failed to sync configmap cache: timed out waiting for the condition
Sep 09 21:19:19.910545 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:19.910528    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7618e9f8-0c09-4409-8899-15b3137f79b1-config-out\") pod \"alertmanager-main-0\" (UID: \"7618e9f8-0c09-4409-8899-15b3137f79b1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 21:19:19.910607 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:19.910567    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7618e9f8-0c09-4409-8899-15b3137f79b1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7618e9f8-0c09-4409-8899-15b3137f79b1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 21:19:19.910607 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:19.910591    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7618e9f8-0c09-4409-8899-15b3137f79b1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7618e9f8-0c09-4409-8899-15b3137f79b1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 21:19:19.910684 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:19.910650    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7618e9f8-0c09-4409-8899-15b3137f79b1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7618e9f8-0c09-4409-8899-15b3137f79b1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 21:19:19.910684 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:19.910673    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7618e9f8-0c09-4409-8899-15b3137f79b1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7618e9f8-0c09-4409-8899-15b3137f79b1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 21:19:19.910784 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:19.910691    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7618e9f8-0c09-4409-8899-15b3137f79b1-config-volume\") pod \"alertmanager-main-0\" (UID: \"7618e9f8-0c09-4409-8899-15b3137f79b1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 21:19:19.910784 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:19.910717    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6k48\" (UniqueName: \"kubernetes.io/projected/7618e9f8-0c09-4409-8899-15b3137f79b1-kube-api-access-t6k48\") pod \"alertmanager-main-0\" (UID: \"7618e9f8-0c09-4409-8899-15b3137f79b1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 21:19:19.910784 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:19.910749    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7618e9f8-0c09-4409-8899-15b3137f79b1-web-config\") pod \"alertmanager-main-0\" (UID: \"7618e9f8-0c09-4409-8899-15b3137f79b1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 21:19:19.910784 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:19.910781    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7618e9f8-0c09-4409-8899-15b3137f79b1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7618e9f8-0c09-4409-8899-15b3137f79b1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 21:19:19.910928 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:19.910848    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7618e9f8-0c09-4409-8899-15b3137f79b1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7618e9f8-0c09-4409-8899-15b3137f79b1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 21:19:19.910928 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:19.910890    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7618e9f8-0c09-4409-8899-15b3137f79b1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7618e9f8-0c09-4409-8899-15b3137f79b1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 21:19:19.910991 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:19.910928    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7618e9f8-0c09-4409-8899-15b3137f79b1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7618e9f8-0c09-4409-8899-15b3137f79b1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 21:19:19.910991 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:19.910943    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7618e9f8-0c09-4409-8899-15b3137f79b1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7618e9f8-0c09-4409-8899-15b3137f79b1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 21:19:19.936927 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:19.936905    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 09 21:19:20.011284 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:20.011222    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7618e9f8-0c09-4409-8899-15b3137f79b1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7618e9f8-0c09-4409-8899-15b3137f79b1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 21:19:20.011284 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:20.011266    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7618e9f8-0c09-4409-8899-15b3137f79b1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7618e9f8-0c09-4409-8899-15b3137f79b1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 21:19:20.011404 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:20.011295    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7618e9f8-0c09-4409-8899-15b3137f79b1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7618e9f8-0c09-4409-8899-15b3137f79b1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 21:19:20.011404 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:20.011317    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7618e9f8-0c09-4409-8899-15b3137f79b1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7618e9f8-0c09-4409-8899-15b3137f79b1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 21:19:20.011404 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:20.011350    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7618e9f8-0c09-4409-8899-15b3137f79b1-config-out\") pod \"alertmanager-main-0\" (UID: \"7618e9f8-0c09-4409-8899-15b3137f79b1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 21:19:20.011404 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:20.011397    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7618e9f8-0c09-4409-8899-15b3137f79b1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7618e9f8-0c09-4409-8899-15b3137f79b1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 21:19:20.011779 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:20.011427    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7618e9f8-0c09-4409-8899-15b3137f79b1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7618e9f8-0c09-4409-8899-15b3137f79b1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 21:19:20.011779 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:20.011463    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7618e9f8-0c09-4409-8899-15b3137f79b1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7618e9f8-0c09-4409-8899-15b3137f79b1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 21:19:20.011779 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:20.011494    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7618e9f8-0c09-4409-8899-15b3137f79b1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7618e9f8-0c09-4409-8899-15b3137f79b1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 21:19:20.011779 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:20.011518    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7618e9f8-0c09-4409-8899-15b3137f79b1-config-volume\") pod \"alertmanager-main-0\" (UID: \"7618e9f8-0c09-4409-8899-15b3137f79b1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 21:19:20.011779 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:20.011557    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6k48\" (UniqueName: \"kubernetes.io/projected/7618e9f8-0c09-4409-8899-15b3137f79b1-kube-api-access-t6k48\") pod \"alertmanager-main-0\" (UID: \"7618e9f8-0c09-4409-8899-15b3137f79b1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 21:19:20.011779 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:20.011582    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7618e9f8-0c09-4409-8899-15b3137f79b1-web-config\") pod \"alertmanager-main-0\" (UID: \"7618e9f8-0c09-4409-8899-15b3137f79b1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 21:19:20.011779 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:20.011606    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7618e9f8-0c09-4409-8899-15b3137f79b1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7618e9f8-0c09-4409-8899-15b3137f79b1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 21:19:20.011779 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:20.011709    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7618e9f8-0c09-4409-8899-15b3137f79b1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7618e9f8-0c09-4409-8899-15b3137f79b1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 21:19:20.012201 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:20.012161    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7618e9f8-0c09-4409-8899-15b3137f79b1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7618e9f8-0c09-4409-8899-15b3137f79b1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 21:19:20.012357 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:20.012333    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7618e9f8-0c09-4409-8899-15b3137f79b1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7618e9f8-0c09-4409-8899-15b3137f79b1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 21:19:20.014914 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:20.014599    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7618e9f8-0c09-4409-8899-15b3137f79b1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7618e9f8-0c09-4409-8899-15b3137f79b1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 21:19:20.014914 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:20.014621    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7618e9f8-0c09-4409-8899-15b3137f79b1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7618e9f8-0c09-4409-8899-15b3137f79b1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 21:19:20.014914 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:20.014658    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7618e9f8-0c09-4409-8899-15b3137f79b1-config-volume\") pod \"alertmanager-main-0\" (UID: \"7618e9f8-0c09-4409-8899-15b3137f79b1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 21:19:20.014914 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:20.014676    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7618e9f8-0c09-4409-8899-15b3137f79b1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7618e9f8-0c09-4409-8899-15b3137f79b1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 21:19:20.014914 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:20.014847    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7618e9f8-0c09-4409-8899-15b3137f79b1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7618e9f8-0c09-4409-8899-15b3137f79b1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 21:19:20.015145 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:20.015078    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7618e9f8-0c09-4409-8899-15b3137f79b1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7618e9f8-0c09-4409-8899-15b3137f79b1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 21:19:20.015145 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:20.015121    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7618e9f8-0c09-4409-8899-15b3137f79b1-web-config\") pod \"alertmanager-main-0\" (UID: \"7618e9f8-0c09-4409-8899-15b3137f79b1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 21:19:20.015324 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:20.015308    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7618e9f8-0c09-4409-8899-15b3137f79b1-config-out\") pod \"alertmanager-main-0\" (UID: \"7618e9f8-0c09-4409-8899-15b3137f79b1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 21:19:20.016490 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:20.016469    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7618e9f8-0c09-4409-8899-15b3137f79b1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7618e9f8-0c09-4409-8899-15b3137f79b1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 21:19:20.029419 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:20.029401    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 09 21:19:20.030396 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:19:20.030381    2555 projected.go:196] Error preparing data for projected volume kube-api-access-zpfmk for pod openshift-monitoring/node-exporter-6p65g: failed to sync configmap cache: timed out waiting for the condition
Sep 09 21:19:20.030452 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:19:20.030429    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86500301-64db-4e6f-b8eb-11d791d85f36-kube-api-access-zpfmk podName:86500301-64db-4e6f-b8eb-11d791d85f36 nodeName:}" failed. No retries permitted until 2026-09-09 21:19:20.530416711 +0000 UTC m=+683.509734802 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-zpfmk" (UniqueName: "kubernetes.io/projected/86500301-64db-4e6f-b8eb-11d791d85f36-kube-api-access-zpfmk") pod "node-exporter-6p65g" (UID: "86500301-64db-4e6f-b8eb-11d791d85f36") : failed to sync configmap cache: timed out waiting for the condition
Sep 09 21:19:20.037692 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:19:20.037678    2555 projected.go:196] Error preparing data for projected volume kube-api-access-74k5d for pod openshift-monitoring/kube-state-metrics-74cb57df7-kql4x: failed to sync configmap cache: timed out waiting for the condition
Sep 09 21:19:20.037741 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:19:20.037735    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e5282c61-9537-4d25-80df-e47bac0afa15-kube-api-access-74k5d podName:e5282c61-9537-4d25-80df-e47bac0afa15 nodeName:}" failed. No retries permitted until 2026-09-09 21:19:20.537722079 +0000 UTC m=+683.517040170 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-74k5d" (UniqueName: "kubernetes.io/projected/e5282c61-9537-4d25-80df-e47bac0afa15-kube-api-access-74k5d") pod "kube-state-metrics-74cb57df7-kql4x" (UID: "e5282c61-9537-4d25-80df-e47bac0afa15") : failed to sync configmap cache: timed out waiting for the condition
Sep 09 21:19:20.059335 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:20.059314    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 09 21:19:20.060892 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:20.060872    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:19:20.099528 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:20.095929    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-m9d7p\""
Sep 09 21:19:20.153859 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:20.153815    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 09 21:19:20.157086 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:20.157064    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6k48\" (UniqueName: \"kubernetes.io/projected/7618e9f8-0c09-4409-8899-15b3137f79b1-kube-api-access-t6k48\") pod \"alertmanager-main-0\" (UID: \"7618e9f8-0c09-4409-8899-15b3137f79b1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 21:19:20.174121 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:20.174095    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 09 21:19:20.314531 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:20.314442    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5282c61-9537-4d25-80df-e47bac0afa15-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-kql4x\" (UID: \"e5282c61-9537-4d25-80df-e47bac0afa15\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-kql4x"
Sep 09 21:19:20.314531 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:20.314493    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e5282c61-9537-4d25-80df-e47bac0afa15-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-kql4x\" (UID: \"e5282c61-9537-4d25-80df-e47bac0afa15\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-kql4x"
Sep 09 21:19:20.314531 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:20.314533    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e5282c61-9537-4d25-80df-e47bac0afa15-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-kql4x\" (UID: \"e5282c61-9537-4d25-80df-e47bac0afa15\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-kql4x"
Sep 09 21:19:20.315151 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:20.315127    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e5282c61-9537-4d25-80df-e47bac0afa15-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-kql4x\" (UID: \"e5282c61-9537-4d25-80df-e47bac0afa15\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-kql4x"
Sep 09 21:19:20.315242 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:20.315178    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e5282c61-9537-4d25-80df-e47bac0afa15-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-kql4x\" (UID: \"e5282c61-9537-4d25-80df-e47bac0afa15\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-kql4x"
Sep 09 21:19:20.316789 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:20.316768    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5282c61-9537-4d25-80df-e47bac0afa15-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-kql4x\" (UID: \"e5282c61-9537-4d25-80df-e47bac0afa15\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-kql4x"
Sep 09 21:19:20.410563 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:20.410527    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 09 21:19:20.415143 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:20.414788    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/86500301-64db-4e6f-b8eb-11d791d85f36-metrics-client-ca\") pod \"node-exporter-6p65g\" (UID: \"86500301-64db-4e6f-b8eb-11d791d85f36\") " pod="openshift-monitoring/node-exporter-6p65g"
Sep 09 21:19:20.415277 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:20.415252    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/86500301-64db-4e6f-b8eb-11d791d85f36-metrics-client-ca\") pod \"node-exporter-6p65g\" (UID: \"86500301-64db-4e6f-b8eb-11d791d85f36\") " pod="openshift-monitoring/node-exporter-6p65g"
Sep 09 21:19:20.461538 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:20.461511    2555 scope.go:117] "RemoveContainer" containerID="0da6f543a0893afd813c8283dbc84f46309cb37f3bebb61dc906c995ffb8be38"
Sep 09 21:19:20.461765 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:19:20.461739    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"registry\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=registry pod=image-registry-588b6c65d4-jnmhd_openshift-image-registry(f0356f0a-0671-452b-a4d6-a845c9e79079)\"" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079"
Sep 09 21:19:20.617223 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:20.617146    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74k5d\" (UniqueName: \"kubernetes.io/projected/e5282c61-9537-4d25-80df-e47bac0afa15-kube-api-access-74k5d\") pod \"kube-state-metrics-74cb57df7-kql4x\" (UID: \"e5282c61-9537-4d25-80df-e47bac0afa15\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-kql4x"
Sep 09 21:19:20.617376 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:20.617254    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpfmk\" (UniqueName: \"kubernetes.io/projected/86500301-64db-4e6f-b8eb-11d791d85f36-kube-api-access-zpfmk\") pod \"node-exporter-6p65g\" (UID: \"86500301-64db-4e6f-b8eb-11d791d85f36\") " pod="openshift-monitoring/node-exporter-6p65g"
Sep 09 21:19:20.619590 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:20.619567    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpfmk\" (UniqueName: \"kubernetes.io/projected/86500301-64db-4e6f-b8eb-11d791d85f36-kube-api-access-zpfmk\") pod \"node-exporter-6p65g\" (UID: \"86500301-64db-4e6f-b8eb-11d791d85f36\") " pod="openshift-monitoring/node-exporter-6p65g"
Sep 09 21:19:20.619691 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:20.619632    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-74k5d\" (UniqueName: \"kubernetes.io/projected/e5282c61-9537-4d25-80df-e47bac0afa15-kube-api-access-74k5d\") pod \"kube-state-metrics-74cb57df7-kql4x\" (UID: \"e5282c61-9537-4d25-80df-e47bac0afa15\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-kql4x"
Sep 09 21:19:20.710366 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:20.710342    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-kql4x"
Sep 09 21:19:20.725325 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:20.725301    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 09 21:19:20.726465 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:19:20.726444    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7618e9f8_0c09_4409_8899_15b3137f79b1.slice/crio-40b09f29afd2dfe0d2575886cf1ac471db4ecb787eda4bba980e3b39bd6e6d40 WatchSource:0}: Error finding container 40b09f29afd2dfe0d2575886cf1ac471db4ecb787eda4bba980e3b39bd6e6d40: Status 404 returned error can't find the container with id 40b09f29afd2dfe0d2575886cf1ac471db4ecb787eda4bba980e3b39bd6e6d40
Sep 09 21:19:20.728399 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:20.728383    2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 21:19:20.793244 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:20.793215    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6p65g"
Sep 09 21:19:20.804060 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:19:20.804033    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86500301_64db_4e6f_b8eb_11d791d85f36.slice/crio-eedd7e3617ad01e6d4bfbb85865eebf5aac368dc721d20a7b4c5abc975970e9b WatchSource:0}: Error finding container eedd7e3617ad01e6d4bfbb85865eebf5aac368dc721d20a7b4c5abc975970e9b: Status 404 returned error can't find the container with id eedd7e3617ad01e6d4bfbb85865eebf5aac368dc721d20a7b4c5abc975970e9b
Sep 09 21:19:20.986469 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:20.986332    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-kql4x"]
Sep 09 21:19:20.988960 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:19:20.988936    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5282c61_9537_4d25_80df_e47bac0afa15.slice/crio-205e8d3d82c0a80aa5050d6dbd959da798e8df2ba88a35b6bd612478f53f5da5 WatchSource:0}: Error finding container 205e8d3d82c0a80aa5050d6dbd959da798e8df2ba88a35b6bd612478f53f5da5: Status 404 returned error can't find the container with id 205e8d3d82c0a80aa5050d6dbd959da798e8df2ba88a35b6bd612478f53f5da5
Sep 09 21:19:21.499572 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:21.499510    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:19:21.539169 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:21.539130    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7618e9f8-0c09-4409-8899-15b3137f79b1","Type":"ContainerStarted","Data":"40b09f29afd2dfe0d2575886cf1ac471db4ecb787eda4bba980e3b39bd6e6d40"}
Sep 09 21:19:21.541586 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:21.541527    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6p65g" event={"ID":"86500301-64db-4e6f-b8eb-11d791d85f36","Type":"ContainerStarted","Data":"eedd7e3617ad01e6d4bfbb85865eebf5aac368dc721d20a7b4c5abc975970e9b"}
Sep 09 21:19:21.543869 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:21.543846    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-kql4x" event={"ID":"e5282c61-9537-4d25-80df-e47bac0afa15","Type":"ContainerStarted","Data":"205e8d3d82c0a80aa5050d6dbd959da798e8df2ba88a35b6bd612478f53f5da5"}
Sep 09 21:19:21.604626 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:21.604540    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:19:21.706170 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:21.706131    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:19:21.773006 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:21.772928    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:19:21.941859 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:21.941802    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:19:22.550322 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:22.550281    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6p65g" event={"ID":"86500301-64db-4e6f-b8eb-11d791d85f36","Type":"ContainerStarted","Data":"c7cfb2f93e73c868c9ae607600066a8c0f2169939cd09f294dbac6dc498b5653"}
Sep 09 21:19:22.553894 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:22.553801    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-kql4x" event={"ID":"e5282c61-9537-4d25-80df-e47bac0afa15","Type":"ContainerStarted","Data":"ef0be25d620ca06a826ecd49e00c1564dbd9516a5e75bbbae60d70973bd6670a"}
Sep 09 21:19:22.560560 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:22.560473    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7618e9f8-0c09-4409-8899-15b3137f79b1","Type":"ContainerStarted","Data":"e3de4ec3e0f5c6e65d85e64a01938d61f0a764cd3ff190903aa348b3ccee5e70"}
Sep 09 21:19:23.329694 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:23.329660    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:19:23.447480 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:23.447447    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-smc58"]
Sep 09 21:19:23.450429 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:23.450414    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-smc58"
Sep 09 21:19:23.459090 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:23.459073    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-bpb2k\""
Sep 09 21:19:23.459183 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:23.459073    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 09 21:19:23.498277 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:23.498252    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-smc58"]
Sep 09 21:19:23.515463 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:23.515429    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:19:23.540547 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:23.540515    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/09d0f3a8-aa64-4d57-abba-487d8dfca3ff-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-smc58\" (UID: \"09d0f3a8-aa64-4d57-abba-487d8dfca3ff\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-smc58"
Sep 09 21:19:23.540675 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:23.540579    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c46jg\" (UniqueName: \"kubernetes.io/projected/09d0f3a8-aa64-4d57-abba-487d8dfca3ff-kube-api-access-c46jg\") pod \"monitoring-plugin-85bbbbbf4-smc58\" (UID: \"09d0f3a8-aa64-4d57-abba-487d8dfca3ff\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-smc58"
Sep 09 21:19:23.565921 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:23.565886    2555 generic.go:356] "Generic (PLEG): container finished" podID="86500301-64db-4e6f-b8eb-11d791d85f36" containerID="c7cfb2f93e73c868c9ae607600066a8c0f2169939cd09f294dbac6dc498b5653" exitCode=0
Sep 09 21:19:23.566323 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:23.565969    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6p65g" event={"ID":"86500301-64db-4e6f-b8eb-11d791d85f36","Type":"ContainerDied","Data":"c7cfb2f93e73c868c9ae607600066a8c0f2169939cd09f294dbac6dc498b5653"}
Sep 09 21:19:23.568150 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:23.568129    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-kql4x" event={"ID":"e5282c61-9537-4d25-80df-e47bac0afa15","Type":"ContainerStarted","Data":"8fcc59deb029772e440d324c8d1f5a5be29bc45317405a5dd598021867498905"}
Sep 09 21:19:23.568250 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:23.568181    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-kql4x" event={"ID":"e5282c61-9537-4d25-80df-e47bac0afa15","Type":"ContainerStarted","Data":"e559feddb45bd82a95f37670ac3a255ad7b287bc5b4d579bf4b5cf2c9e6c8005"}
Sep 09 21:19:23.569661 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:23.569639    2555 generic.go:356] "Generic (PLEG): container finished" podID="7618e9f8-0c09-4409-8899-15b3137f79b1" containerID="e3de4ec3e0f5c6e65d85e64a01938d61f0a764cd3ff190903aa348b3ccee5e70" exitCode=0
Sep 09 21:19:23.569759 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:23.569672    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7618e9f8-0c09-4409-8899-15b3137f79b1","Type":"ContainerDied","Data":"e3de4ec3e0f5c6e65d85e64a01938d61f0a764cd3ff190903aa348b3ccee5e70"}
Sep 09 21:19:23.621269 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:23.621243    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:19:23.641193 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:23.641160    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/09d0f3a8-aa64-4d57-abba-487d8dfca3ff-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-smc58\" (UID: \"09d0f3a8-aa64-4d57-abba-487d8dfca3ff\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-smc58"
Sep 09 21:19:23.641499 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:23.641468    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c46jg\" (UniqueName: \"kubernetes.io/projected/09d0f3a8-aa64-4d57-abba-487d8dfca3ff-kube-api-access-c46jg\") pod \"monitoring-plugin-85bbbbbf4-smc58\" (UID: \"09d0f3a8-aa64-4d57-abba-487d8dfca3ff\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-smc58"
Sep 09 21:19:23.643663 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:23.643640    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/09d0f3a8-aa64-4d57-abba-487d8dfca3ff-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-smc58\" (UID: \"09d0f3a8-aa64-4d57-abba-487d8dfca3ff\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-smc58"
Sep 09 21:19:23.659348 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:23.659325    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c46jg\" (UniqueName: \"kubernetes.io/projected/09d0f3a8-aa64-4d57-abba-487d8dfca3ff-kube-api-access-c46jg\") pod \"monitoring-plugin-85bbbbbf4-smc58\" (UID: \"09d0f3a8-aa64-4d57-abba-487d8dfca3ff\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-smc58"
Sep 09 21:19:23.673943 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:23.673895    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-74cb57df7-kql4x" podStartSLOduration=4.199239877 podStartE2EDuration="5.673881342s" totalImagesPullingTime="1.474641465s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:19:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:19:23.672963918 +0000 UTC m=+686.652282032" watchObservedRunningTime="2026-09-09 21:19:23.673881342 +0000 UTC m=+686.653199460"
Sep 09 21:19:23.759112 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:23.759085    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-smc58"
Sep 09 21:19:24.032864 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:24.032809    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-smc58"]
Sep 09 21:19:24.036124 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:19:24.036092    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09d0f3a8_aa64_4d57_abba_487d8dfca3ff.slice/crio-841c9c70d429932874f0b372924298c6a1cf8f825958f05da9e7f71ba91233d9 WatchSource:0}: Error finding container 841c9c70d429932874f0b372924298c6a1cf8f825958f05da9e7f71ba91233d9: Status 404 returned error can't find the container with id 841c9c70d429932874f0b372924298c6a1cf8f825958f05da9e7f71ba91233d9
Sep 09 21:19:24.067814 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:24.067783    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:19:24.168248 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:24.168216    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:19:24.569313 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:24.569279    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:19:24.576039 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:24.575983    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6p65g" event={"ID":"86500301-64db-4e6f-b8eb-11d791d85f36","Type":"ContainerStarted","Data":"fffbc8d7a7b4872c89ff6d921346ae8c0e8f7c51aa00aa65d3073964d162d230"}
Sep 09 21:19:24.576186 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:24.576043    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6p65g" event={"ID":"86500301-64db-4e6f-b8eb-11d791d85f36","Type":"ContainerStarted","Data":"72c0f17970bd95c2c7d5b6582a64bda3b30a43cf7b3f01ac36d6a31a7f3cb9b4"}
Sep 09 21:19:24.577467 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:24.577424    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-smc58" event={"ID":"09d0f3a8-aa64-4d57-abba-487d8dfca3ff","Type":"ContainerStarted","Data":"841c9c70d429932874f0b372924298c6a1cf8f825958f05da9e7f71ba91233d9"}
Sep 09 21:19:24.601922 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:24.601870    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-6p65g" podStartSLOduration=4.8653627010000005 podStartE2EDuration="6.601850256s" totalImagesPullingTime="1.658180027s" totalInitContainerRuntime="78.307528ms" isStatefulPod=true podCreationTimestamp="2026-09-09 21:19:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:19:24.599279366 +0000 UTC m=+687.578597482" watchObservedRunningTime="2026-09-09 21:19:24.601850256 +0000 UTC m=+687.581168369"
Sep 09 21:19:24.668453 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:24.668428    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:19:24.876650 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:24.876613    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:19:25.586189 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:25.586156    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7618e9f8-0c09-4409-8899-15b3137f79b1","Type":"ContainerStarted","Data":"9141ee40c5ae853455ff843cc0c90c219dc90c15d433a55542fc57d279873e57"}
Sep 09 21:19:25.586591 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:25.586242    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7618e9f8-0c09-4409-8899-15b3137f79b1","Type":"ContainerStarted","Data":"516a77432087c22f87041d3c1027d732a7d8d87fd21f29c949546f2dcb8ae5c4"}
Sep 09 21:19:25.586591 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:25.586285    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7618e9f8-0c09-4409-8899-15b3137f79b1","Type":"ContainerStarted","Data":"5ca8feb5277593271c7a9109580f8230a75db33d294067d9d616b2f27b224570"}
Sep 09 21:19:25.586591 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:25.586323    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7618e9f8-0c09-4409-8899-15b3137f79b1","Type":"ContainerStarted","Data":"229e3e5d1ef732ffde2af2848c20690827c10042d0b452d43f38c5204697f4d0"}
Sep 09 21:19:25.586591 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:25.586361    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7618e9f8-0c09-4409-8899-15b3137f79b1","Type":"ContainerStarted","Data":"af5b8cea1b6bee0f8cd3c3b77d597c9abc392afbd034a8aba4253cbe11246682"}
Sep 09 21:19:25.587840 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:25.587800    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-smc58" event={"ID":"09d0f3a8-aa64-4d57-abba-487d8dfca3ff","Type":"ContainerStarted","Data":"5dad251a541799960868849f4377e2bf725b7f8986c8a0640decf9677f2de990"}
Sep 09 21:19:25.588279 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:25.588257    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-smc58"
Sep 09 21:19:25.594107 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:25.594087    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-smc58"
Sep 09 21:19:25.626087 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:25.626035    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-smc58" podStartSLOduration=1.254036575 podStartE2EDuration="2.626007173s" totalImagesPullingTime="1.371970598s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:19:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:19:25.625683438 +0000 UTC m=+688.605001564" watchObservedRunningTime="2026-09-09 21:19:25.626007173 +0000 UTC m=+688.605325309"
Sep 09 21:19:26.594777 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:26.594733    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7618e9f8-0c09-4409-8899-15b3137f79b1","Type":"ContainerStarted","Data":"275353a539ebdef304191ed7028070c225c4a6fe8503da7b4ce916fae77963ca"}
Sep 09 21:19:26.640481 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:26.640425    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.047629489 podStartE2EDuration="7.640405654s" totalImagesPullingTime="3.570376156s" totalInitContainerRuntime="22.400009ms" isStatefulPod=false podCreationTimestamp="2026-09-09 21:19:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:19:26.639557834 +0000 UTC m=+689.618875986" watchObservedRunningTime="2026-09-09 21:19:26.640405654 +0000 UTC m=+689.619723777"
Sep 09 21:19:32.460797 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:32.460767    2555 scope.go:117] "RemoveContainer" containerID="0da6f543a0893afd813c8283dbc84f46309cb37f3bebb61dc906c995ffb8be38"
Sep 09 21:19:32.461182 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:19:32.460960    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"registry\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=registry pod=image-registry-588b6c65d4-jnmhd_openshift-image-registry(f0356f0a-0671-452b-a4d6-a845c9e79079)\"" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079"
Sep 09 21:19:33.045802 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:33.045767    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-588b6c65d4-jnmhd"]
Sep 09 21:19:33.163391 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:33.163368    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd"
Sep 09 21:19:33.233351 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:33.233330    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:19:33.311147 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:33.311079    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f0356f0a-0671-452b-a4d6-a845c9e79079-bound-sa-token\") pod \"f0356f0a-0671-452b-a4d6-a845c9e79079\" (UID: \"f0356f0a-0671-452b-a4d6-a845c9e79079\") "
Sep 09 21:19:33.311147 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:33.311117    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f0356f0a-0671-452b-a4d6-a845c9e79079-ca-trust-extracted\") pod \"f0356f0a-0671-452b-a4d6-a845c9e79079\" (UID: \"f0356f0a-0671-452b-a4d6-a845c9e79079\") "
Sep 09 21:19:33.311147 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:33.311142    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f0356f0a-0671-452b-a4d6-a845c9e79079-trusted-ca\") pod \"f0356f0a-0671-452b-a4d6-a845c9e79079\" (UID: \"f0356f0a-0671-452b-a4d6-a845c9e79079\") "
Sep 09 21:19:33.311394 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:33.311271    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f0356f0a-0671-452b-a4d6-a845c9e79079-registry-tls\") pod \"f0356f0a-0671-452b-a4d6-a845c9e79079\" (UID: \"f0356f0a-0671-452b-a4d6-a845c9e79079\") "
Sep 09 21:19:33.311394 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:33.311314    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f0356f0a-0671-452b-a4d6-a845c9e79079-image-registry-private-configuration\") pod \"f0356f0a-0671-452b-a4d6-a845c9e79079\" (UID: \"f0356f0a-0671-452b-a4d6-a845c9e79079\") "
Sep 09 21:19:33.311394 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:33.311374    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f0356f0a-0671-452b-a4d6-a845c9e79079-installation-pull-secrets\") pod \"f0356f0a-0671-452b-a4d6-a845c9e79079\" (UID: \"f0356f0a-0671-452b-a4d6-a845c9e79079\") "
Sep 09 21:19:33.311541 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:33.311404    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jtnjl\" (UniqueName: \"kubernetes.io/projected/f0356f0a-0671-452b-a4d6-a845c9e79079-kube-api-access-jtnjl\") pod \"f0356f0a-0671-452b-a4d6-a845c9e79079\" (UID: \"f0356f0a-0671-452b-a4d6-a845c9e79079\") "
Sep 09 21:19:33.311541 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:33.311434    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f0356f0a-0671-452b-a4d6-a845c9e79079-registry-certificates\") pod \"f0356f0a-0671-452b-a4d6-a845c9e79079\" (UID: \"f0356f0a-0671-452b-a4d6-a845c9e79079\") "
Sep 09 21:19:33.311541 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:33.311512    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0356f0a-0671-452b-a4d6-a845c9e79079-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "f0356f0a-0671-452b-a4d6-a845c9e79079" (UID: "f0356f0a-0671-452b-a4d6-a845c9e79079"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 21:19:33.311689 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:33.311677    2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f0356f0a-0671-452b-a4d6-a845c9e79079-trusted-ca\") on node \"ip-10-0-133-235.ec2.internal\" DevicePath \"\""
Sep 09 21:19:33.311961 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:33.311936    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0356f0a-0671-452b-a4d6-a845c9e79079-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "f0356f0a-0671-452b-a4d6-a845c9e79079" (UID: "f0356f0a-0671-452b-a4d6-a845c9e79079"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 21:19:33.313833 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:33.313788    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0356f0a-0671-452b-a4d6-a845c9e79079-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "f0356f0a-0671-452b-a4d6-a845c9e79079" (UID: "f0356f0a-0671-452b-a4d6-a845c9e79079"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:19:33.313943 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:33.313886    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0356f0a-0671-452b-a4d6-a845c9e79079-kube-api-access-jtnjl" (OuterVolumeSpecName: "kube-api-access-jtnjl") pod "f0356f0a-0671-452b-a4d6-a845c9e79079" (UID: "f0356f0a-0671-452b-a4d6-a845c9e79079"). InnerVolumeSpecName "kube-api-access-jtnjl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:19:33.313943 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:33.313900    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0356f0a-0671-452b-a4d6-a845c9e79079-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "f0356f0a-0671-452b-a4d6-a845c9e79079" (UID: "f0356f0a-0671-452b-a4d6-a845c9e79079"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:19:33.313943 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:33.313902    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0356f0a-0671-452b-a4d6-a845c9e79079-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "f0356f0a-0671-452b-a4d6-a845c9e79079" (UID: "f0356f0a-0671-452b-a4d6-a845c9e79079"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:19:33.314115 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:33.314032    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0356f0a-0671-452b-a4d6-a845c9e79079-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "f0356f0a-0671-452b-a4d6-a845c9e79079" (UID: "f0356f0a-0671-452b-a4d6-a845c9e79079"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:19:33.320419 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:33.320395    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0356f0a-0671-452b-a4d6-a845c9e79079-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "f0356f0a-0671-452b-a4d6-a845c9e79079" (UID: "f0356f0a-0671-452b-a4d6-a845c9e79079"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:19:33.405332 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:33.405299    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:19:33.412642 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:33.412622    2555 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f0356f0a-0671-452b-a4d6-a845c9e79079-bound-sa-token\") on node \"ip-10-0-133-235.ec2.internal\" DevicePath \"\""
Sep 09 21:19:33.412642 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:33.412641    2555 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f0356f0a-0671-452b-a4d6-a845c9e79079-ca-trust-extracted\") on node \"ip-10-0-133-235.ec2.internal\" DevicePath \"\""
Sep 09 21:19:33.412742 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:33.412650    2555 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f0356f0a-0671-452b-a4d6-a845c9e79079-registry-tls\") on node \"ip-10-0-133-235.ec2.internal\" DevicePath \"\""
Sep 09 21:19:33.412742 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:33.412661    2555 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f0356f0a-0671-452b-a4d6-a845c9e79079-image-registry-private-configuration\") on node \"ip-10-0-133-235.ec2.internal\" DevicePath \"\""
Sep 09 21:19:33.412742 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:33.412669    2555 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f0356f0a-0671-452b-a4d6-a845c9e79079-installation-pull-secrets\") on node \"ip-10-0-133-235.ec2.internal\" DevicePath \"\""
Sep 09 21:19:33.412742 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:33.412678    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jtnjl\" (UniqueName: \"kubernetes.io/projected/f0356f0a-0671-452b-a4d6-a845c9e79079-kube-api-access-jtnjl\") on node \"ip-10-0-133-235.ec2.internal\" DevicePath \"\""
Sep 09 21:19:33.412742 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:33.412686    2555 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f0356f0a-0671-452b-a4d6-a845c9e79079-registry-certificates\") on node \"ip-10-0-133-235.ec2.internal\" DevicePath \"\""
Sep 09 21:19:33.620929 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:33.620864    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd"
Sep 09 21:19:33.620929 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:33.620877    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-588b6c65d4-jnmhd" event={"ID":"f0356f0a-0671-452b-a4d6-a845c9e79079","Type":"ContainerDied","Data":"d18e53c2929b134d3d1b0addd6acc14375a99ed1489deef15f54c2e59ac06ce1"}
Sep 09 21:19:33.620929 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:33.620927    2555 scope.go:117] "RemoveContainer" containerID="0da6f543a0893afd813c8283dbc84f46309cb37f3bebb61dc906c995ffb8be38"
Sep 09 21:19:33.652377 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:33.652352    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-588b6c65d4-jnmhd"]
Sep 09 21:19:33.658827 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:33.658801    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-588b6c65d4-jnmhd"]
Sep 09 21:19:34.180356 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:34.180322    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:19:34.343656 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:34.343620    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:19:34.626591 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:34.626515    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:19:34.933754 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:34.933725    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:19:35.196100 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:35.196017    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:19:35.465645 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:35.465569    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079" path="/var/lib/kubelet/pods/f0356f0a-0671-452b-a4d6-a845c9e79079/volumes"
Sep 09 21:19:39.645731 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:39.645695    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:19:39.900329 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:39.900245    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:19:54.654802 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:54.654720    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:19:54.807747 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:19:54.807718    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:20:38.300346 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:20:38.300312    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:20:38.812162 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:20:38.812131    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:20:43.606521 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:20:43.606491    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-658dbfff77-j48jw"]
Sep 09 21:20:43.606911 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:20:43.606744    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerName="registry"
Sep 09 21:20:43.606911 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:20:43.606756    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerName="registry"
Sep 09 21:20:43.606911 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:20:43.606765    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerName="registry"
Sep 09 21:20:43.606911 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:20:43.606771    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerName="registry"
Sep 09 21:20:43.606911 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:20:43.606785    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerName="registry"
Sep 09 21:20:43.606911 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:20:43.606790    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerName="registry"
Sep 09 21:20:43.606911 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:20:43.606801    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerName="registry"
Sep 09 21:20:43.606911 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:20:43.606806    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerName="registry"
Sep 09 21:20:43.606911 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:20:43.606859    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerName="registry"
Sep 09 21:20:43.606911 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:20:43.606866    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerName="registry"
Sep 09 21:20:43.606911 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:20:43.606872    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerName="registry"
Sep 09 21:20:43.606911 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:20:43.606884    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerName="registry"
Sep 09 21:20:43.606911 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:20:43.606890    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerName="registry"
Sep 09 21:20:43.607295 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:20:43.606935    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerName="registry"
Sep 09 21:20:43.607295 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:20:43.606940    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerName="registry"
Sep 09 21:20:43.607295 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:20:43.606979    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerName="registry"
Sep 09 21:20:43.607295 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:20:43.607016    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerName="registry"
Sep 09 21:20:43.607295 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:20:43.607022    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0356f0a-0671-452b-a4d6-a845c9e79079" containerName="registry"
Sep 09 21:20:43.608855 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:20:43.608837    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-658dbfff77-j48jw"
Sep 09 21:20:43.614144 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:20:43.614122    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 09 21:20:43.614259 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:20:43.614186    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 09 21:20:43.614400 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:20:43.614381    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-2tkc9\""
Sep 09 21:20:43.615271 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:20:43.615232    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 09 21:20:43.615361 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:20:43.615281    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 09 21:20:43.615474 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:20:43.615458    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 09 21:20:43.624125 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:20:43.624083    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 09 21:20:43.651773 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:20:43.651748    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-658dbfff77-j48jw"]
Sep 09 21:20:43.671925 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:20:43.671904    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/796a503a-5adb-40e7-87e9-c2a230b22898-serving-certs-ca-bundle\") pod \"telemeter-client-658dbfff77-j48jw\" (UID: \"796a503a-5adb-40e7-87e9-c2a230b22898\") " pod="openshift-monitoring/telemeter-client-658dbfff77-j48jw"
Sep 09 21:20:43.672017 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:20:43.671942    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/796a503a-5adb-40e7-87e9-c2a230b22898-telemeter-client-tls\") pod \"telemeter-client-658dbfff77-j48jw\" (UID: \"796a503a-5adb-40e7-87e9-c2a230b22898\") " pod="openshift-monitoring/telemeter-client-658dbfff77-j48jw"
Sep 09 21:20:43.672017 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:20:43.671971    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/796a503a-5adb-40e7-87e9-c2a230b22898-federate-client-tls\") pod \"telemeter-client-658dbfff77-j48jw\" (UID: \"796a503a-5adb-40e7-87e9-c2a230b22898\") " pod="openshift-monitoring/telemeter-client-658dbfff77-j48jw"
Sep 09 21:20:43.672090 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:20:43.672039    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/796a503a-5adb-40e7-87e9-c2a230b22898-secret-telemeter-client\") pod \"telemeter-client-658dbfff77-j48jw\" (UID: \"796a503a-5adb-40e7-87e9-c2a230b22898\") " pod="openshift-monitoring/telemeter-client-658dbfff77-j48jw"
Sep 09 21:20:43.672090 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:20:43.672077    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/796a503a-5adb-40e7-87e9-c2a230b22898-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-658dbfff77-j48jw\" (UID: \"796a503a-5adb-40e7-87e9-c2a230b22898\") " pod="openshift-monitoring/telemeter-client-658dbfff77-j48jw"
Sep 09 21:20:43.672153 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:20:43.672107    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/796a503a-5adb-40e7-87e9-c2a230b22898-metrics-client-ca\") pod \"telemeter-client-658dbfff77-j48jw\" (UID: \"796a503a-5adb-40e7-87e9-c2a230b22898\") " pod="openshift-monitoring/telemeter-client-658dbfff77-j48jw"
Sep 09 21:20:43.672153 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:20:43.672125    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cs56b\" (UniqueName: \"kubernetes.io/projected/796a503a-5adb-40e7-87e9-c2a230b22898-kube-api-access-cs56b\") pod \"telemeter-client-658dbfff77-j48jw\" (UID: \"796a503a-5adb-40e7-87e9-c2a230b22898\") " pod="openshift-monitoring/telemeter-client-658dbfff77-j48jw"
Sep 09 21:20:43.672153 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:20:43.672144    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/796a503a-5adb-40e7-87e9-c2a230b22898-telemeter-trusted-ca-bundle\") pod \"telemeter-client-658dbfff77-j48jw\" (UID: \"796a503a-5adb-40e7-87e9-c2a230b22898\") " pod="openshift-monitoring/telemeter-client-658dbfff77-j48jw"
Sep 09 21:20:43.772908 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:20:43.772882    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/796a503a-5adb-40e7-87e9-c2a230b22898-serving-certs-ca-bundle\") pod \"telemeter-client-658dbfff77-j48jw\" (UID: \"796a503a-5adb-40e7-87e9-c2a230b22898\") " pod="openshift-monitoring/telemeter-client-658dbfff77-j48jw"
Sep 09 21:20:43.773009 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:20:43.772915    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/796a503a-5adb-40e7-87e9-c2a230b22898-telemeter-client-tls\") pod \"telemeter-client-658dbfff77-j48jw\" (UID: \"796a503a-5adb-40e7-87e9-c2a230b22898\") " pod="openshift-monitoring/telemeter-client-658dbfff77-j48jw"
Sep 09 21:20:43.773009 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:20:43.772935    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/796a503a-5adb-40e7-87e9-c2a230b22898-federate-client-tls\") pod \"telemeter-client-658dbfff77-j48jw\" (UID: \"796a503a-5adb-40e7-87e9-c2a230b22898\") " pod="openshift-monitoring/telemeter-client-658dbfff77-j48jw"
Sep 09 21:20:43.773009 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:20:43.772965    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/796a503a-5adb-40e7-87e9-c2a230b22898-secret-telemeter-client\") pod \"telemeter-client-658dbfff77-j48jw\" (UID: \"796a503a-5adb-40e7-87e9-c2a230b22898\") " pod="openshift-monitoring/telemeter-client-658dbfff77-j48jw"
Sep 09 21:20:43.773180 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:20:43.773008    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/796a503a-5adb-40e7-87e9-c2a230b22898-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-658dbfff77-j48jw\" (UID: \"796a503a-5adb-40e7-87e9-c2a230b22898\") " pod="openshift-monitoring/telemeter-client-658dbfff77-j48jw"
Sep 09 21:20:43.773180 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:20:43.773049    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/796a503a-5adb-40e7-87e9-c2a230b22898-metrics-client-ca\") pod \"telemeter-client-658dbfff77-j48jw\" (UID: \"796a503a-5adb-40e7-87e9-c2a230b22898\") " pod="openshift-monitoring/telemeter-client-658dbfff77-j48jw"
Sep 09 21:20:43.773180 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:20:43.773078    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cs56b\" (UniqueName: \"kubernetes.io/projected/796a503a-5adb-40e7-87e9-c2a230b22898-kube-api-access-cs56b\") pod \"telemeter-client-658dbfff77-j48jw\" (UID: \"796a503a-5adb-40e7-87e9-c2a230b22898\") " pod="openshift-monitoring/telemeter-client-658dbfff77-j48jw"
Sep 09 21:20:43.773180 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:20:43.773108    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/796a503a-5adb-40e7-87e9-c2a230b22898-telemeter-trusted-ca-bundle\") pod \"telemeter-client-658dbfff77-j48jw\" (UID: \"796a503a-5adb-40e7-87e9-c2a230b22898\") " pod="openshift-monitoring/telemeter-client-658dbfff77-j48jw"
Sep 09 21:20:43.773882 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:20:43.773853    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/796a503a-5adb-40e7-87e9-c2a230b22898-metrics-client-ca\") pod \"telemeter-client-658dbfff77-j48jw\" (UID: \"796a503a-5adb-40e7-87e9-c2a230b22898\") " pod="openshift-monitoring/telemeter-client-658dbfff77-j48jw"
Sep 09 21:20:43.773986 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:20:43.773905    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/796a503a-5adb-40e7-87e9-c2a230b22898-serving-certs-ca-bundle\") pod \"telemeter-client-658dbfff77-j48jw\" (UID: \"796a503a-5adb-40e7-87e9-c2a230b22898\") " pod="openshift-monitoring/telemeter-client-658dbfff77-j48jw"
Sep 09 21:20:43.774343 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:20:43.774317    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/796a503a-5adb-40e7-87e9-c2a230b22898-telemeter-trusted-ca-bundle\") pod \"telemeter-client-658dbfff77-j48jw\" (UID: \"796a503a-5adb-40e7-87e9-c2a230b22898\") " pod="openshift-monitoring/telemeter-client-658dbfff77-j48jw"
Sep 09 21:20:43.775535 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:20:43.775510    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/796a503a-5adb-40e7-87e9-c2a230b22898-federate-client-tls\") pod \"telemeter-client-658dbfff77-j48jw\" (UID: \"796a503a-5adb-40e7-87e9-c2a230b22898\") " pod="openshift-monitoring/telemeter-client-658dbfff77-j48jw"
Sep 09 21:20:43.775641 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:20:43.775626    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/796a503a-5adb-40e7-87e9-c2a230b22898-secret-telemeter-client\") pod \"telemeter-client-658dbfff77-j48jw\" (UID: \"796a503a-5adb-40e7-87e9-c2a230b22898\") " pod="openshift-monitoring/telemeter-client-658dbfff77-j48jw"
Sep 09 21:20:43.775853 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:20:43.775814    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/796a503a-5adb-40e7-87e9-c2a230b22898-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-658dbfff77-j48jw\" (UID: \"796a503a-5adb-40e7-87e9-c2a230b22898\") " pod="openshift-monitoring/telemeter-client-658dbfff77-j48jw"
Sep 09 21:20:43.775949 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:20:43.775933    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/796a503a-5adb-40e7-87e9-c2a230b22898-telemeter-client-tls\") pod \"telemeter-client-658dbfff77-j48jw\" (UID: \"796a503a-5adb-40e7-87e9-c2a230b22898\") " pod="openshift-monitoring/telemeter-client-658dbfff77-j48jw"
Sep 09 21:20:43.785340 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:20:43.785317    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cs56b\" (UniqueName: \"kubernetes.io/projected/796a503a-5adb-40e7-87e9-c2a230b22898-kube-api-access-cs56b\") pod \"telemeter-client-658dbfff77-j48jw\" (UID: \"796a503a-5adb-40e7-87e9-c2a230b22898\") " pod="openshift-monitoring/telemeter-client-658dbfff77-j48jw"
Sep 09 21:20:43.917925 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:20:43.917897    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-658dbfff77-j48jw"
Sep 09 21:20:44.231928 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:20:44.231897    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod796a503a_5adb_40e7_87e9_c2a230b22898.slice/crio-a6dbeccced1675728c6d646bedf74ff25ca13170ce84c7e83270dbbac30ad1c7 WatchSource:0}: Error finding container a6dbeccced1675728c6d646bedf74ff25ca13170ce84c7e83270dbbac30ad1c7: Status 404 returned error can't find the container with id a6dbeccced1675728c6d646bedf74ff25ca13170ce84c7e83270dbbac30ad1c7
Sep 09 21:20:44.232053 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:20:44.231989    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-658dbfff77-j48jw"]
Sep 09 21:20:44.866012 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:20:44.865968    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-658dbfff77-j48jw" event={"ID":"796a503a-5adb-40e7-87e9-c2a230b22898","Type":"ContainerStarted","Data":"a6dbeccced1675728c6d646bedf74ff25ca13170ce84c7e83270dbbac30ad1c7"}
Sep 09 21:20:45.872194 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:20:45.872169    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-658dbfff77-j48jw" event={"ID":"796a503a-5adb-40e7-87e9-c2a230b22898","Type":"ContainerStarted","Data":"9b6ff230c70db2467007843b4bbac55219c7b9f6f2f7a9219e5c56e1a48a5cfb"}
Sep 09 21:20:45.872503 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:20:45.872218    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-658dbfff77-j48jw" event={"ID":"796a503a-5adb-40e7-87e9-c2a230b22898","Type":"ContainerStarted","Data":"c6635b5a3d933bd1ae3edf4b4eb75a7373cf74460024300e078953bc91ff02ed"}
Sep 09 21:20:45.872503 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:20:45.872238    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-658dbfff77-j48jw" event={"ID":"796a503a-5adb-40e7-87e9-c2a230b22898","Type":"ContainerStarted","Data":"782e970b55c8a0212eab8a410e20093ff1b9d5d65adf776e272a270b76ac8ade"}
Sep 09 21:20:45.903482 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:20:45.903436    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-658dbfff77-j48jw" podStartSLOduration=1.475240249 podStartE2EDuration="2.903420299s" totalImagesPullingTime="1.42818005s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:20:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:20:45.90164246 +0000 UTC m=+768.880960595" watchObservedRunningTime="2026-09-09 21:20:45.903420299 +0000 UTC m=+768.882738406"
Sep 09 21:20:46.256679 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:20:46.256642    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:20:46.433716 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:20:46.433680    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:20:46.662059 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:20:46.661978    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:20:46.773687 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:20:46.773656    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:20:53.711961 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:20:53.711916    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:20:53.793416 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:20:53.793385    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:20:57.125056 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:20:57.125004    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:20:57.251398 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:20:57.251366    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:20:57.536475 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:20:57.536445    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:20:57.632838 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:20:57.632794    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:21:05.670483 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:21:05.670451    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:21:05.732398 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:21:05.732370    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:21:07.944090 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:21:07.944057    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:21:08.045028 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:21:08.045000    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:21:08.145572 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:21:08.145538    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:21:09.592280 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:21:09.592248    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:21:09.689695 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:21:09.689665    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:21:43.877749 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:21:43.877708    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:21:44.087345 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:21:44.087285    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:22:16.621836 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:16.621795    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bmn7l"]
Sep 09 21:22:16.624020 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:16.624004    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bmn7l"
Sep 09 21:22:16.628259 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:16.628241    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bq875\""
Sep 09 21:22:16.628876 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:16.628855    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 09 21:22:16.630769 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:16.630750    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 09 21:22:16.644033 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:16.641486    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlqmt\" (UniqueName: \"kubernetes.io/projected/bd997f21-e7c1-4923-b735-71fd8c5ad622-kube-api-access-vlqmt\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bmn7l\" (UID: \"bd997f21-e7c1-4923-b735-71fd8c5ad622\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bmn7l"
Sep 09 21:22:16.644033 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:16.641539    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bd997f21-e7c1-4923-b735-71fd8c5ad622-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bmn7l\" (UID: \"bd997f21-e7c1-4923-b735-71fd8c5ad622\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bmn7l"
Sep 09 21:22:16.644033 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:16.641584    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bd997f21-e7c1-4923-b735-71fd8c5ad622-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bmn7l\" (UID: \"bd997f21-e7c1-4923-b735-71fd8c5ad622\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bmn7l"
Sep 09 21:22:16.647779 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:16.647758    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bmn7l"]
Sep 09 21:22:16.742162 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:16.742137    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlqmt\" (UniqueName: \"kubernetes.io/projected/bd997f21-e7c1-4923-b735-71fd8c5ad622-kube-api-access-vlqmt\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bmn7l\" (UID: \"bd997f21-e7c1-4923-b735-71fd8c5ad622\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bmn7l"
Sep 09 21:22:16.742281 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:16.742169    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bd997f21-e7c1-4923-b735-71fd8c5ad622-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bmn7l\" (UID: \"bd997f21-e7c1-4923-b735-71fd8c5ad622\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bmn7l"
Sep 09 21:22:16.742281 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:16.742193    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bd997f21-e7c1-4923-b735-71fd8c5ad622-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bmn7l\" (UID: \"bd997f21-e7c1-4923-b735-71fd8c5ad622\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bmn7l"
Sep 09 21:22:16.742495 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:16.742477    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bd997f21-e7c1-4923-b735-71fd8c5ad622-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bmn7l\" (UID: \"bd997f21-e7c1-4923-b735-71fd8c5ad622\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bmn7l"
Sep 09 21:22:16.742577 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:16.742555    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bd997f21-e7c1-4923-b735-71fd8c5ad622-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bmn7l\" (UID: \"bd997f21-e7c1-4923-b735-71fd8c5ad622\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bmn7l"
Sep 09 21:22:16.751938 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:16.751912    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlqmt\" (UniqueName: \"kubernetes.io/projected/bd997f21-e7c1-4923-b735-71fd8c5ad622-kube-api-access-vlqmt\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bmn7l\" (UID: \"bd997f21-e7c1-4923-b735-71fd8c5ad622\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bmn7l"
Sep 09 21:22:16.932884 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:16.932851    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bmn7l"
Sep 09 21:22:17.226982 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:17.226897    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bmn7l"]
Sep 09 21:22:17.231217 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:22:17.231188    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd997f21_e7c1_4923_b735_71fd8c5ad622.slice/crio-89bb40f7f7ef9e0bf18bedeb3ba2624c5da04154b646c3ecec25bf5f4d460e12 WatchSource:0}: Error finding container 89bb40f7f7ef9e0bf18bedeb3ba2624c5da04154b646c3ecec25bf5f4d460e12: Status 404 returned error can't find the container with id 89bb40f7f7ef9e0bf18bedeb3ba2624c5da04154b646c3ecec25bf5f4d460e12
Sep 09 21:22:18.197180 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:18.197140    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bmn7l" event={"ID":"bd997f21-e7c1-4923-b735-71fd8c5ad622","Type":"ContainerStarted","Data":"89bb40f7f7ef9e0bf18bedeb3ba2624c5da04154b646c3ecec25bf5f4d460e12"}
Sep 09 21:22:24.221382 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:24.221345    2555 generic.go:356] "Generic (PLEG): container finished" podID="bd997f21-e7c1-4923-b735-71fd8c5ad622" containerID="260583a3928d440f1dfdebce369b78330a4c7e81c05249063271b65f77b6ad63" exitCode=0
Sep 09 21:22:24.221796 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:24.221416    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bmn7l" event={"ID":"bd997f21-e7c1-4923-b735-71fd8c5ad622","Type":"ContainerDied","Data":"260583a3928d440f1dfdebce369b78330a4c7e81c05249063271b65f77b6ad63"}
Sep 09 21:22:27.234370 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:27.234332    2555 generic.go:356] "Generic (PLEG): container finished" podID="bd997f21-e7c1-4923-b735-71fd8c5ad622" containerID="3217a28f04f504e5d094916c8a4d9e53d5eaf9ab2558923bcf4c50e57232b085" exitCode=0
Sep 09 21:22:27.234851 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:27.234393    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bmn7l" event={"ID":"bd997f21-e7c1-4923-b735-71fd8c5ad622","Type":"ContainerDied","Data":"3217a28f04f504e5d094916c8a4d9e53d5eaf9ab2558923bcf4c50e57232b085"}
Sep 09 21:22:35.268997 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:35.268954    2555 generic.go:356] "Generic (PLEG): container finished" podID="bd997f21-e7c1-4923-b735-71fd8c5ad622" containerID="6cfe3715f3b974240154a3632be4660495182e7afbe5934f5701a3a0ec3725fb" exitCode=0
Sep 09 21:22:35.269408 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:35.269034    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bmn7l" event={"ID":"bd997f21-e7c1-4923-b735-71fd8c5ad622","Type":"ContainerDied","Data":"6cfe3715f3b974240154a3632be4660495182e7afbe5934f5701a3a0ec3725fb"}
Sep 09 21:22:36.398139 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:36.398112    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bmn7l"
Sep 09 21:22:36.499070 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:36.499041    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bd997f21-e7c1-4923-b735-71fd8c5ad622-bundle\") pod \"bd997f21-e7c1-4923-b735-71fd8c5ad622\" (UID: \"bd997f21-e7c1-4923-b735-71fd8c5ad622\") "
Sep 09 21:22:36.499212 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:36.499080    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bd997f21-e7c1-4923-b735-71fd8c5ad622-util\") pod \"bd997f21-e7c1-4923-b735-71fd8c5ad622\" (UID: \"bd997f21-e7c1-4923-b735-71fd8c5ad622\") "
Sep 09 21:22:36.499212 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:36.499106    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vlqmt\" (UniqueName: \"kubernetes.io/projected/bd997f21-e7c1-4923-b735-71fd8c5ad622-kube-api-access-vlqmt\") pod \"bd997f21-e7c1-4923-b735-71fd8c5ad622\" (UID: \"bd997f21-e7c1-4923-b735-71fd8c5ad622\") "
Sep 09 21:22:36.499668 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:36.499636    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd997f21-e7c1-4923-b735-71fd8c5ad622-bundle" (OuterVolumeSpecName: "bundle") pod "bd997f21-e7c1-4923-b735-71fd8c5ad622" (UID: "bd997f21-e7c1-4923-b735-71fd8c5ad622"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:22:36.501218 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:36.501193    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd997f21-e7c1-4923-b735-71fd8c5ad622-kube-api-access-vlqmt" (OuterVolumeSpecName: "kube-api-access-vlqmt") pod "bd997f21-e7c1-4923-b735-71fd8c5ad622" (UID: "bd997f21-e7c1-4923-b735-71fd8c5ad622"). InnerVolumeSpecName "kube-api-access-vlqmt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:22:36.503372 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:36.503351    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd997f21-e7c1-4923-b735-71fd8c5ad622-util" (OuterVolumeSpecName: "util") pod "bd997f21-e7c1-4923-b735-71fd8c5ad622" (UID: "bd997f21-e7c1-4923-b735-71fd8c5ad622"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:22:36.599589 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:36.599515    2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bd997f21-e7c1-4923-b735-71fd8c5ad622-bundle\") on node \"ip-10-0-133-235.ec2.internal\" DevicePath \"\""
Sep 09 21:22:36.599589 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:36.599542    2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bd997f21-e7c1-4923-b735-71fd8c5ad622-util\") on node \"ip-10-0-133-235.ec2.internal\" DevicePath \"\""
Sep 09 21:22:36.599589 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:36.599554    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vlqmt\" (UniqueName: \"kubernetes.io/projected/bd997f21-e7c1-4923-b735-71fd8c5ad622-kube-api-access-vlqmt\") on node \"ip-10-0-133-235.ec2.internal\" DevicePath \"\""
Sep 09 21:22:37.278880 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:37.278840    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bmn7l" event={"ID":"bd997f21-e7c1-4923-b735-71fd8c5ad622","Type":"ContainerDied","Data":"89bb40f7f7ef9e0bf18bedeb3ba2624c5da04154b646c3ecec25bf5f4d460e12"}
Sep 09 21:22:37.278880 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:37.278869    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bmn7l"
Sep 09 21:22:37.279085 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:37.278895    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="89bb40f7f7ef9e0bf18bedeb3ba2624c5da04154b646c3ecec25bf5f4d460e12"
Sep 09 21:22:43.182546 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:43.182518    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:22:43.668498 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:43.668468    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:22:45.531444 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:45.531407    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-q4c77"]
Sep 09 21:22:45.531810 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:45.531661    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd997f21-e7c1-4923-b735-71fd8c5ad622" containerName="pull"
Sep 09 21:22:45.531810 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:45.531672    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd997f21-e7c1-4923-b735-71fd8c5ad622" containerName="pull"
Sep 09 21:22:45.531810 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:45.531682    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd997f21-e7c1-4923-b735-71fd8c5ad622" containerName="util"
Sep 09 21:22:45.531810 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:45.531687    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd997f21-e7c1-4923-b735-71fd8c5ad622" containerName="util"
Sep 09 21:22:45.531810 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:45.531704    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd997f21-e7c1-4923-b735-71fd8c5ad622" containerName="extract"
Sep 09 21:22:45.531810 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:45.531710    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd997f21-e7c1-4923-b735-71fd8c5ad622" containerName="extract"
Sep 09 21:22:45.531810 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:45.531751    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd997f21-e7c1-4923-b735-71fd8c5ad622" containerName="extract"
Sep 09 21:22:45.535280 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:45.535263    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-q4c77"
Sep 09 21:22:45.539587 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:45.539565    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 09 21:22:45.540088 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:45.540071    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 09 21:22:45.540159 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:45.540105    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-8d22r\""
Sep 09 21:22:45.551573 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:45.551549    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-q4c77"]
Sep 09 21:22:45.664118 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:45.664082    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf23cbbc-c327-4b17-90db-2c1c340a924f-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-q4c77\" (UID: \"bf23cbbc-c327-4b17-90db-2c1c340a924f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-q4c77"
Sep 09 21:22:45.664283 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:45.664135    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9v48j\" (UniqueName: \"kubernetes.io/projected/bf23cbbc-c327-4b17-90db-2c1c340a924f-kube-api-access-9v48j\") pod \"cert-manager-operator-controller-manager-55c444bf86-q4c77\" (UID: \"bf23cbbc-c327-4b17-90db-2c1c340a924f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-q4c77"
Sep 09 21:22:45.764711 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:45.764677    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf23cbbc-c327-4b17-90db-2c1c340a924f-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-q4c77\" (UID: \"bf23cbbc-c327-4b17-90db-2c1c340a924f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-q4c77"
Sep 09 21:22:45.764859 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:45.764724    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9v48j\" (UniqueName: \"kubernetes.io/projected/bf23cbbc-c327-4b17-90db-2c1c340a924f-kube-api-access-9v48j\") pod \"cert-manager-operator-controller-manager-55c444bf86-q4c77\" (UID: \"bf23cbbc-c327-4b17-90db-2c1c340a924f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-q4c77"
Sep 09 21:22:45.765174 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:45.765156    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf23cbbc-c327-4b17-90db-2c1c340a924f-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-q4c77\" (UID: \"bf23cbbc-c327-4b17-90db-2c1c340a924f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-q4c77"
Sep 09 21:22:45.774970 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:45.774947    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9v48j\" (UniqueName: \"kubernetes.io/projected/bf23cbbc-c327-4b17-90db-2c1c340a924f-kube-api-access-9v48j\") pod \"cert-manager-operator-controller-manager-55c444bf86-q4c77\" (UID: \"bf23cbbc-c327-4b17-90db-2c1c340a924f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-q4c77"
Sep 09 21:22:45.863964 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:45.863890    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-q4c77"
Sep 09 21:22:46.149786 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:46.149759    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-q4c77"]
Sep 09 21:22:46.152618 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:22:46.152594    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf23cbbc_c327_4b17_90db_2c1c340a924f.slice/crio-0d476873809c6fa8cbc72c9c61c8fa71d7197f07603089361b2dd28128b320c6 WatchSource:0}: Error finding container 0d476873809c6fa8cbc72c9c61c8fa71d7197f07603089361b2dd28128b320c6: Status 404 returned error can't find the container with id 0d476873809c6fa8cbc72c9c61c8fa71d7197f07603089361b2dd28128b320c6
Sep 09 21:22:46.312801 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:46.312767    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-q4c77" event={"ID":"bf23cbbc-c327-4b17-90db-2c1c340a924f","Type":"ContainerStarted","Data":"0d476873809c6fa8cbc72c9c61c8fa71d7197f07603089361b2dd28128b320c6"}
Sep 09 21:22:47.292763 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:47.292734    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:22:47.385100 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:47.385069    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:22:48.326066 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:48.326032    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-q4c77" event={"ID":"bf23cbbc-c327-4b17-90db-2c1c340a924f","Type":"ContainerStarted","Data":"6ba7c0fea3f8b5e7bbf1677ffd637c322ec327277e370acba027e5055e81410d"}
Sep 09 21:22:48.419629 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:48.419575    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-q4c77" podStartSLOduration=1.8728989660000002 podStartE2EDuration="3.419561543s" totalImagesPullingTime="1.546662577s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:22:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:22:48.419560163 +0000 UTC m=+891.398878275" watchObservedRunningTime="2026-09-09 21:22:48.419561543 +0000 UTC m=+891.398879655"
Sep 09 21:22:49.051063 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:49.051031    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:22:49.216741 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:49.216701    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:22:49.371271 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:49.371201    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc4bkx"]
Sep 09 21:22:49.373396 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:49.373380    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc4bkx"
Sep 09 21:22:49.376267 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:22:49.376238    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc4bkx\" is forbidden: User \"system:node:ip-10-0-133-235.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-marketplace\": no relationship found between node 'ip-10-0-133-235.ec2.internal' and this object" podUID="ef2bc80d-6fb7-43c2-b2ef-6e4be0d8e760" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc4bkx"
Sep 09 21:22:49.376442 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:49.376348    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 09 21:22:49.376442 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:49.376359    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 09 21:22:49.377428 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:49.377403    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bq875\""
Sep 09 21:22:49.407509 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:49.407484    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc4bkx"]
Sep 09 21:22:49.489688 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:49.489658    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:22:49.494247 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:49.494219    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vglws\" (UniqueName: \"kubernetes.io/projected/ef2bc80d-6fb7-43c2-b2ef-6e4be0d8e760-kube-api-access-vglws\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc4bkx\" (UID: \"ef2bc80d-6fb7-43c2-b2ef-6e4be0d8e760\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc4bkx"
Sep 09 21:22:49.494359 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:49.494261    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef2bc80d-6fb7-43c2-b2ef-6e4be0d8e760-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc4bkx\" (UID: \"ef2bc80d-6fb7-43c2-b2ef-6e4be0d8e760\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc4bkx"
Sep 09 21:22:49.494359 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:49.494351    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef2bc80d-6fb7-43c2-b2ef-6e4be0d8e760-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc4bkx\" (UID: \"ef2bc80d-6fb7-43c2-b2ef-6e4be0d8e760\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc4bkx"
Sep 09 21:22:49.595493 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:49.595468    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vglws\" (UniqueName: \"kubernetes.io/projected/ef2bc80d-6fb7-43c2-b2ef-6e4be0d8e760-kube-api-access-vglws\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc4bkx\" (UID: \"ef2bc80d-6fb7-43c2-b2ef-6e4be0d8e760\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc4bkx"
Sep 09 21:22:49.595613 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:49.595499    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef2bc80d-6fb7-43c2-b2ef-6e4be0d8e760-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc4bkx\" (UID: \"ef2bc80d-6fb7-43c2-b2ef-6e4be0d8e760\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc4bkx"
Sep 09 21:22:49.595613 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:49.595538    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef2bc80d-6fb7-43c2-b2ef-6e4be0d8e760-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc4bkx\" (UID: \"ef2bc80d-6fb7-43c2-b2ef-6e4be0d8e760\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc4bkx"
Sep 09 21:22:49.595838 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:49.595807    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef2bc80d-6fb7-43c2-b2ef-6e4be0d8e760-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc4bkx\" (UID: \"ef2bc80d-6fb7-43c2-b2ef-6e4be0d8e760\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc4bkx"
Sep 09 21:22:49.595922 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:49.595860    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef2bc80d-6fb7-43c2-b2ef-6e4be0d8e760-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc4bkx\" (UID: \"ef2bc80d-6fb7-43c2-b2ef-6e4be0d8e760\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc4bkx"
Sep 09 21:22:49.621349 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:49.621296    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vglws\" (UniqueName: \"kubernetes.io/projected/ef2bc80d-6fb7-43c2-b2ef-6e4be0d8e760-kube-api-access-vglws\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc4bkx\" (UID: \"ef2bc80d-6fb7-43c2-b2ef-6e4be0d8e760\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc4bkx"
Sep 09 21:22:49.653790 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:49.653768    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:22:49.683288 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:49.683266    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc4bkx"
Sep 09 21:22:50.000075 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:50.000053    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc4bkx"]
Sep 09 21:22:50.001967 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:22:50.001941    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef2bc80d_6fb7_43c2_b2ef_6e4be0d8e760.slice/crio-a5c4f142fdcf34a78fead496a04521667676c1ccc2e8678266a631770cc7ece6 WatchSource:0}: Error finding container a5c4f142fdcf34a78fead496a04521667676c1ccc2e8678266a631770cc7ece6: Status 404 returned error can't find the container with id a5c4f142fdcf34a78fead496a04521667676c1ccc2e8678266a631770cc7ece6
Sep 09 21:22:50.335850 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:50.335753    2555 generic.go:356] "Generic (PLEG): container finished" podID="ef2bc80d-6fb7-43c2-b2ef-6e4be0d8e760" containerID="79d954c17d2444ed47d15a9913274fe32509caac38f87bf14e51d348b4e48686" exitCode=0
Sep 09 21:22:50.335992 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:50.335858    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc4bkx" event={"ID":"ef2bc80d-6fb7-43c2-b2ef-6e4be0d8e760","Type":"ContainerDied","Data":"79d954c17d2444ed47d15a9913274fe32509caac38f87bf14e51d348b4e48686"}
Sep 09 21:22:50.335992 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:50.335918    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc4bkx" event={"ID":"ef2bc80d-6fb7-43c2-b2ef-6e4be0d8e760","Type":"ContainerStarted","Data":"a5c4f142fdcf34a78fead496a04521667676c1ccc2e8678266a631770cc7ece6"}
Sep 09 21:22:51.909793 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:51.909756    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:22:52.138718 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:52.138684    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:22:52.188228 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:52.188200    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-dp6p8"]
Sep 09 21:22:52.194496 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:52.194475    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-dp6p8"
Sep 09 21:22:52.198061 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:52.198037    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-2r29c\""
Sep 09 21:22:52.198617 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:52.198601    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 09 21:22:52.199025 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:52.199006    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 09 21:22:52.213744 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:52.213720    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-dp6p8"]
Sep 09 21:22:52.316743 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:52.316702    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27jdg\" (UniqueName: \"kubernetes.io/projected/bbc4e92e-20c7-4b63-ba6f-fe83777c3ad5-kube-api-access-27jdg\") pod \"cert-manager-cainjector-559cdd8c87-dp6p8\" (UID: \"bbc4e92e-20c7-4b63-ba6f-fe83777c3ad5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-dp6p8"
Sep 09 21:22:52.316921 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:52.316796    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bbc4e92e-20c7-4b63-ba6f-fe83777c3ad5-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-dp6p8\" (UID: \"bbc4e92e-20c7-4b63-ba6f-fe83777c3ad5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-dp6p8"
Sep 09 21:22:52.418012 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:52.417976    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27jdg\" (UniqueName: \"kubernetes.io/projected/bbc4e92e-20c7-4b63-ba6f-fe83777c3ad5-kube-api-access-27jdg\") pod \"cert-manager-cainjector-559cdd8c87-dp6p8\" (UID: \"bbc4e92e-20c7-4b63-ba6f-fe83777c3ad5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-dp6p8"
Sep 09 21:22:52.418197 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:52.418045    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bbc4e92e-20c7-4b63-ba6f-fe83777c3ad5-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-dp6p8\" (UID: \"bbc4e92e-20c7-4b63-ba6f-fe83777c3ad5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-dp6p8"
Sep 09 21:22:52.435686 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:52.435657    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bbc4e92e-20c7-4b63-ba6f-fe83777c3ad5-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-dp6p8\" (UID: \"bbc4e92e-20c7-4b63-ba6f-fe83777c3ad5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-dp6p8"
Sep 09 21:22:52.435865 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:52.435772    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27jdg\" (UniqueName: \"kubernetes.io/projected/bbc4e92e-20c7-4b63-ba6f-fe83777c3ad5-kube-api-access-27jdg\") pod \"cert-manager-cainjector-559cdd8c87-dp6p8\" (UID: \"bbc4e92e-20c7-4b63-ba6f-fe83777c3ad5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-dp6p8"
Sep 09 21:22:52.505469 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:52.505384    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-dp6p8"
Sep 09 21:22:52.807362 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:52.807297    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-dp6p8"]
Sep 09 21:22:52.809770 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:22:52.809745    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbbc4e92e_20c7_4b63_ba6f_fe83777c3ad5.slice/crio-2932106d2676a51245efcc7efc62385b5d345f84e8b7cbee62bdb4f761b1fa9a WatchSource:0}: Error finding container 2932106d2676a51245efcc7efc62385b5d345f84e8b7cbee62bdb4f761b1fa9a: Status 404 returned error can't find the container with id 2932106d2676a51245efcc7efc62385b5d345f84e8b7cbee62bdb4f761b1fa9a
Sep 09 21:22:53.350140 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:53.350104    2555 generic.go:356] "Generic (PLEG): container finished" podID="ef2bc80d-6fb7-43c2-b2ef-6e4be0d8e760" containerID="31fd5f8846143452ba1d1ee944ccdbdd2d176397c06c1da3416329236b5c8dab" exitCode=0
Sep 09 21:22:53.350590 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:53.350188    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc4bkx" event={"ID":"ef2bc80d-6fb7-43c2-b2ef-6e4be0d8e760","Type":"ContainerDied","Data":"31fd5f8846143452ba1d1ee944ccdbdd2d176397c06c1da3416329236b5c8dab"}
Sep 09 21:22:53.351372 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:53.351352    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-dp6p8" event={"ID":"bbc4e92e-20c7-4b63-ba6f-fe83777c3ad5","Type":"ContainerStarted","Data":"2932106d2676a51245efcc7efc62385b5d345f84e8b7cbee62bdb4f761b1fa9a"}
Sep 09 21:22:54.183518 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:54.183484    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:22:54.289899 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:54.289868    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:22:54.358204 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:54.358167    2555 generic.go:356] "Generic (PLEG): container finished" podID="ef2bc80d-6fb7-43c2-b2ef-6e4be0d8e760" containerID="88ffdea08f923b8bbc9d3ec01b205ace944fd63e781629b296c2951a4944e2f3" exitCode=0
Sep 09 21:22:54.358645 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:54.358219    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc4bkx" event={"ID":"ef2bc80d-6fb7-43c2-b2ef-6e4be0d8e760","Type":"ContainerDied","Data":"88ffdea08f923b8bbc9d3ec01b205ace944fd63e781629b296c2951a4944e2f3"}
Sep 09 21:22:55.364634 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:55.364466    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-dp6p8" event={"ID":"bbc4e92e-20c7-4b63-ba6f-fe83777c3ad5","Type":"ContainerStarted","Data":"e8e675189a2b84488bf331eb51171844f269cc2bdd5a0e7d9d9b6c23423acf75"}
Sep 09 21:22:55.390108 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:55.389963    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-dp6p8" podStartSLOduration=0.913607834 podStartE2EDuration="3.389940712s" totalImagesPullingTime="2.476332878s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:22:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:22:55.387576931 +0000 UTC m=+898.366895044" watchObservedRunningTime="2026-09-09 21:22:55.389940712 +0000 UTC m=+898.369258830"
Sep 09 21:22:55.490525 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:55.490501    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc4bkx"
Sep 09 21:22:55.644296 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:55.644209    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef2bc80d-6fb7-43c2-b2ef-6e4be0d8e760-util\") pod \"ef2bc80d-6fb7-43c2-b2ef-6e4be0d8e760\" (UID: \"ef2bc80d-6fb7-43c2-b2ef-6e4be0d8e760\") "
Sep 09 21:22:55.644296 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:55.644290    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vglws\" (UniqueName: \"kubernetes.io/projected/ef2bc80d-6fb7-43c2-b2ef-6e4be0d8e760-kube-api-access-vglws\") pod \"ef2bc80d-6fb7-43c2-b2ef-6e4be0d8e760\" (UID: \"ef2bc80d-6fb7-43c2-b2ef-6e4be0d8e760\") "
Sep 09 21:22:55.644534 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:55.644315    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef2bc80d-6fb7-43c2-b2ef-6e4be0d8e760-bundle\") pod \"ef2bc80d-6fb7-43c2-b2ef-6e4be0d8e760\" (UID: \"ef2bc80d-6fb7-43c2-b2ef-6e4be0d8e760\") "
Sep 09 21:22:55.644853 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:55.644809    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef2bc80d-6fb7-43c2-b2ef-6e4be0d8e760-bundle" (OuterVolumeSpecName: "bundle") pod "ef2bc80d-6fb7-43c2-b2ef-6e4be0d8e760" (UID: "ef2bc80d-6fb7-43c2-b2ef-6e4be0d8e760"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:22:55.646410 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:55.646384    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef2bc80d-6fb7-43c2-b2ef-6e4be0d8e760-kube-api-access-vglws" (OuterVolumeSpecName: "kube-api-access-vglws") pod "ef2bc80d-6fb7-43c2-b2ef-6e4be0d8e760" (UID: "ef2bc80d-6fb7-43c2-b2ef-6e4be0d8e760"). InnerVolumeSpecName "kube-api-access-vglws". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:22:55.649376 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:55.649353    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef2bc80d-6fb7-43c2-b2ef-6e4be0d8e760-util" (OuterVolumeSpecName: "util") pod "ef2bc80d-6fb7-43c2-b2ef-6e4be0d8e760" (UID: "ef2bc80d-6fb7-43c2-b2ef-6e4be0d8e760"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:22:55.745693 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:55.745664    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vglws\" (UniqueName: \"kubernetes.io/projected/ef2bc80d-6fb7-43c2-b2ef-6e4be0d8e760-kube-api-access-vglws\") on node \"ip-10-0-133-235.ec2.internal\" DevicePath \"\""
Sep 09 21:22:55.745693 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:55.745687    2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef2bc80d-6fb7-43c2-b2ef-6e4be0d8e760-bundle\") on node \"ip-10-0-133-235.ec2.internal\" DevicePath \"\""
Sep 09 21:22:55.745693 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:55.745697    2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef2bc80d-6fb7-43c2-b2ef-6e4be0d8e760-util\") on node \"ip-10-0-133-235.ec2.internal\" DevicePath \"\""
Sep 09 21:22:56.370492 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:56.370464    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc4bkx"
Sep 09 21:22:56.370492 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:56.370488    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc4bkx" event={"ID":"ef2bc80d-6fb7-43c2-b2ef-6e4be0d8e760","Type":"ContainerDied","Data":"a5c4f142fdcf34a78fead496a04521667676c1ccc2e8678266a631770cc7ece6"}
Sep 09 21:22:56.370956 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:56.370530    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a5c4f142fdcf34a78fead496a04521667676c1ccc2e8678266a631770cc7ece6"
Sep 09 21:22:57.607168 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:57.607137    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:22:57.694758 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:57.694728    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:22:59.467520 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:22:59.467492    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:23:00.533353 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:00.533324    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:23:00.662056 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:00.662021    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:23:01.878014 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:01.877979    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2qpc5"]
Sep 09 21:23:01.878356 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:01.878271    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef2bc80d-6fb7-43c2-b2ef-6e4be0d8e760" containerName="util"
Sep 09 21:23:01.878356 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:01.878282    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef2bc80d-6fb7-43c2-b2ef-6e4be0d8e760" containerName="util"
Sep 09 21:23:01.878356 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:01.878298    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef2bc80d-6fb7-43c2-b2ef-6e4be0d8e760" containerName="pull"
Sep 09 21:23:01.878356 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:01.878303    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef2bc80d-6fb7-43c2-b2ef-6e4be0d8e760" containerName="pull"
Sep 09 21:23:01.878356 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:01.878310    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef2bc80d-6fb7-43c2-b2ef-6e4be0d8e760" containerName="extract"
Sep 09 21:23:01.878356 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:01.878315    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef2bc80d-6fb7-43c2-b2ef-6e4be0d8e760" containerName="extract"
Sep 09 21:23:01.878356 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:01.878358    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef2bc80d-6fb7-43c2-b2ef-6e4be0d8e760" containerName="extract"
Sep 09 21:23:01.880268 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:01.880238    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2qpc5"
Sep 09 21:23:01.884919 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:01.884895    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 09 21:23:01.885055 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:01.884900    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-nzdjv\""
Sep 09 21:23:01.885902 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:01.885881    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 09 21:23:01.891144 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:01.891122    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2qpc5"]
Sep 09 21:23:01.991249 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:01.991224    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e8f8af28-0545-4772-bc66-0ee3aa635744-tmp\") pod \"openshift-lws-operator-fd8ccff4c-2qpc5\" (UID: \"e8f8af28-0545-4772-bc66-0ee3aa635744\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2qpc5"
Sep 09 21:23:01.991375 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:01.991273    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cb96\" (UniqueName: \"kubernetes.io/projected/e8f8af28-0545-4772-bc66-0ee3aa635744-kube-api-access-4cb96\") pod \"openshift-lws-operator-fd8ccff4c-2qpc5\" (UID: \"e8f8af28-0545-4772-bc66-0ee3aa635744\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2qpc5"
Sep 09 21:23:02.092061 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:02.092027    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e8f8af28-0545-4772-bc66-0ee3aa635744-tmp\") pod \"openshift-lws-operator-fd8ccff4c-2qpc5\" (UID: \"e8f8af28-0545-4772-bc66-0ee3aa635744\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2qpc5"
Sep 09 21:23:02.092209 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:02.092091    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cb96\" (UniqueName: \"kubernetes.io/projected/e8f8af28-0545-4772-bc66-0ee3aa635744-kube-api-access-4cb96\") pod \"openshift-lws-operator-fd8ccff4c-2qpc5\" (UID: \"e8f8af28-0545-4772-bc66-0ee3aa635744\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2qpc5"
Sep 09 21:23:02.092531 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:02.092512    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e8f8af28-0545-4772-bc66-0ee3aa635744-tmp\") pod \"openshift-lws-operator-fd8ccff4c-2qpc5\" (UID: \"e8f8af28-0545-4772-bc66-0ee3aa635744\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2qpc5"
Sep 09 21:23:02.101931 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:02.101909    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cb96\" (UniqueName: \"kubernetes.io/projected/e8f8af28-0545-4772-bc66-0ee3aa635744-kube-api-access-4cb96\") pod \"openshift-lws-operator-fd8ccff4c-2qpc5\" (UID: \"e8f8af28-0545-4772-bc66-0ee3aa635744\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2qpc5"
Sep 09 21:23:02.189138 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:02.189108    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2qpc5"
Sep 09 21:23:02.467447 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:02.467426    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2qpc5"]
Sep 09 21:23:02.469498 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:23:02.469460    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode8f8af28_0545_4772_bc66_0ee3aa635744.slice/crio-7bcf34cccb223287551c413794ec76a6ce608a0ed025542aaa3503e1a9e1b0c4 WatchSource:0}: Error finding container 7bcf34cccb223287551c413794ec76a6ce608a0ed025542aaa3503e1a9e1b0c4: Status 404 returned error can't find the container with id 7bcf34cccb223287551c413794ec76a6ce608a0ed025542aaa3503e1a9e1b0c4
Sep 09 21:23:03.400184 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:03.400149    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2qpc5" event={"ID":"e8f8af28-0545-4772-bc66-0ee3aa635744","Type":"ContainerStarted","Data":"7bcf34cccb223287551c413794ec76a6ce608a0ed025542aaa3503e1a9e1b0c4"}
Sep 09 21:23:05.410292 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:05.410251    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2qpc5" event={"ID":"e8f8af28-0545-4772-bc66-0ee3aa635744","Type":"ContainerStarted","Data":"8c5982755352ad503027bfc60e01b995161586053b28829982f1eaa3d0aa9985"}
Sep 09 21:23:05.432355 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:05.432296    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2qpc5" podStartSLOduration=2.124520121 podStartE2EDuration="4.432276678s" totalImagesPullingTime="2.307756557s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:23:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:23:05.431022756 +0000 UTC m=+908.410340869" watchObservedRunningTime="2026-09-09 21:23:05.432276678 +0000 UTC m=+908.411594793"
Sep 09 21:23:06.218859 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:06.218809    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:23:06.317278 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:06.317248    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:23:07.617023 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:07.616994    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affqhbj"]
Sep 09 21:23:07.619835 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:07.619805    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affqhbj"
Sep 09 21:23:07.622464 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:07.622443    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bq875\""
Sep 09 21:23:07.622578 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:07.622447    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 09 21:23:07.622578 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:07.622449    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 09 21:23:07.629209 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:07.629189    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affqhbj"]
Sep 09 21:23:07.741101 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:07.741070    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdqkd\" (UniqueName: \"kubernetes.io/projected/1e7a0895-bbcd-44bc-97a6-b9f0a5cdfc98-kube-api-access-sdqkd\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affqhbj\" (UID: \"1e7a0895-bbcd-44bc-97a6-b9f0a5cdfc98\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affqhbj"
Sep 09 21:23:07.741285 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:07.741109    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e7a0895-bbcd-44bc-97a6-b9f0a5cdfc98-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affqhbj\" (UID: \"1e7a0895-bbcd-44bc-97a6-b9f0a5cdfc98\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affqhbj"
Sep 09 21:23:07.741285 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:07.741127    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e7a0895-bbcd-44bc-97a6-b9f0a5cdfc98-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affqhbj\" (UID: \"1e7a0895-bbcd-44bc-97a6-b9f0a5cdfc98\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affqhbj"
Sep 09 21:23:07.842482 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:07.842446    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdqkd\" (UniqueName: \"kubernetes.io/projected/1e7a0895-bbcd-44bc-97a6-b9f0a5cdfc98-kube-api-access-sdqkd\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affqhbj\" (UID: \"1e7a0895-bbcd-44bc-97a6-b9f0a5cdfc98\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affqhbj"
Sep 09 21:23:07.842482 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:07.842494    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e7a0895-bbcd-44bc-97a6-b9f0a5cdfc98-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affqhbj\" (UID: \"1e7a0895-bbcd-44bc-97a6-b9f0a5cdfc98\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affqhbj"
Sep 09 21:23:07.842703 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:07.842518    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e7a0895-bbcd-44bc-97a6-b9f0a5cdfc98-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affqhbj\" (UID: \"1e7a0895-bbcd-44bc-97a6-b9f0a5cdfc98\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affqhbj"
Sep 09 21:23:07.842946 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:07.842927    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e7a0895-bbcd-44bc-97a6-b9f0a5cdfc98-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affqhbj\" (UID: \"1e7a0895-bbcd-44bc-97a6-b9f0a5cdfc98\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affqhbj"
Sep 09 21:23:07.842997 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:07.842957    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e7a0895-bbcd-44bc-97a6-b9f0a5cdfc98-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affqhbj\" (UID: \"1e7a0895-bbcd-44bc-97a6-b9f0a5cdfc98\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affqhbj"
Sep 09 21:23:07.854058 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:07.854030    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdqkd\" (UniqueName: \"kubernetes.io/projected/1e7a0895-bbcd-44bc-97a6-b9f0a5cdfc98-kube-api-access-sdqkd\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affqhbj\" (UID: \"1e7a0895-bbcd-44bc-97a6-b9f0a5cdfc98\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affqhbj"
Sep 09 21:23:07.928987 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:07.928954    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affqhbj"
Sep 09 21:23:08.205664 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:08.205588    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affqhbj"]
Sep 09 21:23:08.208590 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:23:08.208563    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e7a0895_bbcd_44bc_97a6_b9f0a5cdfc98.slice/crio-cb474564435f7b453e57cddf8092a49fc8b9a664a5fcd34fba7c1b3a5632c498 WatchSource:0}: Error finding container cb474564435f7b453e57cddf8092a49fc8b9a664a5fcd34fba7c1b3a5632c498: Status 404 returned error can't find the container with id cb474564435f7b453e57cddf8092a49fc8b9a664a5fcd34fba7c1b3a5632c498
Sep 09 21:23:08.423687 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:08.423649    2555 generic.go:356] "Generic (PLEG): container finished" podID="1e7a0895-bbcd-44bc-97a6-b9f0a5cdfc98" containerID="7ab0f199b9f8b95f92fa996f35730b7d3eb73d57cfa21beeaafce19f972034f1" exitCode=0
Sep 09 21:23:08.423883 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:08.423708    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affqhbj" event={"ID":"1e7a0895-bbcd-44bc-97a6-b9f0a5cdfc98","Type":"ContainerDied","Data":"7ab0f199b9f8b95f92fa996f35730b7d3eb73d57cfa21beeaafce19f972034f1"}
Sep 09 21:23:08.423883 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:08.423748    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affqhbj" event={"ID":"1e7a0895-bbcd-44bc-97a6-b9f0a5cdfc98","Type":"ContainerStarted","Data":"cb474564435f7b453e57cddf8092a49fc8b9a664a5fcd34fba7c1b3a5632c498"}
Sep 09 21:23:08.623154 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:08.623077    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:23:09.429462 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:09.429430    2555 generic.go:356] "Generic (PLEG): container finished" podID="1e7a0895-bbcd-44bc-97a6-b9f0a5cdfc98" containerID="220d15953bda68bea5e2fb85142aaaef10b305a76b42bd6e92ed75e66f8c1dea" exitCode=0
Sep 09 21:23:09.429628 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:09.429470    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affqhbj" event={"ID":"1e7a0895-bbcd-44bc-97a6-b9f0a5cdfc98","Type":"ContainerDied","Data":"220d15953bda68bea5e2fb85142aaaef10b305a76b42bd6e92ed75e66f8c1dea"}
Sep 09 21:23:10.435727 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:10.435694    2555 generic.go:356] "Generic (PLEG): container finished" podID="1e7a0895-bbcd-44bc-97a6-b9f0a5cdfc98" containerID="09ced06a9fcda5bf4ac4d47a9bbedcc08b0204c428ea57b9ef2f790175adbae5" exitCode=0
Sep 09 21:23:10.435727 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:10.435729    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affqhbj" event={"ID":"1e7a0895-bbcd-44bc-97a6-b9f0a5cdfc98","Type":"ContainerDied","Data":"09ced06a9fcda5bf4ac4d47a9bbedcc08b0204c428ea57b9ef2f790175adbae5"}
Sep 09 21:23:11.562647 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:11.562625    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affqhbj"
Sep 09 21:23:11.665134 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:11.665107    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e7a0895-bbcd-44bc-97a6-b9f0a5cdfc98-bundle\") pod \"1e7a0895-bbcd-44bc-97a6-b9f0a5cdfc98\" (UID: \"1e7a0895-bbcd-44bc-97a6-b9f0a5cdfc98\") "
Sep 09 21:23:11.665277 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:11.665160    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sdqkd\" (UniqueName: \"kubernetes.io/projected/1e7a0895-bbcd-44bc-97a6-b9f0a5cdfc98-kube-api-access-sdqkd\") pod \"1e7a0895-bbcd-44bc-97a6-b9f0a5cdfc98\" (UID: \"1e7a0895-bbcd-44bc-97a6-b9f0a5cdfc98\") "
Sep 09 21:23:11.665277 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:11.665234    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e7a0895-bbcd-44bc-97a6-b9f0a5cdfc98-util\") pod \"1e7a0895-bbcd-44bc-97a6-b9f0a5cdfc98\" (UID: \"1e7a0895-bbcd-44bc-97a6-b9f0a5cdfc98\") "
Sep 09 21:23:11.665917 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:11.665877    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e7a0895-bbcd-44bc-97a6-b9f0a5cdfc98-bundle" (OuterVolumeSpecName: "bundle") pod "1e7a0895-bbcd-44bc-97a6-b9f0a5cdfc98" (UID: "1e7a0895-bbcd-44bc-97a6-b9f0a5cdfc98"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:23:11.667247 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:11.667215    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e7a0895-bbcd-44bc-97a6-b9f0a5cdfc98-kube-api-access-sdqkd" (OuterVolumeSpecName: "kube-api-access-sdqkd") pod "1e7a0895-bbcd-44bc-97a6-b9f0a5cdfc98" (UID: "1e7a0895-bbcd-44bc-97a6-b9f0a5cdfc98"). InnerVolumeSpecName "kube-api-access-sdqkd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:23:11.673524 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:11.673501    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e7a0895-bbcd-44bc-97a6-b9f0a5cdfc98-util" (OuterVolumeSpecName: "util") pod "1e7a0895-bbcd-44bc-97a6-b9f0a5cdfc98" (UID: "1e7a0895-bbcd-44bc-97a6-b9f0a5cdfc98"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:23:11.766763 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:11.766696    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sdqkd\" (UniqueName: \"kubernetes.io/projected/1e7a0895-bbcd-44bc-97a6-b9f0a5cdfc98-kube-api-access-sdqkd\") on node \"ip-10-0-133-235.ec2.internal\" DevicePath \"\""
Sep 09 21:23:11.766763 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:11.766722    2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e7a0895-bbcd-44bc-97a6-b9f0a5cdfc98-util\") on node \"ip-10-0-133-235.ec2.internal\" DevicePath \"\""
Sep 09 21:23:11.766763 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:11.766731    2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e7a0895-bbcd-44bc-97a6-b9f0a5cdfc98-bundle\") on node \"ip-10-0-133-235.ec2.internal\" DevicePath \"\""
Sep 09 21:23:12.446427 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:12.446397    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affqhbj"
Sep 09 21:23:12.446427 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:12.446403    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affqhbj" event={"ID":"1e7a0895-bbcd-44bc-97a6-b9f0a5cdfc98","Type":"ContainerDied","Data":"cb474564435f7b453e57cddf8092a49fc8b9a664a5fcd34fba7c1b3a5632c498"}
Sep 09 21:23:12.446630 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:12.446452    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cb474564435f7b453e57cddf8092a49fc8b9a664a5fcd34fba7c1b3a5632c498"
Sep 09 21:23:21.446865 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:21.446832    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rwqkz"]
Sep 09 21:23:21.447273 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:21.447127    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e7a0895-bbcd-44bc-97a6-b9f0a5cdfc98" containerName="extract"
Sep 09 21:23:21.447273 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:21.447139    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e7a0895-bbcd-44bc-97a6-b9f0a5cdfc98" containerName="extract"
Sep 09 21:23:21.447273 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:21.447158    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e7a0895-bbcd-44bc-97a6-b9f0a5cdfc98" containerName="pull"
Sep 09 21:23:21.447273 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:21.447163    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e7a0895-bbcd-44bc-97a6-b9f0a5cdfc98" containerName="pull"
Sep 09 21:23:21.447273 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:21.447171    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e7a0895-bbcd-44bc-97a6-b9f0a5cdfc98" containerName="util"
Sep 09 21:23:21.447273 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:21.447176    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e7a0895-bbcd-44bc-97a6-b9f0a5cdfc98" containerName="util"
Sep 09 21:23:21.447273 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:21.447221    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e7a0895-bbcd-44bc-97a6-b9f0a5cdfc98" containerName="extract"
Sep 09 21:23:21.450184 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:21.450167    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rwqkz"
Sep 09 21:23:21.454474 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:21.454447    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 09 21:23:21.454584 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:21.454536    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bq875\""
Sep 09 21:23:21.455562 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:21.455542    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 09 21:23:21.466390 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:21.466368    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rwqkz"]
Sep 09 21:23:21.638323 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:21.638289    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:23:21.640426 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:21.640407    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/747d33a1-969d-421c-abe5-44b3f6309536-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rwqkz\" (UID: \"747d33a1-969d-421c-abe5-44b3f6309536\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rwqkz"
Sep 09 21:23:21.640487 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:21.640451    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwskb\" (UniqueName: \"kubernetes.io/projected/747d33a1-969d-421c-abe5-44b3f6309536-kube-api-access-bwskb\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rwqkz\" (UID: \"747d33a1-969d-421c-abe5-44b3f6309536\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rwqkz"
Sep 09 21:23:21.640544 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:21.640526    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/747d33a1-969d-421c-abe5-44b3f6309536-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rwqkz\" (UID: \"747d33a1-969d-421c-abe5-44b3f6309536\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rwqkz"
Sep 09 21:23:21.741784 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:21.741712    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/747d33a1-969d-421c-abe5-44b3f6309536-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rwqkz\" (UID: \"747d33a1-969d-421c-abe5-44b3f6309536\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rwqkz"
Sep 09 21:23:21.741784 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:21.741763    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/747d33a1-969d-421c-abe5-44b3f6309536-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rwqkz\" (UID: \"747d33a1-969d-421c-abe5-44b3f6309536\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rwqkz"
Sep 09 21:23:21.741959 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:21.741789    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwskb\" (UniqueName: \"kubernetes.io/projected/747d33a1-969d-421c-abe5-44b3f6309536-kube-api-access-bwskb\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rwqkz\" (UID: \"747d33a1-969d-421c-abe5-44b3f6309536\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rwqkz"
Sep 09 21:23:21.742099 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:21.742082    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/747d33a1-969d-421c-abe5-44b3f6309536-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rwqkz\" (UID: \"747d33a1-969d-421c-abe5-44b3f6309536\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rwqkz"
Sep 09 21:23:21.742147 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:21.742102    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/747d33a1-969d-421c-abe5-44b3f6309536-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rwqkz\" (UID: \"747d33a1-969d-421c-abe5-44b3f6309536\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rwqkz"
Sep 09 21:23:21.774536 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:21.774516    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwskb\" (UniqueName: \"kubernetes.io/projected/747d33a1-969d-421c-abe5-44b3f6309536-kube-api-access-bwskb\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rwqkz\" (UID: \"747d33a1-969d-421c-abe5-44b3f6309536\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rwqkz"
Sep 09 21:23:22.058959 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:22.058865    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rwqkz"
Sep 09 21:23:22.412099 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:22.412069    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rwqkz"]
Sep 09 21:23:22.413504 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:23:22.413479    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod747d33a1_969d_421c_abe5_44b3f6309536.slice/crio-3890b812b2131f926269b6ec9766690ba523ae1ba041f4bea5878f9f0328b0ff WatchSource:0}: Error finding container 3890b812b2131f926269b6ec9766690ba523ae1ba041f4bea5878f9f0328b0ff: Status 404 returned error can't find the container with id 3890b812b2131f926269b6ec9766690ba523ae1ba041f4bea5878f9f0328b0ff
Sep 09 21:23:22.488482 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:22.488452    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rwqkz" event={"ID":"747d33a1-969d-421c-abe5-44b3f6309536","Type":"ContainerStarted","Data":"c42cf3614fd02ae7f45747ee107c21d780439f19d5b9cf02a9963babbbae00c7"}
Sep 09 21:23:22.488799 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:22.488502    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rwqkz" event={"ID":"747d33a1-969d-421c-abe5-44b3f6309536","Type":"ContainerStarted","Data":"3890b812b2131f926269b6ec9766690ba523ae1ba041f4bea5878f9f0328b0ff"}
Sep 09 21:23:23.259494 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:23.259466    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:23:23.391937 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:23.391907    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:23:23.494314 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:23.494274    2555 generic.go:356] "Generic (PLEG): container finished" podID="747d33a1-969d-421c-abe5-44b3f6309536" containerID="c42cf3614fd02ae7f45747ee107c21d780439f19d5b9cf02a9963babbbae00c7" exitCode=0
Sep 09 21:23:23.494780 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:23.494333    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rwqkz" event={"ID":"747d33a1-969d-421c-abe5-44b3f6309536","Type":"ContainerDied","Data":"c42cf3614fd02ae7f45747ee107c21d780439f19d5b9cf02a9963babbbae00c7"}
Sep 09 21:23:23.526527 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:23.526469    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:23:23.554475 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:23.554446    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79ffd8f657-rpx4w"]
Sep 09 21:23:23.556808 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:23.556792    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79ffd8f657-rpx4w"
Sep 09 21:23:23.562903 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:23.562847    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 09 21:23:23.563295 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:23.563153    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-z4nj8\""
Sep 09 21:23:23.565137 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:23.565119    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 09 21:23:23.565293 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:23.565274    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 09 21:23:23.565372 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:23.565339    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 09 21:23:23.589232 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:23.589212    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79ffd8f657-rpx4w"]
Sep 09 21:23:23.657103 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:23.657062    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/72bbd3dc-cacc-4f2e-a2d5-b9e417c73b3f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79ffd8f657-rpx4w\" (UID: \"72bbd3dc-cacc-4f2e-a2d5-b9e417c73b3f\") " pod="opendatahub/opendatahub-operator-controller-manager-79ffd8f657-rpx4w"
Sep 09 21:23:23.657103 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:23.657106    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/72bbd3dc-cacc-4f2e-a2d5-b9e417c73b3f-webhook-cert\") pod \"opendatahub-operator-controller-manager-79ffd8f657-rpx4w\" (UID: \"72bbd3dc-cacc-4f2e-a2d5-b9e417c73b3f\") " pod="opendatahub/opendatahub-operator-controller-manager-79ffd8f657-rpx4w"
Sep 09 21:23:23.657258 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:23.657135    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bf9h\" (UniqueName: \"kubernetes.io/projected/72bbd3dc-cacc-4f2e-a2d5-b9e417c73b3f-kube-api-access-4bf9h\") pod \"opendatahub-operator-controller-manager-79ffd8f657-rpx4w\" (UID: \"72bbd3dc-cacc-4f2e-a2d5-b9e417c73b3f\") " pod="opendatahub/opendatahub-operator-controller-manager-79ffd8f657-rpx4w"
Sep 09 21:23:23.657258 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:23.657185    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/72bbd3dc-cacc-4f2e-a2d5-b9e417c73b3f-manifests\") pod \"opendatahub-operator-controller-manager-79ffd8f657-rpx4w\" (UID: \"72bbd3dc-cacc-4f2e-a2d5-b9e417c73b3f\") " pod="opendatahub/opendatahub-operator-controller-manager-79ffd8f657-rpx4w"
Sep 09 21:23:23.657258 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:23.657204    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/72bbd3dc-cacc-4f2e-a2d5-b9e417c73b3f-tmp\") pod \"opendatahub-operator-controller-manager-79ffd8f657-rpx4w\" (UID: \"72bbd3dc-cacc-4f2e-a2d5-b9e417c73b3f\") " pod="opendatahub/opendatahub-operator-controller-manager-79ffd8f657-rpx4w"
Sep 09 21:23:23.758193 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:23.758164    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bf9h\" (UniqueName: \"kubernetes.io/projected/72bbd3dc-cacc-4f2e-a2d5-b9e417c73b3f-kube-api-access-4bf9h\") pod \"opendatahub-operator-controller-manager-79ffd8f657-rpx4w\" (UID: \"72bbd3dc-cacc-4f2e-a2d5-b9e417c73b3f\") " pod="opendatahub/opendatahub-operator-controller-manager-79ffd8f657-rpx4w"
Sep 09 21:23:23.758302 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:23.758208    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/72bbd3dc-cacc-4f2e-a2d5-b9e417c73b3f-manifests\") pod \"opendatahub-operator-controller-manager-79ffd8f657-rpx4w\" (UID: \"72bbd3dc-cacc-4f2e-a2d5-b9e417c73b3f\") " pod="opendatahub/opendatahub-operator-controller-manager-79ffd8f657-rpx4w"
Sep 09 21:23:23.758302 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:23.758230    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/72bbd3dc-cacc-4f2e-a2d5-b9e417c73b3f-tmp\") pod \"opendatahub-operator-controller-manager-79ffd8f657-rpx4w\" (UID: \"72bbd3dc-cacc-4f2e-a2d5-b9e417c73b3f\") " pod="opendatahub/opendatahub-operator-controller-manager-79ffd8f657-rpx4w"
Sep 09 21:23:23.758302 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:23.758270    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/72bbd3dc-cacc-4f2e-a2d5-b9e417c73b3f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79ffd8f657-rpx4w\" (UID: \"72bbd3dc-cacc-4f2e-a2d5-b9e417c73b3f\") " pod="opendatahub/opendatahub-operator-controller-manager-79ffd8f657-rpx4w"
Sep 09 21:23:23.758302 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:23.758292    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/72bbd3dc-cacc-4f2e-a2d5-b9e417c73b3f-webhook-cert\") pod \"opendatahub-operator-controller-manager-79ffd8f657-rpx4w\" (UID: \"72bbd3dc-cacc-4f2e-a2d5-b9e417c73b3f\") " pod="opendatahub/opendatahub-operator-controller-manager-79ffd8f657-rpx4w"
Sep 09 21:23:23.758611 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:23.758590    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/72bbd3dc-cacc-4f2e-a2d5-b9e417c73b3f-manifests\") pod \"opendatahub-operator-controller-manager-79ffd8f657-rpx4w\" (UID: \"72bbd3dc-cacc-4f2e-a2d5-b9e417c73b3f\") " pod="opendatahub/opendatahub-operator-controller-manager-79ffd8f657-rpx4w"
Sep 09 21:23:23.760628 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:23.760596    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/72bbd3dc-cacc-4f2e-a2d5-b9e417c73b3f-tmp\") pod \"opendatahub-operator-controller-manager-79ffd8f657-rpx4w\" (UID: \"72bbd3dc-cacc-4f2e-a2d5-b9e417c73b3f\") " pod="opendatahub/opendatahub-operator-controller-manager-79ffd8f657-rpx4w"
Sep 09 21:23:23.760724 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:23.760692    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/72bbd3dc-cacc-4f2e-a2d5-b9e417c73b3f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79ffd8f657-rpx4w\" (UID: \"72bbd3dc-cacc-4f2e-a2d5-b9e417c73b3f\") " pod="opendatahub/opendatahub-operator-controller-manager-79ffd8f657-rpx4w"
Sep 09 21:23:23.760837 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:23.760799    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/72bbd3dc-cacc-4f2e-a2d5-b9e417c73b3f-webhook-cert\") pod \"opendatahub-operator-controller-manager-79ffd8f657-rpx4w\" (UID: \"72bbd3dc-cacc-4f2e-a2d5-b9e417c73b3f\") " pod="opendatahub/opendatahub-operator-controller-manager-79ffd8f657-rpx4w"
Sep 09 21:23:23.772295 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:23.772269    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bf9h\" (UniqueName: \"kubernetes.io/projected/72bbd3dc-cacc-4f2e-a2d5-b9e417c73b3f-kube-api-access-4bf9h\") pod \"opendatahub-operator-controller-manager-79ffd8f657-rpx4w\" (UID: \"72bbd3dc-cacc-4f2e-a2d5-b9e417c73b3f\") " pod="opendatahub/opendatahub-operator-controller-manager-79ffd8f657-rpx4w"
Sep 09 21:23:23.866071 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:23.866006    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79ffd8f657-rpx4w"
Sep 09 21:23:23.890094 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:23.890072    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:23:23.993811 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:23.993786    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:23:24.111886 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:24.111851    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:23:24.169287 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:24.169267    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79ffd8f657-rpx4w"]
Sep 09 21:23:24.171218 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:23:24.171193    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72bbd3dc_cacc_4f2e_a2d5_b9e417c73b3f.slice/crio-48a2820ee09822029e1b24f7d48fea06018d2d2e273e9fd1be71793fc5427fa3 WatchSource:0}: Error finding container 48a2820ee09822029e1b24f7d48fea06018d2d2e273e9fd1be71793fc5427fa3: Status 404 returned error can't find the container with id 48a2820ee09822029e1b24f7d48fea06018d2d2e273e9fd1be71793fc5427fa3
Sep 09 21:23:24.256730 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:24.256698    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:23:24.349689 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:24.349669    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:23:24.450915 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:24.450891    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:23:24.499858 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:24.499814    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79ffd8f657-rpx4w" event={"ID":"72bbd3dc-cacc-4f2e-a2d5-b9e417c73b3f","Type":"ContainerStarted","Data":"48a2820ee09822029e1b24f7d48fea06018d2d2e273e9fd1be71793fc5427fa3"}
Sep 09 21:23:24.501743 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:24.501723    2555 generic.go:356] "Generic (PLEG): container finished" podID="747d33a1-969d-421c-abe5-44b3f6309536" containerID="7f0dccb96a8c7dd90976fe041d67e05220990435fab61a7246868ccc7af53670" exitCode=0
Sep 09 21:23:24.501859 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:24.501807    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rwqkz" event={"ID":"747d33a1-969d-421c-abe5-44b3f6309536","Type":"ContainerDied","Data":"7f0dccb96a8c7dd90976fe041d67e05220990435fab61a7246868ccc7af53670"}
Sep 09 21:23:24.541021 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:24.540993    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:23:24.640702 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:24.640666    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:23:25.510519 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:25.510463    2555 generic.go:356] "Generic (PLEG): container finished" podID="747d33a1-969d-421c-abe5-44b3f6309536" containerID="16aa80b5e8616fee65b81b8b49f688f8e09a0c68f1e97bc5dd734d344caa8ca2" exitCode=0
Sep 09 21:23:25.510907 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:25.510546    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rwqkz" event={"ID":"747d33a1-969d-421c-abe5-44b3f6309536","Type":"ContainerDied","Data":"16aa80b5e8616fee65b81b8b49f688f8e09a0c68f1e97bc5dd734d344caa8ca2"}
Sep 09 21:23:27.113764 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:27.113738    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rwqkz"
Sep 09 21:23:27.184202 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:27.184180    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bwskb\" (UniqueName: \"kubernetes.io/projected/747d33a1-969d-421c-abe5-44b3f6309536-kube-api-access-bwskb\") pod \"747d33a1-969d-421c-abe5-44b3f6309536\" (UID: \"747d33a1-969d-421c-abe5-44b3f6309536\") "
Sep 09 21:23:27.184323 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:27.184247    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/747d33a1-969d-421c-abe5-44b3f6309536-bundle\") pod \"747d33a1-969d-421c-abe5-44b3f6309536\" (UID: \"747d33a1-969d-421c-abe5-44b3f6309536\") "
Sep 09 21:23:27.184323 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:27.184281    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/747d33a1-969d-421c-abe5-44b3f6309536-util\") pod \"747d33a1-969d-421c-abe5-44b3f6309536\" (UID: \"747d33a1-969d-421c-abe5-44b3f6309536\") "
Sep 09 21:23:27.185309 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:27.185278    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/747d33a1-969d-421c-abe5-44b3f6309536-bundle" (OuterVolumeSpecName: "bundle") pod "747d33a1-969d-421c-abe5-44b3f6309536" (UID: "747d33a1-969d-421c-abe5-44b3f6309536"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:23:27.186646 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:27.186613    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/747d33a1-969d-421c-abe5-44b3f6309536-kube-api-access-bwskb" (OuterVolumeSpecName: "kube-api-access-bwskb") pod "747d33a1-969d-421c-abe5-44b3f6309536" (UID: "747d33a1-969d-421c-abe5-44b3f6309536"). InnerVolumeSpecName "kube-api-access-bwskb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:23:27.189797 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:27.189771    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/747d33a1-969d-421c-abe5-44b3f6309536-util" (OuterVolumeSpecName: "util") pod "747d33a1-969d-421c-abe5-44b3f6309536" (UID: "747d33a1-969d-421c-abe5-44b3f6309536"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:23:27.285585 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:27.285553    2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/747d33a1-969d-421c-abe5-44b3f6309536-bundle\") on node \"ip-10-0-133-235.ec2.internal\" DevicePath \"\""
Sep 09 21:23:27.285585 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:27.285578    2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/747d33a1-969d-421c-abe5-44b3f6309536-util\") on node \"ip-10-0-133-235.ec2.internal\" DevicePath \"\""
Sep 09 21:23:27.285585 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:27.285589    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bwskb\" (UniqueName: \"kubernetes.io/projected/747d33a1-969d-421c-abe5-44b3f6309536-kube-api-access-bwskb\") on node \"ip-10-0-133-235.ec2.internal\" DevicePath \"\""
Sep 09 21:23:27.521294 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:27.521262    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79ffd8f657-rpx4w" event={"ID":"72bbd3dc-cacc-4f2e-a2d5-b9e417c73b3f","Type":"ContainerStarted","Data":"7f3a801ad3569b3bc5523bc5d7ace3b2edf059197d27e66002c8fa8c061bd9ad"}
Sep 09 21:23:27.523217 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:27.523195    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rwqkz"
Sep 09 21:23:27.523217 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:27.523208    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rwqkz" event={"ID":"747d33a1-969d-421c-abe5-44b3f6309536","Type":"ContainerDied","Data":"3890b812b2131f926269b6ec9766690ba523ae1ba041f4bea5878f9f0328b0ff"}
Sep 09 21:23:27.523382 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:27.523246    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3890b812b2131f926269b6ec9766690ba523ae1ba041f4bea5878f9f0328b0ff"
Sep 09 21:23:28.529516 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:28.529425    2555 generic.go:356] "Generic (PLEG): container finished" podID="72bbd3dc-cacc-4f2e-a2d5-b9e417c73b3f" containerID="7f3a801ad3569b3bc5523bc5d7ace3b2edf059197d27e66002c8fa8c061bd9ad" exitCode=0
Sep 09 21:23:28.529985 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:28.529508    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79ffd8f657-rpx4w" event={"ID":"72bbd3dc-cacc-4f2e-a2d5-b9e417c73b3f","Type":"ContainerDied","Data":"7f3a801ad3569b3bc5523bc5d7ace3b2edf059197d27e66002c8fa8c061bd9ad"}
Sep 09 21:23:28.902881 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:28.902780    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:23:29.060846 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:29.060806    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:23:29.536098 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:29.536065    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79ffd8f657-rpx4w" event={"ID":"72bbd3dc-cacc-4f2e-a2d5-b9e417c73b3f","Type":"ContainerStarted","Data":"f9abc5df9a4c32987e8770b1bb5777ba8bd6619ca8a7f440a5cf970a0c87b468"}
Sep 09 21:23:29.536580 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:29.536154    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-79ffd8f657-rpx4w"
Sep 09 21:23:29.633956 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:29.633908    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-79ffd8f657-rpx4w" podStartSLOduration=2.222677025 podStartE2EDuration="6.63389197s" totalImagesPullingTime="3.378766108s" totalInitContainerRuntime="1.032448837s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:23:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:23:29.618846706 +0000 UTC m=+932.598164810" watchObservedRunningTime="2026-09-09 21:23:29.63389197 +0000 UTC m=+932.613210073"
Sep 09 21:23:34.911784 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:34.911750    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:23:35.010963 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:35.010928    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:23:40.543682 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:40.543645    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-79ffd8f657-rpx4w"
Sep 09 21:23:43.244242 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:43.244205    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:23:43.510380 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:43.510304    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:23:54.479267 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:54.479233    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:23:54.511938 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:54.511904    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-9vqfn"]
Sep 09 21:23:54.512198 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:54.512186    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="747d33a1-969d-421c-abe5-44b3f6309536" containerName="pull"
Sep 09 21:23:54.512243 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:54.512200    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="747d33a1-969d-421c-abe5-44b3f6309536" containerName="pull"
Sep 09 21:23:54.512243 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:54.512213    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="747d33a1-969d-421c-abe5-44b3f6309536" containerName="util"
Sep 09 21:23:54.512243 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:54.512219    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="747d33a1-969d-421c-abe5-44b3f6309536" containerName="util"
Sep 09 21:23:54.512243 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:54.512231    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="747d33a1-969d-421c-abe5-44b3f6309536" containerName="extract"
Sep 09 21:23:54.512243 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:54.512237    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="747d33a1-969d-421c-abe5-44b3f6309536" containerName="extract"
Sep 09 21:23:54.512389 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:54.512291    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="747d33a1-969d-421c-abe5-44b3f6309536" containerName="extract"
Sep 09 21:23:54.514048 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:54.514027    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-9vqfn"
Sep 09 21:23:54.516928 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:54.516909    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 09 21:23:54.517014 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:54.516952    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-4r8t7\""
Sep 09 21:23:54.526576 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:54.526551    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-9vqfn"]
Sep 09 21:23:54.575356 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:54.575325    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6679dddbff-4zv2n"]
Sep 09 21:23:54.577501 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:54.577479    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6679dddbff-4zv2n"
Sep 09 21:23:54.580157 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:54.580134    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 09 21:23:54.580261 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:54.580239    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 09 21:23:54.580388 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:54.580351    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-48kjf\""
Sep 09 21:23:54.581085 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:54.581064    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 09 21:23:54.582542 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:54.582523    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 09 21:23:54.587617 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:54.587598    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9zh5\" (UniqueName: \"kubernetes.io/projected/38e16af4-0a96-4d51-8d9c-ef49795ea0e5-kube-api-access-n9zh5\") pod \"odh-model-controller-7998c67dc4-9vqfn\" (UID: \"38e16af4-0a96-4d51-8d9c-ef49795ea0e5\") " pod="opendatahub/odh-model-controller-7998c67dc4-9vqfn"
Sep 09 21:23:54.587697 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:54.587640    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/38e16af4-0a96-4d51-8d9c-ef49795ea0e5-cert\") pod \"odh-model-controller-7998c67dc4-9vqfn\" (UID: \"38e16af4-0a96-4d51-8d9c-ef49795ea0e5\") " pod="opendatahub/odh-model-controller-7998c67dc4-9vqfn"
Sep 09 21:23:54.594236 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:54.594215    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6679dddbff-4zv2n"]
Sep 09 21:23:54.610529 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:54.610501    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:23:54.688623 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:54.688590    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7cct\" (UniqueName: \"kubernetes.io/projected/34c1b937-3c1c-4554-8745-589474055d28-kube-api-access-j7cct\") pod \"kube-auth-proxy-6679dddbff-4zv2n\" (UID: \"34c1b937-3c1c-4554-8745-589474055d28\") " pod="openshift-ingress/kube-auth-proxy-6679dddbff-4zv2n"
Sep 09 21:23:54.688793 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:54.688646    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/38e16af4-0a96-4d51-8d9c-ef49795ea0e5-cert\") pod \"odh-model-controller-7998c67dc4-9vqfn\" (UID: \"38e16af4-0a96-4d51-8d9c-ef49795ea0e5\") " pod="opendatahub/odh-model-controller-7998c67dc4-9vqfn"
Sep 09 21:23:54.688793 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:54.688675    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/34c1b937-3c1c-4554-8745-589474055d28-tmp\") pod \"kube-auth-proxy-6679dddbff-4zv2n\" (UID: \"34c1b937-3c1c-4554-8745-589474055d28\") " pod="openshift-ingress/kube-auth-proxy-6679dddbff-4zv2n"
Sep 09 21:23:54.688793 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:54.688754    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9zh5\" (UniqueName: \"kubernetes.io/projected/38e16af4-0a96-4d51-8d9c-ef49795ea0e5-kube-api-access-n9zh5\") pod \"odh-model-controller-7998c67dc4-9vqfn\" (UID: \"38e16af4-0a96-4d51-8d9c-ef49795ea0e5\") " pod="opendatahub/odh-model-controller-7998c67dc4-9vqfn"
Sep 09 21:23:54.688793 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:23:54.688776    2555 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Sep 09 21:23:54.688793 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:54.688793    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/34c1b937-3c1c-4554-8745-589474055d28-tls-certs\") pod \"kube-auth-proxy-6679dddbff-4zv2n\" (UID: \"34c1b937-3c1c-4554-8745-589474055d28\") " pod="openshift-ingress/kube-auth-proxy-6679dddbff-4zv2n"
Sep 09 21:23:54.689036 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:23:54.688883    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38e16af4-0a96-4d51-8d9c-ef49795ea0e5-cert podName:38e16af4-0a96-4d51-8d9c-ef49795ea0e5 nodeName:}" failed. No retries permitted until 2026-09-09 21:23:55.188860675 +0000 UTC m=+958.168178780 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/38e16af4-0a96-4d51-8d9c-ef49795ea0e5-cert") pod "odh-model-controller-7998c67dc4-9vqfn" (UID: "38e16af4-0a96-4d51-8d9c-ef49795ea0e5") : secret "odh-model-controller-webhook-cert" not found
Sep 09 21:23:54.707405 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:54.707379    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9zh5\" (UniqueName: \"kubernetes.io/projected/38e16af4-0a96-4d51-8d9c-ef49795ea0e5-kube-api-access-n9zh5\") pod \"odh-model-controller-7998c67dc4-9vqfn\" (UID: \"38e16af4-0a96-4d51-8d9c-ef49795ea0e5\") " pod="opendatahub/odh-model-controller-7998c67dc4-9vqfn"
Sep 09 21:23:54.732411 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:54.732354    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:23:54.789537 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:54.789509    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7cct\" (UniqueName: \"kubernetes.io/projected/34c1b937-3c1c-4554-8745-589474055d28-kube-api-access-j7cct\") pod \"kube-auth-proxy-6679dddbff-4zv2n\" (UID: \"34c1b937-3c1c-4554-8745-589474055d28\") " pod="openshift-ingress/kube-auth-proxy-6679dddbff-4zv2n"
Sep 09 21:23:54.789690 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:54.789557    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/34c1b937-3c1c-4554-8745-589474055d28-tmp\") pod \"kube-auth-proxy-6679dddbff-4zv2n\" (UID: \"34c1b937-3c1c-4554-8745-589474055d28\") " pod="openshift-ingress/kube-auth-proxy-6679dddbff-4zv2n"
Sep 09 21:23:54.789690 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:54.789618    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/34c1b937-3c1c-4554-8745-589474055d28-tls-certs\") pod \"kube-auth-proxy-6679dddbff-4zv2n\" (UID: \"34c1b937-3c1c-4554-8745-589474055d28\") " pod="openshift-ingress/kube-auth-proxy-6679dddbff-4zv2n"
Sep 09 21:23:54.792089 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:54.792061    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/34c1b937-3c1c-4554-8745-589474055d28-tmp\") pod \"kube-auth-proxy-6679dddbff-4zv2n\" (UID: \"34c1b937-3c1c-4554-8745-589474055d28\") " pod="openshift-ingress/kube-auth-proxy-6679dddbff-4zv2n"
Sep 09 21:23:54.792203 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:54.792168    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/34c1b937-3c1c-4554-8745-589474055d28-tls-certs\") pod \"kube-auth-proxy-6679dddbff-4zv2n\" (UID: \"34c1b937-3c1c-4554-8745-589474055d28\") " pod="openshift-ingress/kube-auth-proxy-6679dddbff-4zv2n"
Sep 09 21:23:54.805652 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:54.805625    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7cct\" (UniqueName: \"kubernetes.io/projected/34c1b937-3c1c-4554-8745-589474055d28-kube-api-access-j7cct\") pod \"kube-auth-proxy-6679dddbff-4zv2n\" (UID: \"34c1b937-3c1c-4554-8745-589474055d28\") " pod="openshift-ingress/kube-auth-proxy-6679dddbff-4zv2n"
Sep 09 21:23:54.858879 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:54.858846    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:23:54.887573 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:54.887546    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6679dddbff-4zv2n"
Sep 09 21:23:55.171457 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:55.171422    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6679dddbff-4zv2n"]
Sep 09 21:23:55.176971 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:23:55.176942    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34c1b937_3c1c_4554_8745_589474055d28.slice/crio-4a5f5f107db22b48d7d5f77a95be0f00e46f5e9c5388100e9d90fc4ecdb5a36e WatchSource:0}: Error finding container 4a5f5f107db22b48d7d5f77a95be0f00e46f5e9c5388100e9d90fc4ecdb5a36e: Status 404 returned error can't find the container with id 4a5f5f107db22b48d7d5f77a95be0f00e46f5e9c5388100e9d90fc4ecdb5a36e
Sep 09 21:23:55.193647 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:55.193622    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/38e16af4-0a96-4d51-8d9c-ef49795ea0e5-cert\") pod \"odh-model-controller-7998c67dc4-9vqfn\" (UID: \"38e16af4-0a96-4d51-8d9c-ef49795ea0e5\") " pod="opendatahub/odh-model-controller-7998c67dc4-9vqfn"
Sep 09 21:23:55.196426 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:55.196401    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/38e16af4-0a96-4d51-8d9c-ef49795ea0e5-cert\") pod \"odh-model-controller-7998c67dc4-9vqfn\" (UID: \"38e16af4-0a96-4d51-8d9c-ef49795ea0e5\") " pod="opendatahub/odh-model-controller-7998c67dc4-9vqfn"
Sep 09 21:23:55.268951 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:55.265406    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-ffh5g"]
Sep 09 21:23:55.275460 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:55.275422    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-ffh5g"
Sep 09 21:23:55.281543 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:55.281518    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 09 21:23:55.298483 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:55.298457    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-ffh5g"]
Sep 09 21:23:55.336662 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:55.336635    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:23:55.395483 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:55.395452    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntmzm\" (UniqueName: \"kubernetes.io/projected/99f5fa28-a900-4faa-bb73-e396c4b3da86-kube-api-access-ntmzm\") pod \"model-serving-api-54d89bd5fc-ffh5g\" (UID: \"99f5fa28-a900-4faa-bb73-e396c4b3da86\") " pod="opendatahub/model-serving-api-54d89bd5fc-ffh5g"
Sep 09 21:23:55.395638 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:55.395489    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99f5fa28-a900-4faa-bb73-e396c4b3da86-tls-certs\") pod \"model-serving-api-54d89bd5fc-ffh5g\" (UID: \"99f5fa28-a900-4faa-bb73-e396c4b3da86\") " pod="opendatahub/model-serving-api-54d89bd5fc-ffh5g"
Sep 09 21:23:55.424087 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:55.424008    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-9vqfn"
Sep 09 21:23:55.434228 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:55.434119    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:23:55.496751 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:55.496717    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntmzm\" (UniqueName: \"kubernetes.io/projected/99f5fa28-a900-4faa-bb73-e396c4b3da86-kube-api-access-ntmzm\") pod \"model-serving-api-54d89bd5fc-ffh5g\" (UID: \"99f5fa28-a900-4faa-bb73-e396c4b3da86\") " pod="opendatahub/model-serving-api-54d89bd5fc-ffh5g"
Sep 09 21:23:55.497185 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:55.496773    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99f5fa28-a900-4faa-bb73-e396c4b3da86-tls-certs\") pod \"model-serving-api-54d89bd5fc-ffh5g\" (UID: \"99f5fa28-a900-4faa-bb73-e396c4b3da86\") " pod="opendatahub/model-serving-api-54d89bd5fc-ffh5g"
Sep 09 21:23:55.499256 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:55.499232    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99f5fa28-a900-4faa-bb73-e396c4b3da86-tls-certs\") pod \"model-serving-api-54d89bd5fc-ffh5g\" (UID: \"99f5fa28-a900-4faa-bb73-e396c4b3da86\") " pod="opendatahub/model-serving-api-54d89bd5fc-ffh5g"
Sep 09 21:23:55.508539 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:55.508521    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntmzm\" (UniqueName: \"kubernetes.io/projected/99f5fa28-a900-4faa-bb73-e396c4b3da86-kube-api-access-ntmzm\") pod \"model-serving-api-54d89bd5fc-ffh5g\" (UID: \"99f5fa28-a900-4faa-bb73-e396c4b3da86\") " pod="opendatahub/model-serving-api-54d89bd5fc-ffh5g"
Sep 09 21:23:55.588692 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:55.588668    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-ffh5g"
Sep 09 21:23:55.661388 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:55.661293    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6679dddbff-4zv2n" event={"ID":"34c1b937-3c1c-4554-8745-589474055d28","Type":"ContainerStarted","Data":"4a5f5f107db22b48d7d5f77a95be0f00e46f5e9c5388100e9d90fc4ecdb5a36e"}
Sep 09 21:23:55.718570 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:55.710985    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-9vqfn"]
Sep 09 21:23:55.880840 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:55.880793    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-ffh5g"]
Sep 09 21:23:55.887846 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:23:55.885360    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99f5fa28_a900_4faa_bb73_e396c4b3da86.slice/crio-de8c9818ca8ec9e94c8813979cc93fa1778830773cf37d8e72f6608c1a712523 WatchSource:0}: Error finding container de8c9818ca8ec9e94c8813979cc93fa1778830773cf37d8e72f6608c1a712523: Status 404 returned error can't find the container with id de8c9818ca8ec9e94c8813979cc93fa1778830773cf37d8e72f6608c1a712523
Sep 09 21:23:56.109529 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:56.109444    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7lhxk"]
Sep 09 21:23:56.112364 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:56.112330    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7lhxk"
Sep 09 21:23:56.116665 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:56.116246    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 09 21:23:56.116665 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:56.116337    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 09 21:23:56.116665 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:56.116251    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-fxkgk\""
Sep 09 21:23:56.116665 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:56.116549    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 09 21:23:56.116665 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:56.116589    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 09 21:23:56.133890 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:56.133809    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7lhxk"]
Sep 09 21:23:56.144519 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:56.144438    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:23:56.202842 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:56.202774    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c738504-8dbc-49ee-92e3-dc58850db4c5-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-7lhxk\" (UID: \"5c738504-8dbc-49ee-92e3-dc58850db4c5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7lhxk"
Sep 09 21:23:56.203015 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:56.202852    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5c738504-8dbc-49ee-92e3-dc58850db4c5-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-7lhxk\" (UID: \"5c738504-8dbc-49ee-92e3-dc58850db4c5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7lhxk"
Sep 09 21:23:56.203015 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:56.202890    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5c738504-8dbc-49ee-92e3-dc58850db4c5-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-7lhxk\" (UID: \"5c738504-8dbc-49ee-92e3-dc58850db4c5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7lhxk"
Sep 09 21:23:56.203015 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:56.202945    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5c738504-8dbc-49ee-92e3-dc58850db4c5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-7lhxk\" (UID: \"5c738504-8dbc-49ee-92e3-dc58850db4c5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7lhxk"
Sep 09 21:23:56.203015 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:56.202993    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5c738504-8dbc-49ee-92e3-dc58850db4c5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-7lhxk\" (UID: \"5c738504-8dbc-49ee-92e3-dc58850db4c5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7lhxk"
Sep 09 21:23:56.203236 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:56.203024    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvclk\" (UniqueName: \"kubernetes.io/projected/5c738504-8dbc-49ee-92e3-dc58850db4c5-kube-api-access-lvclk\") pod \"istiod-openshift-gateway-7b7995d5cd-7lhxk\" (UID: \"5c738504-8dbc-49ee-92e3-dc58850db4c5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7lhxk"
Sep 09 21:23:56.203236 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:56.203049    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c738504-8dbc-49ee-92e3-dc58850db4c5-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-7lhxk\" (UID: \"5c738504-8dbc-49ee-92e3-dc58850db4c5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7lhxk"
Sep 09 21:23:56.234791 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:56.234757    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:23:56.303749 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:56.303624    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c738504-8dbc-49ee-92e3-dc58850db4c5-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-7lhxk\" (UID: \"5c738504-8dbc-49ee-92e3-dc58850db4c5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7lhxk"
Sep 09 21:23:56.303749 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:56.303673    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5c738504-8dbc-49ee-92e3-dc58850db4c5-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-7lhxk\" (UID: \"5c738504-8dbc-49ee-92e3-dc58850db4c5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7lhxk"
Sep 09 21:23:56.303749 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:56.303708    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5c738504-8dbc-49ee-92e3-dc58850db4c5-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-7lhxk\" (UID: \"5c738504-8dbc-49ee-92e3-dc58850db4c5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7lhxk"
Sep 09 21:23:56.304053 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:56.303808    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5c738504-8dbc-49ee-92e3-dc58850db4c5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-7lhxk\" (UID: \"5c738504-8dbc-49ee-92e3-dc58850db4c5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7lhxk"
Sep 09 21:23:56.304053 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:56.303910    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5c738504-8dbc-49ee-92e3-dc58850db4c5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-7lhxk\" (UID: \"5c738504-8dbc-49ee-92e3-dc58850db4c5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7lhxk"
Sep 09 21:23:56.304053 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:56.303942    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvclk\" (UniqueName: \"kubernetes.io/projected/5c738504-8dbc-49ee-92e3-dc58850db4c5-kube-api-access-lvclk\") pod \"istiod-openshift-gateway-7b7995d5cd-7lhxk\" (UID: \"5c738504-8dbc-49ee-92e3-dc58850db4c5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7lhxk"
Sep 09 21:23:56.304053 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:56.303970    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c738504-8dbc-49ee-92e3-dc58850db4c5-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-7lhxk\" (UID: \"5c738504-8dbc-49ee-92e3-dc58850db4c5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7lhxk"
Sep 09 21:23:56.304897 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:56.304845    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5c738504-8dbc-49ee-92e3-dc58850db4c5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-7lhxk\" (UID: \"5c738504-8dbc-49ee-92e3-dc58850db4c5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7lhxk"
Sep 09 21:23:56.307269 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:56.307227    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5c738504-8dbc-49ee-92e3-dc58850db4c5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-7lhxk\" (UID: \"5c738504-8dbc-49ee-92e3-dc58850db4c5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7lhxk"
Sep 09 21:23:56.307586 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:56.307545    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c738504-8dbc-49ee-92e3-dc58850db4c5-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-7lhxk\" (UID: \"5c738504-8dbc-49ee-92e3-dc58850db4c5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7lhxk"
Sep 09 21:23:56.307726 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:56.307649    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5c738504-8dbc-49ee-92e3-dc58850db4c5-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-7lhxk\" (UID: \"5c738504-8dbc-49ee-92e3-dc58850db4c5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7lhxk"
Sep 09 21:23:56.309301 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:56.309262    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5c738504-8dbc-49ee-92e3-dc58850db4c5-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-7lhxk\" (UID: \"5c738504-8dbc-49ee-92e3-dc58850db4c5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7lhxk"
Sep 09 21:23:56.313874 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:56.313799    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvclk\" (UniqueName: \"kubernetes.io/projected/5c738504-8dbc-49ee-92e3-dc58850db4c5-kube-api-access-lvclk\") pod \"istiod-openshift-gateway-7b7995d5cd-7lhxk\" (UID: \"5c738504-8dbc-49ee-92e3-dc58850db4c5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7lhxk"
Sep 09 21:23:56.313874 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:56.313802    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c738504-8dbc-49ee-92e3-dc58850db4c5-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-7lhxk\" (UID: \"5c738504-8dbc-49ee-92e3-dc58850db4c5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7lhxk"
Sep 09 21:23:56.426571 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:56.426267    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7lhxk"
Sep 09 21:23:56.679220 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:56.679134    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-9vqfn" event={"ID":"38e16af4-0a96-4d51-8d9c-ef49795ea0e5","Type":"ContainerStarted","Data":"e0ab1bdca577075e47018b5a6c6183049d610c8f6d99fb73f3d227dcbc7bb707"}
Sep 09 21:23:56.681691 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:56.681657    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-ffh5g" event={"ID":"99f5fa28-a900-4faa-bb73-e396c4b3da86","Type":"ContainerStarted","Data":"de8c9818ca8ec9e94c8813979cc93fa1778830773cf37d8e72f6608c1a712523"}
Sep 09 21:23:56.760251 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:56.760217    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7lhxk"]
Sep 09 21:23:57.554341 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:57.554248    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:23:58.129707 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:23:58.129673    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c738504_8dbc_49ee_92e3_dc58850db4c5.slice/crio-340e819f830256af9f780324d8b041689af260d4068f9413e0aca8a011d1c2da WatchSource:0}: Error finding container 340e819f830256af9f780324d8b041689af260d4068f9413e0aca8a011d1c2da: Status 404 returned error can't find the container with id 340e819f830256af9f780324d8b041689af260d4068f9413e0aca8a011d1c2da
Sep 09 21:23:58.698634 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:23:58.698588    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7lhxk" event={"ID":"5c738504-8dbc-49ee-92e3-dc58850db4c5","Type":"ContainerStarted","Data":"340e819f830256af9f780324d8b041689af260d4068f9413e0aca8a011d1c2da"}
Sep 09 21:24:01.018357 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:01.018332    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 09 21:24:01.550271 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:01.550210    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:24:01.718833 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:01.718766    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-9vqfn" event={"ID":"38e16af4-0a96-4d51-8d9c-ef49795ea0e5","Type":"ContainerStarted","Data":"f4f01bd2aed4e2a41f8dd33e68d37be715e2771799344104b73ac24ada9d0d38"}
Sep 09 21:24:01.719011 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:01.718902    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-9vqfn"
Sep 09 21:24:01.721134 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:01.721062    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-ffh5g" event={"ID":"99f5fa28-a900-4faa-bb73-e396c4b3da86","Type":"ContainerStarted","Data":"3050a2bcb68beb7688bcad69b3af389126c6dd731e12c0a6915fa26478d95034"}
Sep 09 21:24:01.721324 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:01.721136    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-ffh5g"
Sep 09 21:24:01.723656 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:01.723605    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6679dddbff-4zv2n" event={"ID":"34c1b937-3c1c-4554-8745-589474055d28","Type":"ContainerStarted","Data":"a95924b9a5c9a6bf85b1f4c354de5cdf463afaf5a13b9e10782748146b9cd51a"}
Sep 09 21:24:01.751780 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:01.751732    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-9vqfn" podStartSLOduration=2.442154917 podStartE2EDuration="7.751713244s" totalImagesPullingTime="5.309558327s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:23:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:24:01.750586385 +0000 UTC m=+964.729904503" watchObservedRunningTime="2026-09-09 21:24:01.751713244 +0000 UTC m=+964.731031357"
Sep 09 21:24:01.788493 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:01.788442    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6679dddbff-4zv2n" podStartSLOduration=1.951942861 podStartE2EDuration="7.788426886s" totalImagesPullingTime="5.836484025s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:23:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:24:01.787917894 +0000 UTC m=+964.767236009" watchObservedRunningTime="2026-09-09 21:24:01.788426886 +0000 UTC m=+964.767744998"
Sep 09 21:24:01.823127 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:01.822996    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-ffh5g" podStartSLOduration=1.695641732 podStartE2EDuration="6.822976147s" totalImagesPullingTime="5.127334415s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:23:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:24:01.820587446 +0000 UTC m=+964.799905560" watchObservedRunningTime="2026-09-09 21:24:01.822976147 +0000 UTC m=+964.802294261"
Sep 09 21:24:02.320640 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:02.320601    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 21:24:02.320958 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:02.320673    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 21:24:02.730171 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:02.730112    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7lhxk" event={"ID":"5c738504-8dbc-49ee-92e3-dc58850db4c5","Type":"ContainerStarted","Data":"5df0be54394038ef9231eea10e3dcd0f7cf56686aec7eef6e900b3d55329e78b"}
Sep 09 21:24:02.730677 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:02.730653    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7lhxk"
Sep 09 21:24:03.007484 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:03.007408    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:24:03.169956 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:03.169918    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:24:03.286138 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:03.286050    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:24:03.736997 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:03.736959    2555 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-7lhxk container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 09 21:24:03.737355 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:03.737026    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7lhxk" podUID="5c738504-8dbc-49ee-92e3-dc58850db4c5" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:24:04.312276 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:04.312224    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7lhxk" podStartSLOduration=4.124304386 podStartE2EDuration="8.312207983s" totalImagesPullingTime="4.187903597s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:23:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:24:02.891123802 +0000 UTC m=+965.870441917" watchObservedRunningTime="2026-09-09 21:24:04.312207983 +0000 UTC m=+967.291526095"
Sep 09 21:24:04.313953 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:04.313933    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb"]
Sep 09 21:24:04.317070 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:04.317052    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb"
Sep 09 21:24:04.343912 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:04.343888    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-mnh2r\""
Sep 09 21:24:04.387075 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:04.387050    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1113cf29-a763-40f5-8b94-31f0097d4d6e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb\" (UID: \"1113cf29-a763-40f5-8b94-31f0097d4d6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb"
Sep 09 21:24:04.387176 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:04.387084    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1113cf29-a763-40f5-8b94-31f0097d4d6e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb\" (UID: \"1113cf29-a763-40f5-8b94-31f0097d4d6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb"
Sep 09 21:24:04.387176 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:04.387103    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1113cf29-a763-40f5-8b94-31f0097d4d6e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb\" (UID: \"1113cf29-a763-40f5-8b94-31f0097d4d6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb"
Sep 09 21:24:04.387176 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:04.387135    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1113cf29-a763-40f5-8b94-31f0097d4d6e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb\" (UID: \"1113cf29-a763-40f5-8b94-31f0097d4d6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb"
Sep 09 21:24:04.387299 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:04.387176    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1113cf29-a763-40f5-8b94-31f0097d4d6e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb\" (UID: \"1113cf29-a763-40f5-8b94-31f0097d4d6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb"
Sep 09 21:24:04.387299 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:04.387207    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1113cf29-a763-40f5-8b94-31f0097d4d6e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb\" (UID: \"1113cf29-a763-40f5-8b94-31f0097d4d6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb"
Sep 09 21:24:04.387299 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:04.387252    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1113cf29-a763-40f5-8b94-31f0097d4d6e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb\" (UID: \"1113cf29-a763-40f5-8b94-31f0097d4d6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb"
Sep 09 21:24:04.387440 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:04.387328    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1113cf29-a763-40f5-8b94-31f0097d4d6e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb\" (UID: \"1113cf29-a763-40f5-8b94-31f0097d4d6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb"
Sep 09 21:24:04.387440 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:04.387374    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vd2nf\" (UniqueName: \"kubernetes.io/projected/1113cf29-a763-40f5-8b94-31f0097d4d6e-kube-api-access-vd2nf\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb\" (UID: \"1113cf29-a763-40f5-8b94-31f0097d4d6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb"
Sep 09 21:24:04.467470 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:04.467438    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb"]
Sep 09 21:24:04.472145 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:04.472119    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:24:04.488295 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:04.488261    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vd2nf\" (UniqueName: \"kubernetes.io/projected/1113cf29-a763-40f5-8b94-31f0097d4d6e-kube-api-access-vd2nf\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb\" (UID: \"1113cf29-a763-40f5-8b94-31f0097d4d6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb"
Sep 09 21:24:04.488426 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:04.488313    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1113cf29-a763-40f5-8b94-31f0097d4d6e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb\" (UID: \"1113cf29-a763-40f5-8b94-31f0097d4d6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb"
Sep 09 21:24:04.488426 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:04.488353    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1113cf29-a763-40f5-8b94-31f0097d4d6e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb\" (UID: \"1113cf29-a763-40f5-8b94-31f0097d4d6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb"
Sep 09 21:24:04.488426 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:04.488376    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1113cf29-a763-40f5-8b94-31f0097d4d6e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb\" (UID: \"1113cf29-a763-40f5-8b94-31f0097d4d6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb"
Sep 09 21:24:04.488426 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:04.488406    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1113cf29-a763-40f5-8b94-31f0097d4d6e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb\" (UID: \"1113cf29-a763-40f5-8b94-31f0097d4d6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb"
Sep 09 21:24:04.488616 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:04.488452    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1113cf29-a763-40f5-8b94-31f0097d4d6e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb\" (UID: \"1113cf29-a763-40f5-8b94-31f0097d4d6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb"
Sep 09 21:24:04.488616 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:04.488491    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1113cf29-a763-40f5-8b94-31f0097d4d6e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb\" (UID: \"1113cf29-a763-40f5-8b94-31f0097d4d6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb"
Sep 09 21:24:04.488616 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:04.488531    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1113cf29-a763-40f5-8b94-31f0097d4d6e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb\" (UID: \"1113cf29-a763-40f5-8b94-31f0097d4d6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb"
Sep 09 21:24:04.488616 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:04.488583    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1113cf29-a763-40f5-8b94-31f0097d4d6e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb\" (UID: \"1113cf29-a763-40f5-8b94-31f0097d4d6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb"
Sep 09 21:24:04.489526 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:04.489497    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1113cf29-a763-40f5-8b94-31f0097d4d6e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb\" (UID: \"1113cf29-a763-40f5-8b94-31f0097d4d6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb"
Sep 09 21:24:04.489773 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:04.489753    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1113cf29-a763-40f5-8b94-31f0097d4d6e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb\" (UID: \"1113cf29-a763-40f5-8b94-31f0097d4d6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb"
Sep 09 21:24:04.491397 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:04.490316    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1113cf29-a763-40f5-8b94-31f0097d4d6e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb\" (UID: \"1113cf29-a763-40f5-8b94-31f0097d4d6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb"
Sep 09 21:24:04.491397 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:04.491114    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1113cf29-a763-40f5-8b94-31f0097d4d6e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb\" (UID: \"1113cf29-a763-40f5-8b94-31f0097d4d6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb"
Sep 09 21:24:04.491715 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:04.491691    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1113cf29-a763-40f5-8b94-31f0097d4d6e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb\" (UID: \"1113cf29-a763-40f5-8b94-31f0097d4d6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb"
Sep 09 21:24:04.493052 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:04.493026    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1113cf29-a763-40f5-8b94-31f0097d4d6e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb\" (UID: \"1113cf29-a763-40f5-8b94-31f0097d4d6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb"
Sep 09 21:24:04.493867 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:04.493848    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1113cf29-a763-40f5-8b94-31f0097d4d6e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb\" (UID: \"1113cf29-a763-40f5-8b94-31f0097d4d6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb"
Sep 09 21:24:04.509088 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:04.509064    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1113cf29-a763-40f5-8b94-31f0097d4d6e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb\" (UID: \"1113cf29-a763-40f5-8b94-31f0097d4d6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb"
Sep 09 21:24:04.522976 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:04.522949    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vd2nf\" (UniqueName: \"kubernetes.io/projected/1113cf29-a763-40f5-8b94-31f0097d4d6e-kube-api-access-vd2nf\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb\" (UID: \"1113cf29-a763-40f5-8b94-31f0097d4d6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb"
Sep 09 21:24:04.627550 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:04.627458    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb"
Sep 09 21:24:04.741095 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:04.741067    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7lhxk"
Sep 09 21:24:04.943275 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:04.943246    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb"]
Sep 09 21:24:04.945473 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:24:04.945436    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1113cf29_a763_40f5_8b94_31f0097d4d6e.slice/crio-cf9d221238a30522d98015dd33730ff35d4dfc05ade3e560d8e905acf44cf6c5 WatchSource:0}: Error finding container cf9d221238a30522d98015dd33730ff35d4dfc05ade3e560d8e905acf44cf6c5: Status 404 returned error can't find the container with id cf9d221238a30522d98015dd33730ff35d4dfc05ade3e560d8e905acf44cf6c5
Sep 09 21:24:04.949518 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:04.949495    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:24:05.059714 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:05.059683    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:24:05.745772 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:05.745734    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb" event={"ID":"1113cf29-a763-40f5-8b94-31f0097d4d6e","Type":"ContainerStarted","Data":"cf9d221238a30522d98015dd33730ff35d4dfc05ade3e560d8e905acf44cf6c5"}
Sep 09 21:24:05.785796 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:05.785768    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:24:05.884553 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:05.884528    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:24:08.605939 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:08.605907    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 21:24:08.606190 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:08.605975    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 21:24:08.606190 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:08.606003    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 21:24:08.615426 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:08.615393    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:24:08.766485 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:08.766452    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb" event={"ID":"1113cf29-a763-40f5-8b94-31f0097d4d6e","Type":"ContainerStarted","Data":"d71085e02981c2e787cdb298742461534066bd8498ce15c93116a0ba8ee8f81a"}
Sep 09 21:24:08.866114 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:08.866043    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-lrsms"]
Sep 09 21:24:08.874482 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:08.874457    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-lrsms"
Sep 09 21:24:08.886455 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:08.886430    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-w5lfn\""
Sep 09 21:24:08.907724 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:08.907699    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 09 21:24:08.918539 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:08.918515    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-lrsms"]
Sep 09 21:24:08.922144 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:08.922117    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:24:08.929998 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:08.929806    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb" podStartSLOduration=1.272213743 podStartE2EDuration="4.929786573s" totalImagesPullingTime="3.65757283s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:24:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:24:08.918901422 +0000 UTC m=+971.898219536" watchObservedRunningTime="2026-09-09 21:24:08.929786573 +0000 UTC m=+971.909104688"
Sep 09 21:24:08.933416 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:08.933395    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-hpthm"]
Sep 09 21:24:08.936634 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:08.936617    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hpthm"
Sep 09 21:24:08.940904 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:08.940884    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-ndjd7\""
Sep 09 21:24:08.941527 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:08.941510    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 09 21:24:08.967116 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:08.967093    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-hpthm"]
Sep 09 21:24:09.025925 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:09.025903    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sx8l7\" (UniqueName: \"kubernetes.io/projected/2a4dce68-cbfc-4101-8a89-a0d35417abd5-kube-api-access-sx8l7\") pod \"kserve-controller-manager-d6f4b65b8-lrsms\" (UID: \"2a4dce68-cbfc-4101-8a89-a0d35417abd5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-lrsms"
Sep 09 21:24:09.026038 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:09.025954    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nb52s\" (UniqueName: \"kubernetes.io/projected/6226f0de-d59b-4502-8e11-94381794f7cc-kube-api-access-nb52s\") pod \"llmisvc-controller-manager-777c6bd7d5-hpthm\" (UID: \"6226f0de-d59b-4502-8e11-94381794f7cc\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hpthm"
Sep 09 21:24:09.026038 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:09.025985    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6226f0de-d59b-4502-8e11-94381794f7cc-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-hpthm\" (UID: \"6226f0de-d59b-4502-8e11-94381794f7cc\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hpthm"
Sep 09 21:24:09.026152 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:09.026047    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2a4dce68-cbfc-4101-8a89-a0d35417abd5-cert\") pod \"kserve-controller-manager-d6f4b65b8-lrsms\" (UID: \"2a4dce68-cbfc-4101-8a89-a0d35417abd5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-lrsms"
Sep 09 21:24:09.039594 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:09.039569    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:24:09.126621 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:09.126563    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nb52s\" (UniqueName: \"kubernetes.io/projected/6226f0de-d59b-4502-8e11-94381794f7cc-kube-api-access-nb52s\") pod \"llmisvc-controller-manager-777c6bd7d5-hpthm\" (UID: \"6226f0de-d59b-4502-8e11-94381794f7cc\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hpthm"
Sep 09 21:24:09.126621 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:09.126595    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6226f0de-d59b-4502-8e11-94381794f7cc-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-hpthm\" (UID: \"6226f0de-d59b-4502-8e11-94381794f7cc\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hpthm"
Sep 09 21:24:09.126621 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:09.126619    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2a4dce68-cbfc-4101-8a89-a0d35417abd5-cert\") pod \"kserve-controller-manager-d6f4b65b8-lrsms\" (UID: \"2a4dce68-cbfc-4101-8a89-a0d35417abd5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-lrsms"
Sep 09 21:24:09.126862 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:09.126755    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sx8l7\" (UniqueName: \"kubernetes.io/projected/2a4dce68-cbfc-4101-8a89-a0d35417abd5-kube-api-access-sx8l7\") pod \"kserve-controller-manager-d6f4b65b8-lrsms\" (UID: \"2a4dce68-cbfc-4101-8a89-a0d35417abd5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-lrsms"
Sep 09 21:24:09.129385 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:09.129361    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2a4dce68-cbfc-4101-8a89-a0d35417abd5-cert\") pod \"kserve-controller-manager-d6f4b65b8-lrsms\" (UID: \"2a4dce68-cbfc-4101-8a89-a0d35417abd5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-lrsms"
Sep 09 21:24:09.129458 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:09.129400    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6226f0de-d59b-4502-8e11-94381794f7cc-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-hpthm\" (UID: \"6226f0de-d59b-4502-8e11-94381794f7cc\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hpthm"
Sep 09 21:24:09.138483 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:09.138458    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sx8l7\" (UniqueName: \"kubernetes.io/projected/2a4dce68-cbfc-4101-8a89-a0d35417abd5-kube-api-access-sx8l7\") pod \"kserve-controller-manager-d6f4b65b8-lrsms\" (UID: \"2a4dce68-cbfc-4101-8a89-a0d35417abd5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-lrsms"
Sep 09 21:24:09.142173 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:09.142151    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nb52s\" (UniqueName: \"kubernetes.io/projected/6226f0de-d59b-4502-8e11-94381794f7cc-kube-api-access-nb52s\") pod \"llmisvc-controller-manager-777c6bd7d5-hpthm\" (UID: \"6226f0de-d59b-4502-8e11-94381794f7cc\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hpthm"
Sep 09 21:24:09.187568 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:09.187547    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-lrsms"
Sep 09 21:24:09.198693 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:09.198653    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:24:09.245457 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:09.244697    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7lhxk"]
Sep 09 21:24:09.245457 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:09.244946    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7lhxk" podUID="5c738504-8dbc-49ee-92e3-dc58850db4c5" containerName="discovery" containerID="cri-o://5df0be54394038ef9231eea10e3dcd0f7cf56686aec7eef6e900b3d55329e78b" gracePeriod=30
Sep 09 21:24:09.246728 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:09.246465    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hpthm"
Sep 09 21:24:09.362308 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:09.362278    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:24:09.480003 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:09.479981    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7lhxk"
Sep 09 21:24:09.492510 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:09.492492    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-lrsms"]
Sep 09 21:24:09.493745 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:24:09.493711    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a4dce68_cbfc_4101_8a89_a0d35417abd5.slice/crio-2e0c21d0d61d6f896a5d72b43b25af24d177ba19ddd51d1b13d32b8bd64e6d24 WatchSource:0}: Error finding container 2e0c21d0d61d6f896a5d72b43b25af24d177ba19ddd51d1b13d32b8bd64e6d24: Status 404 returned error can't find the container with id 2e0c21d0d61d6f896a5d72b43b25af24d177ba19ddd51d1b13d32b8bd64e6d24
Sep 09 21:24:09.519453 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:09.519428    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:24:09.542986 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:24:09.542954    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6226f0de_d59b_4502_8e11_94381794f7cc.slice/crio-81e7daae9e4352d33959a57952d5cb753dbeefded04d5bab74fd2f13e1dda991 WatchSource:0}: Error finding container 81e7daae9e4352d33959a57952d5cb753dbeefded04d5bab74fd2f13e1dda991: Status 404 returned error can't find the container with id 81e7daae9e4352d33959a57952d5cb753dbeefded04d5bab74fd2f13e1dda991
Sep 09 21:24:09.543939 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:09.543919    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-hpthm"]
Sep 09 21:24:09.628087 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:09.628052    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb"
Sep 09 21:24:09.631684 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:09.631619    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5c738504-8dbc-49ee-92e3-dc58850db4c5-istio-csr-dns-cert\") pod \"5c738504-8dbc-49ee-92e3-dc58850db4c5\" (UID: \"5c738504-8dbc-49ee-92e3-dc58850db4c5\") "
Sep 09 21:24:09.631684 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:09.631679    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c738504-8dbc-49ee-92e3-dc58850db4c5-local-certs\") pod \"5c738504-8dbc-49ee-92e3-dc58850db4c5\" (UID: \"5c738504-8dbc-49ee-92e3-dc58850db4c5\") "
Sep 09 21:24:09.631925 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:09.631709    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5c738504-8dbc-49ee-92e3-dc58850db4c5-istio-kubeconfig\") pod \"5c738504-8dbc-49ee-92e3-dc58850db4c5\" (UID: \"5c738504-8dbc-49ee-92e3-dc58850db4c5\") "
Sep 09 21:24:09.631925 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:09.631844    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5c738504-8dbc-49ee-92e3-dc58850db4c5-istio-csr-ca-configmap\") pod \"5c738504-8dbc-49ee-92e3-dc58850db4c5\" (UID: \"5c738504-8dbc-49ee-92e3-dc58850db4c5\") "
Sep 09 21:24:09.631925 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:09.631884    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c738504-8dbc-49ee-92e3-dc58850db4c5-istio-token\") pod \"5c738504-8dbc-49ee-92e3-dc58850db4c5\" (UID: \"5c738504-8dbc-49ee-92e3-dc58850db4c5\") "
Sep 09 21:24:09.632090 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:09.631942    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5c738504-8dbc-49ee-92e3-dc58850db4c5-cacerts\") pod \"5c738504-8dbc-49ee-92e3-dc58850db4c5\" (UID: \"5c738504-8dbc-49ee-92e3-dc58850db4c5\") "
Sep 09 21:24:09.632090 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:09.631984    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lvclk\" (UniqueName: \"kubernetes.io/projected/5c738504-8dbc-49ee-92e3-dc58850db4c5-kube-api-access-lvclk\") pod \"5c738504-8dbc-49ee-92e3-dc58850db4c5\" (UID: \"5c738504-8dbc-49ee-92e3-dc58850db4c5\") "
Sep 09 21:24:09.632289 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:09.632213    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c738504-8dbc-49ee-92e3-dc58850db4c5-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "5c738504-8dbc-49ee-92e3-dc58850db4c5" (UID: "5c738504-8dbc-49ee-92e3-dc58850db4c5"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 21:24:09.634080 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:09.634051    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb"
Sep 09 21:24:09.634791 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:09.634762    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c738504-8dbc-49ee-92e3-dc58850db4c5-local-certs" (OuterVolumeSpecName: "local-certs") pod "5c738504-8dbc-49ee-92e3-dc58850db4c5" (UID: "5c738504-8dbc-49ee-92e3-dc58850db4c5"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:24:09.634917 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:09.634772    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c738504-8dbc-49ee-92e3-dc58850db4c5-istio-token" (OuterVolumeSpecName: "istio-token") pod "5c738504-8dbc-49ee-92e3-dc58850db4c5" (UID: "5c738504-8dbc-49ee-92e3-dc58850db4c5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:24:09.634917 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:09.634798    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c738504-8dbc-49ee-92e3-dc58850db4c5-cacerts" (OuterVolumeSpecName: "cacerts") pod "5c738504-8dbc-49ee-92e3-dc58850db4c5" (UID: "5c738504-8dbc-49ee-92e3-dc58850db4c5"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:24:09.634917 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:09.634851    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c738504-8dbc-49ee-92e3-dc58850db4c5-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "5c738504-8dbc-49ee-92e3-dc58850db4c5" (UID: "5c738504-8dbc-49ee-92e3-dc58850db4c5"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:24:09.635154 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:09.635133    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c738504-8dbc-49ee-92e3-dc58850db4c5-kube-api-access-lvclk" (OuterVolumeSpecName: "kube-api-access-lvclk") pod "5c738504-8dbc-49ee-92e3-dc58850db4c5" (UID: "5c738504-8dbc-49ee-92e3-dc58850db4c5"). InnerVolumeSpecName "kube-api-access-lvclk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:24:09.635424 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:09.635405    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c738504-8dbc-49ee-92e3-dc58850db4c5-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "5c738504-8dbc-49ee-92e3-dc58850db4c5" (UID: "5c738504-8dbc-49ee-92e3-dc58850db4c5"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:24:09.733242 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:09.733218    2555 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c738504-8dbc-49ee-92e3-dc58850db4c5-local-certs\") on node \"ip-10-0-133-235.ec2.internal\" DevicePath \"\""
Sep 09 21:24:09.733242 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:09.733238    2555 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5c738504-8dbc-49ee-92e3-dc58850db4c5-istio-kubeconfig\") on node \"ip-10-0-133-235.ec2.internal\" DevicePath \"\""
Sep 09 21:24:09.733379 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:09.733247    2555 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5c738504-8dbc-49ee-92e3-dc58850db4c5-istio-csr-ca-configmap\") on node \"ip-10-0-133-235.ec2.internal\" DevicePath \"\""
Sep 09 21:24:09.733379 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:09.733256    2555 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c738504-8dbc-49ee-92e3-dc58850db4c5-istio-token\") on node \"ip-10-0-133-235.ec2.internal\" DevicePath \"\""
Sep 09 21:24:09.733379 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:09.733263    2555 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5c738504-8dbc-49ee-92e3-dc58850db4c5-cacerts\") on node \"ip-10-0-133-235.ec2.internal\" DevicePath \"\""
Sep 09 21:24:09.733379 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:09.733270    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lvclk\" (UniqueName: \"kubernetes.io/projected/5c738504-8dbc-49ee-92e3-dc58850db4c5-kube-api-access-lvclk\") on node \"ip-10-0-133-235.ec2.internal\" DevicePath \"\""
Sep 09 21:24:09.733379 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:09.733278    2555 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5c738504-8dbc-49ee-92e3-dc58850db4c5-istio-csr-dns-cert\") on node \"ip-10-0-133-235.ec2.internal\" DevicePath \"\""
Sep 09 21:24:09.771871 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:09.771841    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-lrsms" event={"ID":"2a4dce68-cbfc-4101-8a89-a0d35417abd5","Type":"ContainerStarted","Data":"2e0c21d0d61d6f896a5d72b43b25af24d177ba19ddd51d1b13d32b8bd64e6d24"}
Sep 09 21:24:09.773151 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:09.773128    2555 generic.go:356] "Generic (PLEG): container finished" podID="5c738504-8dbc-49ee-92e3-dc58850db4c5" containerID="5df0be54394038ef9231eea10e3dcd0f7cf56686aec7eef6e900b3d55329e78b" exitCode=0
Sep 09 21:24:09.773221 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:09.773177    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7lhxk"
Sep 09 21:24:09.773257 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:09.773213    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7lhxk" event={"ID":"5c738504-8dbc-49ee-92e3-dc58850db4c5","Type":"ContainerDied","Data":"5df0be54394038ef9231eea10e3dcd0f7cf56686aec7eef6e900b3d55329e78b"}
Sep 09 21:24:09.773314 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:09.773265    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7lhxk" event={"ID":"5c738504-8dbc-49ee-92e3-dc58850db4c5","Type":"ContainerDied","Data":"340e819f830256af9f780324d8b041689af260d4068f9413e0aca8a011d1c2da"}
Sep 09 21:24:09.773314 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:09.773295    2555 scope.go:117] "RemoveContainer" containerID="5df0be54394038ef9231eea10e3dcd0f7cf56686aec7eef6e900b3d55329e78b"
Sep 09 21:24:09.774584 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:09.774562    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hpthm" event={"ID":"6226f0de-d59b-4502-8e11-94381794f7cc","Type":"ContainerStarted","Data":"81e7daae9e4352d33959a57952d5cb753dbeefded04d5bab74fd2f13e1dda991"}
Sep 09 21:24:09.774703 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:09.774685    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb"
Sep 09 21:24:09.775693 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:09.775674    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb"
Sep 09 21:24:09.781563 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:09.781546    2555 scope.go:117] "RemoveContainer" containerID="5df0be54394038ef9231eea10e3dcd0f7cf56686aec7eef6e900b3d55329e78b"
Sep 09 21:24:09.781836 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:24:09.781796    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5df0be54394038ef9231eea10e3dcd0f7cf56686aec7eef6e900b3d55329e78b\": container with ID starting with 5df0be54394038ef9231eea10e3dcd0f7cf56686aec7eef6e900b3d55329e78b not found: ID does not exist" containerID="5df0be54394038ef9231eea10e3dcd0f7cf56686aec7eef6e900b3d55329e78b"
Sep 09 21:24:09.781921 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:09.781841    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5df0be54394038ef9231eea10e3dcd0f7cf56686aec7eef6e900b3d55329e78b"} err="failed to get container status \"5df0be54394038ef9231eea10e3dcd0f7cf56686aec7eef6e900b3d55329e78b\": rpc error: code = NotFound desc = could not find container \"5df0be54394038ef9231eea10e3dcd0f7cf56686aec7eef6e900b3d55329e78b\": container with ID starting with 5df0be54394038ef9231eea10e3dcd0f7cf56686aec7eef6e900b3d55329e78b not found: ID does not exist"
Sep 09 21:24:09.832869 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:09.832831    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7lhxk"]
Sep 09 21:24:09.846575 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:09.846548    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7lhxk"]
Sep 09 21:24:11.471930 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:11.471897    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c738504-8dbc-49ee-92e3-dc58850db4c5" path="/var/lib/kubelet/pods/5c738504-8dbc-49ee-92e3-dc58850db4c5/volumes"
Sep 09 21:24:12.732537 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:12.732504    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-9vqfn"
Sep 09 21:24:12.736391 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:12.736371    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-ffh5g"
Sep 09 21:24:13.800175 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:13.800135    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-lrsms" event={"ID":"2a4dce68-cbfc-4101-8a89-a0d35417abd5","Type":"ContainerStarted","Data":"cf10f336c0b0873f69f448080dd5936fca2f22ca818293ee76ce6d4df1ad4edc"}
Sep 09 21:24:13.800612 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:13.800210    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-lrsms"
Sep 09 21:24:13.801713 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:13.801683    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hpthm" event={"ID":"6226f0de-d59b-4502-8e11-94381794f7cc","Type":"ContainerStarted","Data":"d2cc8299f5641eade3d3d79b1117c20f5dba83477d15fba282f1f29440cb5477"}
Sep 09 21:24:13.801814 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:13.801743    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hpthm"
Sep 09 21:24:13.873020 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:13.872977    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-lrsms" podStartSLOduration=2.466137417 podStartE2EDuration="5.872963745s" totalImagesPullingTime="3.406826328s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:24:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:24:13.838435394 +0000 UTC m=+976.817753506" watchObservedRunningTime="2026-09-09 21:24:13.872963745 +0000 UTC m=+976.852281857"
Sep 09 21:24:13.873747 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:13.873721    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hpthm" podStartSLOduration=2.466480054 podStartE2EDuration="5.873713939s" totalImagesPullingTime="3.407233885s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:24:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:24:13.872334681 +0000 UTC m=+976.851652806" watchObservedRunningTime="2026-09-09 21:24:13.873713939 +0000 UTC m=+976.853032052"
Sep 09 21:24:32.619777 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:32.619742    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:24:32.714933 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:32.714905    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:24:34.411424 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:34.411388    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:24:34.492439 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:34.492409    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:24:44.808499 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:44.808469    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hpthm"
Sep 09 21:24:44.811497 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:44.811477    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-lrsms"
Sep 09 21:24:55.370129 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:55.370096    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:24:55.560098 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:24:55.560068    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:25:00.752760 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:00.752726    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5dc9c"]
Sep 09 21:25:00.753226 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:00.753069    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c738504-8dbc-49ee-92e3-dc58850db4c5" containerName="discovery"
Sep 09 21:25:00.753226 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:00.753082    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c738504-8dbc-49ee-92e3-dc58850db4c5" containerName="discovery"
Sep 09 21:25:00.753226 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:00.753152    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c738504-8dbc-49ee-92e3-dc58850db4c5" containerName="discovery"
Sep 09 21:25:00.755640 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:00.755621    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5dc9c"
Sep 09 21:25:00.759023 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:00.759004    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bq875\""
Sep 09 21:25:00.759138 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:00.759029    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 09 21:25:00.760005 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:00.759986    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 09 21:25:00.774336 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:00.774313    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5dc9c"]
Sep 09 21:25:00.850854 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:00.850800    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkkr6\" (UniqueName: \"kubernetes.io/projected/144c772a-ec10-467c-983c-7c8d63d525e2-kube-api-access-fkkr6\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5dc9c\" (UID: \"144c772a-ec10-467c-983c-7c8d63d525e2\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5dc9c"
Sep 09 21:25:00.850985 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:00.850863    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/144c772a-ec10-467c-983c-7c8d63d525e2-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5dc9c\" (UID: \"144c772a-ec10-467c-983c-7c8d63d525e2\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5dc9c"
Sep 09 21:25:00.850985 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:00.850898    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/144c772a-ec10-467c-983c-7c8d63d525e2-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5dc9c\" (UID: \"144c772a-ec10-467c-983c-7c8d63d525e2\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5dc9c"
Sep 09 21:25:00.854018 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:00.853993    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76j7cv"]
Sep 09 21:25:00.856592 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:00.856573    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76j7cv"
Sep 09 21:25:00.870493 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:00.870468    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76j7cv"]
Sep 09 21:25:00.942173 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:00.942147    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847acj59l"]
Sep 09 21:25:00.944915 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:00.944899    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847acj59l"
Sep 09 21:25:00.951345 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:00.951325    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkkr6\" (UniqueName: \"kubernetes.io/projected/144c772a-ec10-467c-983c-7c8d63d525e2-kube-api-access-fkkr6\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5dc9c\" (UID: \"144c772a-ec10-467c-983c-7c8d63d525e2\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5dc9c"
Sep 09 21:25:00.951430 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:00.951353    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/144c772a-ec10-467c-983c-7c8d63d525e2-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5dc9c\" (UID: \"144c772a-ec10-467c-983c-7c8d63d525e2\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5dc9c"
Sep 09 21:25:00.951430 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:00.951375    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/61a69899-0d52-417b-8bff-be596acd0d7c-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76j7cv\" (UID: \"61a69899-0d52-417b-8bff-be596acd0d7c\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76j7cv"
Sep 09 21:25:00.951534 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:00.951509    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/144c772a-ec10-467c-983c-7c8d63d525e2-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5dc9c\" (UID: \"144c772a-ec10-467c-983c-7c8d63d525e2\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5dc9c"
Sep 09 21:25:00.951625 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:00.951607    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/61a69899-0d52-417b-8bff-be596acd0d7c-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76j7cv\" (UID: \"61a69899-0d52-417b-8bff-be596acd0d7c\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76j7cv"
Sep 09 21:25:00.951701 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:00.951682    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/144c772a-ec10-467c-983c-7c8d63d525e2-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5dc9c\" (UID: \"144c772a-ec10-467c-983c-7c8d63d525e2\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5dc9c"
Sep 09 21:25:00.951741 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:00.951700    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlpdj\" (UniqueName: \"kubernetes.io/projected/61a69899-0d52-417b-8bff-be596acd0d7c-kube-api-access-jlpdj\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76j7cv\" (UID: \"61a69899-0d52-417b-8bff-be596acd0d7c\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76j7cv"
Sep 09 21:25:00.951815 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:00.951799    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/144c772a-ec10-467c-983c-7c8d63d525e2-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5dc9c\" (UID: \"144c772a-ec10-467c-983c-7c8d63d525e2\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5dc9c"
Sep 09 21:25:00.957632 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:00.957610    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847acj59l"]
Sep 09 21:25:00.961381 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:00.961362    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkkr6\" (UniqueName: \"kubernetes.io/projected/144c772a-ec10-467c-983c-7c8d63d525e2-kube-api-access-fkkr6\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5dc9c\" (UID: \"144c772a-ec10-467c-983c-7c8d63d525e2\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5dc9c"
Sep 09 21:25:01.050074 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:01.049998    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsd8c"]
Sep 09 21:25:01.052276 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:01.052254    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/61a69899-0d52-417b-8bff-be596acd0d7c-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76j7cv\" (UID: \"61a69899-0d52-417b-8bff-be596acd0d7c\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76j7cv"
Sep 09 21:25:01.052337 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:01.052306    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlpdj\" (UniqueName: \"kubernetes.io/projected/61a69899-0d52-417b-8bff-be596acd0d7c-kube-api-access-jlpdj\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76j7cv\" (UID: \"61a69899-0d52-417b-8bff-be596acd0d7c\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76j7cv"
Sep 09 21:25:01.052337 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:01.052326    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d08148e3-f3ca-4658-8b29-3e717a2d7a5d-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847acj59l\" (UID: \"d08148e3-f3ca-4658-8b29-3e717a2d7a5d\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847acj59l"
Sep 09 21:25:01.052409 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:01.052355    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d08148e3-f3ca-4658-8b29-3e717a2d7a5d-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847acj59l\" (UID: \"d08148e3-f3ca-4658-8b29-3e717a2d7a5d\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847acj59l"
Sep 09 21:25:01.052451 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:01.052433    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjsbq\" (UniqueName: \"kubernetes.io/projected/d08148e3-f3ca-4658-8b29-3e717a2d7a5d-kube-api-access-sjsbq\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847acj59l\" (UID: \"d08148e3-f3ca-4658-8b29-3e717a2d7a5d\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847acj59l"
Sep 09 21:25:01.052485 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:01.052468    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/61a69899-0d52-417b-8bff-be596acd0d7c-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76j7cv\" (UID: \"61a69899-0d52-417b-8bff-be596acd0d7c\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76j7cv"
Sep 09 21:25:01.052654 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:01.052638    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsd8c"
Sep 09 21:25:01.052735 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:01.052655    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/61a69899-0d52-417b-8bff-be596acd0d7c-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76j7cv\" (UID: \"61a69899-0d52-417b-8bff-be596acd0d7c\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76j7cv"
Sep 09 21:25:01.052843 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:01.052807    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/61a69899-0d52-417b-8bff-be596acd0d7c-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76j7cv\" (UID: \"61a69899-0d52-417b-8bff-be596acd0d7c\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76j7cv"
Sep 09 21:25:01.064023 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:01.064002    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlpdj\" (UniqueName: \"kubernetes.io/projected/61a69899-0d52-417b-8bff-be596acd0d7c-kube-api-access-jlpdj\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76j7cv\" (UID: \"61a69899-0d52-417b-8bff-be596acd0d7c\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76j7cv"
Sep 09 21:25:01.064736 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:01.064723    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5dc9c"
Sep 09 21:25:01.071301 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:01.071277    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsd8c"]
Sep 09 21:25:01.153415 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:01.153386    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d08148e3-f3ca-4658-8b29-3e717a2d7a5d-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847acj59l\" (UID: \"d08148e3-f3ca-4658-8b29-3e717a2d7a5d\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847acj59l"
Sep 09 21:25:01.153578 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:01.153439    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clhmq\" (UniqueName: \"kubernetes.io/projected/3bf92ca0-80ab-44d7-a1da-071f22294670-kube-api-access-clhmq\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsd8c\" (UID: \"3bf92ca0-80ab-44d7-a1da-071f22294670\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsd8c"
Sep 09 21:25:01.153578 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:01.153476    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d08148e3-f3ca-4658-8b29-3e717a2d7a5d-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847acj59l\" (UID: \"d08148e3-f3ca-4658-8b29-3e717a2d7a5d\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847acj59l"
Sep 09 21:25:01.153578 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:01.153502    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3bf92ca0-80ab-44d7-a1da-071f22294670-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsd8c\" (UID: \"3bf92ca0-80ab-44d7-a1da-071f22294670\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsd8c"
Sep 09 21:25:01.153578 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:01.153535    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3bf92ca0-80ab-44d7-a1da-071f22294670-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsd8c\" (UID: \"3bf92ca0-80ab-44d7-a1da-071f22294670\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsd8c"
Sep 09 21:25:01.153578 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:01.153565    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjsbq\" (UniqueName: \"kubernetes.io/projected/d08148e3-f3ca-4658-8b29-3e717a2d7a5d-kube-api-access-sjsbq\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847acj59l\" (UID: \"d08148e3-f3ca-4658-8b29-3e717a2d7a5d\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847acj59l"
Sep 09 21:25:01.154264 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:01.153782    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d08148e3-f3ca-4658-8b29-3e717a2d7a5d-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847acj59l\" (UID: \"d08148e3-f3ca-4658-8b29-3e717a2d7a5d\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847acj59l"
Sep 09 21:25:01.154264 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:01.153878    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d08148e3-f3ca-4658-8b29-3e717a2d7a5d-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847acj59l\" (UID: \"d08148e3-f3ca-4658-8b29-3e717a2d7a5d\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847acj59l"
Sep 09 21:25:01.163032 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:01.163005    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjsbq\" (UniqueName: \"kubernetes.io/projected/d08148e3-f3ca-4658-8b29-3e717a2d7a5d-kube-api-access-sjsbq\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847acj59l\" (UID: \"d08148e3-f3ca-4658-8b29-3e717a2d7a5d\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847acj59l"
Sep 09 21:25:01.165794 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:01.165774    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76j7cv"
Sep 09 21:25:01.253671 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:01.253644    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847acj59l"
Sep 09 21:25:01.255129 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:01.255101    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clhmq\" (UniqueName: \"kubernetes.io/projected/3bf92ca0-80ab-44d7-a1da-071f22294670-kube-api-access-clhmq\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsd8c\" (UID: \"3bf92ca0-80ab-44d7-a1da-071f22294670\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsd8c"
Sep 09 21:25:01.255259 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:01.255150    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3bf92ca0-80ab-44d7-a1da-071f22294670-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsd8c\" (UID: \"3bf92ca0-80ab-44d7-a1da-071f22294670\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsd8c"
Sep 09 21:25:01.255259 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:01.255190    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3bf92ca0-80ab-44d7-a1da-071f22294670-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsd8c\" (UID: \"3bf92ca0-80ab-44d7-a1da-071f22294670\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsd8c"
Sep 09 21:25:01.255765 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:01.255580    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3bf92ca0-80ab-44d7-a1da-071f22294670-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsd8c\" (UID: \"3bf92ca0-80ab-44d7-a1da-071f22294670\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsd8c"
Sep 09 21:25:01.255765 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:01.255675    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3bf92ca0-80ab-44d7-a1da-071f22294670-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsd8c\" (UID: \"3bf92ca0-80ab-44d7-a1da-071f22294670\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsd8c"
Sep 09 21:25:01.265874 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:01.265846    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-clhmq\" (UniqueName: \"kubernetes.io/projected/3bf92ca0-80ab-44d7-a1da-071f22294670-kube-api-access-clhmq\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsd8c\" (UID: \"3bf92ca0-80ab-44d7-a1da-071f22294670\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsd8c"
Sep 09 21:25:01.340416 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:01.340383    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5dc9c"]
Sep 09 21:25:01.341754 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:25:01.341713    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod144c772a_ec10_467c_983c_7c8d63d525e2.slice/crio-9b521587d038338c630f76a2200ca583d94cfdec0d9f3694bc5e5d80daefdd46 WatchSource:0}: Error finding container 9b521587d038338c630f76a2200ca583d94cfdec0d9f3694bc5e5d80daefdd46: Status 404 returned error can't find the container with id 9b521587d038338c630f76a2200ca583d94cfdec0d9f3694bc5e5d80daefdd46
Sep 09 21:25:01.361461 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:01.361442    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsd8c"
Sep 09 21:25:01.460006 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:01.459977    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76j7cv"]
Sep 09 21:25:01.462074 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:25:01.462047    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61a69899_0d52_417b_8bff_be596acd0d7c.slice/crio-12e5fcfec0dc363bc865c370bd4ea1121149fc552778382dc55ab2f05c337139 WatchSource:0}: Error finding container 12e5fcfec0dc363bc865c370bd4ea1121149fc552778382dc55ab2f05c337139: Status 404 returned error can't find the container with id 12e5fcfec0dc363bc865c370bd4ea1121149fc552778382dc55ab2f05c337139
Sep 09 21:25:01.528668 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:01.528640    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847acj59l"]
Sep 09 21:25:01.530716 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:25:01.530693    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd08148e3_f3ca_4658_8b29_3e717a2d7a5d.slice/crio-8331772f5d5b25aef00f8896cb39d141f4eb9ecc02d29a4845a1002b784948b5 WatchSource:0}: Error finding container 8331772f5d5b25aef00f8896cb39d141f4eb9ecc02d29a4845a1002b784948b5: Status 404 returned error can't find the container with id 8331772f5d5b25aef00f8896cb39d141f4eb9ecc02d29a4845a1002b784948b5
Sep 09 21:25:01.645688 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:01.645664    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsd8c"]
Sep 09 21:25:01.695615 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:25:01.695588    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bf92ca0_80ab_44d7_a1da_071f22294670.slice/crio-c257ff7c2dd62d512557d76d215784f3d2a9eb92fed02dd122241ab029a475c9 WatchSource:0}: Error finding container c257ff7c2dd62d512557d76d215784f3d2a9eb92fed02dd122241ab029a475c9: Status 404 returned error can't find the container with id c257ff7c2dd62d512557d76d215784f3d2a9eb92fed02dd122241ab029a475c9
Sep 09 21:25:02.026186 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:02.026154    2555 generic.go:356] "Generic (PLEG): container finished" podID="144c772a-ec10-467c-983c-7c8d63d525e2" containerID="8b1aae064d9ec40767661c76e22da9ae138dc913dbe5d4655f61e73ba1746e30" exitCode=0
Sep 09 21:25:02.026573 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:02.026240    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5dc9c" event={"ID":"144c772a-ec10-467c-983c-7c8d63d525e2","Type":"ContainerDied","Data":"8b1aae064d9ec40767661c76e22da9ae138dc913dbe5d4655f61e73ba1746e30"}
Sep 09 21:25:02.026573 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:02.026291    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5dc9c" event={"ID":"144c772a-ec10-467c-983c-7c8d63d525e2","Type":"ContainerStarted","Data":"9b521587d038338c630f76a2200ca583d94cfdec0d9f3694bc5e5d80daefdd46"}
Sep 09 21:25:02.027323 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:02.027300    2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 21:25:02.027882 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:02.027860    2555 generic.go:356] "Generic (PLEG): container finished" podID="d08148e3-f3ca-4658-8b29-3e717a2d7a5d" containerID="d85625c9b44bde3967ea7ee97d67361155236324c75c3517db8fbf4a754f82e1" exitCode=0
Sep 09 21:25:02.027972 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:02.027948    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847acj59l" event={"ID":"d08148e3-f3ca-4658-8b29-3e717a2d7a5d","Type":"ContainerDied","Data":"d85625c9b44bde3967ea7ee97d67361155236324c75c3517db8fbf4a754f82e1"}
Sep 09 21:25:02.028090 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:02.027998    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847acj59l" event={"ID":"d08148e3-f3ca-4658-8b29-3e717a2d7a5d","Type":"ContainerStarted","Data":"8331772f5d5b25aef00f8896cb39d141f4eb9ecc02d29a4845a1002b784948b5"}
Sep 09 21:25:02.029460 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:02.029443    2555 generic.go:356] "Generic (PLEG): container finished" podID="3bf92ca0-80ab-44d7-a1da-071f22294670" containerID="1adeb9f334009ff42b7c6151b47bb96b33dac77186192fe885b9a1a5a0ef05ef" exitCode=0
Sep 09 21:25:02.029534 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:02.029513    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsd8c" event={"ID":"3bf92ca0-80ab-44d7-a1da-071f22294670","Type":"ContainerDied","Data":"1adeb9f334009ff42b7c6151b47bb96b33dac77186192fe885b9a1a5a0ef05ef"}
Sep 09 21:25:02.029597 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:02.029557    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsd8c" event={"ID":"3bf92ca0-80ab-44d7-a1da-071f22294670","Type":"ContainerStarted","Data":"c257ff7c2dd62d512557d76d215784f3d2a9eb92fed02dd122241ab029a475c9"}
Sep 09 21:25:02.031189 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:02.031170    2555 generic.go:356] "Generic (PLEG): container finished" podID="61a69899-0d52-417b-8bff-be596acd0d7c" containerID="6a9510238ccbc9743d6abede65c1c411fcf5ef666ef83ad51caca2846b5d08f4" exitCode=0
Sep 09 21:25:02.031340 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:02.031221    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76j7cv" event={"ID":"61a69899-0d52-417b-8bff-be596acd0d7c","Type":"ContainerDied","Data":"6a9510238ccbc9743d6abede65c1c411fcf5ef666ef83ad51caca2846b5d08f4"}
Sep 09 21:25:02.031340 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:02.031249    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76j7cv" event={"ID":"61a69899-0d52-417b-8bff-be596acd0d7c","Type":"ContainerStarted","Data":"12e5fcfec0dc363bc865c370bd4ea1121149fc552778382dc55ab2f05c337139"}
Sep 09 21:25:04.045619 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:04.045585    2555 generic.go:356] "Generic (PLEG): container finished" podID="3bf92ca0-80ab-44d7-a1da-071f22294670" containerID="733cfa16f7fef1d6922535a460fba1264b2ad9ac0fe772ba235da883494f79db" exitCode=0
Sep 09 21:25:04.046139 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:04.045671    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsd8c" event={"ID":"3bf92ca0-80ab-44d7-a1da-071f22294670","Type":"ContainerDied","Data":"733cfa16f7fef1d6922535a460fba1264b2ad9ac0fe772ba235da883494f79db"}
Sep 09 21:25:04.047574 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:04.047550    2555 generic.go:356] "Generic (PLEG): container finished" podID="61a69899-0d52-417b-8bff-be596acd0d7c" containerID="4b8e1a21215b61150b28cb1f3677bf89a2d31f86e8e5c449730aa694ddb85616" exitCode=0
Sep 09 21:25:04.047648 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:04.047632    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76j7cv" event={"ID":"61a69899-0d52-417b-8bff-be596acd0d7c","Type":"ContainerDied","Data":"4b8e1a21215b61150b28cb1f3677bf89a2d31f86e8e5c449730aa694ddb85616"}
Sep 09 21:25:04.049397 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:04.049373    2555 generic.go:356] "Generic (PLEG): container finished" podID="144c772a-ec10-467c-983c-7c8d63d525e2" containerID="a64e0c7e30194d1eb7e5eda93a0901f997c19559df1f35880cc01fcb157d2d60" exitCode=0
Sep 09 21:25:04.049474 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:04.049451    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5dc9c" event={"ID":"144c772a-ec10-467c-983c-7c8d63d525e2","Type":"ContainerDied","Data":"a64e0c7e30194d1eb7e5eda93a0901f997c19559df1f35880cc01fcb157d2d60"}
Sep 09 21:25:04.051549 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:04.051528    2555 generic.go:356] "Generic (PLEG): container finished" podID="d08148e3-f3ca-4658-8b29-3e717a2d7a5d" containerID="a2e2f88ef9f19cfb59f30209b1b063c633f193a26bae64745cd5f22d7c7ccbd1" exitCode=0
Sep 09 21:25:04.051682 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:04.051564    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847acj59l" event={"ID":"d08148e3-f3ca-4658-8b29-3e717a2d7a5d","Type":"ContainerDied","Data":"a2e2f88ef9f19cfb59f30209b1b063c633f193a26bae64745cd5f22d7c7ccbd1"}
Sep 09 21:25:05.059691 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:05.059658    2555 generic.go:356] "Generic (PLEG): container finished" podID="144c772a-ec10-467c-983c-7c8d63d525e2" containerID="d5c4a78c7e50824c66032fd9c7b084609755805aa35fdad1a506760b9ec18f04" exitCode=0
Sep 09 21:25:05.060072 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:05.059742    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5dc9c" event={"ID":"144c772a-ec10-467c-983c-7c8d63d525e2","Type":"ContainerDied","Data":"d5c4a78c7e50824c66032fd9c7b084609755805aa35fdad1a506760b9ec18f04"}
Sep 09 21:25:05.061793 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:05.061768    2555 generic.go:356] "Generic (PLEG): container finished" podID="d08148e3-f3ca-4658-8b29-3e717a2d7a5d" containerID="7b1a46859b27fc112e12beecea5e1a4a5e23d339fe267961540545711e266118" exitCode=0
Sep 09 21:25:05.061925 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:05.061847    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847acj59l" event={"ID":"d08148e3-f3ca-4658-8b29-3e717a2d7a5d","Type":"ContainerDied","Data":"7b1a46859b27fc112e12beecea5e1a4a5e23d339fe267961540545711e266118"}
Sep 09 21:25:05.063893 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:05.063874    2555 generic.go:356] "Generic (PLEG): container finished" podID="3bf92ca0-80ab-44d7-a1da-071f22294670" containerID="c039412fef4d430053aa969497ebc7463dc65ba6a780c208af7a3d8d841ff767" exitCode=0
Sep 09 21:25:05.064069 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:05.063951    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsd8c" event={"ID":"3bf92ca0-80ab-44d7-a1da-071f22294670","Type":"ContainerDied","Data":"c039412fef4d430053aa969497ebc7463dc65ba6a780c208af7a3d8d841ff767"}
Sep 09 21:25:05.065778 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:05.065756    2555 generic.go:356] "Generic (PLEG): container finished" podID="61a69899-0d52-417b-8bff-be596acd0d7c" containerID="ef91f65cece49e95e48e01dbd1f8657082eb946fb29d3e127f5c542484acb8ed" exitCode=0
Sep 09 21:25:05.065886 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:05.065836    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76j7cv" event={"ID":"61a69899-0d52-417b-8bff-be596acd0d7c","Type":"ContainerDied","Data":"ef91f65cece49e95e48e01dbd1f8657082eb946fb29d3e127f5c542484acb8ed"}
Sep 09 21:25:06.215358 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:06.215308    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsd8c"
Sep 09 21:25:06.237694 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:06.237666    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847acj59l"
Sep 09 21:25:06.263375 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:06.263285    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5dc9c"
Sep 09 21:25:06.270070 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:06.269971    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76j7cv"
Sep 09 21:25:06.300174 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:06.300105    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3bf92ca0-80ab-44d7-a1da-071f22294670-bundle\") pod \"3bf92ca0-80ab-44d7-a1da-071f22294670\" (UID: \"3bf92ca0-80ab-44d7-a1da-071f22294670\") "
Sep 09 21:25:06.300174 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:06.300167    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3bf92ca0-80ab-44d7-a1da-071f22294670-util\") pod \"3bf92ca0-80ab-44d7-a1da-071f22294670\" (UID: \"3bf92ca0-80ab-44d7-a1da-071f22294670\") "
Sep 09 21:25:06.300366 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:06.300286    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-clhmq\" (UniqueName: \"kubernetes.io/projected/3bf92ca0-80ab-44d7-a1da-071f22294670-kube-api-access-clhmq\") pod \"3bf92ca0-80ab-44d7-a1da-071f22294670\" (UID: \"3bf92ca0-80ab-44d7-a1da-071f22294670\") "
Sep 09 21:25:06.300619 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:06.300596    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3bf92ca0-80ab-44d7-a1da-071f22294670-bundle" (OuterVolumeSpecName: "bundle") pod "3bf92ca0-80ab-44d7-a1da-071f22294670" (UID: "3bf92ca0-80ab-44d7-a1da-071f22294670"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:25:06.302759 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:06.302734    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3bf92ca0-80ab-44d7-a1da-071f22294670-kube-api-access-clhmq" (OuterVolumeSpecName: "kube-api-access-clhmq") pod "3bf92ca0-80ab-44d7-a1da-071f22294670" (UID: "3bf92ca0-80ab-44d7-a1da-071f22294670"). InnerVolumeSpecName "kube-api-access-clhmq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:25:06.306555 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:06.306534    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3bf92ca0-80ab-44d7-a1da-071f22294670-util" (OuterVolumeSpecName: "util") pod "3bf92ca0-80ab-44d7-a1da-071f22294670" (UID: "3bf92ca0-80ab-44d7-a1da-071f22294670"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:25:06.401070 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:06.401011    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/61a69899-0d52-417b-8bff-be596acd0d7c-util\") pod \"61a69899-0d52-417b-8bff-be596acd0d7c\" (UID: \"61a69899-0d52-417b-8bff-be596acd0d7c\") "
Sep 09 21:25:06.401070 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:06.401048    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fkkr6\" (UniqueName: \"kubernetes.io/projected/144c772a-ec10-467c-983c-7c8d63d525e2-kube-api-access-fkkr6\") pod \"144c772a-ec10-467c-983c-7c8d63d525e2\" (UID: \"144c772a-ec10-467c-983c-7c8d63d525e2\") "
Sep 09 21:25:06.401249 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:06.401073    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sjsbq\" (UniqueName: \"kubernetes.io/projected/d08148e3-f3ca-4658-8b29-3e717a2d7a5d-kube-api-access-sjsbq\") pod \"d08148e3-f3ca-4658-8b29-3e717a2d7a5d\" (UID: \"d08148e3-f3ca-4658-8b29-3e717a2d7a5d\") "
Sep 09 21:25:06.401249 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:06.401113    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/144c772a-ec10-467c-983c-7c8d63d525e2-util\") pod \"144c772a-ec10-467c-983c-7c8d63d525e2\" (UID: \"144c772a-ec10-467c-983c-7c8d63d525e2\") "
Sep 09 21:25:06.401249 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:06.401138    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d08148e3-f3ca-4658-8b29-3e717a2d7a5d-bundle\") pod \"d08148e3-f3ca-4658-8b29-3e717a2d7a5d\" (UID: \"d08148e3-f3ca-4658-8b29-3e717a2d7a5d\") "
Sep 09 21:25:06.401249 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:06.401182    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/144c772a-ec10-467c-983c-7c8d63d525e2-bundle\") pod \"144c772a-ec10-467c-983c-7c8d63d525e2\" (UID: \"144c772a-ec10-467c-983c-7c8d63d525e2\") "
Sep 09 21:25:06.401249 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:06.401205    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jlpdj\" (UniqueName: \"kubernetes.io/projected/61a69899-0d52-417b-8bff-be596acd0d7c-kube-api-access-jlpdj\") pod \"61a69899-0d52-417b-8bff-be596acd0d7c\" (UID: \"61a69899-0d52-417b-8bff-be596acd0d7c\") "
Sep 09 21:25:06.401249 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:06.401242    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d08148e3-f3ca-4658-8b29-3e717a2d7a5d-util\") pod \"d08148e3-f3ca-4658-8b29-3e717a2d7a5d\" (UID: \"d08148e3-f3ca-4658-8b29-3e717a2d7a5d\") "
Sep 09 21:25:06.401562 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:06.401301    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/61a69899-0d52-417b-8bff-be596acd0d7c-bundle\") pod \"61a69899-0d52-417b-8bff-be596acd0d7c\" (UID: \"61a69899-0d52-417b-8bff-be596acd0d7c\") "
Sep 09 21:25:06.401618 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:06.401575    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-clhmq\" (UniqueName: \"kubernetes.io/projected/3bf92ca0-80ab-44d7-a1da-071f22294670-kube-api-access-clhmq\") on node \"ip-10-0-133-235.ec2.internal\" DevicePath \"\""
Sep 09 21:25:06.401618 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:06.401591    2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3bf92ca0-80ab-44d7-a1da-071f22294670-bundle\") on node \"ip-10-0-133-235.ec2.internal\" DevicePath \"\""
Sep 09 21:25:06.401618 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:06.401603    2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3bf92ca0-80ab-44d7-a1da-071f22294670-util\") on node \"ip-10-0-133-235.ec2.internal\" DevicePath \"\""
Sep 09 21:25:06.402172 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:06.402107    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/144c772a-ec10-467c-983c-7c8d63d525e2-bundle" (OuterVolumeSpecName: "bundle") pod "144c772a-ec10-467c-983c-7c8d63d525e2" (UID: "144c772a-ec10-467c-983c-7c8d63d525e2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:25:06.402282 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:06.402156    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d08148e3-f3ca-4658-8b29-3e717a2d7a5d-bundle" (OuterVolumeSpecName: "bundle") pod "d08148e3-f3ca-4658-8b29-3e717a2d7a5d" (UID: "d08148e3-f3ca-4658-8b29-3e717a2d7a5d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:25:06.402282 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:06.402195    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61a69899-0d52-417b-8bff-be596acd0d7c-bundle" (OuterVolumeSpecName: "bundle") pod "61a69899-0d52-417b-8bff-be596acd0d7c" (UID: "61a69899-0d52-417b-8bff-be596acd0d7c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:25:06.403711 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:06.403679    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/144c772a-ec10-467c-983c-7c8d63d525e2-kube-api-access-fkkr6" (OuterVolumeSpecName: "kube-api-access-fkkr6") pod "144c772a-ec10-467c-983c-7c8d63d525e2" (UID: "144c772a-ec10-467c-983c-7c8d63d525e2"). InnerVolumeSpecName "kube-api-access-fkkr6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:25:06.403850 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:06.403736    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61a69899-0d52-417b-8bff-be596acd0d7c-kube-api-access-jlpdj" (OuterVolumeSpecName: "kube-api-access-jlpdj") pod "61a69899-0d52-417b-8bff-be596acd0d7c" (UID: "61a69899-0d52-417b-8bff-be596acd0d7c"). InnerVolumeSpecName "kube-api-access-jlpdj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:25:06.403850 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:06.403804    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d08148e3-f3ca-4658-8b29-3e717a2d7a5d-kube-api-access-sjsbq" (OuterVolumeSpecName: "kube-api-access-sjsbq") pod "d08148e3-f3ca-4658-8b29-3e717a2d7a5d" (UID: "d08148e3-f3ca-4658-8b29-3e717a2d7a5d"). InnerVolumeSpecName "kube-api-access-sjsbq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:25:06.409103 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:06.409071    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/144c772a-ec10-467c-983c-7c8d63d525e2-util" (OuterVolumeSpecName: "util") pod "144c772a-ec10-467c-983c-7c8d63d525e2" (UID: "144c772a-ec10-467c-983c-7c8d63d525e2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:25:06.410051 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:06.410014    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61a69899-0d52-417b-8bff-be596acd0d7c-util" (OuterVolumeSpecName: "util") pod "61a69899-0d52-417b-8bff-be596acd0d7c" (UID: "61a69899-0d52-417b-8bff-be596acd0d7c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:25:06.412057 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:06.412035    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d08148e3-f3ca-4658-8b29-3e717a2d7a5d-util" (OuterVolumeSpecName: "util") pod "d08148e3-f3ca-4658-8b29-3e717a2d7a5d" (UID: "d08148e3-f3ca-4658-8b29-3e717a2d7a5d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:25:06.502273 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:06.502246    2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/61a69899-0d52-417b-8bff-be596acd0d7c-util\") on node \"ip-10-0-133-235.ec2.internal\" DevicePath \"\""
Sep 09 21:25:06.502273 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:06.502269    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fkkr6\" (UniqueName: \"kubernetes.io/projected/144c772a-ec10-467c-983c-7c8d63d525e2-kube-api-access-fkkr6\") on node \"ip-10-0-133-235.ec2.internal\" DevicePath \"\""
Sep 09 21:25:06.502426 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:06.502284    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sjsbq\" (UniqueName: \"kubernetes.io/projected/d08148e3-f3ca-4658-8b29-3e717a2d7a5d-kube-api-access-sjsbq\") on node \"ip-10-0-133-235.ec2.internal\" DevicePath \"\""
Sep 09 21:25:06.502426 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:06.502296    2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/144c772a-ec10-467c-983c-7c8d63d525e2-util\") on node \"ip-10-0-133-235.ec2.internal\" DevicePath \"\""
Sep 09 21:25:06.502426 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:06.502308    2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d08148e3-f3ca-4658-8b29-3e717a2d7a5d-bundle\") on node \"ip-10-0-133-235.ec2.internal\" DevicePath \"\""
Sep 09 21:25:06.502426 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:06.502318    2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/144c772a-ec10-467c-983c-7c8d63d525e2-bundle\") on node \"ip-10-0-133-235.ec2.internal\" DevicePath \"\""
Sep 09 21:25:06.502426 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:06.502330    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jlpdj\" (UniqueName: \"kubernetes.io/projected/61a69899-0d52-417b-8bff-be596acd0d7c-kube-api-access-jlpdj\") on node \"ip-10-0-133-235.ec2.internal\" DevicePath \"\""
Sep 09 21:25:06.502426 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:06.502341    2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d08148e3-f3ca-4658-8b29-3e717a2d7a5d-util\") on node \"ip-10-0-133-235.ec2.internal\" DevicePath \"\""
Sep 09 21:25:06.502426 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:06.502353    2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/61a69899-0d52-417b-8bff-be596acd0d7c-bundle\") on node \"ip-10-0-133-235.ec2.internal\" DevicePath \"\""
Sep 09 21:25:07.078293 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:07.078256    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847acj59l"
Sep 09 21:25:07.078488 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:07.078257    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847acj59l" event={"ID":"d08148e3-f3ca-4658-8b29-3e717a2d7a5d","Type":"ContainerDied","Data":"8331772f5d5b25aef00f8896cb39d141f4eb9ecc02d29a4845a1002b784948b5"}
Sep 09 21:25:07.078488 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:07.078401    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8331772f5d5b25aef00f8896cb39d141f4eb9ecc02d29a4845a1002b784948b5"
Sep 09 21:25:07.080422 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:07.080395    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsd8c"
Sep 09 21:25:07.080422 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:07.080400    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsd8c" event={"ID":"3bf92ca0-80ab-44d7-a1da-071f22294670","Type":"ContainerDied","Data":"c257ff7c2dd62d512557d76d215784f3d2a9eb92fed02dd122241ab029a475c9"}
Sep 09 21:25:07.080639 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:07.080448    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c257ff7c2dd62d512557d76d215784f3d2a9eb92fed02dd122241ab029a475c9"
Sep 09 21:25:07.082571 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:07.082552    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76j7cv"
Sep 09 21:25:07.082694 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:07.082570    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76j7cv" event={"ID":"61a69899-0d52-417b-8bff-be596acd0d7c","Type":"ContainerDied","Data":"12e5fcfec0dc363bc865c370bd4ea1121149fc552778382dc55ab2f05c337139"}
Sep 09 21:25:07.082694 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:07.082608    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="12e5fcfec0dc363bc865c370bd4ea1121149fc552778382dc55ab2f05c337139"
Sep 09 21:25:07.085022 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:07.084997    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5dc9c" event={"ID":"144c772a-ec10-467c-983c-7c8d63d525e2","Type":"ContainerDied","Data":"9b521587d038338c630f76a2200ca583d94cfdec0d9f3694bc5e5d80daefdd46"}
Sep 09 21:25:07.085155 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:07.085033    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5dc9c"
Sep 09 21:25:07.085155 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:07.085038    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9b521587d038338c630f76a2200ca583d94cfdec0d9f3694bc5e5d80daefdd46"
Sep 09 21:25:11.559413 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:11.559376    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:25:12.337652 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:12.337617    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:25:13.187372 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:13.187346    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:25:15.461076 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:15.461041    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:25:15.659917 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:15.659887    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:25:16.247293 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:16.247259    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n2jnl"]
Sep 09 21:25:16.247586 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:16.247574    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61a69899-0d52-417b-8bff-be596acd0d7c" containerName="extract"
Sep 09 21:25:16.247645 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:16.247587    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="61a69899-0d52-417b-8bff-be596acd0d7c" containerName="extract"
Sep 09 21:25:16.247645 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:16.247597    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bf92ca0-80ab-44d7-a1da-071f22294670" containerName="extract"
Sep 09 21:25:16.247645 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:16.247605    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bf92ca0-80ab-44d7-a1da-071f22294670" containerName="extract"
Sep 09 21:25:16.247645 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:16.247612    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d08148e3-f3ca-4658-8b29-3e717a2d7a5d" containerName="util"
Sep 09 21:25:16.247645 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:16.247617    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="d08148e3-f3ca-4658-8b29-3e717a2d7a5d" containerName="util"
Sep 09 21:25:16.247645 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:16.247627    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61a69899-0d52-417b-8bff-be596acd0d7c" containerName="pull"
Sep 09 21:25:16.247645 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:16.247635    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="61a69899-0d52-417b-8bff-be596acd0d7c" containerName="pull"
Sep 09 21:25:16.247645 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:16.247643    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d08148e3-f3ca-4658-8b29-3e717a2d7a5d" containerName="extract"
Sep 09 21:25:16.247933 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:16.247650    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="d08148e3-f3ca-4658-8b29-3e717a2d7a5d" containerName="extract"
Sep 09 21:25:16.247933 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:16.247657    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="144c772a-ec10-467c-983c-7c8d63d525e2" containerName="pull"
Sep 09 21:25:16.247933 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:16.247662    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="144c772a-ec10-467c-983c-7c8d63d525e2" containerName="pull"
Sep 09 21:25:16.247933 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:16.247669    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bf92ca0-80ab-44d7-a1da-071f22294670" containerName="util"
Sep 09 21:25:16.247933 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:16.247673    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bf92ca0-80ab-44d7-a1da-071f22294670" containerName="util"
Sep 09 21:25:16.247933 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:16.247679    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="144c772a-ec10-467c-983c-7c8d63d525e2" containerName="extract"
Sep 09 21:25:16.247933 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:16.247684    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="144c772a-ec10-467c-983c-7c8d63d525e2" containerName="extract"
Sep 09 21:25:16.247933 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:16.247690    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="144c772a-ec10-467c-983c-7c8d63d525e2" containerName="util"
Sep 09 21:25:16.247933 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:16.247694    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="144c772a-ec10-467c-983c-7c8d63d525e2" containerName="util"
Sep 09 21:25:16.247933 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:16.247700    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bf92ca0-80ab-44d7-a1da-071f22294670" containerName="pull"
Sep 09 21:25:16.247933 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:16.247705    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bf92ca0-80ab-44d7-a1da-071f22294670" containerName="pull"
Sep 09 21:25:16.247933 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:16.247711    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d08148e3-f3ca-4658-8b29-3e717a2d7a5d" containerName="pull"
Sep 09 21:25:16.247933 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:16.247715    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="d08148e3-f3ca-4658-8b29-3e717a2d7a5d" containerName="pull"
Sep 09 21:25:16.247933 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:16.247721    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61a69899-0d52-417b-8bff-be596acd0d7c" containerName="util"
Sep 09 21:25:16.247933 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:16.247725    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="61a69899-0d52-417b-8bff-be596acd0d7c" containerName="util"
Sep 09 21:25:16.247933 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:16.247779    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="3bf92ca0-80ab-44d7-a1da-071f22294670" containerName="extract"
Sep 09 21:25:16.247933 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:16.247787    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="61a69899-0d52-417b-8bff-be596acd0d7c" containerName="extract"
Sep 09 21:25:16.247933 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:16.247793    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="d08148e3-f3ca-4658-8b29-3e717a2d7a5d" containerName="extract"
Sep 09 21:25:16.247933 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:16.247799    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="144c772a-ec10-467c-983c-7c8d63d525e2" containerName="extract"
Sep 09 21:25:16.250675 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:16.250659    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n2jnl"
Sep 09 21:25:16.253588 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:16.253558    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 09 21:25:16.253588 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:16.253588    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 09 21:25:16.254042 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:16.254023    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-gnvgw\""
Sep 09 21:25:16.274499 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:16.274475    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n2jnl"]
Sep 09 21:25:16.379789 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:16.379761    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/08469a2e-a57e-46a0-a47a-013f933e4bbd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-n2jnl\" (UID: \"08469a2e-a57e-46a0-a47a-013f933e4bbd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n2jnl"
Sep 09 21:25:16.379941 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:16.379815    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hmd2\" (UniqueName: \"kubernetes.io/projected/08469a2e-a57e-46a0-a47a-013f933e4bbd-kube-api-access-8hmd2\") pod \"kuadrant-operator-controller-manager-76f8f686bf-n2jnl\" (UID: \"08469a2e-a57e-46a0-a47a-013f933e4bbd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n2jnl"
Sep 09 21:25:16.480855 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:16.480813    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/08469a2e-a57e-46a0-a47a-013f933e4bbd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-n2jnl\" (UID: \"08469a2e-a57e-46a0-a47a-013f933e4bbd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n2jnl"
Sep 09 21:25:16.481176 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:16.480886    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hmd2\" (UniqueName: \"kubernetes.io/projected/08469a2e-a57e-46a0-a47a-013f933e4bbd-kube-api-access-8hmd2\") pod \"kuadrant-operator-controller-manager-76f8f686bf-n2jnl\" (UID: \"08469a2e-a57e-46a0-a47a-013f933e4bbd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n2jnl"
Sep 09 21:25:16.481176 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:16.481123    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/08469a2e-a57e-46a0-a47a-013f933e4bbd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-n2jnl\" (UID: \"08469a2e-a57e-46a0-a47a-013f933e4bbd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n2jnl"
Sep 09 21:25:16.495470 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:16.495449    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hmd2\" (UniqueName: \"kubernetes.io/projected/08469a2e-a57e-46a0-a47a-013f933e4bbd-kube-api-access-8hmd2\") pod \"kuadrant-operator-controller-manager-76f8f686bf-n2jnl\" (UID: \"08469a2e-a57e-46a0-a47a-013f933e4bbd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n2jnl"
Sep 09 21:25:16.560677 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:16.560619    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n2jnl"
Sep 09 21:25:16.817599 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:16.817481    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:25:16.864490 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:16.864466    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n2jnl"]
Sep 09 21:25:16.866912 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:25:16.866874    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08469a2e_a57e_46a0_a47a_013f933e4bbd.slice/crio-a094d088f70e09e696cf62356a238c87e24e5e2e835f534980126ec564556ae4 WatchSource:0}: Error finding container a094d088f70e09e696cf62356a238c87e24e5e2e835f534980126ec564556ae4: Status 404 returned error can't find the container with id a094d088f70e09e696cf62356a238c87e24e5e2e835f534980126ec564556ae4
Sep 09 21:25:17.141847 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:17.141745    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n2jnl" event={"ID":"08469a2e-a57e-46a0-a47a-013f933e4bbd","Type":"ContainerStarted","Data":"a094d088f70e09e696cf62356a238c87e24e5e2e835f534980126ec564556ae4"}
Sep 09 21:25:18.541601 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:18.541566    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-6rhbf"]
Sep 09 21:25:18.546794 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:18.546769    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-6rhbf"
Sep 09 21:25:18.550914 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:18.550764    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-zhhx6\""
Sep 09 21:25:18.581674 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:18.581642    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-6rhbf"]
Sep 09 21:25:18.699056 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:18.699007    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjjxd\" (UniqueName: \"kubernetes.io/projected/bb654efd-4ff5-4f93-8147-cec993c941a5-kube-api-access-qjjxd\") pod \"limitador-operator-controller-manager-74495c69f8-6rhbf\" (UID: \"bb654efd-4ff5-4f93-8147-cec993c941a5\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-6rhbf"
Sep 09 21:25:18.800200 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:18.800112    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjjxd\" (UniqueName: \"kubernetes.io/projected/bb654efd-4ff5-4f93-8147-cec993c941a5-kube-api-access-qjjxd\") pod \"limitador-operator-controller-manager-74495c69f8-6rhbf\" (UID: \"bb654efd-4ff5-4f93-8147-cec993c941a5\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-6rhbf"
Sep 09 21:25:18.817472 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:18.817439    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjjxd\" (UniqueName: \"kubernetes.io/projected/bb654efd-4ff5-4f93-8147-cec993c941a5-kube-api-access-qjjxd\") pod \"limitador-operator-controller-manager-74495c69f8-6rhbf\" (UID: \"bb654efd-4ff5-4f93-8147-cec993c941a5\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-6rhbf"
Sep 09 21:25:18.861385 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:18.861349    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-6rhbf"
Sep 09 21:25:19.080871 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:19.080730    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:25:19.280144 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:19.280097    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:25:19.393115 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:19.393082    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:25:19.608675 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:19.608640    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-6rhbf"]
Sep 09 21:25:20.457103 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:20.457069    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:25:20.868528 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:25:20.868456    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb654efd_4ff5_4f93_8147_cec993c941a5.slice/crio-735aa244456f5b8a8cfbea1ad69411f9a1924f6cbcf29efb28d8dd828e5a4bc2 WatchSource:0}: Error finding container 735aa244456f5b8a8cfbea1ad69411f9a1924f6cbcf29efb28d8dd828e5a4bc2: Status 404 returned error can't find the container with id 735aa244456f5b8a8cfbea1ad69411f9a1924f6cbcf29efb28d8dd828e5a4bc2
Sep 09 21:25:21.175348 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:21.175309    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-6rhbf" event={"ID":"bb654efd-4ff5-4f93-8147-cec993c941a5","Type":"ContainerStarted","Data":"735aa244456f5b8a8cfbea1ad69411f9a1924f6cbcf29efb28d8dd828e5a4bc2"}
Sep 09 21:25:21.180150 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:21.180125    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n2jnl" event={"ID":"08469a2e-a57e-46a0-a47a-013f933e4bbd","Type":"ContainerStarted","Data":"0c592095eae3b24375d8e40327987ed942ce5ab3282998442e675ae0dab48611"}
Sep 09 21:25:21.180293 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:21.180194    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n2jnl"
Sep 09 21:25:21.250018 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:21.249962    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n2jnl" podStartSLOduration=1.178019157 podStartE2EDuration="5.249944311s" totalImagesPullingTime="4.071925154s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:25:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:25:21.229075678 +0000 UTC m=+1044.208393791" watchObservedRunningTime="2026-09-09 21:25:21.249944311 +0000 UTC m=+1044.229262425"
Sep 09 21:25:21.695197 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:21.695164    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-sqbfs"]
Sep 09 21:25:21.698813 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:21.698788    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-sqbfs"
Sep 09 21:25:21.704228 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:21.704210    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-t7mtl\""
Sep 09 21:25:21.722505 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:21.722478    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-sqbfs"]
Sep 09 21:25:21.827653 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:21.827612    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2tks\" (UniqueName: \"kubernetes.io/projected/cf35fb72-b001-468d-9467-e6722b40f167-kube-api-access-w2tks\") pod \"authorino-operator-76b478bd78-sqbfs\" (UID: \"cf35fb72-b001-468d-9467-e6722b40f167\") " pod="kuadrant-system/authorino-operator-76b478bd78-sqbfs"
Sep 09 21:25:21.928230 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:21.928195    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2tks\" (UniqueName: \"kubernetes.io/projected/cf35fb72-b001-468d-9467-e6722b40f167-kube-api-access-w2tks\") pod \"authorino-operator-76b478bd78-sqbfs\" (UID: \"cf35fb72-b001-468d-9467-e6722b40f167\") " pod="kuadrant-system/authorino-operator-76b478bd78-sqbfs"
Sep 09 21:25:21.939560 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:21.939532    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2tks\" (UniqueName: \"kubernetes.io/projected/cf35fb72-b001-468d-9467-e6722b40f167-kube-api-access-w2tks\") pod \"authorino-operator-76b478bd78-sqbfs\" (UID: \"cf35fb72-b001-468d-9467-e6722b40f167\") " pod="kuadrant-system/authorino-operator-76b478bd78-sqbfs"
Sep 09 21:25:22.009952 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:22.009856    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-sqbfs"
Sep 09 21:25:22.166443 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:22.166406    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:25:22.305588 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:22.305559    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-sqbfs"]
Sep 09 21:25:22.307704 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:25:22.307669    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf35fb72_b001_468d_9467_e6722b40f167.slice/crio-64de6938e57866b9bf1e85781fae43e7700d5b5fdc4ae1758928c640153e84cc WatchSource:0}: Error finding container 64de6938e57866b9bf1e85781fae43e7700d5b5fdc4ae1758928c640153e84cc: Status 404 returned error can't find the container with id 64de6938e57866b9bf1e85781fae43e7700d5b5fdc4ae1758928c640153e84cc
Sep 09 21:25:23.193270 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:23.193232    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-6rhbf" event={"ID":"bb654efd-4ff5-4f93-8147-cec993c941a5","Type":"ContainerStarted","Data":"47d78a3f50e229fffab2006e74648b99ee41f45906ceb18fee61821c1754252b"}
Sep 09 21:25:23.193702 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:23.193394    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-6rhbf"
Sep 09 21:25:23.194971 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:23.194941    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-sqbfs" event={"ID":"cf35fb72-b001-468d-9467-e6722b40f167","Type":"ContainerStarted","Data":"64de6938e57866b9bf1e85781fae43e7700d5b5fdc4ae1758928c640153e84cc"}
Sep 09 21:25:23.291978 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:23.291924    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-6rhbf" podStartSLOduration=3.256940966 podStartE2EDuration="5.291909005s" totalImagesPullingTime="2.034968039s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:25:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:25:23.286653865 +0000 UTC m=+1046.265971999" watchObservedRunningTime="2026-09-09 21:25:23.291909005 +0000 UTC m=+1046.271227118"
Sep 09 21:25:24.063830 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:24.063796    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:25:24.201980 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:24.201940    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-sqbfs" event={"ID":"cf35fb72-b001-468d-9467-e6722b40f167","Type":"ContainerStarted","Data":"c8105d597e19728c4fc7b5e5d634082ce915433fefa22352dd1452d7480d4e5e"}
Sep 09 21:25:24.202353 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:24.202105    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-sqbfs"
Sep 09 21:25:24.259035 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:24.258990    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-sqbfs" podStartSLOduration=1.54668929 podStartE2EDuration="3.258975769s" totalImagesPullingTime="1.712286479s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:25:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:25:24.257978961 +0000 UTC m=+1047.237297073" watchObservedRunningTime="2026-09-09 21:25:24.258975769 +0000 UTC m=+1047.238293882"
Sep 09 21:25:24.305226 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:24.305117    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:25:24.313052 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:24.313019    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-rmtz8"]
Sep 09 21:25:24.316507 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:24.316448    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-rmtz8"
Sep 09 21:25:24.329041 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:24.329014    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Sep 09 21:25:24.329125 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:24.329058    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-mqs9q\""
Sep 09 21:25:24.330852 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:24.330834    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Sep 09 21:25:24.339876 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:24.339847    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-rmtz8"]
Sep 09 21:25:24.451770 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:24.451737    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/74967a20-433c-4462-b629-ea1a882002be-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-rmtz8\" (UID: \"74967a20-433c-4462-b629-ea1a882002be\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-rmtz8"
Sep 09 21:25:24.451770 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:24.451774    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7b5p\" (UniqueName: \"kubernetes.io/projected/74967a20-433c-4462-b629-ea1a882002be-kube-api-access-n7b5p\") pod \"kuadrant-console-plugin-fbdd4f445-rmtz8\" (UID: \"74967a20-433c-4462-b629-ea1a882002be\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-rmtz8"
Sep 09 21:25:24.451988 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:24.451840    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/74967a20-433c-4462-b629-ea1a882002be-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-rmtz8\" (UID: \"74967a20-433c-4462-b629-ea1a882002be\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-rmtz8"
Sep 09 21:25:24.552802 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:24.552773    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/74967a20-433c-4462-b629-ea1a882002be-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-rmtz8\" (UID: \"74967a20-433c-4462-b629-ea1a882002be\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-rmtz8"
Sep 09 21:25:24.552802 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:24.552803    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7b5p\" (UniqueName: \"kubernetes.io/projected/74967a20-433c-4462-b629-ea1a882002be-kube-api-access-n7b5p\") pod \"kuadrant-console-plugin-fbdd4f445-rmtz8\" (UID: \"74967a20-433c-4462-b629-ea1a882002be\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-rmtz8"
Sep 09 21:25:24.552995 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:24.552920    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/74967a20-433c-4462-b629-ea1a882002be-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-rmtz8\" (UID: \"74967a20-433c-4462-b629-ea1a882002be\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-rmtz8"
Sep 09 21:25:24.553495 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:24.553472    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/74967a20-433c-4462-b629-ea1a882002be-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-rmtz8\" (UID: \"74967a20-433c-4462-b629-ea1a882002be\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-rmtz8"
Sep 09 21:25:24.555546 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:24.555495    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/74967a20-433c-4462-b629-ea1a882002be-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-rmtz8\" (UID: \"74967a20-433c-4462-b629-ea1a882002be\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-rmtz8"
Sep 09 21:25:24.565481 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:24.565460    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7b5p\" (UniqueName: \"kubernetes.io/projected/74967a20-433c-4462-b629-ea1a882002be-kube-api-access-n7b5p\") pod \"kuadrant-console-plugin-fbdd4f445-rmtz8\" (UID: \"74967a20-433c-4462-b629-ea1a882002be\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-rmtz8"
Sep 09 21:25:24.625814 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:24.625784    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-rmtz8"
Sep 09 21:25:24.660908 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:24.660877    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:25:24.904053 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:24.904026    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-rmtz8"]
Sep 09 21:25:24.906897 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:25:24.906870    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod74967a20_433c_4462_b629_ea1a882002be.slice/crio-4854754f547908f3d84c4ec3a7422ced0bf96e2275b79989d279b25d2ec20cfa WatchSource:0}: Error finding container 4854754f547908f3d84c4ec3a7422ced0bf96e2275b79989d279b25d2ec20cfa: Status 404 returned error can't find the container with id 4854754f547908f3d84c4ec3a7422ced0bf96e2275b79989d279b25d2ec20cfa
Sep 09 21:25:25.058833 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:25.058796    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:25:25.208761 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:25.208731    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-rmtz8" event={"ID":"74967a20-433c-4462-b629-ea1a882002be","Type":"ContainerStarted","Data":"4854754f547908f3d84c4ec3a7422ced0bf96e2275b79989d279b25d2ec20cfa"}
Sep 09 21:25:27.616944 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:27.616883    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:25:27.714931 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:27.714876    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:25:28.066101 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:28.066065    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:25:28.256167 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:28.256138    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:25:28.444192 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:28.444161    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:25:28.568127 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:28.568090    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:25:30.249804 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:30.249770    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-rmtz8" event={"ID":"74967a20-433c-4462-b629-ea1a882002be","Type":"ContainerStarted","Data":"eea61418876a6d5bf0145d7061d1ba88a0667f73c28483abac56330686b4c801"}
Sep 09 21:25:30.273476 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:30.273426    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-rmtz8" podStartSLOduration=1.499193117 podStartE2EDuration="6.273412885s" totalImagesPullingTime="4.774219768s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:25:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:25:30.273077022 +0000 UTC m=+1053.252395136" watchObservedRunningTime="2026-09-09 21:25:30.273412885 +0000 UTC m=+1053.252730997"
Sep 09 21:25:32.188618 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:32.188588    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n2jnl"
Sep 09 21:25:34.204502 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:34.204471    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-6rhbf"
Sep 09 21:25:34.751353 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:34.751323    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n2jnl"]
Sep 09 21:25:34.751583 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:34.751516    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n2jnl" podUID="08469a2e-a57e-46a0-a47a-013f933e4bbd" containerName="manager" containerID="cri-o://0c592095eae3b24375d8e40327987ed942ce5ab3282998442e675ae0dab48611" gracePeriod=2
Sep 09 21:25:34.759078 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:34.759051    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n2jnl"]
Sep 09 21:25:34.777286 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:34.777262    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-6rhbf"]
Sep 09 21:25:34.777462 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:34.777439    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-6rhbf" podUID="bb654efd-4ff5-4f93-8147-cec993c941a5" containerName="manager" containerID="cri-o://47d78a3f50e229fffab2006e74648b99ee41f45906ceb18fee61821c1754252b" gracePeriod=2
Sep 09 21:25:34.781781 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:25:34.781750    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-n2jnl\" is forbidden: User \"system:node:ip-10-0-133-235.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-235.ec2.internal' and this object" podUID="08469a2e-a57e-46a0-a47a-013f933e4bbd" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n2jnl"
Sep 09 21:25:34.792517 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:34.792492    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-6rhbf"]
Sep 09 21:25:34.796674 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:25:34.796634    2555 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"bb654efd-4ff5-4f93-8147-cec993c941a5\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-74495c69f8-6rhbf\": pods \"limitador-operator-controller-manager-74495c69f8-6rhbf\" not found" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-6rhbf"
Sep 09 21:25:34.797450 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:34.797429    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-g5ncr"]
Sep 09 21:25:34.797955 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:34.797940    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb654efd-4ff5-4f93-8147-cec993c941a5" containerName="manager"
Sep 09 21:25:34.797998 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:34.797959    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb654efd-4ff5-4f93-8147-cec993c941a5" containerName="manager"
Sep 09 21:25:34.797998 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:34.797978    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08469a2e-a57e-46a0-a47a-013f933e4bbd" containerName="manager"
Sep 09 21:25:34.797998 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:34.797987    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="08469a2e-a57e-46a0-a47a-013f933e4bbd" containerName="manager"
Sep 09 21:25:34.798094 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:34.798066    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="08469a2e-a57e-46a0-a47a-013f933e4bbd" containerName="manager"
Sep 09 21:25:34.798094 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:34.798082    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb654efd-4ff5-4f93-8147-cec993c941a5" containerName="manager"
Sep 09 21:25:34.801371 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:34.801352    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-g5ncr"
Sep 09 21:25:34.804508 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:25:34.804483    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-6rhbf\" is forbidden: User \"system:node:ip-10-0-133-235.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-235.ec2.internal' and this object" podUID="bb654efd-4ff5-4f93-8147-cec993c941a5" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-6rhbf"
Sep 09 21:25:34.823131 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:34.823104    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-gbplw"]
Sep 09 21:25:34.826674 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:34.826655    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-g5ncr"]
Sep 09 21:25:34.826768 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:34.826737    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-gbplw"
Sep 09 21:25:34.830590 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:34.830557    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtm2x\" (UniqueName: \"kubernetes.io/projected/c6419b52-5fa5-4c41-8a1c-3eaccd1538d6-kube-api-access-dtm2x\") pod \"kuadrant-operator-controller-manager-76f8f686bf-g5ncr\" (UID: \"c6419b52-5fa5-4c41-8a1c-3eaccd1538d6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-g5ncr"
Sep 09 21:25:34.830699 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:34.830621    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c6419b52-5fa5-4c41-8a1c-3eaccd1538d6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-g5ncr\" (UID: \"c6419b52-5fa5-4c41-8a1c-3eaccd1538d6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-g5ncr"
Sep 09 21:25:34.831470 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:34.831443    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:25:34.841006 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:34.840983    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-gbplw"]
Sep 09 21:25:34.866365 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:25:34.866337    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-n2jnl\" is forbidden: User \"system:node:ip-10-0-133-235.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-235.ec2.internal' and this object" podUID="08469a2e-a57e-46a0-a47a-013f933e4bbd" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n2jnl"
Sep 09 21:25:34.870477 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:25:34.870448    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-n2jnl\" is forbidden: User \"system:node:ip-10-0-133-235.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-235.ec2.internal' and this object" podUID="08469a2e-a57e-46a0-a47a-013f933e4bbd" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n2jnl"
Sep 09 21:25:34.872896 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:25:34.872872    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-6rhbf\" is forbidden: User \"system:node:ip-10-0-133-235.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-235.ec2.internal' and this object" podUID="bb654efd-4ff5-4f93-8147-cec993c941a5" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-6rhbf"
Sep 09 21:25:34.931938 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:34.931899    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c6419b52-5fa5-4c41-8a1c-3eaccd1538d6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-g5ncr\" (UID: \"c6419b52-5fa5-4c41-8a1c-3eaccd1538d6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-g5ncr"
Sep 09 21:25:34.932104 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:34.932004    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtm2x\" (UniqueName: \"kubernetes.io/projected/c6419b52-5fa5-4c41-8a1c-3eaccd1538d6-kube-api-access-dtm2x\") pod \"kuadrant-operator-controller-manager-76f8f686bf-g5ncr\" (UID: \"c6419b52-5fa5-4c41-8a1c-3eaccd1538d6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-g5ncr"
Sep 09 21:25:34.932104 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:34.932060    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dnj2\" (UniqueName: \"kubernetes.io/projected/ab5dbeeb-e34e-4677-a19a-8192e9983271-kube-api-access-4dnj2\") pod \"limitador-operator-controller-manager-74495c69f8-gbplw\" (UID: \"ab5dbeeb-e34e-4677-a19a-8192e9983271\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-gbplw"
Sep 09 21:25:34.932462 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:34.932443    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c6419b52-5fa5-4c41-8a1c-3eaccd1538d6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-g5ncr\" (UID: \"c6419b52-5fa5-4c41-8a1c-3eaccd1538d6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-g5ncr"
Sep 09 21:25:34.969001 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:34.968941    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtm2x\" (UniqueName: \"kubernetes.io/projected/c6419b52-5fa5-4c41-8a1c-3eaccd1538d6-kube-api-access-dtm2x\") pod \"kuadrant-operator-controller-manager-76f8f686bf-g5ncr\" (UID: \"c6419b52-5fa5-4c41-8a1c-3eaccd1538d6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-g5ncr"
Sep 09 21:25:35.011944 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:35.011913    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:25:35.025866 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:35.025845    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n2jnl"
Sep 09 21:25:35.028194 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:25:35.028166    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-n2jnl\" is forbidden: User \"system:node:ip-10-0-133-235.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-235.ec2.internal' and this object" podUID="08469a2e-a57e-46a0-a47a-013f933e4bbd" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n2jnl"
Sep 09 21:25:35.031026 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:25:35.030999    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-6rhbf\" is forbidden: User \"system:node:ip-10-0-133-235.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-235.ec2.internal' and this object" podUID="bb654efd-4ff5-4f93-8147-cec993c941a5" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-6rhbf"
Sep 09 21:25:35.032502 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:35.032484    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8hmd2\" (UniqueName: \"kubernetes.io/projected/08469a2e-a57e-46a0-a47a-013f933e4bbd-kube-api-access-8hmd2\") pod \"08469a2e-a57e-46a0-a47a-013f933e4bbd\" (UID: \"08469a2e-a57e-46a0-a47a-013f933e4bbd\") "
Sep 09 21:25:35.032597 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:35.032524    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/08469a2e-a57e-46a0-a47a-013f933e4bbd-extensions-socket-volume\") pod \"08469a2e-a57e-46a0-a47a-013f933e4bbd\" (UID: \"08469a2e-a57e-46a0-a47a-013f933e4bbd\") "
Sep 09 21:25:35.032661 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:35.032611    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dnj2\" (UniqueName: \"kubernetes.io/projected/ab5dbeeb-e34e-4677-a19a-8192e9983271-kube-api-access-4dnj2\") pod \"limitador-operator-controller-manager-74495c69f8-gbplw\" (UID: \"ab5dbeeb-e34e-4677-a19a-8192e9983271\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-gbplw"
Sep 09 21:25:35.033052 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:35.033030    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08469a2e-a57e-46a0-a47a-013f933e4bbd-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "08469a2e-a57e-46a0-a47a-013f933e4bbd" (UID: "08469a2e-a57e-46a0-a47a-013f933e4bbd"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:25:35.034693 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:35.034673    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08469a2e-a57e-46a0-a47a-013f933e4bbd-kube-api-access-8hmd2" (OuterVolumeSpecName: "kube-api-access-8hmd2") pod "08469a2e-a57e-46a0-a47a-013f933e4bbd" (UID: "08469a2e-a57e-46a0-a47a-013f933e4bbd"). InnerVolumeSpecName "kube-api-access-8hmd2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:25:35.040146 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:35.040128    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-6rhbf"
Sep 09 21:25:35.042597 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:25:35.042575    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-6rhbf\" is forbidden: User \"system:node:ip-10-0-133-235.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-235.ec2.internal' and this object" podUID="bb654efd-4ff5-4f93-8147-cec993c941a5" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-6rhbf"
Sep 09 21:25:35.045071 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:25:35.045050    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-n2jnl\" is forbidden: User \"system:node:ip-10-0-133-235.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-235.ec2.internal' and this object" podUID="08469a2e-a57e-46a0-a47a-013f933e4bbd" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n2jnl"
Sep 09 21:25:35.047191 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:35.047171    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dnj2\" (UniqueName: \"kubernetes.io/projected/ab5dbeeb-e34e-4677-a19a-8192e9983271-kube-api-access-4dnj2\") pod \"limitador-operator-controller-manager-74495c69f8-gbplw\" (UID: \"ab5dbeeb-e34e-4677-a19a-8192e9983271\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-gbplw"
Sep 09 21:25:35.133282 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:35.133259    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8hmd2\" (UniqueName: \"kubernetes.io/projected/08469a2e-a57e-46a0-a47a-013f933e4bbd-kube-api-access-8hmd2\") on node \"ip-10-0-133-235.ec2.internal\" DevicePath \"\""
Sep 09 21:25:35.133282 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:35.133278    2555 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/08469a2e-a57e-46a0-a47a-013f933e4bbd-extensions-socket-volume\") on node \"ip-10-0-133-235.ec2.internal\" DevicePath \"\""
Sep 09 21:25:35.153212 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:35.153196    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-g5ncr"
Sep 09 21:25:35.166975 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:35.166956    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-gbplw"
Sep 09 21:25:35.211216 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:35.211187    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-sqbfs"
Sep 09 21:25:35.215278 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:25:35.215238    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-n2jnl\" is forbidden: User \"system:node:ip-10-0-133-235.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-235.ec2.internal' and this object" podUID="08469a2e-a57e-46a0-a47a-013f933e4bbd" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n2jnl"
Sep 09 21:25:35.220639 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:25:35.219701    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-6rhbf\" is forbidden: User \"system:node:ip-10-0-133-235.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-235.ec2.internal' and this object" podUID="bb654efd-4ff5-4f93-8147-cec993c941a5" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-6rhbf"
Sep 09 21:25:35.234081 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:35.234060    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qjjxd\" (UniqueName: \"kubernetes.io/projected/bb654efd-4ff5-4f93-8147-cec993c941a5-kube-api-access-qjjxd\") pod \"bb654efd-4ff5-4f93-8147-cec993c941a5\" (UID: \"bb654efd-4ff5-4f93-8147-cec993c941a5\") "
Sep 09 21:25:35.235995 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:35.235907    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb654efd-4ff5-4f93-8147-cec993c941a5-kube-api-access-qjjxd" (OuterVolumeSpecName: "kube-api-access-qjjxd") pod "bb654efd-4ff5-4f93-8147-cec993c941a5" (UID: "bb654efd-4ff5-4f93-8147-cec993c941a5"). InnerVolumeSpecName "kube-api-access-qjjxd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:25:35.283363 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:35.283289    2555 generic.go:356] "Generic (PLEG): container finished" podID="08469a2e-a57e-46a0-a47a-013f933e4bbd" containerID="0c592095eae3b24375d8e40327987ed942ce5ab3282998442e675ae0dab48611" exitCode=0
Sep 09 21:25:35.283494 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:35.283363    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n2jnl"
Sep 09 21:25:35.283494 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:35.283392    2555 scope.go:117] "RemoveContainer" containerID="0c592095eae3b24375d8e40327987ed942ce5ab3282998442e675ae0dab48611"
Sep 09 21:25:35.285085 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:35.285062    2555 generic.go:356] "Generic (PLEG): container finished" podID="bb654efd-4ff5-4f93-8147-cec993c941a5" containerID="47d78a3f50e229fffab2006e74648b99ee41f45906ceb18fee61821c1754252b" exitCode=0
Sep 09 21:25:35.285209 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:35.285114    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-6rhbf"
Sep 09 21:25:35.286557 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:25:35.286530    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-6rhbf\" is forbidden: User \"system:node:ip-10-0-133-235.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-235.ec2.internal' and this object" podUID="bb654efd-4ff5-4f93-8147-cec993c941a5" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-6rhbf"
Sep 09 21:25:35.289016 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:25:35.288985    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-n2jnl\" is forbidden: User \"system:node:ip-10-0-133-235.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-235.ec2.internal' and this object" podUID="08469a2e-a57e-46a0-a47a-013f933e4bbd" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n2jnl"
Sep 09 21:25:35.293598 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:25:35.293452    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-n2jnl\" is forbidden: User \"system:node:ip-10-0-133-235.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-235.ec2.internal' and this object" podUID="08469a2e-a57e-46a0-a47a-013f933e4bbd" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n2jnl"
Sep 09 21:25:35.296037 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:25:35.296006    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-6rhbf\" is forbidden: User \"system:node:ip-10-0-133-235.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-235.ec2.internal' and this object" podUID="bb654efd-4ff5-4f93-8147-cec993c941a5" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-6rhbf"
Sep 09 21:25:35.298706 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:35.298690    2555 scope.go:117] "RemoveContainer" containerID="0c592095eae3b24375d8e40327987ed942ce5ab3282998442e675ae0dab48611"
Sep 09 21:25:35.299032 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:25:35.299004    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c592095eae3b24375d8e40327987ed942ce5ab3282998442e675ae0dab48611\": container with ID starting with 0c592095eae3b24375d8e40327987ed942ce5ab3282998442e675ae0dab48611 not found: ID does not exist" containerID="0c592095eae3b24375d8e40327987ed942ce5ab3282998442e675ae0dab48611"
Sep 09 21:25:35.299096 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:35.299045    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c592095eae3b24375d8e40327987ed942ce5ab3282998442e675ae0dab48611"} err="failed to get container status \"0c592095eae3b24375d8e40327987ed942ce5ab3282998442e675ae0dab48611\": rpc error: code = NotFound desc = could not find container \"0c592095eae3b24375d8e40327987ed942ce5ab3282998442e675ae0dab48611\": container with ID starting with 0c592095eae3b24375d8e40327987ed942ce5ab3282998442e675ae0dab48611 not found: ID does not exist"
Sep 09 21:25:35.299096 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:35.299069    2555 scope.go:117] "RemoveContainer" containerID="47d78a3f50e229fffab2006e74648b99ee41f45906ceb18fee61821c1754252b"
Sep 09 21:25:35.300712 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:25:35.300691    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-6rhbf\" is forbidden: User \"system:node:ip-10-0-133-235.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-235.ec2.internal' and this object" podUID="bb654efd-4ff5-4f93-8147-cec993c941a5" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-6rhbf"
Sep 09 21:25:35.303335 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:25:35.303306    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-n2jnl\" is forbidden: User \"system:node:ip-10-0-133-235.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-235.ec2.internal' and this object" podUID="08469a2e-a57e-46a0-a47a-013f933e4bbd" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n2jnl"
Sep 09 21:25:35.306045 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:25:35.306021    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-n2jnl\" is forbidden: User \"system:node:ip-10-0-133-235.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-235.ec2.internal' and this object" podUID="08469a2e-a57e-46a0-a47a-013f933e4bbd" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n2jnl"
Sep 09 21:25:35.308123 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:25:35.308098    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-6rhbf\" is forbidden: User \"system:node:ip-10-0-133-235.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-235.ec2.internal' and this object" podUID="bb654efd-4ff5-4f93-8147-cec993c941a5" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-6rhbf"
Sep 09 21:25:35.308993 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:35.308968    2555 scope.go:117] "RemoveContainer" containerID="47d78a3f50e229fffab2006e74648b99ee41f45906ceb18fee61821c1754252b"
Sep 09 21:25:35.309240 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:25:35.309224    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47d78a3f50e229fffab2006e74648b99ee41f45906ceb18fee61821c1754252b\": container with ID starting with 47d78a3f50e229fffab2006e74648b99ee41f45906ceb18fee61821c1754252b not found: ID does not exist" containerID="47d78a3f50e229fffab2006e74648b99ee41f45906ceb18fee61821c1754252b"
Sep 09 21:25:35.309294 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:35.309245    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47d78a3f50e229fffab2006e74648b99ee41f45906ceb18fee61821c1754252b"} err="failed to get container status \"47d78a3f50e229fffab2006e74648b99ee41f45906ceb18fee61821c1754252b\": rpc error: code = NotFound desc = could not find container \"47d78a3f50e229fffab2006e74648b99ee41f45906ceb18fee61821c1754252b\": container with ID starting with 47d78a3f50e229fffab2006e74648b99ee41f45906ceb18fee61821c1754252b not found: ID does not exist"
Sep 09 21:25:35.334806 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:35.334786    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qjjxd\" (UniqueName: \"kubernetes.io/projected/bb654efd-4ff5-4f93-8147-cec993c941a5-kube-api-access-qjjxd\") on node \"ip-10-0-133-235.ec2.internal\" DevicePath \"\""
Sep 09 21:25:35.452119 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:35.452080    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-g5ncr"]
Sep 09 21:25:35.455248 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:25:35.455221    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6419b52_5fa5_4c41_8a1c_3eaccd1538d6.slice/crio-f3d18db4b37c957947c867f952b3bc8c7626257d2f725822bd048bdf12ac8afc WatchSource:0}: Error finding container f3d18db4b37c957947c867f952b3bc8c7626257d2f725822bd048bdf12ac8afc: Status 404 returned error can't find the container with id f3d18db4b37c957947c867f952b3bc8c7626257d2f725822bd048bdf12ac8afc
Sep 09 21:25:35.468216 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:35.468189    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08469a2e-a57e-46a0-a47a-013f933e4bbd" path="/var/lib/kubelet/pods/08469a2e-a57e-46a0-a47a-013f933e4bbd/volumes"
Sep 09 21:25:35.468694 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:35.468676    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb654efd-4ff5-4f93-8147-cec993c941a5" path="/var/lib/kubelet/pods/bb654efd-4ff5-4f93-8147-cec993c941a5/volumes"
Sep 09 21:25:35.470491 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:35.470472    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-gbplw"]
Sep 09 21:25:35.470600 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:25:35.470565    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab5dbeeb_e34e_4677_a19a_8192e9983271.slice/crio-fa7172f57f30d91c7e4dc392287db0f02ade118c6971de3e262205928faebf46 WatchSource:0}: Error finding container fa7172f57f30d91c7e4dc392287db0f02ade118c6971de3e262205928faebf46: Status 404 returned error can't find the container with id fa7172f57f30d91c7e4dc392287db0f02ade118c6971de3e262205928faebf46
Sep 09 21:25:36.293804 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:36.293762    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-gbplw" event={"ID":"ab5dbeeb-e34e-4677-a19a-8192e9983271","Type":"ContainerStarted","Data":"b9ddfe9e3f558e015aaa8edc2859a7000073cbecbddca544bf94f220bba8fe05"}
Sep 09 21:25:36.294254 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:36.293847    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-gbplw" event={"ID":"ab5dbeeb-e34e-4677-a19a-8192e9983271","Type":"ContainerStarted","Data":"fa7172f57f30d91c7e4dc392287db0f02ade118c6971de3e262205928faebf46"}
Sep 09 21:25:36.294254 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:36.293947    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-gbplw"
Sep 09 21:25:36.296517 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:36.296489    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-g5ncr" event={"ID":"c6419b52-5fa5-4c41-8a1c-3eaccd1538d6","Type":"ContainerStarted","Data":"59718b9f4773d53769a028eb6b75dc836fada4d636486e4f2fc625f9dff69789"}
Sep 09 21:25:36.296665 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:36.296541    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-g5ncr"
Sep 09 21:25:36.296665 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:36.296565    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-g5ncr" event={"ID":"c6419b52-5fa5-4c41-8a1c-3eaccd1538d6","Type":"ContainerStarted","Data":"f3d18db4b37c957947c867f952b3bc8c7626257d2f725822bd048bdf12ac8afc"}
Sep 09 21:25:36.337403 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:36.337350    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-gbplw" podStartSLOduration=2.337329485 podStartE2EDuration="2.337329485s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:25:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:25:36.334681345 +0000 UTC m=+1059.313999477" watchObservedRunningTime="2026-09-09 21:25:36.337329485 +0000 UTC m=+1059.316647601"
Sep 09 21:25:36.371737 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:36.371693    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-g5ncr" podStartSLOduration=2.371678553 podStartE2EDuration="2.371678553s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:25:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:25:36.370250537 +0000 UTC m=+1059.349568650" watchObservedRunningTime="2026-09-09 21:25:36.371678553 +0000 UTC m=+1059.350996666"
Sep 09 21:25:39.605728 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:39.605700    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:25:39.794676 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:39.794648    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:25:40.218843 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:40.218784    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:25:40.319469 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:40.319435    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:25:42.143525 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:42.143494    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:25:42.308779 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:42.308749    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:25:47.303318 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:47.303287    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-gbplw"
Sep 09 21:25:47.303708 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:47.303354    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-g5ncr"
Sep 09 21:25:48.922665 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:48.922633    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:25:49.104559 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:49.104527    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:25:49.215143 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:49.215077    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:25:52.607803 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:52.607731    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-g5ncr"]
Sep 09 21:25:52.608260 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:52.607952    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-g5ncr" podUID="c6419b52-5fa5-4c41-8a1c-3eaccd1538d6" containerName="manager" containerID="cri-o://59718b9f4773d53769a028eb6b75dc836fada4d636486e4f2fc625f9dff69789" gracePeriod=10
Sep 09 21:25:52.852184 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:52.852161    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-g5ncr"
Sep 09 21:25:52.976949 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:52.976921    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dtm2x\" (UniqueName: \"kubernetes.io/projected/c6419b52-5fa5-4c41-8a1c-3eaccd1538d6-kube-api-access-dtm2x\") pod \"c6419b52-5fa5-4c41-8a1c-3eaccd1538d6\" (UID: \"c6419b52-5fa5-4c41-8a1c-3eaccd1538d6\") "
Sep 09 21:25:52.977083 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:52.977012    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c6419b52-5fa5-4c41-8a1c-3eaccd1538d6-extensions-socket-volume\") pod \"c6419b52-5fa5-4c41-8a1c-3eaccd1538d6\" (UID: \"c6419b52-5fa5-4c41-8a1c-3eaccd1538d6\") "
Sep 09 21:25:52.977380 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:52.977357    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6419b52-5fa5-4c41-8a1c-3eaccd1538d6-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c6419b52-5fa5-4c41-8a1c-3eaccd1538d6" (UID: "c6419b52-5fa5-4c41-8a1c-3eaccd1538d6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:25:52.978924 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:52.978897    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6419b52-5fa5-4c41-8a1c-3eaccd1538d6-kube-api-access-dtm2x" (OuterVolumeSpecName: "kube-api-access-dtm2x") pod "c6419b52-5fa5-4c41-8a1c-3eaccd1538d6" (UID: "c6419b52-5fa5-4c41-8a1c-3eaccd1538d6"). InnerVolumeSpecName "kube-api-access-dtm2x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:25:53.078089 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:53.078059    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dtm2x\" (UniqueName: \"kubernetes.io/projected/c6419b52-5fa5-4c41-8a1c-3eaccd1538d6-kube-api-access-dtm2x\") on node \"ip-10-0-133-235.ec2.internal\" DevicePath \"\""
Sep 09 21:25:53.078089 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:53.078086    2555 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c6419b52-5fa5-4c41-8a1c-3eaccd1538d6-extensions-socket-volume\") on node \"ip-10-0-133-235.ec2.internal\" DevicePath \"\""
Sep 09 21:25:53.392783 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:53.392704    2555 generic.go:356] "Generic (PLEG): container finished" podID="c6419b52-5fa5-4c41-8a1c-3eaccd1538d6" containerID="59718b9f4773d53769a028eb6b75dc836fada4d636486e4f2fc625f9dff69789" exitCode=0
Sep 09 21:25:53.392783 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:53.392760    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-g5ncr"
Sep 09 21:25:53.393005 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:53.392791    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-g5ncr" event={"ID":"c6419b52-5fa5-4c41-8a1c-3eaccd1538d6","Type":"ContainerDied","Data":"59718b9f4773d53769a028eb6b75dc836fada4d636486e4f2fc625f9dff69789"}
Sep 09 21:25:53.393005 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:53.392864    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-g5ncr" event={"ID":"c6419b52-5fa5-4c41-8a1c-3eaccd1538d6","Type":"ContainerDied","Data":"f3d18db4b37c957947c867f952b3bc8c7626257d2f725822bd048bdf12ac8afc"}
Sep 09 21:25:53.393005 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:53.392881    2555 scope.go:117] "RemoveContainer" containerID="59718b9f4773d53769a028eb6b75dc836fada4d636486e4f2fc625f9dff69789"
Sep 09 21:25:53.402556 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:53.402540    2555 scope.go:117] "RemoveContainer" containerID="59718b9f4773d53769a028eb6b75dc836fada4d636486e4f2fc625f9dff69789"
Sep 09 21:25:53.402867 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:25:53.402848    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59718b9f4773d53769a028eb6b75dc836fada4d636486e4f2fc625f9dff69789\": container with ID starting with 59718b9f4773d53769a028eb6b75dc836fada4d636486e4f2fc625f9dff69789 not found: ID does not exist" containerID="59718b9f4773d53769a028eb6b75dc836fada4d636486e4f2fc625f9dff69789"
Sep 09 21:25:53.402936 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:53.402876    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59718b9f4773d53769a028eb6b75dc836fada4d636486e4f2fc625f9dff69789"} err="failed to get container status \"59718b9f4773d53769a028eb6b75dc836fada4d636486e4f2fc625f9dff69789\": rpc error: code = NotFound desc = could not find container \"59718b9f4773d53769a028eb6b75dc836fada4d636486e4f2fc625f9dff69789\": container with ID starting with 59718b9f4773d53769a028eb6b75dc836fada4d636486e4f2fc625f9dff69789 not found: ID does not exist"
Sep 09 21:25:53.429537 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:53.429517    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-g5ncr"]
Sep 09 21:25:53.435828 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:53.435797    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-g5ncr"]
Sep 09 21:25:53.466218 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:53.466195    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6419b52-5fa5-4c41-8a1c-3eaccd1538d6" path="/var/lib/kubelet/pods/c6419b52-5fa5-4c41-8a1c-3eaccd1538d6/volumes"
Sep 09 21:25:55.886236 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:55.886204    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:25:56.135987 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:25:56.135949    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:26:00.439193 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:00.439155    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:26:00.541416 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:00.541361    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:26:00.715762 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:00.715684    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:26:00.844150 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:00.844110    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:26:03.034753 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:03.034721    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:26:03.136336 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:03.136309    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:26:09.188205 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:09.188172    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5qzpn"]
Sep 09 21:26:09.188617 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:09.188543    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6419b52-5fa5-4c41-8a1c-3eaccd1538d6" containerName="manager"
Sep 09 21:26:09.188617 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:09.188556    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6419b52-5fa5-4c41-8a1c-3eaccd1538d6" containerName="manager"
Sep 09 21:26:09.188617 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:09.188617    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6419b52-5fa5-4c41-8a1c-3eaccd1538d6" containerName="manager"
Sep 09 21:26:09.205526 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:09.205506    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5qzpn"
Sep 09 21:26:09.211517 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:09.211480    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-pjb5s\""
Sep 09 21:26:09.221678 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:09.221648    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5qzpn"]
Sep 09 21:26:09.225809 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:09.225753    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:26:09.310806 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:09.310760    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4793104-a9fb-47c7-80f8-2dba65c5239c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-5qzpn\" (UID: \"b4793104-a9fb-47c7-80f8-2dba65c5239c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5qzpn"
Sep 09 21:26:09.310987 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:09.310813    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjnpl\" (UniqueName: \"kubernetes.io/projected/b4793104-a9fb-47c7-80f8-2dba65c5239c-kube-api-access-rjnpl\") pod \"maas-default-gateway-openshift-default-78bb78ff78-5qzpn\" (UID: \"b4793104-a9fb-47c7-80f8-2dba65c5239c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5qzpn"
Sep 09 21:26:09.310987 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:09.310874    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4793104-a9fb-47c7-80f8-2dba65c5239c-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-5qzpn\" (UID: \"b4793104-a9fb-47c7-80f8-2dba65c5239c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5qzpn"
Sep 09 21:26:09.310987 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:09.310904    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4793104-a9fb-47c7-80f8-2dba65c5239c-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-5qzpn\" (UID: \"b4793104-a9fb-47c7-80f8-2dba65c5239c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5qzpn"
Sep 09 21:26:09.310987 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:09.310965    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4793104-a9fb-47c7-80f8-2dba65c5239c-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-5qzpn\" (UID: \"b4793104-a9fb-47c7-80f8-2dba65c5239c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5qzpn"
Sep 09 21:26:09.311207 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:09.310993    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4793104-a9fb-47c7-80f8-2dba65c5239c-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-5qzpn\" (UID: \"b4793104-a9fb-47c7-80f8-2dba65c5239c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5qzpn"
Sep 09 21:26:09.311207 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:09.311018    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4793104-a9fb-47c7-80f8-2dba65c5239c-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-5qzpn\" (UID: \"b4793104-a9fb-47c7-80f8-2dba65c5239c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5qzpn"
Sep 09 21:26:09.311207 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:09.311063    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4793104-a9fb-47c7-80f8-2dba65c5239c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-5qzpn\" (UID: \"b4793104-a9fb-47c7-80f8-2dba65c5239c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5qzpn"
Sep 09 21:26:09.311207 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:09.311118    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4793104-a9fb-47c7-80f8-2dba65c5239c-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-5qzpn\" (UID: \"b4793104-a9fb-47c7-80f8-2dba65c5239c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5qzpn"
Sep 09 21:26:09.411549 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:09.411513    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4793104-a9fb-47c7-80f8-2dba65c5239c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-5qzpn\" (UID: \"b4793104-a9fb-47c7-80f8-2dba65c5239c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5qzpn"
Sep 09 21:26:09.411549 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:09.411549    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjnpl\" (UniqueName: \"kubernetes.io/projected/b4793104-a9fb-47c7-80f8-2dba65c5239c-kube-api-access-rjnpl\") pod \"maas-default-gateway-openshift-default-78bb78ff78-5qzpn\" (UID: \"b4793104-a9fb-47c7-80f8-2dba65c5239c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5qzpn"
Sep 09 21:26:09.411801 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:09.411582    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4793104-a9fb-47c7-80f8-2dba65c5239c-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-5qzpn\" (UID: \"b4793104-a9fb-47c7-80f8-2dba65c5239c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5qzpn"
Sep 09 21:26:09.411801 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:09.411615    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4793104-a9fb-47c7-80f8-2dba65c5239c-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-5qzpn\" (UID: \"b4793104-a9fb-47c7-80f8-2dba65c5239c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5qzpn"
Sep 09 21:26:09.411801 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:09.411658    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4793104-a9fb-47c7-80f8-2dba65c5239c-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-5qzpn\" (UID: \"b4793104-a9fb-47c7-80f8-2dba65c5239c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5qzpn"
Sep 09 21:26:09.411801 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:09.411687    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4793104-a9fb-47c7-80f8-2dba65c5239c-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-5qzpn\" (UID: \"b4793104-a9fb-47c7-80f8-2dba65c5239c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5qzpn"
Sep 09 21:26:09.411801 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:09.411711    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4793104-a9fb-47c7-80f8-2dba65c5239c-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-5qzpn\" (UID: \"b4793104-a9fb-47c7-80f8-2dba65c5239c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5qzpn"
Sep 09 21:26:09.411801 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:09.411755    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4793104-a9fb-47c7-80f8-2dba65c5239c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-5qzpn\" (UID: \"b4793104-a9fb-47c7-80f8-2dba65c5239c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5qzpn"
Sep 09 21:26:09.412141 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:09.411811    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4793104-a9fb-47c7-80f8-2dba65c5239c-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-5qzpn\" (UID: \"b4793104-a9fb-47c7-80f8-2dba65c5239c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5qzpn"
Sep 09 21:26:09.412141 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:09.412065    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4793104-a9fb-47c7-80f8-2dba65c5239c-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-5qzpn\" (UID: \"b4793104-a9fb-47c7-80f8-2dba65c5239c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5qzpn"
Sep 09 21:26:09.412141 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:09.412123    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4793104-a9fb-47c7-80f8-2dba65c5239c-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-5qzpn\" (UID: \"b4793104-a9fb-47c7-80f8-2dba65c5239c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5qzpn"
Sep 09 21:26:09.412350 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:09.412317    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4793104-a9fb-47c7-80f8-2dba65c5239c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-5qzpn\" (UID: \"b4793104-a9fb-47c7-80f8-2dba65c5239c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5qzpn"
Sep 09 21:26:09.412482 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:09.412356    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4793104-a9fb-47c7-80f8-2dba65c5239c-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-5qzpn\" (UID: \"b4793104-a9fb-47c7-80f8-2dba65c5239c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5qzpn"
Sep 09 21:26:09.412482 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:09.412366    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4793104-a9fb-47c7-80f8-2dba65c5239c-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-5qzpn\" (UID: \"b4793104-a9fb-47c7-80f8-2dba65c5239c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5qzpn"
Sep 09 21:26:09.414212 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:09.414189    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4793104-a9fb-47c7-80f8-2dba65c5239c-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-5qzpn\" (UID: \"b4793104-a9fb-47c7-80f8-2dba65c5239c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5qzpn"
Sep 09 21:26:09.414379 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:09.414359    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4793104-a9fb-47c7-80f8-2dba65c5239c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-5qzpn\" (UID: \"b4793104-a9fb-47c7-80f8-2dba65c5239c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5qzpn"
Sep 09 21:26:09.420520 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:09.420498    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4793104-a9fb-47c7-80f8-2dba65c5239c-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-5qzpn\" (UID: \"b4793104-a9fb-47c7-80f8-2dba65c5239c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5qzpn"
Sep 09 21:26:09.420740 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:09.420712    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjnpl\" (UniqueName: \"kubernetes.io/projected/b4793104-a9fb-47c7-80f8-2dba65c5239c-kube-api-access-rjnpl\") pod \"maas-default-gateway-openshift-default-78bb78ff78-5qzpn\" (UID: \"b4793104-a9fb-47c7-80f8-2dba65c5239c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5qzpn"
Sep 09 21:26:09.516213 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:09.516132    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5qzpn"
Sep 09 21:26:09.792039 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:09.791941    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:26:09.812648 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:09.812629    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5qzpn"]
Sep 09 21:26:09.815234 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:26:09.815207    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4793104_a9fb_47c7_80f8_2dba65c5239c.slice/crio-4ac9589b9f2cadd305a1d49372998f2c113fb9218ea9d3fed0d3a91360c3cf84 WatchSource:0}: Error finding container 4ac9589b9f2cadd305a1d49372998f2c113fb9218ea9d3fed0d3a91360c3cf84: Status 404 returned error can't find the container with id 4ac9589b9f2cadd305a1d49372998f2c113fb9218ea9d3fed0d3a91360c3cf84
Sep 09 21:26:09.817837 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:09.817782    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 21:26:09.817927 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:09.817885    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 21:26:09.817973 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:09.817932    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 21:26:09.996228 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:09.996185    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:26:10.069137 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:10.069037    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:26:10.386771 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:10.386682    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:26:10.458667 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:10.458616    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:26:10.489539 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:10.489511    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5qzpn" event={"ID":"b4793104-a9fb-47c7-80f8-2dba65c5239c","Type":"ContainerStarted","Data":"68e1c0e966060869a85bb33963b9b11e61a87e00823080d7d33e939267c1acb2"}
Sep 09 21:26:10.489682 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:10.489556    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5qzpn" event={"ID":"b4793104-a9fb-47c7-80f8-2dba65c5239c","Type":"ContainerStarted","Data":"4ac9589b9f2cadd305a1d49372998f2c113fb9218ea9d3fed0d3a91360c3cf84"}
Sep 09 21:26:10.513120 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:10.513074    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5qzpn" podStartSLOduration=1.513059173 podStartE2EDuration="1.513059173s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:26:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:26:10.511918277 +0000 UTC m=+1093.491236407" watchObservedRunningTime="2026-09-09 21:26:10.513059173 +0000 UTC m=+1093.492377287"
Sep 09 21:26:10.516476 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:10.516453    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5qzpn"
Sep 09 21:26:10.521308 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:10.521288    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5qzpn"
Sep 09 21:26:10.615803 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:10.615772    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:26:10.788389 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:10.788356    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:26:11.458944 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:11.458914    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:26:11.494484 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:11.494453    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5qzpn"
Sep 09 21:26:11.495517 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:11.495496    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5qzpn"
Sep 09 21:26:11.695651 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:11.695622    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-l8pgl"]
Sep 09 21:26:11.698214 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:11.698194    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-l8pgl"
Sep 09 21:26:11.704300 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:11.704281    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 09 21:26:11.704639 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:11.704595    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:26:11.720754 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:11.720698    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-l8pgl"]
Sep 09 21:26:11.792051 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:11.792002    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-l8pgl"]
Sep 09 21:26:11.809396 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:11.809364    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:26:11.831721 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:11.831691    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7bcb\" (UniqueName: \"kubernetes.io/projected/3fa3c711-e395-4a75-a522-5db3af493fa3-kube-api-access-w7bcb\") pod \"limitador-limitador-8588749977-l8pgl\" (UID: \"3fa3c711-e395-4a75-a522-5db3af493fa3\") " pod="kuadrant-system/limitador-limitador-8588749977-l8pgl"
Sep 09 21:26:11.831890 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:11.831751    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3fa3c711-e395-4a75-a522-5db3af493fa3-config-file\") pod \"limitador-limitador-8588749977-l8pgl\" (UID: \"3fa3c711-e395-4a75-a522-5db3af493fa3\") " pod="kuadrant-system/limitador-limitador-8588749977-l8pgl"
Sep 09 21:26:11.911554 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:11.911523    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:26:11.932672 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:11.932644    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3fa3c711-e395-4a75-a522-5db3af493fa3-config-file\") pod \"limitador-limitador-8588749977-l8pgl\" (UID: \"3fa3c711-e395-4a75-a522-5db3af493fa3\") " pod="kuadrant-system/limitador-limitador-8588749977-l8pgl"
Sep 09 21:26:11.932865 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:11.932733    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7bcb\" (UniqueName: \"kubernetes.io/projected/3fa3c711-e395-4a75-a522-5db3af493fa3-kube-api-access-w7bcb\") pod \"limitador-limitador-8588749977-l8pgl\" (UID: \"3fa3c711-e395-4a75-a522-5db3af493fa3\") " pod="kuadrant-system/limitador-limitador-8588749977-l8pgl"
Sep 09 21:26:11.933252 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:11.933233    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3fa3c711-e395-4a75-a522-5db3af493fa3-config-file\") pod \"limitador-limitador-8588749977-l8pgl\" (UID: \"3fa3c711-e395-4a75-a522-5db3af493fa3\") " pod="kuadrant-system/limitador-limitador-8588749977-l8pgl"
Sep 09 21:26:11.943264 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:11.943239    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7bcb\" (UniqueName: \"kubernetes.io/projected/3fa3c711-e395-4a75-a522-5db3af493fa3-kube-api-access-w7bcb\") pod \"limitador-limitador-8588749977-l8pgl\" (UID: \"3fa3c711-e395-4a75-a522-5db3af493fa3\") " pod="kuadrant-system/limitador-limitador-8588749977-l8pgl"
Sep 09 21:26:12.009445 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:12.009353    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-l8pgl"
Sep 09 21:26:12.290954 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:12.290929    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-l8pgl"]
Sep 09 21:26:12.292525 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:26:12.292503    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fa3c711_e395_4a75_a522_5db3af493fa3.slice/crio-440a47560a9796ac43f42fece81fcca6a77710b54b5639066ea3a89f11b81607 WatchSource:0}: Error finding container 440a47560a9796ac43f42fece81fcca6a77710b54b5639066ea3a89f11b81607: Status 404 returned error can't find the container with id 440a47560a9796ac43f42fece81fcca6a77710b54b5639066ea3a89f11b81607
Sep 09 21:26:12.500738 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:12.500699    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-l8pgl" event={"ID":"3fa3c711-e395-4a75-a522-5db3af493fa3","Type":"ContainerStarted","Data":"440a47560a9796ac43f42fece81fcca6a77710b54b5639066ea3a89f11b81607"}
Sep 09 21:26:12.692684 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:12.692652    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:26:12.790617 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:12.790588    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:26:12.850801 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:12.850761    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59c974bd48-nn4qf"]
Sep 09 21:26:12.854017 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:12.853996    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-nn4qf"
Sep 09 21:26:12.856881 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:12.856859    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-69kcj\""
Sep 09 21:26:12.862557 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:12.862537    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-nn4qf"]
Sep 09 21:26:12.942474 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:12.942442    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9g49v\" (UniqueName: \"kubernetes.io/projected/0ace6f86-a100-40c8-b41f-14a9c74ceed9-kube-api-access-9g49v\") pod \"authorino-59c974bd48-nn4qf\" (UID: \"0ace6f86-a100-40c8-b41f-14a9c74ceed9\") " pod="kuadrant-system/authorino-59c974bd48-nn4qf"
Sep 09 21:26:13.043397 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:13.043304    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9g49v\" (UniqueName: \"kubernetes.io/projected/0ace6f86-a100-40c8-b41f-14a9c74ceed9-kube-api-access-9g49v\") pod \"authorino-59c974bd48-nn4qf\" (UID: \"0ace6f86-a100-40c8-b41f-14a9c74ceed9\") " pod="kuadrant-system/authorino-59c974bd48-nn4qf"
Sep 09 21:26:13.054963 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:13.054933    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9g49v\" (UniqueName: \"kubernetes.io/projected/0ace6f86-a100-40c8-b41f-14a9c74ceed9-kube-api-access-9g49v\") pod \"authorino-59c974bd48-nn4qf\" (UID: \"0ace6f86-a100-40c8-b41f-14a9c74ceed9\") " pod="kuadrant-system/authorino-59c974bd48-nn4qf"
Sep 09 21:26:13.163840 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:13.163794    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-nn4qf"
Sep 09 21:26:13.440853 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:13.440808    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-nn4qf"]
Sep 09 21:26:13.442845 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:26:13.442800    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0ace6f86_a100_40c8_b41f_14a9c74ceed9.slice/crio-dbb32d087eb184614f0a58b7ef95fa6dd0889efcf6d33dcbd3fc982b17243f23 WatchSource:0}: Error finding container dbb32d087eb184614f0a58b7ef95fa6dd0889efcf6d33dcbd3fc982b17243f23: Status 404 returned error can't find the container with id dbb32d087eb184614f0a58b7ef95fa6dd0889efcf6d33dcbd3fc982b17243f23
Sep 09 21:26:13.507696 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:13.507663    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-nn4qf" event={"ID":"0ace6f86-a100-40c8-b41f-14a9c74ceed9","Type":"ContainerStarted","Data":"dbb32d087eb184614f0a58b7ef95fa6dd0889efcf6d33dcbd3fc982b17243f23"}
Sep 09 21:26:14.514295 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:14.514261    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-l8pgl" event={"ID":"3fa3c711-e395-4a75-a522-5db3af493fa3","Type":"ContainerStarted","Data":"c2191ff2d01e1dd72d5f3511913d4d7fec00f785bb5ec7416c5533af063cbc1f"}
Sep 09 21:26:14.514671 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:14.514342    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-l8pgl"
Sep 09 21:26:14.535660 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:14.535610    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-l8pgl" podStartSLOduration=2.06796101 podStartE2EDuration="3.535594524s" totalImagesPullingTime="1.467633514s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:26:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:26:14.533132515 +0000 UTC m=+1097.512450629" watchObservedRunningTime="2026-09-09 21:26:14.535594524 +0000 UTC m=+1097.514912645"
Sep 09 21:26:17.792848 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:17.792795    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:26:18.060756 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:18.060659    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:26:19.543554 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:19.543515    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-nn4qf" event={"ID":"0ace6f86-a100-40c8-b41f-14a9c74ceed9","Type":"ContainerStarted","Data":"04204a8ab6c96024136fc7aa503919066730f94dadef2f7fd12768a6923a0f69"}
Sep 09 21:26:19.563053 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:19.563008    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59c974bd48-nn4qf" podStartSLOduration=2.258120796 podStartE2EDuration="7.562993402s" totalImagesPullingTime="5.304872606s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:26:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:26:19.560581568 +0000 UTC m=+1102.539899684" watchObservedRunningTime="2026-09-09 21:26:19.562993402 +0000 UTC m=+1102.542311514"
Sep 09 21:26:22.354937 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:22.354897    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:26:22.511739 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:22.511703    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:26:24.710631 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:24.710601    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:26:24.786138 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:24.786108    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:26:25.081762 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:25.081686    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-l8pgl"]
Sep 09 21:26:25.081923 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:25.081861    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-l8pgl" podUID="3fa3c711-e395-4a75-a522-5db3af493fa3" containerName="limitador" containerID="cri-o://c2191ff2d01e1dd72d5f3511913d4d7fec00f785bb5ec7416c5533af063cbc1f" gracePeriod=30
Sep 09 21:26:25.082569 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:25.082487    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-l8pgl"
Sep 09 21:26:25.581436 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:25.581401    2555 generic.go:356] "Generic (PLEG): container finished" podID="3fa3c711-e395-4a75-a522-5db3af493fa3" containerID="c2191ff2d01e1dd72d5f3511913d4d7fec00f785bb5ec7416c5533af063cbc1f" exitCode=0
Sep 09 21:26:25.581588 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:25.581472    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-l8pgl" event={"ID":"3fa3c711-e395-4a75-a522-5db3af493fa3","Type":"ContainerDied","Data":"c2191ff2d01e1dd72d5f3511913d4d7fec00f785bb5ec7416c5533af063cbc1f"}
Sep 09 21:26:26.032993 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:26.032963    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-l8pgl"
Sep 09 21:26:26.159032 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:26.158956    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3fa3c711-e395-4a75-a522-5db3af493fa3-config-file\") pod \"3fa3c711-e395-4a75-a522-5db3af493fa3\" (UID: \"3fa3c711-e395-4a75-a522-5db3af493fa3\") "
Sep 09 21:26:26.159032 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:26.158997    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w7bcb\" (UniqueName: \"kubernetes.io/projected/3fa3c711-e395-4a75-a522-5db3af493fa3-kube-api-access-w7bcb\") pod \"3fa3c711-e395-4a75-a522-5db3af493fa3\" (UID: \"3fa3c711-e395-4a75-a522-5db3af493fa3\") "
Sep 09 21:26:26.159335 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:26.159309    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3fa3c711-e395-4a75-a522-5db3af493fa3-config-file" (OuterVolumeSpecName: "config-file") pod "3fa3c711-e395-4a75-a522-5db3af493fa3" (UID: "3fa3c711-e395-4a75-a522-5db3af493fa3"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 21:26:26.161046 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:26.161026    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fa3c711-e395-4a75-a522-5db3af493fa3-kube-api-access-w7bcb" (OuterVolumeSpecName: "kube-api-access-w7bcb") pod "3fa3c711-e395-4a75-a522-5db3af493fa3" (UID: "3fa3c711-e395-4a75-a522-5db3af493fa3"). InnerVolumeSpecName "kube-api-access-w7bcb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:26:26.259703 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:26.259672    2555 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3fa3c711-e395-4a75-a522-5db3af493fa3-config-file\") on node \"ip-10-0-133-235.ec2.internal\" DevicePath \"\""
Sep 09 21:26:26.259703 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:26.259697    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w7bcb\" (UniqueName: \"kubernetes.io/projected/3fa3c711-e395-4a75-a522-5db3af493fa3-kube-api-access-w7bcb\") on node \"ip-10-0-133-235.ec2.internal\" DevicePath \"\""
Sep 09 21:26:26.593397 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:26.593364    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-l8pgl" event={"ID":"3fa3c711-e395-4a75-a522-5db3af493fa3","Type":"ContainerDied","Data":"440a47560a9796ac43f42fece81fcca6a77710b54b5639066ea3a89f11b81607"}
Sep 09 21:26:26.593397 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:26.593396    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-l8pgl"
Sep 09 21:26:26.593626 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:26.593425    2555 scope.go:117] "RemoveContainer" containerID="c2191ff2d01e1dd72d5f3511913d4d7fec00f785bb5ec7416c5533af063cbc1f"
Sep 09 21:26:26.619601 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:26.619577    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-l8pgl"]
Sep 09 21:26:26.624220 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:26.624196    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-l8pgl"]
Sep 09 21:26:27.466851 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:27.466807    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3fa3c711-e395-4a75-a522-5db3af493fa3" path="/var/lib/kubelet/pods/3fa3c711-e395-4a75-a522-5db3af493fa3/volumes"
Sep 09 21:26:27.741732 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:27.741657    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:26:27.858113 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:27.858080    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:26:28.144609 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:28.144533    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-hqxz4"]
Sep 09 21:26:28.144990 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:28.144976    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fa3c711-e395-4a75-a522-5db3af493fa3" containerName="limitador"
Sep 09 21:26:28.145038 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:28.144991    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fa3c711-e395-4a75-a522-5db3af493fa3" containerName="limitador"
Sep 09 21:26:28.145075 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:28.145048    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fa3c711-e395-4a75-a522-5db3af493fa3" containerName="limitador"
Sep 09 21:26:28.147807 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:28.147787    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hqxz4"
Sep 09 21:26:28.151351 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:28.151332    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-vq65r\""
Sep 09 21:26:28.151610 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:28.151594    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 09 21:26:28.152206 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:28.152188    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 09 21:26:28.152454 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:28.152440    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 09 21:26:28.173323 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:28.173300    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-hqxz4"]
Sep 09 21:26:28.231840 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:28.231794    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:26:28.276957 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:28.276928    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6l2b\" (UniqueName: \"kubernetes.io/projected/266a385c-b69b-411c-997f-b948c3aaef6d-kube-api-access-n6l2b\") pod \"postgres-69fb4594cf-hqxz4\" (UID: \"266a385c-b69b-411c-997f-b948c3aaef6d\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-hqxz4"
Sep 09 21:26:28.277111 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:28.276972    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/266a385c-b69b-411c-997f-b948c3aaef6d-data\") pod \"postgres-69fb4594cf-hqxz4\" (UID: \"266a385c-b69b-411c-997f-b948c3aaef6d\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-hqxz4"
Sep 09 21:26:28.378143 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:28.378118    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6l2b\" (UniqueName: \"kubernetes.io/projected/266a385c-b69b-411c-997f-b948c3aaef6d-kube-api-access-n6l2b\") pod \"postgres-69fb4594cf-hqxz4\" (UID: \"266a385c-b69b-411c-997f-b948c3aaef6d\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-hqxz4"
Sep 09 21:26:28.378265 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:28.378151    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/266a385c-b69b-411c-997f-b948c3aaef6d-data\") pod \"postgres-69fb4594cf-hqxz4\" (UID: \"266a385c-b69b-411c-997f-b948c3aaef6d\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-hqxz4"
Sep 09 21:26:28.378492 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:28.378476    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/266a385c-b69b-411c-997f-b948c3aaef6d-data\") pod \"postgres-69fb4594cf-hqxz4\" (UID: \"266a385c-b69b-411c-997f-b948c3aaef6d\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-hqxz4"
Sep 09 21:26:28.399283 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:28.399220    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6l2b\" (UniqueName: \"kubernetes.io/projected/266a385c-b69b-411c-997f-b948c3aaef6d-kube-api-access-n6l2b\") pod \"postgres-69fb4594cf-hqxz4\" (UID: \"266a385c-b69b-411c-997f-b948c3aaef6d\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-hqxz4"
Sep 09 21:26:28.458082 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:28.458063    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hqxz4"
Sep 09 21:26:28.756890 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:28.756855    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-hqxz4"]
Sep 09 21:26:28.761953 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:26:28.761870    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod266a385c_b69b_411c_997f_b948c3aaef6d.slice/crio-a337ffef1b4db5795cc7c4b1759a01863d8ff450bebbb2b0592878a418832e5a WatchSource:0}: Error finding container a337ffef1b4db5795cc7c4b1759a01863d8ff450bebbb2b0592878a418832e5a: Status 404 returned error can't find the container with id a337ffef1b4db5795cc7c4b1759a01863d8ff450bebbb2b0592878a418832e5a
Sep 09 21:26:29.612551 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:29.612511    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hqxz4" event={"ID":"266a385c-b69b-411c-997f-b948c3aaef6d","Type":"ContainerStarted","Data":"a337ffef1b4db5795cc7c4b1759a01863d8ff450bebbb2b0592878a418832e5a"}
Sep 09 21:26:31.626864 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:31.626813    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hqxz4" event={"ID":"266a385c-b69b-411c-997f-b948c3aaef6d","Type":"ContainerStarted","Data":"779ab3cdf9e5cdf43f20a327ef3b07e4426ba34fab455dfa9d80d0b0c90127e0"}
Sep 09 21:26:31.627246 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:31.626908    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hqxz4"
Sep 09 21:26:31.647455 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:31.647402    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hqxz4" podStartSLOduration=1.5528500859999999 podStartE2EDuration="3.64738519s" totalImagesPullingTime="2.094535104s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:26:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:26:31.647062685 +0000 UTC m=+1114.626380802" watchObservedRunningTime="2026-09-09 21:26:31.64738519 +0000 UTC m=+1114.626703304"
Sep 09 21:26:37.668021 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:37.667992    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hqxz4"
Sep 09 21:26:37.983264 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:37.983181    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:26:38.208476 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:38.208435    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-557f876f69-qdvjx"]
Sep 09 21:26:38.211811 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:38.211788    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-qdvjx"
Sep 09 21:26:38.226714 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:38.226688    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-557f876f69-qdvjx"]
Sep 09 21:26:38.255642 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:38.255577    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g72tk\" (UniqueName: \"kubernetes.io/projected/2b17bf82-77ae-4364-b127-ac2d737cd756-kube-api-access-g72tk\") pod \"authorino-557f876f69-qdvjx\" (UID: \"2b17bf82-77ae-4364-b127-ac2d737cd756\") " pod="kuadrant-system/authorino-557f876f69-qdvjx"
Sep 09 21:26:38.284761 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:38.284738    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:26:38.346362 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:38.346323    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-qdvjx"]
Sep 09 21:26:38.346638 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:26:38.346617    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-g72tk], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-557f876f69-qdvjx" podUID="2b17bf82-77ae-4364-b127-ac2d737cd756"
Sep 09 21:26:38.356593 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:38.356561    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g72tk\" (UniqueName: \"kubernetes.io/projected/2b17bf82-77ae-4364-b127-ac2d737cd756-kube-api-access-g72tk\") pod \"authorino-557f876f69-qdvjx\" (UID: \"2b17bf82-77ae-4364-b127-ac2d737cd756\") " pod="kuadrant-system/authorino-557f876f69-qdvjx"
Sep 09 21:26:38.370117 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:38.370087    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g72tk\" (UniqueName: \"kubernetes.io/projected/2b17bf82-77ae-4364-b127-ac2d737cd756-kube-api-access-g72tk\") pod \"authorino-557f876f69-qdvjx\" (UID: \"2b17bf82-77ae-4364-b127-ac2d737cd756\") " pod="kuadrant-system/authorino-557f876f69-qdvjx"
Sep 09 21:26:38.389806 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:38.389776    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-xfc8l"]
Sep 09 21:26:38.392160 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:38.392142    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-xfc8l"
Sep 09 21:26:38.395887 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:38.395868    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 09 21:26:38.422358 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:38.422336    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-xfc8l"]
Sep 09 21:26:38.457031 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:38.456988    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/21e09df4-e03e-4ab5-8b00-6651c68eb1d6-tls-cert\") pod \"authorino-6d4dfc649f-xfc8l\" (UID: \"21e09df4-e03e-4ab5-8b00-6651c68eb1d6\") " pod="kuadrant-system/authorino-6d4dfc649f-xfc8l"
Sep 09 21:26:38.457140 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:38.457047    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxn5n\" (UniqueName: \"kubernetes.io/projected/21e09df4-e03e-4ab5-8b00-6651c68eb1d6-kube-api-access-dxn5n\") pod \"authorino-6d4dfc649f-xfc8l\" (UID: \"21e09df4-e03e-4ab5-8b00-6651c68eb1d6\") " pod="kuadrant-system/authorino-6d4dfc649f-xfc8l"
Sep 09 21:26:38.459406 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:38.459385    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-xfc8l"]
Sep 09 21:26:38.459592 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:26:38.459574    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-dxn5n tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6d4dfc649f-xfc8l" podUID="21e09df4-e03e-4ab5-8b00-6651c68eb1d6"
Sep 09 21:26:38.492628 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:38.492602    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f4f78bd6b-zx96w"]
Sep 09 21:26:38.494988 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:38.494972    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f4f78bd6b-zx96w"
Sep 09 21:26:38.510256 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:38.510205    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f4f78bd6b-zx96w"]
Sep 09 21:26:38.557710 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:38.557687    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c595f678-1651-46cd-b33b-413f8a9bffbd-tls-cert\") pod \"authorino-f4f78bd6b-zx96w\" (UID: \"c595f678-1651-46cd-b33b-413f8a9bffbd\") " pod="kuadrant-system/authorino-f4f78bd6b-zx96w"
Sep 09 21:26:38.557854 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:38.557814    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/21e09df4-e03e-4ab5-8b00-6651c68eb1d6-tls-cert\") pod \"authorino-6d4dfc649f-xfc8l\" (UID: \"21e09df4-e03e-4ab5-8b00-6651c68eb1d6\") " pod="kuadrant-system/authorino-6d4dfc649f-xfc8l"
Sep 09 21:26:38.557948 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:38.557930    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lh8g\" (UniqueName: \"kubernetes.io/projected/c595f678-1651-46cd-b33b-413f8a9bffbd-kube-api-access-7lh8g\") pod \"authorino-f4f78bd6b-zx96w\" (UID: \"c595f678-1651-46cd-b33b-413f8a9bffbd\") " pod="kuadrant-system/authorino-f4f78bd6b-zx96w"
Sep 09 21:26:38.558067 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:38.558052    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxn5n\" (UniqueName: \"kubernetes.io/projected/21e09df4-e03e-4ab5-8b00-6651c68eb1d6-kube-api-access-dxn5n\") pod \"authorino-6d4dfc649f-xfc8l\" (UID: \"21e09df4-e03e-4ab5-8b00-6651c68eb1d6\") " pod="kuadrant-system/authorino-6d4dfc649f-xfc8l"
Sep 09 21:26:38.560255 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:38.560230    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/21e09df4-e03e-4ab5-8b00-6651c68eb1d6-tls-cert\") pod \"authorino-6d4dfc649f-xfc8l\" (UID: \"21e09df4-e03e-4ab5-8b00-6651c68eb1d6\") " pod="kuadrant-system/authorino-6d4dfc649f-xfc8l"
Sep 09 21:26:38.568599 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:38.568572    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxn5n\" (UniqueName: \"kubernetes.io/projected/21e09df4-e03e-4ab5-8b00-6651c68eb1d6-kube-api-access-dxn5n\") pod \"authorino-6d4dfc649f-xfc8l\" (UID: \"21e09df4-e03e-4ab5-8b00-6651c68eb1d6\") " pod="kuadrant-system/authorino-6d4dfc649f-xfc8l"
Sep 09 21:26:38.659092 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:38.659067    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lh8g\" (UniqueName: \"kubernetes.io/projected/c595f678-1651-46cd-b33b-413f8a9bffbd-kube-api-access-7lh8g\") pod \"authorino-f4f78bd6b-zx96w\" (UID: \"c595f678-1651-46cd-b33b-413f8a9bffbd\") " pod="kuadrant-system/authorino-f4f78bd6b-zx96w"
Sep 09 21:26:38.659201 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:38.659121    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c595f678-1651-46cd-b33b-413f8a9bffbd-tls-cert\") pod \"authorino-f4f78bd6b-zx96w\" (UID: \"c595f678-1651-46cd-b33b-413f8a9bffbd\") " pod="kuadrant-system/authorino-f4f78bd6b-zx96w"
Sep 09 21:26:38.661255 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:38.661234    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c595f678-1651-46cd-b33b-413f8a9bffbd-tls-cert\") pod \"authorino-f4f78bd6b-zx96w\" (UID: \"c595f678-1651-46cd-b33b-413f8a9bffbd\") " pod="kuadrant-system/authorino-f4f78bd6b-zx96w"
Sep 09 21:26:38.671348 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:38.671324    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lh8g\" (UniqueName: \"kubernetes.io/projected/c595f678-1651-46cd-b33b-413f8a9bffbd-kube-api-access-7lh8g\") pod \"authorino-f4f78bd6b-zx96w\" (UID: \"c595f678-1651-46cd-b33b-413f8a9bffbd\") " pod="kuadrant-system/authorino-f4f78bd6b-zx96w"
Sep 09 21:26:38.673579 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:38.673562    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-qdvjx"
Sep 09 21:26:38.673668 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:38.673562    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-xfc8l"
Sep 09 21:26:38.682705 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:38.682687    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-qdvjx"
Sep 09 21:26:38.685897 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:38.685882    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-xfc8l"
Sep 09 21:26:38.759589 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:38.759562    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g72tk\" (UniqueName: \"kubernetes.io/projected/2b17bf82-77ae-4364-b127-ac2d737cd756-kube-api-access-g72tk\") pod \"2b17bf82-77ae-4364-b127-ac2d737cd756\" (UID: \"2b17bf82-77ae-4364-b127-ac2d737cd756\") "
Sep 09 21:26:38.759706 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:38.759605    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/21e09df4-e03e-4ab5-8b00-6651c68eb1d6-tls-cert\") pod \"21e09df4-e03e-4ab5-8b00-6651c68eb1d6\" (UID: \"21e09df4-e03e-4ab5-8b00-6651c68eb1d6\") "
Sep 09 21:26:38.759706 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:38.759651    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dxn5n\" (UniqueName: \"kubernetes.io/projected/21e09df4-e03e-4ab5-8b00-6651c68eb1d6-kube-api-access-dxn5n\") pod \"21e09df4-e03e-4ab5-8b00-6651c68eb1d6\" (UID: \"21e09df4-e03e-4ab5-8b00-6651c68eb1d6\") "
Sep 09 21:26:38.761598 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:38.761543    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b17bf82-77ae-4364-b127-ac2d737cd756-kube-api-access-g72tk" (OuterVolumeSpecName: "kube-api-access-g72tk") pod "2b17bf82-77ae-4364-b127-ac2d737cd756" (UID: "2b17bf82-77ae-4364-b127-ac2d737cd756"). InnerVolumeSpecName "kube-api-access-g72tk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:26:38.761682 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:38.761660    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21e09df4-e03e-4ab5-8b00-6651c68eb1d6-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "21e09df4-e03e-4ab5-8b00-6651c68eb1d6" (UID: "21e09df4-e03e-4ab5-8b00-6651c68eb1d6"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:26:38.761727 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:38.761685    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21e09df4-e03e-4ab5-8b00-6651c68eb1d6-kube-api-access-dxn5n" (OuterVolumeSpecName: "kube-api-access-dxn5n") pod "21e09df4-e03e-4ab5-8b00-6651c68eb1d6" (UID: "21e09df4-e03e-4ab5-8b00-6651c68eb1d6"). InnerVolumeSpecName "kube-api-access-dxn5n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:26:38.803166 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:38.803143    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f4f78bd6b-zx96w"
Sep 09 21:26:38.860431 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:38.860398    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g72tk\" (UniqueName: \"kubernetes.io/projected/2b17bf82-77ae-4364-b127-ac2d737cd756-kube-api-access-g72tk\") on node \"ip-10-0-133-235.ec2.internal\" DevicePath \"\""
Sep 09 21:26:38.860547 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:38.860435    2555 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/21e09df4-e03e-4ab5-8b00-6651c68eb1d6-tls-cert\") on node \"ip-10-0-133-235.ec2.internal\" DevicePath \"\""
Sep 09 21:26:38.860547 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:38.860450    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dxn5n\" (UniqueName: \"kubernetes.io/projected/21e09df4-e03e-4ab5-8b00-6651c68eb1d6-kube-api-access-dxn5n\") on node \"ip-10-0-133-235.ec2.internal\" DevicePath \"\""
Sep 09 21:26:39.074646 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:39.074618    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f4f78bd6b-zx96w"]
Sep 09 21:26:39.076274 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:26:39.076250    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc595f678_1651_46cd_b33b_413f8a9bffbd.slice/crio-fafde4b71f8031ce70c11f73b4889844c4cc7ddbcb2e65e79b545ae1906b3eea WatchSource:0}: Error finding container fafde4b71f8031ce70c11f73b4889844c4cc7ddbcb2e65e79b545ae1906b3eea: Status 404 returned error can't find the container with id fafde4b71f8031ce70c11f73b4889844c4cc7ddbcb2e65e79b545ae1906b3eea
Sep 09 21:26:39.680382 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:39.680352    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f4f78bd6b-zx96w" event={"ID":"c595f678-1651-46cd-b33b-413f8a9bffbd","Type":"ContainerStarted","Data":"fafde4b71f8031ce70c11f73b4889844c4cc7ddbcb2e65e79b545ae1906b3eea"}
Sep 09 21:26:39.680715 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:39.680401    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-xfc8l"
Sep 09 21:26:39.680715 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:39.680412    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-qdvjx"
Sep 09 21:26:39.714025 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:39.713999    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-qdvjx"]
Sep 09 21:26:39.718265 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:39.718243    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-557f876f69-qdvjx"]
Sep 09 21:26:39.745259 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:39.745238    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-xfc8l"]
Sep 09 21:26:39.751430 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:39.751413    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-xfc8l"]
Sep 09 21:26:40.688960 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:40.688923    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f4f78bd6b-zx96w" event={"ID":"c595f678-1651-46cd-b33b-413f8a9bffbd","Type":"ContainerStarted","Data":"af8afd8364001cedb99efac7de10ad97ec47c1ce526cc4445160d7fe3d749369"}
Sep 09 21:26:40.709174 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:40.709121    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-f4f78bd6b-zx96w" podStartSLOduration=1.8816102620000001 podStartE2EDuration="2.709108022s" totalImagesPullingTime="827.49776ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:26:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:26:40.707373186 +0000 UTC m=+1123.686691300" watchObservedRunningTime="2026-09-09 21:26:40.709108022 +0000 UTC m=+1123.688426172"
Sep 09 21:26:40.740887 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:40.740859    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-nn4qf"]
Sep 09 21:26:40.741073 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:40.741051    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-59c974bd48-nn4qf" podUID="0ace6f86-a100-40c8-b41f-14a9c74ceed9" containerName="authorino" containerID="cri-o://04204a8ab6c96024136fc7aa503919066730f94dadef2f7fd12768a6923a0f69" gracePeriod=30
Sep 09 21:26:40.988905 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:40.988877    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-nn4qf"
Sep 09 21:26:41.079172 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:41.079141    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9g49v\" (UniqueName: \"kubernetes.io/projected/0ace6f86-a100-40c8-b41f-14a9c74ceed9-kube-api-access-9g49v\") pod \"0ace6f86-a100-40c8-b41f-14a9c74ceed9\" (UID: \"0ace6f86-a100-40c8-b41f-14a9c74ceed9\") "
Sep 09 21:26:41.081150 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:41.081127    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ace6f86-a100-40c8-b41f-14a9c74ceed9-kube-api-access-9g49v" (OuterVolumeSpecName: "kube-api-access-9g49v") pod "0ace6f86-a100-40c8-b41f-14a9c74ceed9" (UID: "0ace6f86-a100-40c8-b41f-14a9c74ceed9"). InnerVolumeSpecName "kube-api-access-9g49v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:26:41.179884 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:41.179850    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9g49v\" (UniqueName: \"kubernetes.io/projected/0ace6f86-a100-40c8-b41f-14a9c74ceed9-kube-api-access-9g49v\") on node \"ip-10-0-133-235.ec2.internal\" DevicePath \"\""
Sep 09 21:26:41.467326 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:41.467286    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21e09df4-e03e-4ab5-8b00-6651c68eb1d6" path="/var/lib/kubelet/pods/21e09df4-e03e-4ab5-8b00-6651c68eb1d6/volumes"
Sep 09 21:26:41.467608 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:41.467589    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b17bf82-77ae-4364-b127-ac2d737cd756" path="/var/lib/kubelet/pods/2b17bf82-77ae-4364-b127-ac2d737cd756/volumes"
Sep 09 21:26:41.697141 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:41.697110    2555 generic.go:356] "Generic (PLEG): container finished" podID="0ace6f86-a100-40c8-b41f-14a9c74ceed9" containerID="04204a8ab6c96024136fc7aa503919066730f94dadef2f7fd12768a6923a0f69" exitCode=0
Sep 09 21:26:41.697513 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:41.697147    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-nn4qf"
Sep 09 21:26:41.697513 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:41.697177    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-nn4qf" event={"ID":"0ace6f86-a100-40c8-b41f-14a9c74ceed9","Type":"ContainerDied","Data":"04204a8ab6c96024136fc7aa503919066730f94dadef2f7fd12768a6923a0f69"}
Sep 09 21:26:41.697513 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:41.697211    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-nn4qf" event={"ID":"0ace6f86-a100-40c8-b41f-14a9c74ceed9","Type":"ContainerDied","Data":"dbb32d087eb184614f0a58b7ef95fa6dd0889efcf6d33dcbd3fc982b17243f23"}
Sep 09 21:26:41.697513 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:41.697227    2555 scope.go:117] "RemoveContainer" containerID="04204a8ab6c96024136fc7aa503919066730f94dadef2f7fd12768a6923a0f69"
Sep 09 21:26:41.705985 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:41.705966    2555 scope.go:117] "RemoveContainer" containerID="04204a8ab6c96024136fc7aa503919066730f94dadef2f7fd12768a6923a0f69"
Sep 09 21:26:41.706243 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:26:41.706224    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04204a8ab6c96024136fc7aa503919066730f94dadef2f7fd12768a6923a0f69\": container with ID starting with 04204a8ab6c96024136fc7aa503919066730f94dadef2f7fd12768a6923a0f69 not found: ID does not exist" containerID="04204a8ab6c96024136fc7aa503919066730f94dadef2f7fd12768a6923a0f69"
Sep 09 21:26:41.706289 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:41.706251    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04204a8ab6c96024136fc7aa503919066730f94dadef2f7fd12768a6923a0f69"} err="failed to get container status \"04204a8ab6c96024136fc7aa503919066730f94dadef2f7fd12768a6923a0f69\": rpc error: code = NotFound desc = could not find container \"04204a8ab6c96024136fc7aa503919066730f94dadef2f7fd12768a6923a0f69\": container with ID starting with 04204a8ab6c96024136fc7aa503919066730f94dadef2f7fd12768a6923a0f69 not found: ID does not exist"
Sep 09 21:26:41.726539 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:41.726487    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-nn4qf"]
Sep 09 21:26:41.742476 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:41.742458    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59c974bd48-nn4qf"]
Sep 09 21:26:43.467355 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:43.467316    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ace6f86-a100-40c8-b41f-14a9c74ceed9" path="/var/lib/kubelet/pods/0ace6f86-a100-40c8-b41f-14a9c74ceed9/volumes"
Sep 09 21:26:45.509050 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:45.509020    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:26:45.550223 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:45.550193    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-67fbbc4964-gdllc"]
Sep 09 21:26:45.550555 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:45.550543    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ace6f86-a100-40c8-b41f-14a9c74ceed9" containerName="authorino"
Sep 09 21:26:45.550599 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:45.550556    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ace6f86-a100-40c8-b41f-14a9c74ceed9" containerName="authorino"
Sep 09 21:26:45.550634 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:45.550619    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ace6f86-a100-40c8-b41f-14a9c74ceed9" containerName="authorino"
Sep 09 21:26:45.555323 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:45.555300    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-67fbbc4964-gdllc"
Sep 09 21:26:45.558223 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:45.558201    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 09 21:26:45.558330 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:45.558260    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 09 21:26:45.558470 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:45.558456    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 09 21:26:45.559558 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:45.559543    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-mbtgf\""
Sep 09 21:26:45.566519 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:45.566498    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-67fbbc4964-gdllc"]
Sep 09 21:26:45.616300 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:45.616268    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rg6gl\" (UniqueName: \"kubernetes.io/projected/a8c0a7ef-bf36-4387-a1d5-45eea22a22e3-kube-api-access-rg6gl\") pod \"maas-controller-67fbbc4964-gdllc\" (UID: \"a8c0a7ef-bf36-4387-a1d5-45eea22a22e3\") " pod="opendatahub/maas-controller-67fbbc4964-gdllc"
Sep 09 21:26:45.616450 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:45.616311    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a8c0a7ef-bf36-4387-a1d5-45eea22a22e3-webhook-cert\") pod \"maas-controller-67fbbc4964-gdllc\" (UID: \"a8c0a7ef-bf36-4387-a1d5-45eea22a22e3\") " pod="opendatahub/maas-controller-67fbbc4964-gdllc"
Sep 09 21:26:45.616450 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:45.616380    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8c0a7ef-bf36-4387-a1d5-45eea22a22e3-metrics-certs\") pod \"maas-controller-67fbbc4964-gdllc\" (UID: \"a8c0a7ef-bf36-4387-a1d5-45eea22a22e3\") " pod="opendatahub/maas-controller-67fbbc4964-gdllc"
Sep 09 21:26:45.670346 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:45.670317    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:26:45.718775 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:45.718658    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rg6gl\" (UniqueName: \"kubernetes.io/projected/a8c0a7ef-bf36-4387-a1d5-45eea22a22e3-kube-api-access-rg6gl\") pod \"maas-controller-67fbbc4964-gdllc\" (UID: \"a8c0a7ef-bf36-4387-a1d5-45eea22a22e3\") " pod="opendatahub/maas-controller-67fbbc4964-gdllc"
Sep 09 21:26:45.718979 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:45.718957    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a8c0a7ef-bf36-4387-a1d5-45eea22a22e3-webhook-cert\") pod \"maas-controller-67fbbc4964-gdllc\" (UID: \"a8c0a7ef-bf36-4387-a1d5-45eea22a22e3\") " pod="opendatahub/maas-controller-67fbbc4964-gdllc"
Sep 09 21:26:45.719186 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:45.719169    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8c0a7ef-bf36-4387-a1d5-45eea22a22e3-metrics-certs\") pod \"maas-controller-67fbbc4964-gdllc\" (UID: \"a8c0a7ef-bf36-4387-a1d5-45eea22a22e3\") " pod="opendatahub/maas-controller-67fbbc4964-gdllc"
Sep 09 21:26:45.720711 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:26:45.720681    2555 secret.go:189] Couldn't get secret opendatahub/maas-controller-metrics-tls: secret "maas-controller-metrics-tls" not found
Sep 09 21:26:45.722270 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:26:45.722236    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8c0a7ef-bf36-4387-a1d5-45eea22a22e3-metrics-certs podName:a8c0a7ef-bf36-4387-a1d5-45eea22a22e3 nodeName:}" failed. No retries permitted until 2026-09-09 21:26:46.222206639 +0000 UTC m=+1129.201524734 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a8c0a7ef-bf36-4387-a1d5-45eea22a22e3-metrics-certs") pod "maas-controller-67fbbc4964-gdllc" (UID: "a8c0a7ef-bf36-4387-a1d5-45eea22a22e3") : secret "maas-controller-metrics-tls" not found
Sep 09 21:26:45.727348 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:45.727320    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a8c0a7ef-bf36-4387-a1d5-45eea22a22e3-webhook-cert\") pod \"maas-controller-67fbbc4964-gdllc\" (UID: \"a8c0a7ef-bf36-4387-a1d5-45eea22a22e3\") " pod="opendatahub/maas-controller-67fbbc4964-gdllc"
Sep 09 21:26:45.727520 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:45.727499    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7d6fd54cd5-6m6dc"]
Sep 09 21:26:45.731188 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:45.731169    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d6fd54cd5-6m6dc"
Sep 09 21:26:45.740601 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:45.740566    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7d6fd54cd5-6m6dc"]
Sep 09 21:26:45.741230 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:45.741209    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rg6gl\" (UniqueName: \"kubernetes.io/projected/a8c0a7ef-bf36-4387-a1d5-45eea22a22e3-kube-api-access-rg6gl\") pod \"maas-controller-67fbbc4964-gdllc\" (UID: \"a8c0a7ef-bf36-4387-a1d5-45eea22a22e3\") " pod="opendatahub/maas-controller-67fbbc4964-gdllc"
Sep 09 21:26:45.768554 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:45.768498    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:26:45.821127 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:45.821105    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ba7ee14-02c8-462d-9149-061bfd562e5b-metrics-certs\") pod \"maas-controller-7d6fd54cd5-6m6dc\" (UID: \"5ba7ee14-02c8-462d-9149-061bfd562e5b\") " pod="opendatahub/maas-controller-7d6fd54cd5-6m6dc"
Sep 09 21:26:45.821239 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:45.821134    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrq9z\" (UniqueName: \"kubernetes.io/projected/5ba7ee14-02c8-462d-9149-061bfd562e5b-kube-api-access-zrq9z\") pod \"maas-controller-7d6fd54cd5-6m6dc\" (UID: \"5ba7ee14-02c8-462d-9149-061bfd562e5b\") " pod="opendatahub/maas-controller-7d6fd54cd5-6m6dc"
Sep 09 21:26:45.821239 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:45.821162    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5ba7ee14-02c8-462d-9149-061bfd562e5b-webhook-cert\") pod \"maas-controller-7d6fd54cd5-6m6dc\" (UID: \"5ba7ee14-02c8-462d-9149-061bfd562e5b\") " pod="opendatahub/maas-controller-7d6fd54cd5-6m6dc"
Sep 09 21:26:45.862888 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:45.862867    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:26:45.922223 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:45.922198    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ba7ee14-02c8-462d-9149-061bfd562e5b-metrics-certs\") pod \"maas-controller-7d6fd54cd5-6m6dc\" (UID: \"5ba7ee14-02c8-462d-9149-061bfd562e5b\") " pod="opendatahub/maas-controller-7d6fd54cd5-6m6dc"
Sep 09 21:26:45.922313 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:45.922231    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrq9z\" (UniqueName: \"kubernetes.io/projected/5ba7ee14-02c8-462d-9149-061bfd562e5b-kube-api-access-zrq9z\") pod \"maas-controller-7d6fd54cd5-6m6dc\" (UID: \"5ba7ee14-02c8-462d-9149-061bfd562e5b\") " pod="opendatahub/maas-controller-7d6fd54cd5-6m6dc"
Sep 09 21:26:45.922313 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:45.922273    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5ba7ee14-02c8-462d-9149-061bfd562e5b-webhook-cert\") pod \"maas-controller-7d6fd54cd5-6m6dc\" (UID: \"5ba7ee14-02c8-462d-9149-061bfd562e5b\") " pod="opendatahub/maas-controller-7d6fd54cd5-6m6dc"
Sep 09 21:26:45.924710 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:45.924688    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ba7ee14-02c8-462d-9149-061bfd562e5b-metrics-certs\") pod \"maas-controller-7d6fd54cd5-6m6dc\" (UID: \"5ba7ee14-02c8-462d-9149-061bfd562e5b\") " pod="opendatahub/maas-controller-7d6fd54cd5-6m6dc"
Sep 09 21:26:45.924788 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:45.924719    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5ba7ee14-02c8-462d-9149-061bfd562e5b-webhook-cert\") pod \"maas-controller-7d6fd54cd5-6m6dc\" (UID: \"5ba7ee14-02c8-462d-9149-061bfd562e5b\") " pod="opendatahub/maas-controller-7d6fd54cd5-6m6dc"
Sep 09 21:26:45.931814 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:45.931794    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrq9z\" (UniqueName: \"kubernetes.io/projected/5ba7ee14-02c8-462d-9149-061bfd562e5b-kube-api-access-zrq9z\") pod \"maas-controller-7d6fd54cd5-6m6dc\" (UID: \"5ba7ee14-02c8-462d-9149-061bfd562e5b\") " pod="opendatahub/maas-controller-7d6fd54cd5-6m6dc"
Sep 09 21:26:46.043640 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:46.043585    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d6fd54cd5-6m6dc"
Sep 09 21:26:46.224631 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:46.224601    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8c0a7ef-bf36-4387-a1d5-45eea22a22e3-metrics-certs\") pod \"maas-controller-67fbbc4964-gdllc\" (UID: \"a8c0a7ef-bf36-4387-a1d5-45eea22a22e3\") " pod="opendatahub/maas-controller-67fbbc4964-gdllc"
Sep 09 21:26:46.226914 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:46.226892    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8c0a7ef-bf36-4387-a1d5-45eea22a22e3-metrics-certs\") pod \"maas-controller-67fbbc4964-gdllc\" (UID: \"a8c0a7ef-bf36-4387-a1d5-45eea22a22e3\") " pod="opendatahub/maas-controller-67fbbc4964-gdllc"
Sep 09 21:26:46.317963 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:46.317940    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7d6fd54cd5-6m6dc"]
Sep 09 21:26:46.319697 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:26:46.319670    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ba7ee14_02c8_462d_9149_061bfd562e5b.slice/crio-5072db52a7b1b019f63706f3ada5f639b5bf293bc89710b990412e645bf14913 WatchSource:0}: Error finding container 5072db52a7b1b019f63706f3ada5f639b5bf293bc89710b990412e645bf14913: Status 404 returned error can't find the container with id 5072db52a7b1b019f63706f3ada5f639b5bf293bc89710b990412e645bf14913
Sep 09 21:26:46.467096 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:46.467060    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-67fbbc4964-gdllc"
Sep 09 21:26:46.736176 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:46.736138    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d6fd54cd5-6m6dc" event={"ID":"5ba7ee14-02c8-462d-9149-061bfd562e5b","Type":"ContainerStarted","Data":"5072db52a7b1b019f63706f3ada5f639b5bf293bc89710b990412e645bf14913"}
Sep 09 21:26:46.753717 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:46.753664    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-67fbbc4964-gdllc"]
Sep 09 21:26:46.756384 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:26:46.756357    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8c0a7ef_bf36_4387_a1d5_45eea22a22e3.slice/crio-0fadc389470952b09904541cd563b3876b5ef0047f97e584afc98c1d7969803b WatchSource:0}: Error finding container 0fadc389470952b09904541cd563b3876b5ef0047f97e584afc98c1d7969803b: Status 404 returned error can't find the container with id 0fadc389470952b09904541cd563b3876b5ef0047f97e584afc98c1d7969803b
Sep 09 21:26:47.748839 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:47.748789    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-67fbbc4964-gdllc" event={"ID":"a8c0a7ef-bf36-4387-a1d5-45eea22a22e3","Type":"ContainerStarted","Data":"0fadc389470952b09904541cd563b3876b5ef0047f97e584afc98c1d7969803b"}
Sep 09 21:26:48.781961 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:48.781928    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:26:48.852487 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:48.852456    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:26:49.310549 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:49.310479    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:26:49.573355 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:49.573271    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:26:49.761793 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:49.761755    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-67fbbc4964-gdllc" event={"ID":"a8c0a7ef-bf36-4387-a1d5-45eea22a22e3","Type":"ContainerStarted","Data":"5d12b66d4b947534bc31ebea1530bf16f7ba07b88a9867282072a5d7c280b983"}
Sep 09 21:26:49.762004 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:49.761829    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-67fbbc4964-gdllc"
Sep 09 21:26:49.763322 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:49.763294    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d6fd54cd5-6m6dc" event={"ID":"5ba7ee14-02c8-462d-9149-061bfd562e5b","Type":"ContainerStarted","Data":"676dfea7e12ec1fcb296fdd8e525ffb61b670a8a95e50cfd09bb0672aac6b231"}
Sep 09 21:26:49.763456 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:49.763347    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7d6fd54cd5-6m6dc"
Sep 09 21:26:49.793543 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:49.793498    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-67fbbc4964-gdllc" podStartSLOduration=2.571465132 podStartE2EDuration="4.793483128s" totalImagesPullingTime="2.222017996s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:26:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:26:49.790103176 +0000 UTC m=+1132.769421300" watchObservedRunningTime="2026-09-09 21:26:49.793483128 +0000 UTC m=+1132.772801242"
Sep 09 21:26:49.831537 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:26:49.831453    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7d6fd54cd5-6m6dc" podStartSLOduration=2.17926902 podStartE2EDuration="4.831438021s" totalImagesPullingTime="2.652169001s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:26:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:26:49.827707062 +0000 UTC m=+1132.807025186" watchObservedRunningTime="2026-09-09 21:26:49.831438021 +0000 UTC m=+1132.810756151"
Sep 09 21:27:00.772485 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:00.772454    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7d6fd54cd5-6m6dc"
Sep 09 21:27:00.772945 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:00.772525    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-67fbbc4964-gdllc"
Sep 09 21:27:00.888474 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:00.888442    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-67fbbc4964-gdllc"]
Sep 09 21:27:00.888685 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:00.888663    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-67fbbc4964-gdllc" podUID="a8c0a7ef-bf36-4387-a1d5-45eea22a22e3" containerName="manager" containerID="cri-o://5d12b66d4b947534bc31ebea1530bf16f7ba07b88a9867282072a5d7c280b983" gracePeriod=30
Sep 09 21:27:01.134008 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:01.133982    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-67fbbc4964-gdllc"
Sep 09 21:27:01.259243 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:01.259211    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a8c0a7ef-bf36-4387-a1d5-45eea22a22e3-webhook-cert\") pod \"a8c0a7ef-bf36-4387-a1d5-45eea22a22e3\" (UID: \"a8c0a7ef-bf36-4387-a1d5-45eea22a22e3\") "
Sep 09 21:27:01.259243 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:01.259252    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8c0a7ef-bf36-4387-a1d5-45eea22a22e3-metrics-certs\") pod \"a8c0a7ef-bf36-4387-a1d5-45eea22a22e3\" (UID: \"a8c0a7ef-bf36-4387-a1d5-45eea22a22e3\") "
Sep 09 21:27:01.259488 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:01.259316    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rg6gl\" (UniqueName: \"kubernetes.io/projected/a8c0a7ef-bf36-4387-a1d5-45eea22a22e3-kube-api-access-rg6gl\") pod \"a8c0a7ef-bf36-4387-a1d5-45eea22a22e3\" (UID: \"a8c0a7ef-bf36-4387-a1d5-45eea22a22e3\") "
Sep 09 21:27:01.261467 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:01.261439    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8c0a7ef-bf36-4387-a1d5-45eea22a22e3-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "a8c0a7ef-bf36-4387-a1d5-45eea22a22e3" (UID: "a8c0a7ef-bf36-4387-a1d5-45eea22a22e3"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:27:01.261574 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:01.261483    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8c0a7ef-bf36-4387-a1d5-45eea22a22e3-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a8c0a7ef-bf36-4387-a1d5-45eea22a22e3" (UID: "a8c0a7ef-bf36-4387-a1d5-45eea22a22e3"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:27:01.261574 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:01.261523    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8c0a7ef-bf36-4387-a1d5-45eea22a22e3-kube-api-access-rg6gl" (OuterVolumeSpecName: "kube-api-access-rg6gl") pod "a8c0a7ef-bf36-4387-a1d5-45eea22a22e3" (UID: "a8c0a7ef-bf36-4387-a1d5-45eea22a22e3"). InnerVolumeSpecName "kube-api-access-rg6gl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:27:01.360512 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:01.360449    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rg6gl\" (UniqueName: \"kubernetes.io/projected/a8c0a7ef-bf36-4387-a1d5-45eea22a22e3-kube-api-access-rg6gl\") on node \"ip-10-0-133-235.ec2.internal\" DevicePath \"\""
Sep 09 21:27:01.360512 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:01.360474    2555 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a8c0a7ef-bf36-4387-a1d5-45eea22a22e3-webhook-cert\") on node \"ip-10-0-133-235.ec2.internal\" DevicePath \"\""
Sep 09 21:27:01.360512 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:01.360494    2555 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8c0a7ef-bf36-4387-a1d5-45eea22a22e3-metrics-certs\") on node \"ip-10-0-133-235.ec2.internal\" DevicePath \"\""
Sep 09 21:27:01.838863 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:01.838811    2555 generic.go:356] "Generic (PLEG): container finished" podID="a8c0a7ef-bf36-4387-a1d5-45eea22a22e3" containerID="5d12b66d4b947534bc31ebea1530bf16f7ba07b88a9867282072a5d7c280b983" exitCode=0
Sep 09 21:27:01.838863 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:01.838848    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-67fbbc4964-gdllc" event={"ID":"a8c0a7ef-bf36-4387-a1d5-45eea22a22e3","Type":"ContainerDied","Data":"5d12b66d4b947534bc31ebea1530bf16f7ba07b88a9867282072a5d7c280b983"}
Sep 09 21:27:01.838863 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:01.838863    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-67fbbc4964-gdllc"
Sep 09 21:27:01.839331 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:01.838905    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-67fbbc4964-gdllc" event={"ID":"a8c0a7ef-bf36-4387-a1d5-45eea22a22e3","Type":"ContainerDied","Data":"0fadc389470952b09904541cd563b3876b5ef0047f97e584afc98c1d7969803b"}
Sep 09 21:27:01.839331 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:01.838932    2555 scope.go:117] "RemoveContainer" containerID="5d12b66d4b947534bc31ebea1530bf16f7ba07b88a9867282072a5d7c280b983"
Sep 09 21:27:01.848221 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:01.848202    2555 scope.go:117] "RemoveContainer" containerID="5d12b66d4b947534bc31ebea1530bf16f7ba07b88a9867282072a5d7c280b983"
Sep 09 21:27:01.848501 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:27:01.848483    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d12b66d4b947534bc31ebea1530bf16f7ba07b88a9867282072a5d7c280b983\": container with ID starting with 5d12b66d4b947534bc31ebea1530bf16f7ba07b88a9867282072a5d7c280b983 not found: ID does not exist" containerID="5d12b66d4b947534bc31ebea1530bf16f7ba07b88a9867282072a5d7c280b983"
Sep 09 21:27:01.848582 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:01.848506    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d12b66d4b947534bc31ebea1530bf16f7ba07b88a9867282072a5d7c280b983"} err="failed to get container status \"5d12b66d4b947534bc31ebea1530bf16f7ba07b88a9867282072a5d7c280b983\": rpc error: code = NotFound desc = could not find container \"5d12b66d4b947534bc31ebea1530bf16f7ba07b88a9867282072a5d7c280b983\": container with ID starting with 5d12b66d4b947534bc31ebea1530bf16f7ba07b88a9867282072a5d7c280b983 not found: ID does not exist"
Sep 09 21:27:01.863394 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:01.863368    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-67fbbc4964-gdllc"]
Sep 09 21:27:01.868363 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:01.868340    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-67fbbc4964-gdllc"]
Sep 09 21:27:03.466995 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:03.466962    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8c0a7ef-bf36-4387-a1d5-45eea22a22e3" path="/var/lib/kubelet/pods/a8c0a7ef-bf36-4387-a1d5-45eea22a22e3/volumes"
Sep 09 21:27:21.211977 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:21.211935    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:27:21.393868 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:21.393837    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:27:22.796917 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:22.796867    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:27:22.923994 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:22.923959    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:27:22.925947 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:22.925924    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-84cd5cfcdc-48m5z"]
Sep 09 21:27:22.926502 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:22.926464    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8c0a7ef-bf36-4387-a1d5-45eea22a22e3" containerName="manager"
Sep 09 21:27:22.926502 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:22.926489    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8c0a7ef-bf36-4387-a1d5-45eea22a22e3" containerName="manager"
Sep 09 21:27:22.926674 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:22.926613    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8c0a7ef-bf36-4387-a1d5-45eea22a22e3" containerName="manager"
Sep 09 21:27:22.930902 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:22.930884    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-84cd5cfcdc-48m5z"
Sep 09 21:27:22.933994 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:22.933971    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 09 21:27:22.934112 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:22.934039    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 09 21:27:22.934112 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:22.934072    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-rrqgz\""
Sep 09 21:27:22.946291 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:22.946266    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-84cd5cfcdc-48m5z"]
Sep 09 21:27:23.027515 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:23.027490    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:27:23.042868 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:23.042839    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebab7898-7c4e-46c2-a747-c3c2e25a1be6-metrics-certs\") pod \"maas-api-84cd5cfcdc-48m5z\" (UID: \"ebab7898-7c4e-46c2-a747-c3c2e25a1be6\") " pod="odh-ai-gateway-infra/maas-api-84cd5cfcdc-48m5z"
Sep 09 21:27:23.042993 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:23.042897    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcxn4\" (UniqueName: \"kubernetes.io/projected/ebab7898-7c4e-46c2-a747-c3c2e25a1be6-kube-api-access-tcxn4\") pod \"maas-api-84cd5cfcdc-48m5z\" (UID: \"ebab7898-7c4e-46c2-a747-c3c2e25a1be6\") " pod="odh-ai-gateway-infra/maas-api-84cd5cfcdc-48m5z"
Sep 09 21:27:23.042993 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:23.042948    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebab7898-7c4e-46c2-a747-c3c2e25a1be6-openshift-service-ca\") pod \"maas-api-84cd5cfcdc-48m5z\" (UID: \"ebab7898-7c4e-46c2-a747-c3c2e25a1be6\") " pod="odh-ai-gateway-infra/maas-api-84cd5cfcdc-48m5z"
Sep 09 21:27:23.043071 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:23.043005    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ebab7898-7c4e-46c2-a747-c3c2e25a1be6-maas-api-tls\") pod \"maas-api-84cd5cfcdc-48m5z\" (UID: \"ebab7898-7c4e-46c2-a747-c3c2e25a1be6\") " pod="odh-ai-gateway-infra/maas-api-84cd5cfcdc-48m5z"
Sep 09 21:27:23.135236 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:23.135170    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:27:23.144358 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:23.144331    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcxn4\" (UniqueName: \"kubernetes.io/projected/ebab7898-7c4e-46c2-a747-c3c2e25a1be6-kube-api-access-tcxn4\") pod \"maas-api-84cd5cfcdc-48m5z\" (UID: \"ebab7898-7c4e-46c2-a747-c3c2e25a1be6\") " pod="odh-ai-gateway-infra/maas-api-84cd5cfcdc-48m5z"
Sep 09 21:27:23.144441 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:23.144366    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebab7898-7c4e-46c2-a747-c3c2e25a1be6-openshift-service-ca\") pod \"maas-api-84cd5cfcdc-48m5z\" (UID: \"ebab7898-7c4e-46c2-a747-c3c2e25a1be6\") " pod="odh-ai-gateway-infra/maas-api-84cd5cfcdc-48m5z"
Sep 09 21:27:23.144441 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:23.144396    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ebab7898-7c4e-46c2-a747-c3c2e25a1be6-maas-api-tls\") pod \"maas-api-84cd5cfcdc-48m5z\" (UID: \"ebab7898-7c4e-46c2-a747-c3c2e25a1be6\") " pod="odh-ai-gateway-infra/maas-api-84cd5cfcdc-48m5z"
Sep 09 21:27:23.144519 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:23.144443    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebab7898-7c4e-46c2-a747-c3c2e25a1be6-metrics-certs\") pod \"maas-api-84cd5cfcdc-48m5z\" (UID: \"ebab7898-7c4e-46c2-a747-c3c2e25a1be6\") " pod="odh-ai-gateway-infra/maas-api-84cd5cfcdc-48m5z"
Sep 09 21:27:23.145075 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:23.145052    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebab7898-7c4e-46c2-a747-c3c2e25a1be6-openshift-service-ca\") pod \"maas-api-84cd5cfcdc-48m5z\" (UID: \"ebab7898-7c4e-46c2-a747-c3c2e25a1be6\") " pod="odh-ai-gateway-infra/maas-api-84cd5cfcdc-48m5z"
Sep 09 21:27:23.146752 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:23.146731    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebab7898-7c4e-46c2-a747-c3c2e25a1be6-metrics-certs\") pod \"maas-api-84cd5cfcdc-48m5z\" (UID: \"ebab7898-7c4e-46c2-a747-c3c2e25a1be6\") " pod="odh-ai-gateway-infra/maas-api-84cd5cfcdc-48m5z"
Sep 09 21:27:23.146901 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:23.146884    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ebab7898-7c4e-46c2-a747-c3c2e25a1be6-maas-api-tls\") pod \"maas-api-84cd5cfcdc-48m5z\" (UID: \"ebab7898-7c4e-46c2-a747-c3c2e25a1be6\") " pod="odh-ai-gateway-infra/maas-api-84cd5cfcdc-48m5z"
Sep 09 21:27:23.155331 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:23.155305    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcxn4\" (UniqueName: \"kubernetes.io/projected/ebab7898-7c4e-46c2-a747-c3c2e25a1be6-kube-api-access-tcxn4\") pod \"maas-api-84cd5cfcdc-48m5z\" (UID: \"ebab7898-7c4e-46c2-a747-c3c2e25a1be6\") " pod="odh-ai-gateway-infra/maas-api-84cd5cfcdc-48m5z"
Sep 09 21:27:23.240924 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:23.240903    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-84cd5cfcdc-48m5z"
Sep 09 21:27:23.532755 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:23.532728    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-84cd5cfcdc-48m5z"]
Sep 09 21:27:23.535442 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:23.535414    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:27:23.536107 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:27:23.536086    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebab7898_7c4e_46c2_a747_c3c2e25a1be6.slice/crio-3e5a0adf60a21c721e5f21cf7f59183eacd9a2b062904d035df8651ffc13822a WatchSource:0}: Error finding container 3e5a0adf60a21c721e5f21cf7f59183eacd9a2b062904d035df8651ffc13822a: Status 404 returned error can't find the container with id 3e5a0adf60a21c721e5f21cf7f59183eacd9a2b062904d035df8651ffc13822a
Sep 09 21:27:23.636444 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:23.636412    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:27:23.967706 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:23.967671    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-84cd5cfcdc-48m5z" event={"ID":"ebab7898-7c4e-46c2-a747-c3c2e25a1be6","Type":"ContainerStarted","Data":"3e5a0adf60a21c721e5f21cf7f59183eacd9a2b062904d035df8651ffc13822a"}
Sep 09 21:27:25.983987 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:25.983945    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-84cd5cfcdc-48m5z" event={"ID":"ebab7898-7c4e-46c2-a747-c3c2e25a1be6","Type":"ContainerStarted","Data":"bcfb44e99b6a79801ddc3b348f427ef36e142c962763b992ea8bcb1abbe7643f"}
Sep 09 21:27:25.984361 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:25.984156    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-84cd5cfcdc-48m5z"
Sep 09 21:27:26.005085 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:26.005019    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-84cd5cfcdc-48m5z" podStartSLOduration=1.922812119 podStartE2EDuration="4.004988348s" totalImagesPullingTime="2.082176229s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:27:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:27:26.004477298 +0000 UTC m=+1168.983795411" watchObservedRunningTime="2026-09-09 21:27:26.004988348 +0000 UTC m=+1168.984306461"
Sep 09 21:27:31.717584 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:31.717548    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:27:31.995204 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:31.995126    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-84cd5cfcdc-48m5z"
Sep 09 21:27:32.991804 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:32.991771    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:27:33.095160 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:33.095129    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:27:34.032684 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:34.032653    2555 generic.go:356] "Generic (PLEG): container finished" podID="b4793104-a9fb-47c7-80f8-2dba65c5239c" containerID="68e1c0e966060869a85bb33963b9b11e61a87e00823080d7d33e939267c1acb2" exitCode=0
Sep 09 21:27:34.033096 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:34.032729    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5qzpn" event={"ID":"b4793104-a9fb-47c7-80f8-2dba65c5239c","Type":"ContainerDied","Data":"68e1c0e966060869a85bb33963b9b11e61a87e00823080d7d33e939267c1acb2"}
Sep 09 21:27:34.033154 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:34.033138    2555 scope.go:117] "RemoveContainer" containerID="68e1c0e966060869a85bb33963b9b11e61a87e00823080d7d33e939267c1acb2"
Sep 09 21:27:34.034190 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:34.034162    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 21:27:34.034287 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:34.034248    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 21:27:34.034329 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:34.034295    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 21:27:35.044332 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:35.043577    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5qzpn" event={"ID":"b4793104-a9fb-47c7-80f8-2dba65c5239c","Type":"ContainerStarted","Data":"93077eef9a2e326ba4def1ebcb4f6d1fb887895f4bd882f2139cba0bfcde6b8a"}
Sep 09 21:27:35.516876 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:35.516844    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5qzpn"
Sep 09 21:27:35.517104 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:35.517081    2555 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-5qzpn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Sep 09 21:27:35.517151 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:35.517132    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5qzpn" podUID="b4793104-a9fb-47c7-80f8-2dba65c5239c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Sep 09 21:27:36.516973 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:36.516936    2555 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-5qzpn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Sep 09 21:27:36.517435 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:36.516997    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5qzpn" podUID="b4793104-a9fb-47c7-80f8-2dba65c5239c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Sep 09 21:27:37.516795 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:37.516756    2555 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-5qzpn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Sep 09 21:27:37.517007 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:37.516844    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5qzpn" podUID="b4793104-a9fb-47c7-80f8-2dba65c5239c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Sep 09 21:27:38.516671 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:38.516638    2555 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-5qzpn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Sep 09 21:27:38.516879 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:38.516689    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5qzpn" podUID="b4793104-a9fb-47c7-80f8-2dba65c5239c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Sep 09 21:27:39.516600 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:39.516566    2555 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-5qzpn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Sep 09 21:27:39.517003 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:39.516628    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5qzpn" podUID="b4793104-a9fb-47c7-80f8-2dba65c5239c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Sep 09 21:27:39.757867 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:39.757810    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:27:40.708434 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:40.708405    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5qzpn"
Sep 09 21:27:40.708804 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:40.708731    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5qzpn"
Sep 09 21:27:40.709483 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:40.709467    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5qzpn"
Sep 09 21:27:43.506994 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:43.506960    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4"]
Sep 09 21:27:43.509914 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:43.509896    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4"
Sep 09 21:27:43.512846 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:43.512793    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 09 21:27:43.512953 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:43.512899    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 09 21:27:43.512953 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:43.512907    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 09 21:27:43.513805 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:43.513783    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-lcjgs\""
Sep 09 21:27:43.529542 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:43.529508    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4"]
Sep 09 21:27:43.542176 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:43.542150    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:27:43.633056 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:43.633018    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ab9c4be-39c8-4024-bc32-a6f55de14612-model-cache\") pod \"e2e-distinct-simulated-kserve-6685d86975-jmmr4\" (UID: \"0ab9c4be-39c8-4024-bc32-a6f55de14612\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4"
Sep 09 21:27:43.633228 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:43.633135    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kf66h\" (UniqueName: \"kubernetes.io/projected/0ab9c4be-39c8-4024-bc32-a6f55de14612-kube-api-access-kf66h\") pod \"e2e-distinct-simulated-kserve-6685d86975-jmmr4\" (UID: \"0ab9c4be-39c8-4024-bc32-a6f55de14612\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4"
Sep 09 21:27:43.633228 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:43.633170    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ab9c4be-39c8-4024-bc32-a6f55de14612-tmp-dir\") pod \"e2e-distinct-simulated-kserve-6685d86975-jmmr4\" (UID: \"0ab9c4be-39c8-4024-bc32-a6f55de14612\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4"
Sep 09 21:27:43.633369 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:43.633288    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ab9c4be-39c8-4024-bc32-a6f55de14612-home\") pod \"e2e-distinct-simulated-kserve-6685d86975-jmmr4\" (UID: \"0ab9c4be-39c8-4024-bc32-a6f55de14612\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4"
Sep 09 21:27:43.633369 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:43.633335    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ab9c4be-39c8-4024-bc32-a6f55de14612-dshm\") pod \"e2e-distinct-simulated-kserve-6685d86975-jmmr4\" (UID: \"0ab9c4be-39c8-4024-bc32-a6f55de14612\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4"
Sep 09 21:27:43.633467 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:43.633368    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ab9c4be-39c8-4024-bc32-a6f55de14612-tls-certs\") pod \"e2e-distinct-simulated-kserve-6685d86975-jmmr4\" (UID: \"0ab9c4be-39c8-4024-bc32-a6f55de14612\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4"
Sep 09 21:27:43.734047 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:43.734005    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kf66h\" (UniqueName: \"kubernetes.io/projected/0ab9c4be-39c8-4024-bc32-a6f55de14612-kube-api-access-kf66h\") pod \"e2e-distinct-simulated-kserve-6685d86975-jmmr4\" (UID: \"0ab9c4be-39c8-4024-bc32-a6f55de14612\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4"
Sep 09 21:27:43.734047 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:43.734051    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ab9c4be-39c8-4024-bc32-a6f55de14612-tmp-dir\") pod \"e2e-distinct-simulated-kserve-6685d86975-jmmr4\" (UID: \"0ab9c4be-39c8-4024-bc32-a6f55de14612\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4"
Sep 09 21:27:43.734303 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:43.734087    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ab9c4be-39c8-4024-bc32-a6f55de14612-home\") pod \"e2e-distinct-simulated-kserve-6685d86975-jmmr4\" (UID: \"0ab9c4be-39c8-4024-bc32-a6f55de14612\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4"
Sep 09 21:27:43.734303 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:43.734114    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ab9c4be-39c8-4024-bc32-a6f55de14612-dshm\") pod \"e2e-distinct-simulated-kserve-6685d86975-jmmr4\" (UID: \"0ab9c4be-39c8-4024-bc32-a6f55de14612\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4"
Sep 09 21:27:43.734303 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:43.734133    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ab9c4be-39c8-4024-bc32-a6f55de14612-tls-certs\") pod \"e2e-distinct-simulated-kserve-6685d86975-jmmr4\" (UID: \"0ab9c4be-39c8-4024-bc32-a6f55de14612\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4"
Sep 09 21:27:43.734303 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:43.734157    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ab9c4be-39c8-4024-bc32-a6f55de14612-model-cache\") pod \"e2e-distinct-simulated-kserve-6685d86975-jmmr4\" (UID: \"0ab9c4be-39c8-4024-bc32-a6f55de14612\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4"
Sep 09 21:27:43.734551 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:43.734526    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ab9c4be-39c8-4024-bc32-a6f55de14612-home\") pod \"e2e-distinct-simulated-kserve-6685d86975-jmmr4\" (UID: \"0ab9c4be-39c8-4024-bc32-a6f55de14612\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4"
Sep 09 21:27:43.734605 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:43.734567    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ab9c4be-39c8-4024-bc32-a6f55de14612-model-cache\") pod \"e2e-distinct-simulated-kserve-6685d86975-jmmr4\" (UID: \"0ab9c4be-39c8-4024-bc32-a6f55de14612\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4"
Sep 09 21:27:43.734643 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:43.734600    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ab9c4be-39c8-4024-bc32-a6f55de14612-tmp-dir\") pod \"e2e-distinct-simulated-kserve-6685d86975-jmmr4\" (UID: \"0ab9c4be-39c8-4024-bc32-a6f55de14612\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4"
Sep 09 21:27:43.736515 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:43.736491    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ab9c4be-39c8-4024-bc32-a6f55de14612-dshm\") pod \"e2e-distinct-simulated-kserve-6685d86975-jmmr4\" (UID: \"0ab9c4be-39c8-4024-bc32-a6f55de14612\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4"
Sep 09 21:27:43.736709 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:43.736689    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ab9c4be-39c8-4024-bc32-a6f55de14612-tls-certs\") pod \"e2e-distinct-simulated-kserve-6685d86975-jmmr4\" (UID: \"0ab9c4be-39c8-4024-bc32-a6f55de14612\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4"
Sep 09 21:27:43.744129 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:43.744109    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kf66h\" (UniqueName: \"kubernetes.io/projected/0ab9c4be-39c8-4024-bc32-a6f55de14612-kube-api-access-kf66h\") pod \"e2e-distinct-simulated-kserve-6685d86975-jmmr4\" (UID: \"0ab9c4be-39c8-4024-bc32-a6f55de14612\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4"
Sep 09 21:27:43.820312 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:43.820240    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4"
Sep 09 21:27:44.097074 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:44.097044    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4"]
Sep 09 21:27:44.098338 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:27:44.098311    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ab9c4be_39c8_4024_bc32_a6f55de14612.slice/crio-5b1bb92c480ee60ef699d4f0c6767e7f4e93665ee21a273de5762b2633cd6277 WatchSource:0}: Error finding container 5b1bb92c480ee60ef699d4f0c6767e7f4e93665ee21a273de5762b2633cd6277: Status 404 returned error can't find the container with id 5b1bb92c480ee60ef699d4f0c6767e7f4e93665ee21a273de5762b2633cd6277
Sep 09 21:27:44.108040 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:44.108015    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4" event={"ID":"0ab9c4be-39c8-4024-bc32-a6f55de14612","Type":"ContainerStarted","Data":"5b1bb92c480ee60ef699d4f0c6767e7f4e93665ee21a273de5762b2633cd6277"}
Sep 09 21:27:46.122586 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:46.122553    2555 generic.go:356] "Generic (PLEG): container finished" podID="0ab9c4be-39c8-4024-bc32-a6f55de14612" containerID="f73bbc52fe10aba80749545442dc0ca4604dac6466215dbef311e19edb50f8e5" exitCode=0
Sep 09 21:27:46.122980 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:46.122634    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4" event={"ID":"0ab9c4be-39c8-4024-bc32-a6f55de14612","Type":"ContainerDied","Data":"f73bbc52fe10aba80749545442dc0ca4604dac6466215dbef311e19edb50f8e5"}
Sep 09 21:27:46.122980 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:46.122884    2555 scope.go:117] "RemoveContainer" containerID="f73bbc52fe10aba80749545442dc0ca4604dac6466215dbef311e19edb50f8e5"
Sep 09 21:27:47.130395 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:47.130361    2555 generic.go:356] "Generic (PLEG): container finished" podID="0ab9c4be-39c8-4024-bc32-a6f55de14612" containerID="5647fe7a6dc9e916927720e47bde5cf9b0edbc7adf722e7542afd7b9c049bc13" exitCode=0
Sep 09 21:27:47.130881 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:47.130442    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4" event={"ID":"0ab9c4be-39c8-4024-bc32-a6f55de14612","Type":"ContainerDied","Data":"5647fe7a6dc9e916927720e47bde5cf9b0edbc7adf722e7542afd7b9c049bc13"}
Sep 09 21:27:47.130881 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:47.130497    2555 scope.go:117] "RemoveContainer" containerID="f73bbc52fe10aba80749545442dc0ca4604dac6466215dbef311e19edb50f8e5"
Sep 09 21:27:47.130881 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:47.130733    2555 scope.go:117] "RemoveContainer" containerID="5647fe7a6dc9e916927720e47bde5cf9b0edbc7adf722e7542afd7b9c049bc13"
Sep 09 21:27:47.131068 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:27:47.130996    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-jmmr4_llm(0ab9c4be-39c8-4024-bc32-a6f55de14612)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4" podUID="0ab9c4be-39c8-4024-bc32-a6f55de14612"
Sep 09 21:27:48.138948 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:48.138915    2555 scope.go:117] "RemoveContainer" containerID="5647fe7a6dc9e916927720e47bde5cf9b0edbc7adf722e7542afd7b9c049bc13"
Sep 09 21:27:48.139332 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:27:48.139150    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-jmmr4_llm(0ab9c4be-39c8-4024-bc32-a6f55de14612)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4" podUID="0ab9c4be-39c8-4024-bc32-a6f55de14612"
Sep 09 21:27:53.820804 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:53.820769    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4"
Sep 09 21:27:53.821252 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:53.820837    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4"
Sep 09 21:27:53.821252 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:53.820861    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4"
Sep 09 21:27:53.821252 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:53.820874    2555 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4"
Sep 09 21:27:53.821252 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:27:53.821187    2555 scope.go:117] "RemoveContainer" containerID="5647fe7a6dc9e916927720e47bde5cf9b0edbc7adf722e7542afd7b9c049bc13"
Sep 09 21:27:53.821419 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:27:53.821344    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-jmmr4_llm(0ab9c4be-39c8-4024-bc32-a6f55de14612)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4" podUID="0ab9c4be-39c8-4024-bc32-a6f55de14612"
Sep 09 21:28:07.467941 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:28:07.467915    2555 scope.go:117] "RemoveContainer" containerID="5647fe7a6dc9e916927720e47bde5cf9b0edbc7adf722e7542afd7b9c049bc13"
Sep 09 21:28:08.247223 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:28:08.247181    2555 generic.go:356] "Generic (PLEG): container finished" podID="0ab9c4be-39c8-4024-bc32-a6f55de14612" containerID="676341e50e024d4f43a8cc28ccfe05cacfbed5656287ed9623408ed9b019b2ce" exitCode=0
Sep 09 21:28:08.247410 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:28:08.247253    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4" event={"ID":"0ab9c4be-39c8-4024-bc32-a6f55de14612","Type":"ContainerDied","Data":"676341e50e024d4f43a8cc28ccfe05cacfbed5656287ed9623408ed9b019b2ce"}
Sep 09 21:28:08.247410 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:28:08.247315    2555 scope.go:117] "RemoveContainer" containerID="5647fe7a6dc9e916927720e47bde5cf9b0edbc7adf722e7542afd7b9c049bc13"
Sep 09 21:28:08.247645 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:28:08.247623    2555 scope.go:117] "RemoveContainer" containerID="676341e50e024d4f43a8cc28ccfe05cacfbed5656287ed9623408ed9b019b2ce"
Sep 09 21:28:08.247891 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:28:08.247871    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-jmmr4_llm(0ab9c4be-39c8-4024-bc32-a6f55de14612)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4" podUID="0ab9c4be-39c8-4024-bc32-a6f55de14612"
Sep 09 21:28:13.820754 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:28:13.820722    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4"
Sep 09 21:28:13.821157 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:28:13.820777    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4"
Sep 09 21:28:13.821157 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:28:13.820797    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4"
Sep 09 21:28:13.821157 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:28:13.820810    2555 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4"
Sep 09 21:28:13.821157 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:28:13.821152    2555 scope.go:117] "RemoveContainer" containerID="676341e50e024d4f43a8cc28ccfe05cacfbed5656287ed9623408ed9b019b2ce"
Sep 09 21:28:13.821363 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:28:13.821342    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-jmmr4_llm(0ab9c4be-39c8-4024-bc32-a6f55de14612)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4" podUID="0ab9c4be-39c8-4024-bc32-a6f55de14612"
Sep 09 21:28:22.277979 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:28:22.277937    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zxwlg"]
Sep 09 21:28:22.281336 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:28:22.281314    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zxwlg"
Sep 09 21:28:22.285445 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:28:22.285424    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 09 21:28:22.324382 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:28:22.324341    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zxwlg"]
Sep 09 21:28:22.358462 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:28:22.358424    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/78b8edb5-5084-47fb-b388-e46542f7376c-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-zxwlg\" (UID: \"78b8edb5-5084-47fb-b388-e46542f7376c\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zxwlg"
Sep 09 21:28:22.358462 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:28:22.358467    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/78b8edb5-5084-47fb-b388-e46542f7376c-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-zxwlg\" (UID: \"78b8edb5-5084-47fb-b388-e46542f7376c\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zxwlg"
Sep 09 21:28:22.358689 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:28:22.358485    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/78b8edb5-5084-47fb-b388-e46542f7376c-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-zxwlg\" (UID: \"78b8edb5-5084-47fb-b388-e46542f7376c\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zxwlg"
Sep 09 21:28:22.358689 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:28:22.358509    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/78b8edb5-5084-47fb-b388-e46542f7376c-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-zxwlg\" (UID: \"78b8edb5-5084-47fb-b388-e46542f7376c\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zxwlg"
Sep 09 21:28:22.358689 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:28:22.358593    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jn7b2\" (UniqueName: \"kubernetes.io/projected/78b8edb5-5084-47fb-b388-e46542f7376c-kube-api-access-jn7b2\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-zxwlg\" (UID: \"78b8edb5-5084-47fb-b388-e46542f7376c\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zxwlg"
Sep 09 21:28:22.358689 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:28:22.358661    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/78b8edb5-5084-47fb-b388-e46542f7376c-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-zxwlg\" (UID: \"78b8edb5-5084-47fb-b388-e46542f7376c\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zxwlg"
Sep 09 21:28:22.361147 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:28:22.361120    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:28:22.459867 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:28:22.459802    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jn7b2\" (UniqueName: \"kubernetes.io/projected/78b8edb5-5084-47fb-b388-e46542f7376c-kube-api-access-jn7b2\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-zxwlg\" (UID: \"78b8edb5-5084-47fb-b388-e46542f7376c\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zxwlg"
Sep 09 21:28:22.460027 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:28:22.459891    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/78b8edb5-5084-47fb-b388-e46542f7376c-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-zxwlg\" (UID: \"78b8edb5-5084-47fb-b388-e46542f7376c\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zxwlg"
Sep 09 21:28:22.460027 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:28:22.459955    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/78b8edb5-5084-47fb-b388-e46542f7376c-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-zxwlg\" (UID: \"78b8edb5-5084-47fb-b388-e46542f7376c\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zxwlg"
Sep 09 21:28:22.460027 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:28:22.459981    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/78b8edb5-5084-47fb-b388-e46542f7376c-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-zxwlg\" (UID: \"78b8edb5-5084-47fb-b388-e46542f7376c\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zxwlg"
Sep 09 21:28:22.460027 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:28:22.459999    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/78b8edb5-5084-47fb-b388-e46542f7376c-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-zxwlg\" (UID: \"78b8edb5-5084-47fb-b388-e46542f7376c\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zxwlg"
Sep 09 21:28:22.460027 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:28:22.460019    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/78b8edb5-5084-47fb-b388-e46542f7376c-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-zxwlg\" (UID: \"78b8edb5-5084-47fb-b388-e46542f7376c\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zxwlg"
Sep 09 21:28:22.460501 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:28:22.460479    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/78b8edb5-5084-47fb-b388-e46542f7376c-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-zxwlg\" (UID: \"78b8edb5-5084-47fb-b388-e46542f7376c\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zxwlg"
Sep 09 21:28:22.460582 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:28:22.460525    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/78b8edb5-5084-47fb-b388-e46542f7376c-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-zxwlg\" (UID: \"78b8edb5-5084-47fb-b388-e46542f7376c\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zxwlg"
Sep 09 21:28:22.460582 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:28:22.460542    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/78b8edb5-5084-47fb-b388-e46542f7376c-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-zxwlg\" (UID: \"78b8edb5-5084-47fb-b388-e46542f7376c\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zxwlg"
Sep 09 21:28:22.462242 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:28:22.462217    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/78b8edb5-5084-47fb-b388-e46542f7376c-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-zxwlg\" (UID: \"78b8edb5-5084-47fb-b388-e46542f7376c\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zxwlg"
Sep 09 21:28:22.462452 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:28:22.462430    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/78b8edb5-5084-47fb-b388-e46542f7376c-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-zxwlg\" (UID: \"78b8edb5-5084-47fb-b388-e46542f7376c\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zxwlg"
Sep 09 21:28:22.470804 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:28:22.470781    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jn7b2\" (UniqueName: \"kubernetes.io/projected/78b8edb5-5084-47fb-b388-e46542f7376c-kube-api-access-jn7b2\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-zxwlg\" (UID: \"78b8edb5-5084-47fb-b388-e46542f7376c\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zxwlg"
Sep 09 21:28:22.592042 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:28:22.591967    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zxwlg"
Sep 09 21:28:22.881908 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:28:22.881883    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zxwlg"]
Sep 09 21:28:22.883217 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:28:22.883181    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78b8edb5_5084_47fb_b388_e46542f7376c.slice/crio-6ebf9df6452e9c0c0bf938db8dceb474fa00e927b37f2e5f666ccb8a81f1e9d0 WatchSource:0}: Error finding container 6ebf9df6452e9c0c0bf938db8dceb474fa00e927b37f2e5f666ccb8a81f1e9d0: Status 404 returned error can't find the container with id 6ebf9df6452e9c0c0bf938db8dceb474fa00e927b37f2e5f666ccb8a81f1e9d0
Sep 09 21:28:23.343363 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:28:23.343328    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zxwlg" event={"ID":"78b8edb5-5084-47fb-b388-e46542f7376c","Type":"ContainerStarted","Data":"1a06ee9aa346382c560afc9fdc07370459089fe47c4d6c00a24b35234164a3b0"}
Sep 09 21:28:23.343745 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:28:23.343381    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zxwlg" event={"ID":"78b8edb5-5084-47fb-b388-e46542f7376c","Type":"ContainerStarted","Data":"6ebf9df6452e9c0c0bf938db8dceb474fa00e927b37f2e5f666ccb8a81f1e9d0"}
Sep 09 21:28:23.436185 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:28:23.436135    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zxwlg" podStartSLOduration=1.240629864 podStartE2EDuration="1.436118073s" totalImagesPullingTime="195.488209ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:28:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:28:23.432408368 +0000 UTC m=+1226.411726493" watchObservedRunningTime="2026-09-09 21:28:23.436118073 +0000 UTC m=+1226.415436185"
Sep 09 21:28:28.461108 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:28:28.461077    2555 scope.go:117] "RemoveContainer" containerID="676341e50e024d4f43a8cc28ccfe05cacfbed5656287ed9623408ed9b019b2ce"
Sep 09 21:28:29.379337 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:28:29.379307    2555 generic.go:356] "Generic (PLEG): container finished" podID="0ab9c4be-39c8-4024-bc32-a6f55de14612" containerID="b0b65039b8793440fb643b932e031c2b0fe4a1f8c17f76b29357c41c1946ee2b" exitCode=0
Sep 09 21:28:29.379505 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:28:29.379376    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4" event={"ID":"0ab9c4be-39c8-4024-bc32-a6f55de14612","Type":"ContainerDied","Data":"b0b65039b8793440fb643b932e031c2b0fe4a1f8c17f76b29357c41c1946ee2b"}
Sep 09 21:28:29.379505 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:28:29.379438    2555 scope.go:117] "RemoveContainer" containerID="676341e50e024d4f43a8cc28ccfe05cacfbed5656287ed9623408ed9b019b2ce"
Sep 09 21:28:29.379761 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:28:29.379746    2555 scope.go:117] "RemoveContainer" containerID="b0b65039b8793440fb643b932e031c2b0fe4a1f8c17f76b29357c41c1946ee2b"
Sep 09 21:28:29.379979 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:28:29.379959    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-jmmr4_llm(0ab9c4be-39c8-4024-bc32-a6f55de14612)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4" podUID="0ab9c4be-39c8-4024-bc32-a6f55de14612"
Sep 09 21:28:32.592133 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:28:32.592095    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zxwlg"
Sep 09 21:28:32.592592 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:28:32.592174    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zxwlg"
Sep 09 21:28:32.605857 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:28:32.605806    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zxwlg"
Sep 09 21:28:33.421223 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:28:33.421196    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zxwlg"
Sep 09 21:28:33.820761 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:28:33.820683    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4"
Sep 09 21:28:33.820761 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:28:33.820743    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4"
Sep 09 21:28:33.820761 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:28:33.820757    2555 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4"
Sep 09 21:28:33.821208 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:28:33.820773    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4"
Sep 09 21:28:33.821208 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:28:33.821138    2555 scope.go:117] "RemoveContainer" containerID="b0b65039b8793440fb643b932e031c2b0fe4a1f8c17f76b29357c41c1946ee2b"
Sep 09 21:28:33.821338 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:28:33.821318    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-jmmr4_llm(0ab9c4be-39c8-4024-bc32-a6f55de14612)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4" podUID="0ab9c4be-39c8-4024-bc32-a6f55de14612"
Sep 09 21:28:36.034948 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:28:36.034920    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:28:42.691098 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:28:42.691063    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:28:48.461074 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:28:48.461042    2555 scope.go:117] "RemoveContainer" containerID="b0b65039b8793440fb643b932e031c2b0fe4a1f8c17f76b29357c41c1946ee2b"
Sep 09 21:28:48.461541 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:28:48.461239    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-jmmr4_llm(0ab9c4be-39c8-4024-bc32-a6f55de14612)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4" podUID="0ab9c4be-39c8-4024-bc32-a6f55de14612"
Sep 09 21:28:52.587066 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:28:52.586979    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:28:53.713128 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:28:53.713095    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:28:53.791889 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:28:53.791861    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:29:02.461479 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:29:02.461443    2555 scope.go:117] "RemoveContainer" containerID="b0b65039b8793440fb643b932e031c2b0fe4a1f8c17f76b29357c41c1946ee2b"
Sep 09 21:29:02.461977 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:29:02.461711    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-jmmr4_llm(0ab9c4be-39c8-4024-bc32-a6f55de14612)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4" podUID="0ab9c4be-39c8-4024-bc32-a6f55de14612"
Sep 09 21:29:09.064451 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:29:09.064415    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:29:17.468967 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:29:17.468937    2555 scope.go:117] "RemoveContainer" containerID="b0b65039b8793440fb643b932e031c2b0fe4a1f8c17f76b29357c41c1946ee2b"
Sep 09 21:29:18.674268 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:29:18.674236    2555 generic.go:356] "Generic (PLEG): container finished" podID="0ab9c4be-39c8-4024-bc32-a6f55de14612" containerID="bc3d0ce59ae59d2dea4b088f70f982c4c1b56f43b7f808341f427474009b00ea" exitCode=0
Sep 09 21:29:18.674268 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:29:18.674275    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4" event={"ID":"0ab9c4be-39c8-4024-bc32-a6f55de14612","Type":"ContainerDied","Data":"bc3d0ce59ae59d2dea4b088f70f982c4c1b56f43b7f808341f427474009b00ea"}
Sep 09 21:29:18.674743 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:29:18.674325    2555 scope.go:117] "RemoveContainer" containerID="b0b65039b8793440fb643b932e031c2b0fe4a1f8c17f76b29357c41c1946ee2b"
Sep 09 21:29:18.674743 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:29:18.674694    2555 scope.go:117] "RemoveContainer" containerID="bc3d0ce59ae59d2dea4b088f70f982c4c1b56f43b7f808341f427474009b00ea"
Sep 09 21:29:18.674926 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:29:18.674902    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-jmmr4_llm(0ab9c4be-39c8-4024-bc32-a6f55de14612)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4" podUID="0ab9c4be-39c8-4024-bc32-a6f55de14612"
Sep 09 21:29:23.820946 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:29:23.820903    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4"
Sep 09 21:29:23.821523 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:29:23.820992    2555 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4"
Sep 09 21:29:23.821523 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:29:23.821015    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4"
Sep 09 21:29:23.821523 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:29:23.821037    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4"
Sep 09 21:29:23.821523 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:29:23.821476    2555 scope.go:117] "RemoveContainer" containerID="bc3d0ce59ae59d2dea4b088f70f982c4c1b56f43b7f808341f427474009b00ea"
Sep 09 21:29:23.821739 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:29:23.821700    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-jmmr4_llm(0ab9c4be-39c8-4024-bc32-a6f55de14612)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4" podUID="0ab9c4be-39c8-4024-bc32-a6f55de14612"
Sep 09 21:29:34.461054 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:29:34.461013    2555 scope.go:117] "RemoveContainer" containerID="bc3d0ce59ae59d2dea4b088f70f982c4c1b56f43b7f808341f427474009b00ea"
Sep 09 21:29:34.461547 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:29:34.461261    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-jmmr4_llm(0ab9c4be-39c8-4024-bc32-a6f55de14612)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4" podUID="0ab9c4be-39c8-4024-bc32-a6f55de14612"
Sep 09 21:29:36.851275 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:29:36.851244    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:29:46.460882 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:29:46.460847    2555 scope.go:117] "RemoveContainer" containerID="bc3d0ce59ae59d2dea4b088f70f982c4c1b56f43b7f808341f427474009b00ea"
Sep 09 21:29:46.461257 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:29:46.461032    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-jmmr4_llm(0ab9c4be-39c8-4024-bc32-a6f55de14612)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4" podUID="0ab9c4be-39c8-4024-bc32-a6f55de14612"
Sep 09 21:30:01.460739 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:30:01.460706    2555 scope.go:117] "RemoveContainer" containerID="bc3d0ce59ae59d2dea4b088f70f982c4c1b56f43b7f808341f427474009b00ea"
Sep 09 21:30:01.461290 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:30:01.461002    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-jmmr4_llm(0ab9c4be-39c8-4024-bc32-a6f55de14612)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4" podUID="0ab9c4be-39c8-4024-bc32-a6f55de14612"
Sep 09 21:30:16.461467 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:30:16.461435    2555 scope.go:117] "RemoveContainer" containerID="bc3d0ce59ae59d2dea4b088f70f982c4c1b56f43b7f808341f427474009b00ea"
Sep 09 21:30:16.461998 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:30:16.461614    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-jmmr4_llm(0ab9c4be-39c8-4024-bc32-a6f55de14612)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4" podUID="0ab9c4be-39c8-4024-bc32-a6f55de14612"
Sep 09 21:30:30.461306 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:30:30.461268    2555 scope.go:117] "RemoveContainer" containerID="bc3d0ce59ae59d2dea4b088f70f982c4c1b56f43b7f808341f427474009b00ea"
Sep 09 21:30:30.461782 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:30:30.461506    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-jmmr4_llm(0ab9c4be-39c8-4024-bc32-a6f55de14612)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4" podUID="0ab9c4be-39c8-4024-bc32-a6f55de14612"
Sep 09 21:30:44.461133 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:30:44.461091    2555 scope.go:117] "RemoveContainer" containerID="bc3d0ce59ae59d2dea4b088f70f982c4c1b56f43b7f808341f427474009b00ea"
Sep 09 21:30:44.461530 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:30:44.461356    2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 21:30:45.169461 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:30:45.169430    2555 generic.go:356] "Generic (PLEG): container finished" podID="0ab9c4be-39c8-4024-bc32-a6f55de14612" containerID="1bd038544ec1091396454a8fe34a4d4d86f27df3b23e9005ad9f69e6be8a12cf" exitCode=0
Sep 09 21:30:45.169635 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:30:45.169509    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4" event={"ID":"0ab9c4be-39c8-4024-bc32-a6f55de14612","Type":"ContainerDied","Data":"1bd038544ec1091396454a8fe34a4d4d86f27df3b23e9005ad9f69e6be8a12cf"}
Sep 09 21:30:45.169635 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:30:45.169576    2555 scope.go:117] "RemoveContainer" containerID="bc3d0ce59ae59d2dea4b088f70f982c4c1b56f43b7f808341f427474009b00ea"
Sep 09 21:30:45.169905 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:30:45.169891    2555 scope.go:117] "RemoveContainer" containerID="1bd038544ec1091396454a8fe34a4d4d86f27df3b23e9005ad9f69e6be8a12cf"
Sep 09 21:30:45.170120 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:30:45.170097    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-jmmr4_llm(0ab9c4be-39c8-4024-bc32-a6f55de14612)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4" podUID="0ab9c4be-39c8-4024-bc32-a6f55de14612"
Sep 09 21:30:53.820371 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:30:53.820325    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4"
Sep 09 21:30:53.820900 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:30:53.820406    2555 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4"
Sep 09 21:30:53.820900 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:30:53.820431    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4"
Sep 09 21:30:53.820900 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:30:53.820453    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4"
Sep 09 21:30:53.820900 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:30:53.820798    2555 scope.go:117] "RemoveContainer" containerID="1bd038544ec1091396454a8fe34a4d4d86f27df3b23e9005ad9f69e6be8a12cf"
Sep 09 21:30:53.821047 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:30:53.821000    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-jmmr4_llm(0ab9c4be-39c8-4024-bc32-a6f55de14612)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4" podUID="0ab9c4be-39c8-4024-bc32-a6f55de14612"
Sep 09 21:31:05.461147 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:31:05.461108    2555 scope.go:117] "RemoveContainer" containerID="1bd038544ec1091396454a8fe34a4d4d86f27df3b23e9005ad9f69e6be8a12cf"
Sep 09 21:31:05.461726 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:31:05.461694    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-jmmr4_llm(0ab9c4be-39c8-4024-bc32-a6f55de14612)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4" podUID="0ab9c4be-39c8-4024-bc32-a6f55de14612"
Sep 09 21:31:16.460689 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:31:16.460658    2555 scope.go:117] "RemoveContainer" containerID="1bd038544ec1091396454a8fe34a4d4d86f27df3b23e9005ad9f69e6be8a12cf"
Sep 09 21:31:16.461098 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:31:16.460879    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-jmmr4_llm(0ab9c4be-39c8-4024-bc32-a6f55de14612)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4" podUID="0ab9c4be-39c8-4024-bc32-a6f55de14612"
Sep 09 21:31:30.461069 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:31:30.461040    2555 scope.go:117] "RemoveContainer" containerID="1bd038544ec1091396454a8fe34a4d4d86f27df3b23e9005ad9f69e6be8a12cf"
Sep 09 21:31:30.461548 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:31:30.461221    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-jmmr4_llm(0ab9c4be-39c8-4024-bc32-a6f55de14612)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4" podUID="0ab9c4be-39c8-4024-bc32-a6f55de14612"
Sep 09 21:31:41.461899 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:31:41.461859    2555 scope.go:117] "RemoveContainer" containerID="1bd038544ec1091396454a8fe34a4d4d86f27df3b23e9005ad9f69e6be8a12cf"
Sep 09 21:31:41.462371 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:31:41.462090    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-jmmr4_llm(0ab9c4be-39c8-4024-bc32-a6f55de14612)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4" podUID="0ab9c4be-39c8-4024-bc32-a6f55de14612"
Sep 09 21:31:44.779407 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:31:44.779369    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:31:55.418208 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:31:55.418132    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:31:56.460732 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:31:56.460701    2555 scope.go:117] "RemoveContainer" containerID="1bd038544ec1091396454a8fe34a4d4d86f27df3b23e9005ad9f69e6be8a12cf"
Sep 09 21:31:56.461134 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:31:56.460914    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-jmmr4_llm(0ab9c4be-39c8-4024-bc32-a6f55de14612)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4" podUID="0ab9c4be-39c8-4024-bc32-a6f55de14612"
Sep 09 21:32:11.461124 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:32:11.461090    2555 scope.go:117] "RemoveContainer" containerID="1bd038544ec1091396454a8fe34a4d4d86f27df3b23e9005ad9f69e6be8a12cf"
Sep 09 21:32:11.461583 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:32:11.461301    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-jmmr4_llm(0ab9c4be-39c8-4024-bc32-a6f55de14612)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4" podUID="0ab9c4be-39c8-4024-bc32-a6f55de14612"
Sep 09 21:32:22.461334 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:32:22.461301    2555 scope.go:117] "RemoveContainer" containerID="1bd038544ec1091396454a8fe34a4d4d86f27df3b23e9005ad9f69e6be8a12cf"
Sep 09 21:32:22.461710 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:32:22.461479    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-jmmr4_llm(0ab9c4be-39c8-4024-bc32-a6f55de14612)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4" podUID="0ab9c4be-39c8-4024-bc32-a6f55de14612"
Sep 09 21:32:36.460669 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:32:36.460633    2555 scope.go:117] "RemoveContainer" containerID="1bd038544ec1091396454a8fe34a4d4d86f27df3b23e9005ad9f69e6be8a12cf"
Sep 09 21:32:36.462978 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:32:36.460861    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-jmmr4_llm(0ab9c4be-39c8-4024-bc32-a6f55de14612)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4" podUID="0ab9c4be-39c8-4024-bc32-a6f55de14612"
Sep 09 21:32:42.836651 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:32:42.836617    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-f4f78bd6b-zx96w_c595f678-1651-46cd-b33b-413f8a9bffbd/authorino/0.log"
Sep 09 21:32:47.464331 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:32:47.464302    2555 scope.go:117] "RemoveContainer" containerID="1bd038544ec1091396454a8fe34a4d4d86f27df3b23e9005ad9f69e6be8a12cf"
Sep 09 21:32:47.464718 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:32:47.464464    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-jmmr4_llm(0ab9c4be-39c8-4024-bc32-a6f55de14612)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4" podUID="0ab9c4be-39c8-4024-bc32-a6f55de14612"
Sep 09 21:32:48.139557 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:32:48.139522    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-lrsms_2a4dce68-cbfc-4101-8a89-a0d35417abd5/manager/0.log"
Sep 09 21:32:48.254253 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:32:48.254227    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-hpthm_6226f0de-d59b-4502-8e11-94381794f7cc/manager/0.log"
Sep 09 21:32:48.388607 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:32:48.388577    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7d6fd54cd5-6m6dc_5ba7ee14-02c8-462d-9149-061bfd562e5b/manager/0.log"
Sep 09 21:32:48.496588 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:32:48.496562    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-ffh5g_99f5fa28-a900-4faa-bb73-e396c4b3da86/server/0.log"
Sep 09 21:32:48.611660 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:32:48.611633    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-9vqfn_38e16af4-0a96-4d51-8d9c-ef49795ea0e5/manager/0.log"
Sep 09 21:32:48.974590 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:32:48.974562    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79ffd8f657-rpx4w_72bbd3dc-cacc-4f2e-a2d5-b9e417c73b3f/copy-manifests/0.log"
Sep 09 21:32:48.987853 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:32:48.987790    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79ffd8f657-rpx4w_72bbd3dc-cacc-4f2e-a2d5-b9e417c73b3f/manager/0.log"
Sep 09 21:32:49.339987 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:32:49.339903    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-84cd5cfcdc-48m5z_ebab7898-7c4e-46c2-a747-c3c2e25a1be6/maas-api/0.log"
Sep 09 21:32:49.601889 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:32:49.601786    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-hqxz4_266a385c-b69b-411c-997f-b948c3aaef6d/postgres/0.log"
Sep 09 21:32:50.367848 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:32:50.367796    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-f4f78bd6b-zx96w_c595f678-1651-46cd-b33b-413f8a9bffbd/authorino/0.log"
Sep 09 21:32:50.482303 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:32:50.482255    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-sqbfs_cf35fb72-b001-468d-9467-e6722b40f167/manager/0.log"
Sep 09 21:32:50.700061 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:32:50.700036    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-rmtz8_74967a20-433c-4462-b629-ea1a882002be/kuadrant-console-plugin/0.log"
Sep 09 21:32:51.052428 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:32:51.052333    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-gbplw_ab5dbeeb-e34e-4677-a19a-8192e9983271/manager/0.log"
Sep 09 21:32:51.380933 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:32:51.380842    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb_1113cf29-a763-40f5-8b94-31f0097d4d6e/istio-proxy/0.log"
Sep 09 21:32:51.605608 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:32:51.605577    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6679dddbff-4zv2n_34c1b937-3c1c-4554-8745-589474055d28/kube-auth-proxy/0.log"
Sep 09 21:32:51.822804 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:32:51.822760    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-5qzpn_b4793104-a9fb-47c7-80f8-2dba65c5239c/istio-proxy/1.log"
Sep 09 21:32:52.588433 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:32:52.588401    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-6685d86975-jmmr4_0ab9c4be-39c8-4024-bc32-a6f55de14612/main/5.log"
Sep 09 21:32:52.691688 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:32:52.691652    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-zxwlg_78b8edb5-5084-47fb-b388-e46542f7376c/main/0.log"
Sep 09 21:32:57.818404 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:32:57.818361    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:32:58.551858 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:32:58.551809    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:32:58.775275 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:32:58.775231    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log" limit=1024
Sep 09 21:33:01.682801 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:01.682769    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5px25_1d5bd2bb-63bd-4425-ae59-2177722354f5/global-pull-secret-syncer/0.log"
Sep 09 21:33:01.834063 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:01.834033    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-fjp57_df53dce4-0da4-4e78-8e7d-e77e0734a8d9/konnectivity-agent/0.log"
Sep 09 21:33:01.945853 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:01.945762    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-235.ec2.internal_f778c97992e131b077853819dd25ede0/haproxy/0.log"
Sep 09 21:33:02.460983 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:02.460956    2555 scope.go:117] "RemoveContainer" containerID="1bd038544ec1091396454a8fe34a4d4d86f27df3b23e9005ad9f69e6be8a12cf"
Sep 09 21:33:02.461165 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:33:02.461143    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-jmmr4_llm(0ab9c4be-39c8-4024-bc32-a6f55de14612)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4" podUID="0ab9c4be-39c8-4024-bc32-a6f55de14612"
Sep 09 21:33:05.938683 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:05.938652    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-f4f78bd6b-zx96w_c595f678-1651-46cd-b33b-413f8a9bffbd/authorino/0.log"
Sep 09 21:33:05.979766 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:05.979736    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-sqbfs_cf35fb72-b001-468d-9467-e6722b40f167/manager/0.log"
Sep 09 21:33:06.072758 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:06.072735    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-rmtz8_74967a20-433c-4462-b629-ea1a882002be/kuadrant-console-plugin/0.log"
Sep 09 21:33:06.270597 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:06.270515    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-gbplw_ab5dbeeb-e34e-4677-a19a-8192e9983271/manager/0.log"
Sep 09 21:33:07.786956 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:07.786929    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7618e9f8-0c09-4409-8899-15b3137f79b1/alertmanager/0.log"
Sep 09 21:33:07.820225 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:07.820204    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7618e9f8-0c09-4409-8899-15b3137f79b1/config-reloader/0.log"
Sep 09 21:33:07.853074 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:07.853032    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7618e9f8-0c09-4409-8899-15b3137f79b1/kube-rbac-proxy-web/0.log"
Sep 09 21:33:07.883640 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:07.883618    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7618e9f8-0c09-4409-8899-15b3137f79b1/kube-rbac-proxy/0.log"
Sep 09 21:33:07.918963 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:07.918936    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7618e9f8-0c09-4409-8899-15b3137f79b1/kube-rbac-proxy-metric/0.log"
Sep 09 21:33:07.947874 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:07.947844    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7618e9f8-0c09-4409-8899-15b3137f79b1/prom-label-proxy/0.log"
Sep 09 21:33:07.974988 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:07.974938    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7618e9f8-0c09-4409-8899-15b3137f79b1/init-config-reloader/0.log"
Sep 09 21:33:08.055698 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:08.055623    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-kql4x_e5282c61-9537-4d25-80df-e47bac0afa15/kube-state-metrics/0.log"
Sep 09 21:33:08.087828 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:08.087788    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-kql4x_e5282c61-9537-4d25-80df-e47bac0afa15/kube-rbac-proxy-main/0.log"
Sep 09 21:33:08.121279 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:08.121251    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-kql4x_e5282c61-9537-4d25-80df-e47bac0afa15/kube-rbac-proxy-self/0.log"
Sep 09 21:33:08.205002 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:08.204971    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-85bbbbbf4-smc58_09d0f3a8-aa64-4d57-abba-487d8dfca3ff/monitoring-plugin/0.log"
Sep 09 21:33:08.254623 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:08.254599    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6p65g_86500301-64db-4e6f-b8eb-11d791d85f36/node-exporter/0.log"
Sep 09 21:33:08.282921 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:08.282896    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6p65g_86500301-64db-4e6f-b8eb-11d791d85f36/kube-rbac-proxy/0.log"
Sep 09 21:33:08.311045 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:08.310972    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6p65g_86500301-64db-4e6f-b8eb-11d791d85f36/init-textfile/0.log"
Sep 09 21:33:09.233981 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:09.233951    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-78f599db79-8sthh_936229c4-18f4-4a45-bdf8-b01a1cf30347/prometheus-operator-admission-webhook/0.log"
Sep 09 21:33:09.266622 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:09.266598    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-658dbfff77-j48jw_796a503a-5adb-40e7-87e9-c2a230b22898/telemeter-client/0.log"
Sep 09 21:33:09.300206 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:09.300176    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-658dbfff77-j48jw_796a503a-5adb-40e7-87e9-c2a230b22898/reload/0.log"
Sep 09 21:33:09.336244 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:09.336227    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-658dbfff77-j48jw_796a503a-5adb-40e7-87e9-c2a230b22898/kube-rbac-proxy/0.log"
Sep 09 21:33:11.313993 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:11.313952    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gc6bv/perf-node-gather-daemonset-tck68"]
Sep 09 21:33:11.317652 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:11.317627    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gc6bv/perf-node-gather-daemonset-tck68"
Sep 09 21:33:11.320766 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:11.320729    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-gc6bv\"/\"default-dockercfg-xsb7r\""
Sep 09 21:33:11.321583 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:11.321566    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gc6bv\"/\"kube-root-ca.crt\""
Sep 09 21:33:11.321658 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:11.321611    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gc6bv\"/\"openshift-service-ca.crt\""
Sep 09 21:33:11.334614 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:11.334590    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gc6bv/perf-node-gather-daemonset-tck68"]
Sep 09 21:33:11.417297 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:11.417263    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5c6e9cc3-f572-43ff-86c6-75739efe2e79-podres\") pod \"perf-node-gather-daemonset-tck68\" (UID: \"5c6e9cc3-f572-43ff-86c6-75739efe2e79\") " pod="openshift-must-gather-gc6bv/perf-node-gather-daemonset-tck68"
Sep 09 21:33:11.417484 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:11.417422    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5c6e9cc3-f572-43ff-86c6-75739efe2e79-sys\") pod \"perf-node-gather-daemonset-tck68\" (UID: \"5c6e9cc3-f572-43ff-86c6-75739efe2e79\") " pod="openshift-must-gather-gc6bv/perf-node-gather-daemonset-tck68"
Sep 09 21:33:11.417484 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:11.417468    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5c6e9cc3-f572-43ff-86c6-75739efe2e79-lib-modules\") pod \"perf-node-gather-daemonset-tck68\" (UID: \"5c6e9cc3-f572-43ff-86c6-75739efe2e79\") " pod="openshift-must-gather-gc6bv/perf-node-gather-daemonset-tck68"
Sep 09 21:33:11.417602 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:11.417500    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvrpp\" (UniqueName: \"kubernetes.io/projected/5c6e9cc3-f572-43ff-86c6-75739efe2e79-kube-api-access-nvrpp\") pod \"perf-node-gather-daemonset-tck68\" (UID: \"5c6e9cc3-f572-43ff-86c6-75739efe2e79\") " pod="openshift-must-gather-gc6bv/perf-node-gather-daemonset-tck68"
Sep 09 21:33:11.417602 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:11.417524    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5c6e9cc3-f572-43ff-86c6-75739efe2e79-proc\") pod \"perf-node-gather-daemonset-tck68\" (UID: \"5c6e9cc3-f572-43ff-86c6-75739efe2e79\") " pod="openshift-must-gather-gc6bv/perf-node-gather-daemonset-tck68"
Sep 09 21:33:11.518114 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:11.518078    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvrpp\" (UniqueName: \"kubernetes.io/projected/5c6e9cc3-f572-43ff-86c6-75739efe2e79-kube-api-access-nvrpp\") pod \"perf-node-gather-daemonset-tck68\" (UID: \"5c6e9cc3-f572-43ff-86c6-75739efe2e79\") " pod="openshift-must-gather-gc6bv/perf-node-gather-daemonset-tck68"
Sep 09 21:33:11.518294 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:11.518121    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5c6e9cc3-f572-43ff-86c6-75739efe2e79-proc\") pod \"perf-node-gather-daemonset-tck68\" (UID: \"5c6e9cc3-f572-43ff-86c6-75739efe2e79\") " pod="openshift-must-gather-gc6bv/perf-node-gather-daemonset-tck68"
Sep 09 21:33:11.518294 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:11.518154    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5c6e9cc3-f572-43ff-86c6-75739efe2e79-podres\") pod \"perf-node-gather-daemonset-tck68\" (UID: \"5c6e9cc3-f572-43ff-86c6-75739efe2e79\") " pod="openshift-must-gather-gc6bv/perf-node-gather-daemonset-tck68"
Sep 09 21:33:11.518411 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:11.518315    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5c6e9cc3-f572-43ff-86c6-75739efe2e79-proc\") pod \"perf-node-gather-daemonset-tck68\" (UID: \"5c6e9cc3-f572-43ff-86c6-75739efe2e79\") " pod="openshift-must-gather-gc6bv/perf-node-gather-daemonset-tck68"
Sep 09 21:33:11.518411 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:11.518330    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5c6e9cc3-f572-43ff-86c6-75739efe2e79-podres\") pod \"perf-node-gather-daemonset-tck68\" (UID: \"5c6e9cc3-f572-43ff-86c6-75739efe2e79\") " pod="openshift-must-gather-gc6bv/perf-node-gather-daemonset-tck68"
Sep 09 21:33:11.518646 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:11.518623    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5c6e9cc3-f572-43ff-86c6-75739efe2e79-sys\") pod \"perf-node-gather-daemonset-tck68\" (UID: \"5c6e9cc3-f572-43ff-86c6-75739efe2e79\") " pod="openshift-must-gather-gc6bv/perf-node-gather-daemonset-tck68"
Sep 09 21:33:11.518743 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:11.518690    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5c6e9cc3-f572-43ff-86c6-75739efe2e79-sys\") pod \"perf-node-gather-daemonset-tck68\" (UID: \"5c6e9cc3-f572-43ff-86c6-75739efe2e79\") " pod="openshift-must-gather-gc6bv/perf-node-gather-daemonset-tck68"
Sep 09 21:33:11.518806 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:11.518739    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5c6e9cc3-f572-43ff-86c6-75739efe2e79-lib-modules\") pod \"perf-node-gather-daemonset-tck68\" (UID: \"5c6e9cc3-f572-43ff-86c6-75739efe2e79\") " pod="openshift-must-gather-gc6bv/perf-node-gather-daemonset-tck68"
Sep 09 21:33:11.518924 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:11.518907    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5c6e9cc3-f572-43ff-86c6-75739efe2e79-lib-modules\") pod \"perf-node-gather-daemonset-tck68\" (UID: \"5c6e9cc3-f572-43ff-86c6-75739efe2e79\") " pod="openshift-must-gather-gc6bv/perf-node-gather-daemonset-tck68"
Sep 09 21:33:11.532176 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:11.532157    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvrpp\" (UniqueName: \"kubernetes.io/projected/5c6e9cc3-f572-43ff-86c6-75739efe2e79-kube-api-access-nvrpp\") pod \"perf-node-gather-daemonset-tck68\" (UID: \"5c6e9cc3-f572-43ff-86c6-75739efe2e79\") " pod="openshift-must-gather-gc6bv/perf-node-gather-daemonset-tck68"
Sep 09 21:33:11.627478 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:11.627393    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gc6bv/perf-node-gather-daemonset-tck68"
Sep 09 21:33:11.918461 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:11.918433    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gc6bv/perf-node-gather-daemonset-tck68"]
Sep 09 21:33:11.920058 ip-10-0-133-235 kubenswrapper[2555]: W0909 21:33:11.920029    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5c6e9cc3_f572_43ff_86c6_75739efe2e79.slice/crio-658e76151c51be83e3f0439d1e33f923be259e57378fdb7716aaf109ffde9974 WatchSource:0}: Error finding container 658e76151c51be83e3f0439d1e33f923be259e57378fdb7716aaf109ffde9974: Status 404 returned error can't find the container with id 658e76151c51be83e3f0439d1e33f923be259e57378fdb7716aaf109ffde9974
Sep 09 21:33:11.993474 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:11.993441    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gc6bv/perf-node-gather-daemonset-tck68" event={"ID":"5c6e9cc3-f572-43ff-86c6-75739efe2e79","Type":"ContainerStarted","Data":"658e76151c51be83e3f0439d1e33f923be259e57378fdb7716aaf109ffde9974"}
Sep 09 21:33:13.000779 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:13.000745    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gc6bv/perf-node-gather-daemonset-tck68" event={"ID":"5c6e9cc3-f572-43ff-86c6-75739efe2e79","Type":"ContainerStarted","Data":"cbc43f222dd66646054d607d571de726e964b7ab2a6d147a70bdc0473edc2820"}
Sep 09 21:33:13.001195 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:13.000843    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-gc6bv/perf-node-gather-daemonset-tck68"
Sep 09 21:33:13.021390 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:13.021342    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-gc6bv/perf-node-gather-daemonset-tck68" podStartSLOduration=2.021327544 podStartE2EDuration="2.021327544s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 21:33:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:33:13.020714283 +0000 UTC m=+1516.000032406" watchObservedRunningTime="2026-09-09 21:33:13.021327544 +0000 UTC m=+1516.000645657"
Sep 09 21:33:14.178392 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:14.178363    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rfxqx_a0e8de06-c61e-40f5-a07e-8a5a426c236a/dns/0.log"
Sep 09 21:33:14.203456 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:14.203431    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rfxqx_a0e8de06-c61e-40f5-a07e-8a5a426c236a/kube-rbac-proxy/0.log"
Sep 09 21:33:14.292536 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:14.292514    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zln8j_22210233-a1fa-4335-a652-6b89192b07ec/dns-node-resolver/0.log"
Sep 09 21:33:15.002793 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:15.002762    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-z8swp_eb3f4d24-4a06-4b75-a0ea-c6e8fba9e5f6/node-ca/0.log"
Sep 09 21:33:16.019577 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:16.019549    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb_1113cf29-a763-40f5-8b94-31f0097d4d6e/istio-proxy/0.log"
Sep 09 21:33:16.103811 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:16.103786    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6679dddbff-4zv2n_34c1b937-3c1c-4554-8745-589474055d28/kube-auth-proxy/0.log"
Sep 09 21:33:16.211153 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:16.211127    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-5qzpn_b4793104-a9fb-47c7-80f8-2dba65c5239c/istio-proxy/1.log"
Sep 09 21:33:16.211447 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:16.211426    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-5qzpn_b4793104-a9fb-47c7-80f8-2dba65c5239c/istio-proxy/0.log"
Sep 09 21:33:17.074150 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:17.074125    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2888n_09f5e589-c6ad-44a0-a60e-8243559b2b65/serve-healthcheck-canary/0.log"
Sep 09 21:33:17.464959 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:17.464930    2555 scope.go:117] "RemoveContainer" containerID="1bd038544ec1091396454a8fe34a4d4d86f27df3b23e9005ad9f69e6be8a12cf"
Sep 09 21:33:17.465173 ip-10-0-133-235 kubenswrapper[2555]: E0909 21:33:17.465148    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-jmmr4_llm(0ab9c4be-39c8-4024-bc32-a6f55de14612)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-jmmr4" podUID="0ab9c4be-39c8-4024-bc32-a6f55de14612"
Sep 09 21:33:17.700484 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:17.700455    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cnv44_52bf3dba-5c47-4e6e-a863-2a656c4d7661/kube-rbac-proxy/0.log"
Sep 09 21:33:17.728764 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:17.728701    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cnv44_52bf3dba-5c47-4e6e-a863-2a656c4d7661/exporter/0.log"
Sep 09 21:33:17.758500 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:17.758477    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cnv44_52bf3dba-5c47-4e6e-a863-2a656c4d7661/extractor/0.log"
Sep 09 21:33:19.018312 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:19.018284    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-gc6bv/perf-node-gather-daemonset-tck68"
Sep 09 21:33:20.281504 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:20.281472    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-lrsms_2a4dce68-cbfc-4101-8a89-a0d35417abd5/manager/0.log"
Sep 09 21:33:20.324725 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:20.324698    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-hpthm_6226f0de-d59b-4502-8e11-94381794f7cc/manager/0.log"
Sep 09 21:33:20.366723 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:20.366696    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7d6fd54cd5-6m6dc_5ba7ee14-02c8-462d-9149-061bfd562e5b/manager/0.log"
Sep 09 21:33:20.412726 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:20.412708    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-ffh5g_99f5fa28-a900-4faa-bb73-e396c4b3da86/server/0.log"
Sep 09 21:33:20.472387 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:20.472331    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-9vqfn_38e16af4-0a96-4d51-8d9c-ef49795ea0e5/manager/0.log"
Sep 09 21:33:20.684775 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:20.684749    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79ffd8f657-rpx4w_72bbd3dc-cacc-4f2e-a2d5-b9e417c73b3f/manager/0.log"
Sep 09 21:33:20.707518 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:20.707496    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79ffd8f657-rpx4w_72bbd3dc-cacc-4f2e-a2d5-b9e417c73b3f/copy-manifests/0.log"
Sep 09 21:33:21.950040 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:21.950011    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb_1113cf29-a763-40f5-8b94-31f0097d4d6e/istio-proxy/0.log"
Sep 09 21:33:22.003694 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:22.003665    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6679dddbff-4zv2n_34c1b937-3c1c-4554-8745-589474055d28/kube-auth-proxy/0.log"
Sep 09 21:33:22.078304 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:22.078272    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-5qzpn_b4793104-a9fb-47c7-80f8-2dba65c5239c/istio-proxy/1.log"
Sep 09 21:33:22.078562 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:22.078461    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-5qzpn_b4793104-a9fb-47c7-80f8-2dba65c5239c/istio-proxy/0.log"
Sep 09 21:33:22.181658 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:22.181626    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-2qpc5_e8f8af28-0545-4772-bc66-0ee3aa635744/openshift-lws-operator/0.log"
Sep 09 21:33:23.386313 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:23.386241    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb_1113cf29-a763-40f5-8b94-31f0097d4d6e/istio-proxy/0.log"
Sep 09 21:33:23.481244 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:23.481203    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6679dddbff-4zv2n_34c1b937-3c1c-4554-8745-589474055d28/kube-auth-proxy/0.log"
Sep 09 21:33:23.543996 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:23.543962    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-5qzpn_b4793104-a9fb-47c7-80f8-2dba65c5239c/istio-proxy/1.log"
Sep 09 21:33:23.544178 ip-10-0-133-235 kubenswrapper[2555]: I0909 21:33:23.544100    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-5qzpn_b4793104-a9fb-47c7-80f8-2dba65c5239c/istio-proxy/0.log"